[08:21:28.905] New invocation is queued and will start shortly
[08:21:33.164] Starting the invocation (attempt 1)
[08:21:33.192] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b207c802035794c0d7878ea4c03abcfdc7149123"
[08:21:33.192] Popped gitiles commit info from properties and tags
[08:21:33.192] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:21:33.192] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:21:33.192] Buildbucket request:
{
"requestId": "8842833227475836976",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b207c802035794c0d7878ea4c03abcfdc7149123",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842833227475836976"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:21:33.809] Scheduled build:
{
"id": "8677403162237296929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3979,
"createdBy": "project:chromium",
"createTime": "2026-07-02T08:21:33.279020692Z",
"updateTime": "2026-07-02T08:21:33.279020692Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b207c802035794c0d7878ea4c03abcfdc7149123",
"ref": "refs/heads/main"
}
}
}
[08:21:33.809] Task URL: https://cr-buildbucket.appspot.com/build/8677403162237296929
[08:21:33.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:2:0) after 7m42s
[08:21:34.757] Received PubSub notification, asking Buildbucket for the build status
[08:21:35.048] Build status: SCHEDULED
[08:21:37.148] Received PubSub notification, asking Buildbucket for the build status
[08:21:37.203] Build status: STARTED
[08:29:15.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:2:0)
[08:29:15.800] Build status: STARTED
[08:29:15.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:5:0) after 1m43s
[08:30:58.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:5:0)
[08:30:58.861] Build status: STARTED
[08:30:58.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:6:0) after 1m53s
[08:32:51.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:6:0)
[08:32:51.900] Build status: STARTED
[08:32:51.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:7:0) after 3m1s
[08:35:53.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:7:0)
[08:35:53.035] Build status: STARTED
[08:35:53.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:8:0) after 8m18s
[08:44:11.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:8:0)
[08:44:11.131] Build status: STARTED
[08:44:11.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:9:0) after 7m55s
[08:52:06.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:9:0)
[08:52:06.185] Build status: STARTED
[08:52:06.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:10:0) after 3m58s
[08:56:04.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:10:0)
[08:56:04.274] Build status: STARTED
[08:56:04.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:11:0) after 1m32s
[08:57:36.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:11:0)
[08:57:36.380] Build status: STARTED
[08:57:36.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:12:0) after 5m51s
[09:03:27.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:12:0)
[09:03:27.385] Build status: STARTED
[09:03:27.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:13:0) after 6m51s
[09:10:18.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:13:0)
[09:10:18.441] Build status: STARTED
[09:10:18.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:14:0) after 7m27s
[09:17:45.461] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:14:0)
[09:17:45.478] Build status: STARTED
[09:17:45.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:15:0) after 4m52s
[09:22:37.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:15:0)
[09:22:37.481] Build status: STARTED
[09:22:37.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:16:0) after 3m16s
[09:25:53.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:16:0)
[09:25:53.606] Build status: STARTED
[09:25:53.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:17:0) after 1m24s
[09:27:17.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:17:0)
[09:27:17.650] Build status: STARTED
[09:27:17.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:18:0) after 7m54s
[09:35:11.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:18:0)
[09:35:11.812] Build status: STARTED
[09:35:11.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:19:0) after 4m18s
[09:39:29.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:19:0)
[09:39:29.945] Build status: STARTED
[09:39:29.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:20:0) after 2m4s
[09:41:33.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:20:0)
[09:41:33.977] Build status: STARTED
[09:41:33.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:21:0) after 9m13s
[09:50:47.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:21:0)
[09:50:47.096] Build status: STARTED
[09:50:47.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:22:0) after 6m24s
[09:57:11.162] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:22:0)
[09:57:11.179] Build status: STARTED
[09:57:11.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:23:0) after 9m35s
[10:06:46.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:23:0)
[10:06:46.224] Build status: STARTED
[10:06:46.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:24:0) after 6m56s
[10:13:42.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:24:0)
[10:13:42.266] Build status: STARTED
[10:13:42.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:25:0) after 7m37s
[10:21:19.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:25:0)
[10:21:19.298] Build status: STARTED
[10:21:19.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:26:0) after 4m12s
[10:25:31.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:26:0)
[10:25:31.300] Build status: STARTED
[10:25:31.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:27:0) after 4m22s
[10:29:53.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:27:0)
[10:29:53.359] Build status: STARTED
[10:29:53.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:28:0) after 9m49s
[10:39:42.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:28:0)
[10:39:42.394] Build status: STARTED
[10:39:42.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:29:0) after 8m19s
[10:48:01.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:29:0)
[10:48:01.436] Build status: STARTED
[10:48:01.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:30:0) after 6m57s
[10:54:58.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:30:0)
[10:54:58.514] Build status: STARTED
[10:54:58.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:31:0) after 3m44s
[10:58:42.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:31:0)
[10:58:42.546] Build status: STARTED
[10:58:42.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:32:0) after 9m56s
[11:08:38.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:32:0)
[11:08:38.767] Build status: STARTED
[11:08:38.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:33:0) after 4m48s
[11:13:26.911] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:33:0)
[11:13:26.925] Build status: STARTED
[11:13:26.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:34:0) after 1m46s
[11:15:12.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:34:0)
[11:15:12.961] Build status: STARTED
[11:15:12.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:35:0) after 2m21s
[11:17:34.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:35:0)
[11:17:34.098] Build status: STARTED
[11:17:34.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:36:0) after 7m35s
[11:25:09.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:36:0)
[11:25:09.187] Build status: STARTED
[11:25:09.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:37:0) after 4m36s
[11:29:45.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:37:0)
[11:29:45.221] Build status: STARTED
[11:29:45.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:38:0) after 2m57s
[11:32:42.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:38:0)
[11:32:42.373] Build status: STARTED
[11:32:42.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:39:0) after 3m28s
[11:36:10.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:39:0)
[11:36:10.460] Build status: STARTED
[11:36:10.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:40:0) after 3m35s
[11:39:45.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:40:0)
[11:39:45.497] Build status: STARTED
[11:39:45.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:41:0) after 7m46s
[11:47:31.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:41:0)
[11:47:31.485] Build status: STARTED
[11:47:31.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:42:0) after 5m33s
[11:53:04.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:42:0)
[11:53:04.524] Build status: STARTED
[11:53:04.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:43:0) after 9m49s
[12:02:53.590] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:43:0)
[12:02:53.676] Build status: STARTED
[12:02:53.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:44:0) after 5m52s
[12:08:45.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:44:0)
[12:08:45.776] Build status: STARTED
[12:08:45.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:45:0) after 8m54s
[12:17:39.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:45:0)
[12:17:39.852] Build status: STARTED
[12:17:39.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:46:0) after 3m18s
[12:20:57.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:46:0)
[12:20:57.865] Build status: STARTED
[12:20:57.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:47:0) after 1m23s
[12:22:20.896] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:47:0)
[12:22:20.913] Build status: STARTED
[12:22:20.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:48:0) after 4m15s
[12:26:35.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:48:0)
[12:26:35.965] Build status: STARTED
[12:26:35.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:49:0) after 7m7s
[12:33:43.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:49:0)
[12:33:43.149] Build status: STARTED
[12:33:43.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842833227475836976:50:0) after 6m49s
[12:38:56.164] Received PubSub notification, asking Buildbucket for the build status
[12:38:56.186] Build:
{
"id": "8677403162237296929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3979,
"createdBy": "project:chromium",
"createTime": "2026-07-02T08:21:33.279020692Z",
"startTime": "2026-07-02T08:21:36.953357577Z",
"endTime": "2026-07-02T12:38:55.929289687Z",
"updateTime": "2026-07-02T12:38:55.929289687Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b207c802035794c0d7878ea4c03abcfdc7149123",
"ref": "refs/heads/main"
}
}
}
[12:38:56.186] Invocation finished in 4h17m27.285668256s with status FAILED