[14:32:04.457] New invocation is queued and will start shortly
[14:32:05.727] Starting the invocation (attempt 1)
[14:32:05.753] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3e877547e67818dfebec4e5d7dd7c8e343aeab09"
[14:32:05.753] Popped gitiles commit info from properties and tags
[14:32:05.753] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:32:05.753] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:32:05.754] Buildbucket request:
{
"requestId": "8848517520692246544",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e877547e67818dfebec4e5d7dd7c8e343aeab09",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848517520692246544"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:32:06.792] Scheduled build:
{
"id": "8683087458609440769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2870,
"createdBy": "project:chromium",
"createTime": "2026-04-30T14:32:05.822822293Z",
"updateTime": "2026-04-30T14:32:05.822822293Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e877547e67818dfebec4e5d7dd7c8e343aeab09",
"ref": "refs/heads/main"
}
}
}
[14:32:06.792] Task URL: https://cr-buildbucket.appspot.com/build/8683087458609440769
[14:32:06.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:2:0) after 8m54s
[14:32:07.480] Received PubSub notification, asking Buildbucket for the build status
[14:32:07.524] Build status: SCHEDULED
[14:32:52.087] Received PubSub notification, asking Buildbucket for the build status
[14:32:52.118] Build status: STARTED
[14:41:00.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:2:0)
[14:41:00.858] Build status: STARTED
[14:41:00.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:5:0) after 9m59s
[14:50:59.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:5:0)
[14:51:00.029] Build status: STARTED
[14:51:00.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:6:0) after 6m17s
[14:57:17.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:6:0)
[14:57:17.065] Build status: STARTED
[14:57:17.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:7:0) after 4m57s
[15:02:14.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:7:0)
[15:02:14.207] Build status: STARTED
[15:02:14.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:8:0) after 7m0s
[15:09:14.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:8:0)
[15:09:14.281] Build status: STARTED
[15:09:14.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:9:0) after 9m58s
[15:19:12.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:9:0)
[15:19:12.343] Build status: STARTED
[15:19:12.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:10:0) after 8m49s
[15:28:01.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:10:0)
[15:28:01.380] Build status: STARTED
[15:28:01.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:11:0) after 2m8s
[15:30:09.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:11:0)
[15:30:09.606] Build status: STARTED
[15:30:09.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:12:0) after 4m22s
[15:34:31.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:12:0)
[15:34:31.730] Build status: STARTED
[15:34:31.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:13:0) after 4m18s
[15:38:49.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:13:0)
[15:38:49.803] Build status: STARTED
[15:38:49.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:14:0) after 2m4s
[15:40:53.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:14:0)
[15:40:53.893] Build status: STARTED
[15:40:53.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:15:0) after 4m44s
[15:45:37.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:15:0)
[15:45:37.889] Build status: STARTED
[15:45:37.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:16:0) after 8m40s
[15:54:17.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:16:0)
[15:54:17.969] Build status: STARTED
[15:54:17.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:17:0) after 4m44s
[15:59:02.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:17:0)
[15:59:02.345] Build status: STARTED
[15:59:02.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:18:0) after 4m35s
[16:03:37.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:18:0)
[16:03:37.447] Build status: STARTED
[16:03:37.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:19:0) after 8m30s
[16:12:07.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:19:0)
[16:12:07.486] Build status: STARTED
[16:12:07.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:20:0) after 5m32s
[16:17:39.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:20:0)
[16:17:39.575] Build status: STARTED
[16:17:39.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:21:0) after 6m1s
[16:23:40.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:21:0)
[16:23:40.810] Build status: STARTED
[16:23:40.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:22:0) after 5m7s
[16:28:47.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:22:0)
[16:28:47.900] Build status: STARTED
[16:28:47.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:23:0) after 5m33s
[16:34:20.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:23:0)
[16:34:20.971] Build status: STARTED
[16:34:20.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:24:0) after 3m5s
[16:37:25.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:24:0)
[16:37:26.024] Build status: STARTED
[16:37:26.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:25:0) after 8m28s
[16:45:54.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:25:0)
[16:45:54.158] Build status: STARTED
[16:45:54.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:26:0) after 5m9s
[16:51:03.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:26:0)
[16:51:03.303] Build status: STARTED
[16:51:03.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:27:0) after 3m5s
[16:54:08.375] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:27:0)
[16:54:08.400] Build status: STARTED
[16:54:08.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:28:0) after 3m33s
[16:57:41.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:28:0)
[16:57:41.442] Build status: STARTED
[16:57:41.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:29:0) after 1m53s
[16:59:34.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:29:0)
[16:59:34.473] Build status: STARTED
[16:59:34.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:30:0) after 8m11s
[17:07:45.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:30:0)
[17:07:45.523] Build status: STARTED
[17:07:45.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:31:0) after 8m27s
[17:16:12.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:31:0)
[17:16:12.767] Build status: STARTED
[17:16:12.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:32:0) after 5m10s
[17:21:22.761] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:32:0)
[17:21:22.832] Build status: STARTED
[17:21:22.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:33:0) after 4m19s
[17:25:41.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:33:0)
[17:25:41.923] Build status: STARTED
[17:25:41.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:34:0) after 2m30s
[17:28:11.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:34:0)
[17:28:12.010] Build status: STARTED
[17:28:12.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:35:0) after 3m46s
[17:31:58.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:35:0)
[17:31:58.045] Build status: STARTED
[17:31:58.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:36:0) after 3m5s
[17:35:03.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:36:0)
[17:35:03.096] Build status: STARTED
[17:35:03.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:37:0) after 6m15s
[17:41:18.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:37:0)
[17:41:18.271] Build status: STARTED
[17:41:18.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:38:0) after 3m37s
[17:44:55.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:38:0)
[17:44:55.343] Build status: STARTED
[17:44:55.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:39:0) after 3m57s
[17:48:52.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:39:0)
[17:48:52.491] Build status: STARTED
[17:48:52.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:40:0) after 3m6s
[17:51:58.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:40:0)
[17:51:58.559] Build status: STARTED
[17:51:58.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:41:0) after 6m28s
[17:58:26.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:41:0)
[17:58:26.644] Build status: STARTED
[17:58:26.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:42:0) after 5m10s
[18:03:36.660] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:42:0)
[18:03:36.676] Build status: STARTED
[18:03:36.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:43:0) after 6m17s
[18:09:53.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:43:0)
[18:09:53.767] Build status: STARTED
[18:09:53.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:44:0) after 1m42s
[18:11:35.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:44:0)
[18:11:35.819] Build status: STARTED
[18:11:35.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:45:0) after 1m24s
[18:12:59.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:45:0)
[18:12:59.904] Build status: STARTED
[18:12:59.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:46:0) after 7m22s
[18:20:21.996] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:46:0)
[18:20:22.016] Build status: STARTED
[18:20:22.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:47:0) after 6m53s
[18:27:15.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:47:0)
[18:27:15.058] Build status: STARTED
[18:27:15.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:48:0) after 6m7s
[18:33:22.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:48:0)
[18:33:22.154] Build status: STARTED
[18:33:22.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:49:0) after 3m28s
[18:36:50.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:49:0)
[18:36:50.352] Build status: STARTED
[18:36:50.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:50:0) after 6m40s
[18:43:30.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:50:0)
[18:43:30.459] Build status: STARTED
[18:43:30.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:51:0) after 5m28s
[18:48:58.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:51:0)
[18:48:58.546] Build status: STARTED
[18:48:58.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:52:0) after 3m5s
[18:52:03.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:52:0)
[18:52:03.638] Build status: STARTED
[18:52:03.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848517520692246544:53:0) after 5m49s
[18:53:21.740] Received PubSub notification, asking Buildbucket for the build status
[18:53:21.768] Build:
{
"id": "8683087458609440769",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2870,
"createdBy": "project:chromium",
"createTime": "2026-04-30T14:32:05.822822293Z",
"startTime": "2026-04-30T14:32:51.879477371Z",
"endTime": "2026-04-30T18:53:21.094340923Z",
"updateTime": "2026-04-30T18:53:21.094340923Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e877547e67818dfebec4e5d7dd7c8e343aeab09",
"ref": "refs/heads/main"
}
}
}
[18:53:21.768] Invocation finished in 4h21m17.315670802s with status FAILED