[17:16:20.360] New invocation is queued and will start shortly
[17:16:21.641] Starting the invocation (attempt 1)
[17:16:21.671] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b3147a4c3d8795ef5cfc44b315a0ed313b7662a2"
[17:16:21.671] Popped gitiles commit info from properties and tags
[17:16:21.671] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:16:21.671] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:16:21.671] Buildbucket request:
{
"requestId": "8842437189279465440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3147a4c3d8795ef5cfc44b315a0ed313b7662a2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842437189279465440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:16:22.332] Scheduled build:
{
"id": "8677007127149853777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 4034,
"createdBy": "project:chromium",
"createTime": "2026-07-06T17:16:21.771406475Z",
"updateTime": "2026-07-06T17:16:21.771406475Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3147a4c3d8795ef5cfc44b315a0ed313b7662a2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:16:22.332] Task URL: https://cr-buildbucket.appspot.com/build/8677007127149853777
[17:16:22.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:2:0) after 8m37s
[17:16:22.658] Received PubSub notification, asking Buildbucket for the build status
[17:16:22.688] Build status: SCHEDULED
[17:16:27.284] Received PubSub notification, asking Buildbucket for the build status
[17:16:27.304] Build status: STARTED
[17:24:59.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:2:0)
[17:24:59.402] Build status: STARTED
[17:24:59.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:5:0) after 6m54s
[17:31:53.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:5:0)
[17:31:53.468] Build status: STARTED
[17:31:53.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:6:0) after 8m21s
[17:40:14.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:6:0)
[17:40:14.563] Build status: STARTED
[17:40:14.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:7:0) after 5m55s
[17:46:09.612] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:7:0)
[17:46:09.652] Build status: STARTED
[17:46:09.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:8:0) after 1m55s
[17:48:04.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:8:0)
[17:48:04.673] Build status: STARTED
[17:48:04.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:9:0) after 3m48s
[17:51:52.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:9:0)
[17:51:52.730] Build status: STARTED
[17:51:52.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:10:0) after 9m6s
[18:00:58.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:10:0)
[18:00:58.773] Build status: STARTED
[18:00:58.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:11:0) after 2m0s
[18:02:58.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:11:0)
[18:02:58.856] Build status: STARTED
[18:02:58.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:12:0) after 5m34s
[18:08:32.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:12:0)
[18:08:32.895] Build status: STARTED
[18:08:32.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:13:0) after 2m40s
[18:11:13.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:13:0)
[18:11:13.062] Build status: STARTED
[18:11:13.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:14:0) after 5m9s
[18:16:22.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:14:0)
[18:16:22.107] Build status: STARTED
[18:16:22.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:15:0) after 5m6s
[18:21:28.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:15:0)
[18:21:28.336] Build status: STARTED
[18:21:28.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:16:0) after 7m32s
[18:29:00.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:16:0)
[18:29:00.459] Build status: STARTED
[18:29:00.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:17:0) after 8m7s
[18:37:07.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:17:0)
[18:37:07.607] Build status: STARTED
[18:37:07.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:18:0) after 5m42s
[18:42:49.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:18:0)
[18:42:49.752] Build status: STARTED
[18:42:49.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:19:0) after 3m20s
[18:46:09.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:19:0)
[18:46:09.795] Build status: STARTED
[18:46:09.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:20:0) after 8m18s
[18:54:27.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:20:0)
[18:54:27.881] Build status: STARTED
[18:54:27.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:21:0) after 9m52s
[19:04:19.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:21:0)
[19:04:19.974] Build status: STARTED
[19:04:19.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:22:0) after 5m7s
[19:09:27.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:22:0)
[19:09:27.151] Build status: STARTED
[19:09:27.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:23:0) after 9m55s
[19:19:22.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:23:0)
[19:19:22.272] Build status: STARTED
[19:19:22.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:24:0) after 9m12s
[19:28:34.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:24:0)
[19:28:34.326] Build status: STARTED
[19:28:34.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:25:0) after 1m31s
[19:30:05.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:25:0)
[19:30:05.389] Build status: STARTED
[19:30:05.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:26:0) after 8m55s
[19:39:00.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:26:0)
[19:39:00.610] Build status: STARTED
[19:39:00.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:27:0) after 6m6s
[19:45:06.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:27:0)
[19:45:06.701] Build status: STARTED
[19:45:06.701] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:28:0) after 3m39s
[19:48:45.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:28:0)
[19:48:45.872] Build status: STARTED
[19:48:45.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:29:0) after 6m42s
[19:55:27.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:29:0)
[19:55:27.913] Build status: STARTED
[19:55:27.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:30:0) after 8m23s
[20:03:50.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:30:0)
[20:03:51.017] Build status: STARTED
[20:03:51.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:31:0) after 7m16s
[20:11:07.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:31:0)
[20:11:07.191] Build status: STARTED
[20:11:07.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:32:0) after 6m6s
[20:17:13.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:32:0)
[20:17:13.255] Build status: STARTED
[20:17:13.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:33:0) after 1m0s
[20:18:13.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:33:0)
[20:18:13.345] Build status: STARTED
[20:18:13.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:34:0) after 8m0s
[20:26:13.465] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:34:0)
[20:26:13.492] Build status: STARTED
[20:26:13.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:35:0) after 9m1s
[20:35:14.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:35:0)
[20:35:14.544] Build status: STARTED
[20:35:14.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:36:0) after 2m57s
[20:38:11.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:36:0)
[20:38:11.641] Build status: STARTED
[20:38:11.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:37:0) after 3m59s
[20:42:10.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:37:0)
[20:42:10.803] Build status: STARTED
[20:42:10.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:38:0) after 9m47s
[20:51:57.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:38:0)
[20:51:57.985] Build status: STARTED
[20:51:57.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:39:0) after 9m42s
[21:01:40.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:39:0)
[21:01:40.022] Build status: STARTED
[21:01:40.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:40:0) after 7m5s
[21:08:45.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:40:0)
[21:08:45.112] Build status: STARTED
[21:08:45.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:41:0) after 5m49s
[21:14:34.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:41:0)
[21:14:34.223] Build status: STARTED
[21:14:34.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:42:0) after 3m24s
[21:17:58.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:42:0)
[21:17:58.289] Build status: STARTED
[21:17:58.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:43:0) after 7m51s
[21:25:49.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:43:0)
[21:25:49.383] Build status: STARTED
[21:25:49.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842437189279465440:44:0) after 7m26s
[21:30:15.858] Received PubSub notification, asking Buildbucket for the build status
[21:30:15.879] Build:
{
"id": "8677007127149853777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 4034,
"createdBy": "project:chromium",
"createTime": "2026-07-06T17:16:21.771406475Z",
"startTime": "2026-07-06T17:16:27.115366473Z",
"endTime": "2026-07-06T21:30:15.531215374Z",
"updateTime": "2026-07-06T21:30:15.531215374Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3147a4c3d8795ef5cfc44b315a0ed313b7662a2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:30:15.879] Invocation finished in 4h13m55.522953842s with status FAILED