[15:21:11.750] New invocation is queued and will start shortly
[15:21:13.782] Starting the invocation (attempt 1)
[15:21:13.984] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/849afc5d9059012299dbf206f4e2d9dd147283f8"
[15:21:13.984] Popped gitiles commit info from properties and tags
[15:21:13.984] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:21:13.985] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:21:13.985] Buildbucket request:
{
"requestId": "8857483529906066800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "849afc5d9059012299dbf206f4e2d9dd147283f8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857483529906066800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:21:15.798] Scheduled build:
{
"id": "8692053466678514897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1406,
"createdBy": "project:chromium",
"createTime": "2026-01-21T15:21:14.206296997Z",
"updateTime": "2026-01-21T15:21:14.206296997Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "849afc5d9059012299dbf206f4e2d9dd147283f8",
"ref": "refs/heads/main"
}
}
}
[15:21:15.798] Task URL: https://cr-buildbucket.appspot.com/build/8692053466678514897
[15:21:15.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:2:0) after 4m47s
[15:22:04.739] Received PubSub notification, asking Buildbucket for the build status
[15:22:04.769] Build status: STARTED
[15:22:05.183] Received PubSub notification, asking Buildbucket for the build status
[15:22:05.198] Build status: STARTED
[15:26:02.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:2:0)
[15:26:02.852] Build status: STARTED
[15:26:02.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:5:0) after 9m10s
[15:35:12.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:5:0)
[15:35:12.901] Build status: STARTED
[15:35:12.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:6:0) after 4m32s
[15:39:44.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:6:0)
[15:39:44.961] Build status: STARTED
[15:39:44.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:7:0) after 2m20s
[15:42:04.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:7:0)
[15:42:05.005] Build status: STARTED
[15:42:05.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:8:0) after 8m8s
[15:50:13.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:8:0)
[15:50:13.049] Build status: STARTED
[15:50:13.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:9:0) after 9m44s
[15:59:57.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:9:0)
[15:59:57.102] Build status: STARTED
[15:59:57.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:10:0) after 7m24s
[16:07:21.146] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:10:0)
[16:07:21.167] Build status: STARTED
[16:07:21.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:11:0) after 6m23s
[16:13:44.370] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:11:0)
[16:13:44.426] Build status: STARTED
[16:13:44.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:12:0) after 5m45s
[16:19:29.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:12:0)
[16:19:29.595] Build status: STARTED
[16:19:29.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:13:0) after 7m9s
[16:26:38.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:13:0)
[16:26:38.639] Build status: STARTED
[16:26:38.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:14:0) after 5m19s
[16:31:57.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:14:0)
[16:31:57.705] Build status: STARTED
[16:31:57.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:15:0) after 3m41s
[16:35:38.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:15:0)
[16:35:38.795] Build status: STARTED
[16:35:38.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:16:0) after 7m52s
[16:43:30.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:16:0)
[16:43:30.822] Build status: STARTED
[16:43:30.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:17:0) after 2m23s
[16:45:53.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:17:0)
[16:45:53.924] Build status: STARTED
[16:45:53.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:18:0) after 6m54s
[16:52:47.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:18:0)
[16:52:47.991] Build status: STARTED
[16:52:47.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:19:0) after 6m44s
[16:59:32.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:19:0)
[16:59:32.097] Build status: STARTED
[16:59:32.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:20:0) after 3m25s
[17:02:57.124] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:20:0)
[17:02:57.143] Build status: STARTED
[17:02:57.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:21:0) after 3m24s
[17:06:21.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:21:0)
[17:06:21.161] Build status: STARTED
[17:06:21.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:22:0) after 4m46s
[17:11:07.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:22:0)
[17:11:07.171] Build status: STARTED
[17:11:07.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:23:0) after 1m27s
[17:12:34.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:23:0)
[17:12:34.232] Build status: STARTED
[17:12:34.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:24:0) after 5m59s
[17:18:33.315] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:24:0)
[17:18:33.331] Build status: STARTED
[17:18:33.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:25:0) after 3m34s
[17:22:07.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:25:0)
[17:22:07.468] Build status: STARTED
[17:22:07.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:26:0) after 2m50s
[17:24:57.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:26:0)
[17:24:57.570] Build status: STARTED
[17:24:57.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:27:0) after 6m43s
[17:31:40.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:27:0)
[17:31:40.646] Build status: STARTED
[17:31:40.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:28:0) after 9m39s
[17:41:19.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:28:0)
[17:41:19.690] Build status: STARTED
[17:41:19.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:29:0) after 1m39s
[17:42:58.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:29:0)
[17:42:58.735] Build status: STARTED
[17:42:58.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:30:0) after 1m59s
[17:44:57.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:30:0)
[17:44:57.845] Build status: STARTED
[17:44:57.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:31:0) after 8m25s
[17:53:22.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:31:0)
[17:53:22.905] Build status: STARTED
[17:53:22.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:32:0) after 8m46s
[18:02:08.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:32:0)
[18:02:08.962] Build status: STARTED
[18:02:08.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:33:0) after 9m17s
[18:11:26.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:33:0)
[18:11:26.067] Build status: STARTED
[18:11:26.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:34:0) after 3m21s
[18:14:47.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:34:0)
[18:14:47.106] Build status: STARTED
[18:14:47.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:35:0) after 1m39s
[18:16:26.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:35:0)
[18:16:26.149] Build status: STARTED
[18:16:26.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:36:0) after 1m40s
[18:18:06.229] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:36:0)
[18:18:06.262] Build status: STARTED
[18:18:06.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:37:0) after 7m44s
[18:25:50.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:37:0)
[18:25:50.318] Build status: STARTED
[18:25:50.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:38:0) after 5m13s
[18:31:03.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:38:0)
[18:31:07.133] Build status: STARTED
[18:31:07.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:39:0) after 9m4s
[18:40:11.155] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:39:0)
[18:40:11.189] Build status: STARTED
[18:40:11.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:40:0) after 9m50s
[18:50:01.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:40:0)
[18:50:01.290] Build status: STARTED
[18:50:01.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:41:0) after 7m31s
[18:57:32.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:41:0)
[18:57:32.336] Build status: STARTED
[18:57:32.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:42:0) after 3m25s
[19:00:57.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:42:0)
[19:00:57.370] Build status: STARTED
[19:00:57.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:43:0) after 3m19s
[19:04:16.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:43:0)
[19:04:16.417] Build status: STARTED
[19:04:16.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:44:0) after 6m29s
[19:10:45.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:44:0)
[19:10:45.536] Build status: STARTED
[19:10:45.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:45:0) after 5m2s
[19:15:47.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:45:0)
[19:15:47.614] Build status: STARTED
[19:15:47.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:46:0) after 5m17s
[19:21:04.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:46:0)
[19:21:04.830] Build status: STARTED
[19:21:04.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:47:0) after 4m24s
[19:25:28.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:47:0)
[19:25:28.866] Build status: STARTED
[19:25:28.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:48:0) after 4m58s
[19:30:26.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:48:0)
[19:30:27.031] Build status: STARTED
[19:30:27.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:49:0) after 4m8s
[19:34:35.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:49:0)
[19:34:35.250] Build status: STARTED
[19:34:35.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:50:0) after 7m27s
[19:42:02.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:50:0)
[19:42:02.345] Build status: STARTED
[19:42:02.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857483529906066800:51:0) after 9m33s
[19:49:17.665] Received PubSub notification, asking Buildbucket for the build status
[19:49:17.735] Build:
{
"id": "8692053466678514897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1406,
"createdBy": "project:chromium",
"createTime": "2026-01-21T15:21:14.206296997Z",
"startTime": "2026-01-21T15:21:18.872806868Z",
"endTime": "2026-01-21T19:49:17.435890043Z",
"updateTime": "2026-01-21T19:49:17.435890043Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "849afc5d9059012299dbf206f4e2d9dd147283f8",
"ref": "refs/heads/main"
}
}
}
[19:49:17.735] Invocation finished in 4h28m5.990193627s with status FAILED