[08:52:26.155] New invocation is queued and will start shortly
[08:52:27.249] Starting the invocation (attempt 1)
[08:52:27.272] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fca99677de3a0c94cb4e15a0a2d8554d50e9184e"
[08:52:27.272] Popped gitiles commit info from properties and tags
[08:52:27.272] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:52:27.273] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:52:27.273] Buildbucket request:
{
"requestId": "8854337094749810384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fca99677de3a0c94cb4e15a0a2d8554d50e9184e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854337094749810384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:52:28.195] Scheduled build:
{
"id": "8688907032636810225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1629,
"createdBy": "project:chromium",
"createTime": "2026-02-25T08:52:27.540465194Z",
"updateTime": "2026-02-25T08:52:27.540465194Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fca99677de3a0c94cb4e15a0a2d8554d50e9184e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:52:28.195] Task URL: https://cr-buildbucket.appspot.com/build/8688907032636810225
[08:52:28.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:2:0) after 3m1s
[08:52:29.007] Received PubSub notification, asking Buildbucket for the build status
[08:52:29.027] Build status: SCHEDULED
[08:52:31.417] Received PubSub notification, asking Buildbucket for the build status
[08:52:31.447] Build status: STARTED
[08:55:29.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:2:0)
[08:55:29.225] Build status: STARTED
[08:55:29.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:5:0) after 1m31s
[08:57:00.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:5:0)
[08:57:00.277] Build status: STARTED
[08:57:00.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:6:0) after 6m56s
[09:03:56.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:6:0)
[09:03:56.306] Build status: STARTED
[09:03:56.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:7:0) after 2m54s
[09:06:50.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:7:0)
[09:06:50.325] Build status: STARTED
[09:06:50.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:8:0) after 1m51s
[09:08:41.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:8:0)
[09:08:41.406] Build status: STARTED
[09:08:41.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:9:0) after 4m25s
[09:13:06.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:9:0)
[09:13:06.444] Build status: STARTED
[09:13:06.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:10:0) after 1m2s
[09:14:08.414] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:10:0)
[09:14:08.429] Build status: STARTED
[09:14:08.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:11:0) after 1m25s
[09:15:33.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:11:0)
[09:15:33.463] Build status: STARTED
[09:15:33.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:12:0) after 5m20s
[09:20:53.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:12:0)
[09:20:53.528] Build status: STARTED
[09:20:53.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:13:0) after 2m52s
[09:23:45.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:13:0)
[09:23:45.557] Build status: STARTED
[09:23:45.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:14:0) after 6m34s
[09:30:19.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:14:0)
[09:30:19.577] Build status: STARTED
[09:30:19.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:15:0) after 5m56s
[09:36:15.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:15:0)
[09:36:15.694] Build status: STARTED
[09:36:15.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:16:0) after 5m43s
[09:41:58.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:16:0)
[09:41:58.727] Build status: STARTED
[09:41:58.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:17:0) after 5m12s
[09:47:10.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:17:0)
[09:47:10.809] Build status: STARTED
[09:47:10.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:18:0) after 8m48s
[09:55:58.830] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:18:0)
[09:55:58.853] Build status: STARTED
[09:55:58.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:19:0) after 4m29s
[10:00:28.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:19:0)
[10:00:28.091] Build status: STARTED
[10:00:28.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:20:0) after 2m5s
[10:02:33.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:20:0)
[10:02:33.134] Build status: STARTED
[10:02:33.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:21:0) after 2m5s
[10:04:38.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:21:0)
[10:04:38.169] Build status: STARTED
[10:04:38.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:22:0) after 3m58s
[10:08:36.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:22:0)
[10:08:36.248] Build status: STARTED
[10:08:36.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:23:0) after 9m53s
[10:18:29.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:23:0)
[10:18:29.250] Build status: STARTED
[10:18:29.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:24:0) after 6m27s
[10:24:56.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:24:0)
[10:24:56.365] Build status: STARTED
[10:24:56.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:25:0) after 2m40s
[10:27:36.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:25:0)
[10:27:36.397] Build status: STARTED
[10:27:36.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:26:0) after 1m29s
[10:29:05.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:26:0)
[10:29:05.426] Build status: STARTED
[10:29:05.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:27:0) after 7m32s
[10:36:37.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:27:0)
[10:36:37.540] Build status: STARTED
[10:36:37.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:28:0) after 7m40s
[10:44:17.559] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:28:0)
[10:44:17.588] Build status: STARTED
[10:44:17.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:29:0) after 9m40s
[10:53:57.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:29:0)
[10:53:57.653] Build status: STARTED
[10:53:57.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:30:0) after 1m43s
[10:55:40.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:30:0)
[10:55:40.685] Build status: STARTED
[10:55:40.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:31:0) after 9m3s
[11:04:43.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:31:0)
[11:04:43.723] Build status: STARTED
[11:04:43.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:32:0) after 3m35s
[11:08:18.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:32:0)
[11:08:18.757] Build status: STARTED
[11:08:18.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:33:0) after 9m28s
[11:17:46.774] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:33:0)
[11:17:46.910] Build status: STARTED
[11:17:46.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:34:0) after 7m15s
[11:25:02.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:34:0)
[11:25:02.090] Build status: STARTED
[11:25:02.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:35:0) after 4m27s
[11:29:29.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:35:0)
[11:29:29.178] Build status: STARTED
[11:29:29.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:36:0) after 6m38s
[11:36:07.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:36:0)
[11:36:07.926] Build status: STARTED
[11:36:07.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:37:0) after 3m20s
[11:39:28.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:37:0)
[11:39:28.066] Build status: STARTED
[11:39:28.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:38:0) after 6m16s
[11:45:44.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:38:0)
[11:45:44.196] Build status: STARTED
[11:45:44.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854337094749810384:39:0) after 4m46s
[11:46:16.860] Received PubSub notification, asking Buildbucket for the build status
[11:46:16.880] Build:
{
"id": "8688907032636810225",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1629,
"createdBy": "project:chromium",
"createTime": "2026-02-25T08:52:27.540465194Z",
"startTime": "2026-02-25T08:52:31.195576677Z",
"endTime": "2026-02-25T11:46:14.483918847Z",
"updateTime": "2026-02-25T11:46:14.483918847Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fca99677de3a0c94cb4e15a0a2d8554d50e9184e",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:46:16.880] Invocation finished in 2h53m50.738737836s with status FAILED