[09:07:26.189] New invocation is queued and will start shortly
[09:07:27.240] Starting the invocation (attempt 1)
[09:07:27.269] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dcc54874b6962dff5e72bc3be668424343f9de2c"
[09:07:27.269] Popped gitiles commit info from properties and tags
[09:07:27.269] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:07:27.269] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:07:27.269] Buildbucket request:
{
"requestId": "8841471381755975456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dcc54874b6962dff5e72bc3be668424343f9de2c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8841471381755975456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:07:28.102] Scheduled build:
{
"id": "8676041319901340561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 4282,
"createdBy": "project:chromium",
"createTime": "2026-07-17T09:07:27.338268200Z",
"updateTime": "2026-07-17T09:07:27.338268200Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dcc54874b6962dff5e72bc3be668424343f9de2c",
"ref": "refs/heads/main"
}
}
}
[09:07:28.102] Task URL: https://cr-buildbucket.appspot.com/build/8676041319901340561
[09:07:28.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:2:0) after 1m44s
[09:07:29.002] Received PubSub notification, asking Buildbucket for the build status
[09:07:29.048] Build status: SCHEDULED
[09:07:31.480] Received PubSub notification, asking Buildbucket for the build status
[09:07:31.498] Build status: STARTED
[09:09:12.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:2:0)
[09:09:12.209] Build status: STARTED
[09:09:12.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:5:0) after 3m34s
[09:12:46.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:5:0)
[09:12:46.294] Build status: STARTED
[09:12:46.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:6:0) after 3m15s
[09:16:01.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:6:0)
[09:16:01.415] Build status: STARTED
[09:16:01.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:7:0) after 8m18s
[09:24:19.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:7:0)
[09:24:19.500] Build status: STARTED
[09:24:19.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:8:0) after 5m45s
[09:30:04.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:8:0)
[09:30:04.637] Build status: STARTED
[09:30:04.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:9:0) after 5m54s
[09:35:58.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:9:0)
[09:35:58.813] Build status: STARTED
[09:35:58.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:10:0) after 3m43s
[09:39:41.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:10:0)
[09:39:41.912] Build status: STARTED
[09:39:41.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:11:0) after 5m22s
[09:45:03.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:11:0)
[09:45:03.955] Build status: STARTED
[09:45:03.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:12:0) after 9m57s
[09:55:00.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:12:0)
[09:55:01.083] Build status: STARTED
[09:55:01.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:13:0) after 2m32s
[09:57:33.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:13:0)
[09:57:33.164] Build status: STARTED
[09:57:33.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:14:0) after 8m50s
[10:06:23.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:14:0)
[10:06:23.242] Build status: STARTED
[10:06:23.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:15:0) after 6m58s
[10:13:21.261] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:15:0)
[10:13:21.280] Build status: STARTED
[10:13:21.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:16:0) after 2m57s
[10:16:18.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:16:0)
[10:16:18.378] Build status: STARTED
[10:16:18.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:17:0) after 5m27s
[10:21:45.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:17:0)
[10:21:45.524] Build status: STARTED
[10:21:45.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:18:0) after 2m10s
[10:23:55.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:18:0)
[10:23:55.665] Build status: STARTED
[10:23:55.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:19:0) after 2m50s
[10:26:45.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:19:0)
[10:26:45.704] Build status: STARTED
[10:26:45.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:20:0) after 1m55s
[10:28:40.755] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:20:0)
[10:28:40.782] Build status: STARTED
[10:28:40.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:21:0) after 3m57s
[10:32:37.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:21:0)
[10:32:37.827] Build status: STARTED
[10:32:37.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:22:0) after 9m11s
[10:41:48.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:22:0)
[10:41:48.870] Build status: STARTED
[10:41:48.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:23:0) after 2m38s
[10:44:26.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:23:0)
[10:44:26.917] Build status: STARTED
[10:44:26.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:24:0) after 4m18s
[10:48:45.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:24:0)
[10:48:45.056] Build status: STARTED
[10:48:45.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:25:0) after 3m17s
[10:52:02.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:25:0)
[10:52:02.182] Build status: STARTED
[10:52:02.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:26:0) after 4m30s
[10:56:32.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:26:0)
[10:56:32.453] Build status: STARTED
[10:56:32.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:27:0) after 7m4s
[11:03:36.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:27:0)
[11:03:36.584] Build status: STARTED
[11:03:36.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:28:0) after 6m48s
[11:10:24.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:28:0)
[11:10:24.693] Build status: STARTED
[11:10:24.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:29:0) after 2m4s
[11:12:28.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:29:0)
[11:12:28.876] Build status: STARTED
[11:12:28.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:30:0) after 9m20s
[11:21:48.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:30:0)
[11:21:48.961] Build status: STARTED
[11:21:48.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:31:0) after 8m10s
[11:29:59.222] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:31:0)
[11:29:59.240] Build status: STARTED
[11:29:59.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:32:0) after 9m57s
[11:39:56.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:32:0)
[11:39:56.329] Build status: STARTED
[11:39:56.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:33:0) after 6m15s
[11:46:11.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:33:0)
[11:46:11.367] Build status: STARTED
[11:46:11.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:34:0) after 5m16s
[11:51:27.525] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:34:0)
[11:51:27.543] Build status: STARTED
[11:51:27.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:35:0) after 9m48s
[12:01:15.547] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:35:0)
[12:01:15.565] Build status: STARTED
[12:01:15.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:36:0) after 8m37s
[12:09:52.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:36:0)
[12:09:52.771] Build status: STARTED
[12:09:52.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:37:0) after 7m0s
[12:16:52.825] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:37:0)
[12:16:52.847] Build status: STARTED
[12:16:52.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:38:0) after 3m4s
[12:19:56.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:38:0)
[12:19:56.898] Build status: STARTED
[12:19:56.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:39:0) after 7m14s
[12:27:10.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:39:0)
[12:27:10.991] Build status: STARTED
[12:27:10.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:40:0) after 1m57s
[12:29:08.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:40:0)
[12:29:08.175] Build status: STARTED
[12:29:08.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:41:0) after 2m5s
[12:31:13.191] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:41:0)
[12:31:13.211] Build status: STARTED
[12:31:13.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:42:0) after 2m2s
[12:33:15.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:42:0)
[12:33:15.338] Build status: STARTED
[12:33:15.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:43:0) after 8m58s
[12:42:13.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:43:0)
[12:42:13.392] Build status: STARTED
[12:42:13.392] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:44:0) after 5m55s
[12:48:08.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:44:0)
[12:48:08.474] Build status: STARTED
[12:48:08.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:45:0) after 1m30s
[12:49:38.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:45:0)
[12:49:38.579] Build status: STARTED
[12:49:38.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:46:0) after 1m10s
[12:50:48.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:46:0)
[12:50:48.640] Build status: STARTED
[12:50:48.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:47:0) after 4m27s
[12:55:15.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:47:0)
[12:55:15.649] Build status: STARTED
[12:55:15.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:48:0) after 6m13s
[13:01:28.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:48:0)
[13:01:28.798] Build status: STARTED
[13:01:28.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:49:0) after 3m23s
[13:04:51.810] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:49:0)
[13:04:51.829] Build status: STARTED
[13:04:51.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:50:0) after 1m36s
[13:06:27.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:50:0)
[13:06:27.861] Build status: STARTED
[13:06:27.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:51:0) after 2m1s
[13:08:28.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:51:0)
[13:08:28.905] Build status: STARTED
[13:08:28.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:52:0) after 1m4s
[13:09:32.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:52:0)
[13:09:32.982] Build status: STARTED
[13:09:32.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:53:0) after 8m59s
[13:18:32.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:53:0)
[13:18:32.122] Build status: STARTED
[13:18:32.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:54:0) after 1m35s
[13:20:07.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:54:0)
[13:20:07.200] Build status: STARTED
[13:20:07.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8841471381755975456:55:0) after 9m32s
[13:25:19.039] Received PubSub notification, asking Buildbucket for the build status
[13:25:19.058] Build:
{
"id": "8676041319901340561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 4282,
"createdBy": "project:chromium",
"createTime": "2026-07-17T09:07:27.338268200Z",
"startTime": "2026-07-17T09:07:31.250877083Z",
"endTime": "2026-07-17T13:25:18.739039037Z",
"updateTime": "2026-07-17T13:25:18.739039037Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dcc54874b6962dff5e72bc3be668424343f9de2c",
"ref": "refs/heads/main"
}
}
}
[13:25:19.058] Invocation finished in 4h17m52.871816259s with status FAILED