[08:06:59.333] New invocation is queued and will start shortly
[08:07:00.383] Starting the invocation (attempt 1)
[08:07:00.404] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a4c0145a78837c4b6c47c94150c773560ec97702"
[08:07:00.404] Popped gitiles commit info from properties and tags
[08:07:00.404] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:07:00.405] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:07:00.405] Buildbucket request:
{
"requestId": "8857601444814211744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4c0145a78837c4b6c47c94150c773560ec97702",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857601444814211744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:07:01.025] Scheduled build:
{
"id": "8692171382909333537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1399,
"createdBy": "project:chromium",
"createTime": "2026-01-20T08:07:00.525063763Z",
"updateTime": "2026-01-20T08:07:00.525063763Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4c0145a78837c4b6c47c94150c773560ec97702",
"ref": "refs/heads/main"
}
}
}
[08:07:01.025] Task URL: https://cr-buildbucket.appspot.com/build/8692171382909333537
[08:07:01.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:2:0) after 2m8s
[08:07:01.386] Received PubSub notification, asking Buildbucket for the build status
[08:07:01.403] Build status: SCHEDULED
[08:07:10.147] Received PubSub notification, asking Buildbucket for the build status
[08:07:10.164] Build status: STARTED
[08:09:09.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:2:0)
[08:09:09.111] Build status: STARTED
[08:09:09.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:5:0) after 2m23s
[08:11:32.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:5:0)
[08:11:32.151] Build status: STARTED
[08:11:32.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:6:0) after 5m43s
[08:17:15.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:6:0)
[08:17:15.185] Build status: STARTED
[08:17:15.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:7:0) after 8m13s
[08:25:28.177] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:7:0)
[08:25:28.229] Build status: STARTED
[08:25:28.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:8:0) after 7m23s
[08:32:51.244] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:8:0)
[08:32:51.261] Build status: STARTED
[08:32:51.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:9:0) after 7m55s
[08:40:46.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:9:0)
[08:40:46.335] Build status: STARTED
[08:40:46.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:10:0) after 4m53s
[08:45:39.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:10:0)
[08:45:39.406] Build status: STARTED
[08:45:39.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:11:0) after 4m6s
[08:49:45.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:11:0)
[08:49:45.564] Build status: STARTED
[08:49:45.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:12:0) after 2m51s
[08:52:36.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:12:0)
[08:52:36.750] Build status: STARTED
[08:52:36.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:13:0) after 8m15s
[09:00:51.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:13:0)
[09:00:51.833] Build status: STARTED
[09:00:51.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:14:0) after 9m53s
[09:10:44.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:14:0)
[09:10:44.862] Build status: STARTED
[09:10:44.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:15:0) after 4m27s
[09:15:11.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:15:0)
[09:15:11.963] Build status: STARTED
[09:15:11.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:16:0) after 7m10s
[09:22:21.979] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:16:0)
[09:22:21.994] Build status: STARTED
[09:22:21.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:17:0) after 6m31s
[09:28:53.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:17:0)
[09:28:53.125] Build status: STARTED
[09:28:53.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:18:0) after 2m57s
[09:31:50.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:18:0)
[09:31:50.213] Build status: STARTED
[09:31:50.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:19:0) after 2m10s
[09:34:00.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:19:0)
[09:34:00.199] Build status: STARTED
[09:34:00.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:20:0) after 4m49s
[09:38:49.408] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:20:0)
[09:38:49.421] Build status: STARTED
[09:38:49.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:21:0) after 7m3s
[09:45:52.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:21:0)
[09:45:52.529] Build status: STARTED
[09:45:52.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:22:0) after 5m8s
[09:51:00.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:22:0)
[09:51:00.625] Build status: STARTED
[09:51:00.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:23:0) after 7m42s
[09:58:42.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:23:0)
[09:58:42.957] Build status: STARTED
[09:58:42.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:24:0) after 8m41s
[10:07:24.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:24:0)
[10:07:24.275] Build status: STARTED
[10:07:24.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:25:0) after 7m46s
[10:15:10.334] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:25:0)
[10:15:10.356] Build status: STARTED
[10:15:10.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:26:0) after 8m2s
[10:23:12.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:26:0)
[10:23:12.541] Build status: STARTED
[10:23:12.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:27:0) after 2m38s
[10:25:50.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:27:0)
[10:25:50.652] Build status: STARTED
[10:25:50.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:28:0) after 2m22s
[10:28:13.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:28:0)
[10:28:13.122] Build status: STARTED
[10:28:13.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:29:0) after 4m52s
[10:33:05.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:29:0)
[10:33:05.757] Build status: STARTED
[10:33:05.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:30:0) after 2m22s
[10:35:27.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:30:0)
[10:35:27.829] Build status: STARTED
[10:35:27.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:31:0) after 9m41s
[10:45:09.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:31:0)
[10:45:09.038] Build status: STARTED
[10:45:09.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:32:0) after 9m39s
[10:54:48.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:32:0)
[10:54:48.266] Build status: STARTED
[10:54:48.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:33:0) after 7m43s
[11:02:31.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:33:0)
[11:02:31.469] Build status: STARTED
[11:02:31.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:34:0) after 4m34s
[11:07:05.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:34:0)
[11:07:05.675] Build status: STARTED
[11:07:05.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:35:0) after 1m54s
[11:08:59.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:35:0)
[11:08:59.726] Build status: STARTED
[11:08:59.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:36:0) after 5m42s
[11:14:41.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:36:0)
[11:14:41.764] Build status: STARTED
[11:14:41.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:37:0) after 1m54s
[11:16:35.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:37:0)
[11:16:35.887] Build status: STARTED
[11:16:35.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:38:0) after 4m52s
[11:21:28.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:38:0)
[11:21:28.040] Build status: STARTED
[11:21:28.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:39:0) after 5m22s
[11:26:50.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:39:0)
[11:26:50.340] Build status: STARTED
[11:26:50.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:40:0) after 9m47s
[11:36:37.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:40:0)
[11:36:37.457] Build status: STARTED
[11:36:37.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:41:0) after 5m30s
[11:42:07.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:41:0)
[11:42:07.496] Build status: STARTED
[11:42:07.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:42:0) after 3m17s
[11:45:24.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:42:0)
[11:45:24.611] Build status: STARTED
[11:45:24.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:43:0) after 2m18s
[11:47:42.806] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:43:0)
[11:47:42.829] Build status: STARTED
[11:47:42.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:44:0) after 7m20s
[11:55:02.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:44:0)
[11:55:02.916] Build status: STARTED
[11:55:02.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:45:0) after 9m45s
[12:04:47.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:45:0)
[12:04:47.954] Build status: STARTED
[12:04:47.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:46:0) after 2m43s
[12:07:30.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:46:0)
[12:07:30.984] Build status: STARTED
[12:07:30.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:47:0) after 7m57s
[12:15:28.004] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:47:0)
[12:15:28.017] Build status: STARTED
[12:15:28.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:48:0) after 3m42s
[12:19:10.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:48:0)
[12:19:10.489] Build status: STARTED
[12:19:10.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:49:0) after 5m6s
[12:24:16.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:49:0)
[12:24:16.817] Build status: STARTED
[12:24:16.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:50:0) after 3m52s
[12:28:08.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:50:0)
[12:28:09.023] Build status: STARTED
[12:28:09.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:51:0) after 4m29s
[12:32:38.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:51:0)
[12:32:38.376] Build status: STARTED
[12:32:38.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8857601444814211744:52:0) after 8m51s
[12:33:28.928] Received PubSub notification, asking Buildbucket for the build status
[12:33:28.941] Build:
{
"id": "8692171382909333537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1399,
"createdBy": "project:chromium",
"createTime": "2026-01-20T08:07:00.525063763Z",
"startTime": "2026-01-20T08:07:09.958902207Z",
"endTime": "2026-01-20T12:33:28.074379121Z",
"updateTime": "2026-01-20T12:33:28.074379121Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a4c0145a78837c4b6c47c94150c773560ec97702",
"ref": "refs/heads/main"
}
}
}
[12:33:28.941] Invocation finished in 4h26m29.61667211s with status FAILED