[19:38:38.526] New invocation is queued and will start shortly
[19:38:39.654] Starting the invocation (attempt 1)
[19:38:39.685] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/42a7dd9fd98813dfd1e91b5945b29aa0543e46cc"
[19:38:39.685] Popped gitiles commit info from properties and tags
[19:38:39.685] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:38:39.685] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:38:39.685] Buildbucket request:
{
"requestId": "8842881221197580880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42a7dd9fd98813dfd1e91b5945b29aa0543e46cc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842881221197580880"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:38:40.210] Scheduled build:
{
"id": "8677451159248622385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3976,
"createdBy": "project:chromium",
"createTime": "2026-07-01T19:38:39.762063476Z",
"updateTime": "2026-07-01T19:38:39.762063476Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42a7dd9fd98813dfd1e91b5945b29aa0543e46cc",
"ref": "refs/heads/main"
}
}
}
[19:38:40.210] Task URL: https://cr-buildbucket.appspot.com/build/8677451159248622385
[19:38:40.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:2:0) after 4m32s
[19:38:41.142] Received PubSub notification, asking Buildbucket for the build status
[19:38:41.194] Build status: SCHEDULED
[19:38:45.345] Received PubSub notification, asking Buildbucket for the build status
[19:38:45.432] Build status: STARTED
[19:43:12.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:2:0)
[19:43:12.311] Build status: STARTED
[19:43:12.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:5:0) after 6m18s
[19:49:30.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:5:0)
[19:49:30.580] Build status: STARTED
[19:49:30.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:6:0) after 7m36s
[19:57:06.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:6:0)
[19:57:06.679] Build status: STARTED
[19:57:06.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:7:0) after 4m58s
[20:02:04.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:7:0)
[20:02:04.851] Build status: STARTED
[20:02:04.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:8:0) after 8m19s
[20:10:23.870] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:8:0)
[20:10:23.883] Build status: STARTED
[20:10:23.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:9:0) after 3m20s
[20:13:43.901] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:9:0)
[20:13:43.918] Build status: STARTED
[20:13:43.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:10:0) after 8m38s
[20:22:21.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:10:0)
[20:22:22.012] Build status: STARTED
[20:22:22.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:11:0) after 7m18s
[20:29:40.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:11:0)
[20:29:40.088] Build status: STARTED
[20:29:40.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:12:0) after 6m34s
[20:36:14.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:12:0)
[20:36:14.133] Build status: STARTED
[20:36:14.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:13:0) after 1m36s
[20:37:50.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:13:0)
[20:37:50.653] Build status: STARTED
[20:37:50.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:14:0) after 4m45s
[20:42:35.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:14:0)
[20:42:35.743] Build status: STARTED
[20:42:35.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:15:0) after 8m1s
[20:50:36.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:15:0)
[20:50:36.839] Build status: STARTED
[20:50:36.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:16:0) after 3m11s
[20:53:52.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:16:0)
[20:53:52.782] Build status: STARTED
[20:53:52.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:17:0) after 8m7s
[21:01:59.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:17:0)
[21:01:59.975] Build status: STARTED
[21:01:59.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:18:0) after 3m10s
[21:05:10.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:18:0)
[21:05:10.115] Build status: STARTED
[21:05:10.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:19:0) after 7m26s
[21:12:36.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:19:0)
[21:12:36.166] Build status: STARTED
[21:12:36.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:20:0) after 4m15s
[21:16:51.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:20:0)
[21:16:51.365] Build status: STARTED
[21:16:51.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:21:0) after 2m15s
[21:19:06.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:21:0)
[21:19:06.414] Build status: STARTED
[21:19:06.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:22:0) after 6m3s
[21:25:09.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:22:0)
[21:25:09.469] Build status: STARTED
[21:25:09.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:23:0) after 4m31s
[21:29:40.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:23:0)
[21:29:40.560] Build status: STARTED
[21:29:40.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:24:0) after 1m9s
[21:30:49.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:24:0)
[21:30:49.607] Build status: STARTED
[21:30:49.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:25:0) after 3m35s
[21:34:24.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:25:0)
[21:34:24.655] Build status: STARTED
[21:34:24.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:26:0) after 3m36s
[21:38:00.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:26:0)
[21:38:00.753] Build status: STARTED
[21:38:00.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:27:0) after 5m21s
[21:43:21.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:27:0)
[21:43:21.845] Build status: STARTED
[21:43:21.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:28:0) after 1m1s
[21:44:23.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:28:0)
[21:44:23.155] Build status: STARTED
[21:44:23.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:29:0) after 4m34s
[21:48:57.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:29:0)
[21:48:57.173] Build status: STARTED
[21:48:57.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:30:0) after 6m18s
[21:55:15.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:30:0)
[21:55:15.260] Build status: STARTED
[21:55:15.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:31:0) after 9m44s
[22:04:59.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:31:0)
[22:04:59.333] Build status: STARTED
[22:04:59.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:32:0) after 9m10s
[22:14:09.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:32:0)
[22:14:09.379] Build status: STARTED
[22:14:09.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:33:0) after 3m1s
[22:17:10.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:33:0)
[22:17:10.423] Build status: STARTED
[22:17:10.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:34:0) after 1m33s
[22:18:43.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:34:0)
[22:18:43.501] Build status: STARTED
[22:18:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:35:0) after 5m21s
[22:24:04.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:35:0)
[22:24:04.562] Build status: STARTED
[22:24:04.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:36:0) after 6m41s
[22:30:45.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:36:0)
[22:30:45.647] Build status: STARTED
[22:30:45.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:37:0) after 8m13s
[22:38:58.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:37:0)
[22:38:58.771] Build status: STARTED
[22:38:58.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:38:0) after 6m47s
[22:45:45.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:38:0)
[22:45:45.887] Build status: STARTED
[22:45:45.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:39:0) after 7m35s
[22:53:20.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:39:0)
[22:53:20.960] Build status: STARTED
[22:53:20.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:40:0) after 3m38s
[22:56:59.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:40:0)
[22:56:59.147] Build status: STARTED
[22:56:59.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:41:0) after 7m33s
[23:04:32.199] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:41:0)
[23:04:32.215] Build status: STARTED
[23:04:32.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:42:0) after 6m30s
[23:11:02.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:42:0)
[23:11:02.458] Build status: STARTED
[23:11:02.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:43:0) after 3m29s
[23:14:31.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:43:0)
[23:14:31.705] Build status: STARTED
[23:14:31.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:44:0) after 4m38s
[23:19:09.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:44:0)
[23:19:09.808] Build status: STARTED
[23:19:09.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:45:0) after 4m37s
[23:23:46.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:45:0)
[23:23:46.895] Build status: STARTED
[23:23:46.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:46:0) after 8m58s
[23:32:44.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:46:0)
[23:32:44.973] Build status: STARTED
[23:32:44.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:47:0) after 6m54s
[23:39:38.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:47:0)
[23:39:39.042] Build status: STARTED
[23:39:39.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:48:0) after 9m30s
[23:49:09.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:48:0)
[23:49:09.210] Build status: STARTED
[23:49:09.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:49:0) after 2m0s
[23:51:09.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:49:0)
[23:51:09.260] Build status: STARTED
[23:51:09.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8842881221197580880:50:0) after 5m45s
[23:52:33.049] Received PubSub notification, asking Buildbucket for the build status
[23:52:33.067] Build:
{
"id": "8677451159248622385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3976,
"createdBy": "project:chromium",
"createTime": "2026-07-01T19:38:39.762063476Z",
"startTime": "2026-07-01T19:38:45.036495960Z",
"endTime": "2026-07-01T23:52:32.818772647Z",
"updateTime": "2026-07-01T23:52:32.818772647Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "42a7dd9fd98813dfd1e91b5945b29aa0543e46cc",
"ref": "refs/heads/main"
}
}
}
[23:52:33.067] Invocation finished in 4h13m54.547025523s with status FAILED