[15:53:02.178] New invocation is queued and will start shortly
[15:53:03.658] Starting the invocation (attempt 1)
[15:53:03.711] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/af71755e7aa8cf49e3f204af56dcffd49392a02c"
[15:53:03.712] Popped gitiles commit info from properties and tags
[15:53:03.712] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:53:03.712] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:53:03.712] Buildbucket request:
{
"requestId": "8854401229828163840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af71755e7aa8cf49e3f204af56dcffd49392a02c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8854401229828163840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:53:04.312] Scheduled build:
{
"id": "8688971167452190113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1624,
"createdBy": "project:chromium",
"createTime": "2026-02-24T15:53:03.814962329Z",
"updateTime": "2026-02-24T15:53:03.814962329Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af71755e7aa8cf49e3f204af56dcffd49392a02c",
"ref": "refs/heads/main"
}
}
}
[15:53:04.312] Task URL: https://cr-buildbucket.appspot.com/build/8688971167452190113
[15:53:04.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:2:0) after 5m25s
[15:53:05.366] Received PubSub notification, asking Buildbucket for the build status
[15:53:05.380] Build status: SCHEDULED
[15:53:07.326] Received PubSub notification, asking Buildbucket for the build status
[15:53:07.353] Build status: STARTED
[15:58:29.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:2:0)
[15:58:29.368] Build status: STARTED
[15:58:29.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:5:0) after 4m3s
[16:02:32.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:5:0)
[16:02:32.417] Build status: STARTED
[16:02:32.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:6:0) after 2m14s
[16:04:46.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:6:0)
[16:04:46.512] Build status: STARTED
[16:04:46.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:7:0) after 3m29s
[16:08:15.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:7:0)
[16:08:15.568] Build status: STARTED
[16:08:15.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:8:0) after 7m51s
[16:16:06.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:8:0)
[16:16:06.632] Build status: STARTED
[16:16:06.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:9:0) after 5m22s
[16:21:28.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:9:0)
[16:21:28.719] Build status: STARTED
[16:21:28.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:10:0) after 8m5s
[16:29:33.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:10:0)
[16:29:33.766] Build status: STARTED
[16:29:33.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:11:0) after 2m9s
[16:31:42.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:11:0)
[16:31:42.847] Build status: STARTED
[16:31:42.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:12:0) after 3m18s
[16:35:00.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:12:0)
[16:35:00.839] Build status: STARTED
[16:35:00.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:13:0) after 1m42s
[16:36:42.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:13:0)
[16:36:42.866] Build status: STARTED
[16:36:42.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:14:0) after 1m19s
[16:38:01.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:14:0)
[16:38:01.895] Build status: STARTED
[16:38:01.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:15:0) after 5m47s
[16:43:48.912] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:15:0)
[16:43:48.926] Build status: STARTED
[16:43:48.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:16:0) after 2m6s
[16:45:55.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:16:0)
[16:45:55.050] Build status: STARTED
[16:45:55.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:17:0) after 1m8s
[16:47:03.079] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:17:0)
[16:47:03.094] Build status: STARTED
[16:47:03.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:18:0) after 3m4s
[16:50:07.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:18:0)
[16:50:07.226] Build status: STARTED
[16:50:07.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:19:0) after 9m13s
[16:59:20.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:19:0)
[16:59:20.313] Build status: STARTED
[16:59:20.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:20:0) after 1m26s
[17:00:46.302] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:20:0)
[17:00:46.316] Build status: STARTED
[17:00:46.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:21:0) after 9m1s
[17:09:47.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:21:0)
[17:09:47.465] Build status: STARTED
[17:09:47.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:22:0) after 2m22s
[17:12:09.687] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:22:0)
[17:12:09.704] Build status: STARTED
[17:12:09.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:23:0) after 1m57s
[17:14:06.723] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:23:0)
[17:14:06.900] Build status: STARTED
[17:14:06.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:24:0) after 7m44s
[17:21:50.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:24:0)
[17:21:50.965] Build status: STARTED
[17:21:50.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:25:0) after 4m14s
[17:26:05.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:25:0)
[17:26:05.051] Build status: STARTED
[17:26:05.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:26:0) after 3m43s
[17:29:48.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:26:0)
[17:29:48.165] Build status: STARTED
[17:29:48.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:27:0) after 2m30s
[17:32:18.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:27:0)
[17:32:18.206] Build status: STARTED
[17:32:18.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:28:0) after 9m44s
[17:42:02.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:28:0)
[17:42:02.313] Build status: STARTED
[17:42:02.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:29:0) after 8m29s
[17:50:31.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:29:0)
[17:50:31.467] Build status: STARTED
[17:50:31.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:30:0) after 1m41s
[17:52:12.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:30:0)
[17:52:12.551] Build status: STARTED
[17:52:12.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:31:0) after 4m24s
[17:56:36.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:31:0)
[17:56:36.583] Build status: STARTED
[17:56:36.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:32:0) after 5m3s
[18:01:39.640] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:32:0)
[18:01:39.653] Build status: STARTED
[18:01:39.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:33:0) after 2m22s
[18:04:01.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:33:0)
[18:04:01.687] Build status: STARTED
[18:04:01.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:34:0) after 6m42s
[18:10:43.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:34:0)
[18:10:43.764] Build status: STARTED
[18:10:43.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:35:0) after 6m24s
[18:17:07.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:35:0)
[18:17:07.905] Build status: STARTED
[18:17:07.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:36:0) after 6m13s
[18:23:20.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:36:0)
[18:23:21.026] Build status: STARTED
[18:23:21.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:37:0) after 2m20s
[18:25:41.118] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:37:0)
[18:25:41.135] Build status: STARTED
[18:25:41.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:38:0) after 8m25s
[18:34:06.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:38:0)
[18:34:06.168] Build status: STARTED
[18:34:06.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:39:0) after 8m43s
[18:42:49.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:39:0)
[18:42:49.348] Build status: STARTED
[18:42:49.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8854401229828163840:40:0) after 7m47s
[18:44:23.477] Received PubSub notification, asking Buildbucket for the build status
[18:44:23.496] Build:
{
"id": "8688971167452190113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 1624,
"createdBy": "project:chromium",
"createTime": "2026-02-24T15:53:03.814962329Z",
"startTime": "2026-02-24T15:53:07.125365506Z",
"endTime": "2026-02-24T18:44:17.282442960Z",
"updateTime": "2026-02-24T18:44:17.282442960Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "af71755e7aa8cf49e3f204af56dcffd49392a02c",
"ref": "refs/heads/main"
}
}
}
[18:44:23.496] Invocation finished in 2h51m21.332526617s with status FAILED