[23:14:35.127] New invocation is queued and will start shortly
[23:14:36.191] Starting the invocation (attempt 1)
[23:14:36.212] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0a53b0e07aef76ace202934c413603e2f2876462"
[23:14:36.212] Popped gitiles commit info from properties and tags
[23:14:36.212] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:14:36.214] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:14:36.214] Buildbucket request:
{
"requestId": "8848484647132642848",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0a53b0e07aef76ace202934c413603e2f2876462",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848484647132642848"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:14:36.831] Scheduled build:
{
"id": "8683054585271895345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2872,
"createdBy": "project:chromium",
"createTime": "2026-04-30T23:14:36.280269616Z",
"updateTime": "2026-04-30T23:14:36.280269616Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0a53b0e07aef76ace202934c413603e2f2876462",
"ref": "refs/heads/main"
}
}
}
[23:14:36.831] Task URL: https://cr-buildbucket.appspot.com/build/8683054585271895345
[23:14:36.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:2:0) after 2m55s
[23:14:37.709] Received PubSub notification, asking Buildbucket for the build status
[23:14:37.766] Build status: SCHEDULED
[23:15:17.523] Received PubSub notification, asking Buildbucket for the build status
[23:15:17.545] Build status: STARTED
[23:17:31.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:2:0)
[23:17:31.931] Build status: STARTED
[23:17:31.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:5:0) after 3m29s
[23:21:00.992] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:5:0)
[23:21:01.097] Build status: STARTED
[23:21:01.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:6:0) after 9m21s
[23:30:22.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:6:0)
[23:30:22.143] Build status: STARTED
[23:30:22.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:7:0) after 3m37s
[23:33:59.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:7:0)
[23:33:59.197] Build status: STARTED
[23:33:59.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:8:0) after 3m28s
[23:37:27.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:8:0)
[23:37:27.214] Build status: STARTED
[23:37:27.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:9:0) after 2m18s
[23:39:45.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:9:0)
[23:39:45.268] Build status: STARTED
[23:39:45.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:10:0) after 7m26s
[23:47:11.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:10:0)
[23:47:11.316] Build status: STARTED
[23:47:11.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:11:0) after 6m20s
[23:53:31.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:11:0)
[23:53:31.425] Build status: STARTED
[23:53:31.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:12:0) after 8m41s
[00:02:12.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:12:0)
[00:02:12.522] Build status: STARTED
[00:02:12.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:13:0) after 5m44s
[00:07:56.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:13:0)
[00:07:56.711] Build status: STARTED
[00:07:56.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:14:0) after 2m29s
[00:10:25.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:14:0)
[00:10:25.783] Build status: STARTED
[00:10:25.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:15:0) after 3m1s
[00:13:26.875] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:15:0)
[00:13:26.922] Build status: STARTED
[00:13:26.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:16:0) after 6m53s
[00:20:20.014] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:16:0)
[00:20:20.040] Build status: STARTED
[00:20:20.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:17:0) after 8m34s
[00:28:54.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:17:0)
[00:28:54.114] Build status: STARTED
[00:28:54.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:18:0) after 9m16s
[00:38:10.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:18:0)
[00:38:10.287] Build status: STARTED
[00:38:10.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:19:0) after 6m19s
[00:44:29.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:19:0)
[00:44:29.570] Build status: STARTED
[00:44:29.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:20:0) after 6m56s
[00:51:25.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:20:0)
[00:51:25.679] Build status: STARTED
[00:51:25.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:21:0) after 7m41s
[00:59:06.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:21:0)
[00:59:06.752] Build status: STARTED
[00:59:06.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:22:0) after 9m59s
[01:09:05.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:22:0)
[01:09:05.950] Build status: STARTED
[01:09:05.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:23:0) after 3m4s
[01:12:10.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:23:0)
[01:12:10.085] Build status: STARTED
[01:12:10.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:24:0) after 6m53s
[01:19:03.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:24:0)
[01:19:03.119] Build status: STARTED
[01:19:03.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:25:0) after 2m2s
[01:21:05.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:25:0)
[01:21:05.144] Build status: STARTED
[01:21:05.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:26:0) after 3m46s
[01:24:51.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:26:0)
[01:24:51.292] Build status: STARTED
[01:24:51.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:27:0) after 4m53s
[01:29:44.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:27:0)
[01:29:44.372] Build status: STARTED
[01:29:44.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:28:0) after 3m22s
[01:33:06.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:28:0)
[01:33:06.506] Build status: STARTED
[01:33:06.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:29:0) after 5m48s
[01:38:54.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:29:0)
[01:38:54.678] Build status: STARTED
[01:38:54.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:30:0) after 7m45s
[01:46:39.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:30:0)
[01:46:39.764] Build status: STARTED
[01:46:39.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:31:0) after 9m0s
[01:55:39.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:31:0)
[01:55:39.908] Build status: STARTED
[01:55:39.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:32:0) after 9m29s
[02:05:09.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:32:0)
[02:05:09.287] Build status: STARTED
[02:05:09.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:33:0) after 1m33s
[02:06:42.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:33:0)
[02:06:42.355] Build status: STARTED
[02:06:42.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:34:0) after 4m18s
[02:11:00.377] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:34:0)
[02:11:00.402] Build status: STARTED
[02:11:00.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:35:0) after 9m23s
[02:20:23.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:35:0)
[02:20:23.545] Build status: STARTED
[02:20:23.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:36:0) after 1m49s
[02:22:12.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:36:0)
[02:22:12.637] Build status: STARTED
[02:22:12.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:37:0) after 9m22s
[02:31:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:37:0)
[02:31:34.682] Build status: STARTED
[02:31:34.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:38:0) after 2m16s
[02:33:50.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:38:0)
[02:33:50.710] Build status: STARTED
[02:33:50.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:39:0) after 3m34s
[02:37:24.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:39:0)
[02:37:24.789] Build status: STARTED
[02:37:24.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:40:0) after 2m17s
[02:39:41.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:40:0)
[02:39:41.829] Build status: STARTED
[02:39:41.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:41:0) after 1m16s
[02:40:57.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:41:0)
[02:40:57.864] Build status: STARTED
[02:40:57.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:42:0) after 7m19s
[02:48:16.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:42:0)
[02:48:16.958] Build status: STARTED
[02:48:16.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:43:0) after 3m26s
[02:51:42.939] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:43:0)
[02:51:43.157] Build status: STARTED
[02:51:43.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:44:0) after 9m48s
[03:01:31.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:44:0)
[03:01:31.505] Build status: STARTED
[03:01:31.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:45:0) after 7m33s
[03:09:04.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:45:0)
[03:09:04.644] Build status: STARTED
[03:09:04.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:46:0) after 9m18s
[03:18:22.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:46:0)
[03:18:22.776] Build status: STARTED
[03:18:22.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:47:0) after 8m14s
[03:26:36.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:47:0)
[03:26:36.905] Build status: STARTED
[03:26:36.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:48:0) after 8m32s
[03:35:09.214] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:48:0)
[03:35:09.232] Build status: STARTED
[03:35:09.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8848484647132642848:49:0) after 5m48s
[03:40:48.494] Received PubSub notification, asking Buildbucket for the build status
[03:40:48.522] Build:
{
"id": "8683054585271895345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2872,
"createdBy": "project:chromium",
"createTime": "2026-04-30T23:14:36.280269616Z",
"startTime": "2026-04-30T23:15:17.303849160Z",
"endTime": "2026-05-01T03:40:23.137625475Z",
"updateTime": "2026-05-01T03:40:23.137625475Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0a53b0e07aef76ace202934c413603e2f2876462",
"ref": "refs/heads/main"
}
}
}
[03:40:48.522] Invocation finished in 4h26m13.40027343s with status FAILED