[14:53:00.688] New invocation is queued and will start shortly
[14:53:01.752] Starting the invocation (attempt 1)
[14:53:01.788] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/38d6ef2be1d566290c2476e8a061cb3da0017bd5"
[14:53:01.788] Popped gitiles commit info from properties and tags
[14:53:01.788] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:53:01.789] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:53:01.789] Buildbucket request:
{
"requestId": "8853046051759820096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38d6ef2be1d566290c2476e8a061cb3da0017bd5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853046051759820096"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:53:02.457] Scheduled build:
{
"id": "8687615989881799665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2054,
"createdBy": "project:chromium",
"createTime": "2026-03-11T14:53:01.857511570Z",
"updateTime": "2026-03-11T14:53:01.857511570Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38d6ef2be1d566290c2476e8a061cb3da0017bd5",
"ref": "refs/heads/main"
}
}
}
[14:53:02.457] Task URL: https://cr-buildbucket.appspot.com/build/8687615989881799665
[14:53:02.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:2:0) after 9m16s
[14:53:03.437] Received PubSub notification, asking Buildbucket for the build status
[14:53:03.464] Build status: SCHEDULED
[14:53:05.706] Received PubSub notification, asking Buildbucket for the build status
[14:53:05.725] Build status: STARTED
[15:02:18.476] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:2:0)
[15:02:18.508] Build status: STARTED
[15:02:18.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:5:0) after 3m53s
[15:06:11.546] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:5:0)
[15:06:11.568] Build status: STARTED
[15:06:11.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:6:0) after 1m13s
[15:07:24.573] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:6:0)
[15:07:24.595] Build status: STARTED
[15:07:24.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:7:0) after 5m46s
[15:13:10.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:7:0)
[15:13:10.673] Build status: STARTED
[15:13:10.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:8:0) after 5m1s
[15:18:11.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:8:0)
[15:18:11.727] Build status: STARTED
[15:18:11.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:9:0) after 9m17s
[15:27:28.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:9:0)
[15:27:28.773] Build status: STARTED
[15:27:28.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:10:0) after 6m45s
[15:34:13.822] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:10:0)
[15:34:13.844] Build status: STARTED
[15:34:13.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:11:0) after 4m13s
[15:38:26.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:11:0)
[15:38:26.898] Build status: STARTED
[15:38:26.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:12:0) after 9m40s
[15:48:06.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:12:0)
[15:48:06.934] Build status: STARTED
[15:48:06.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:13:0) after 1m5s
[15:49:11.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:13:0)
[15:49:12.002] Build status: STARTED
[15:49:12.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:14:0) after 3m58s
[15:53:10.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:14:0)
[15:53:11.324] Build status: STARTED
[15:53:11.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:15:0) after 8m7s
[16:01:18.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:15:0)
[16:01:18.367] Build status: STARTED
[16:01:18.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:16:0) after 6m57s
[16:08:15.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:16:0)
[16:08:15.577] Build status: STARTED
[16:08:15.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:17:0) after 8m28s
[16:16:43.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:17:0)
[16:16:43.659] Build status: STARTED
[16:16:43.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:18:0) after 6m58s
[16:23:41.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:18:0)
[16:23:41.694] Build status: STARTED
[16:23:41.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:19:0) after 8m23s
[16:32:04.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:19:0)
[16:32:04.907] Build status: STARTED
[16:32:04.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:20:0) after 3m14s
[16:35:19.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:20:0)
[16:35:19.082] Build status: STARTED
[16:35:19.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:21:0) after 9m35s
[16:44:54.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:21:0)
[16:44:54.181] Build status: STARTED
[16:44:54.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:22:0) after 4m44s
[16:49:38.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:22:0)
[16:49:38.378] Build status: STARTED
[16:49:38.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:23:0) after 7m21s
[16:56:59.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:23:0)
[16:56:59.413] Build status: STARTED
[16:56:59.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:24:0) after 6m20s
[17:03:19.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:24:0)
[17:03:19.633] Build status: STARTED
[17:03:19.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:25:0) after 1m5s
[17:04:24.695] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:25:0)
[17:04:24.729] Build status: STARTED
[17:04:24.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:26:0) after 1m45s
[17:06:09.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:26:0)
[17:06:09.821] Build status: STARTED
[17:06:09.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:27:0) after 7m3s
[17:13:12.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:27:0)
[17:13:12.906] Build status: STARTED
[17:13:12.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:28:0) after 9m57s
[17:23:09.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:28:0)
[17:23:09.951] Build status: STARTED
[17:23:09.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:29:0) after 4m14s
[17:27:23.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:29:0)
[17:27:24.022] Build status: STARTED
[17:27:24.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:30:0) after 6m8s
[17:33:32.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:30:0)
[17:33:32.065] Build status: STARTED
[17:33:32.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:31:0) after 1m33s
[17:35:05.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:31:0)
[17:35:05.110] Build status: STARTED
[17:35:05.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:32:0) after 5m33s
[17:40:38.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:32:0)
[17:40:38.278] Build status: STARTED
[17:40:38.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:33:0) after 4m57s
[17:45:35.362] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:33:0)
[17:45:35.446] Build status: STARTED
[17:45:35.446] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:34:0) after 6m58s
[17:52:33.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:34:0)
[17:52:33.474] Build status: STARTED
[17:52:33.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:35:0) after 8m38s
[18:01:11.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:35:0)
[18:01:11.598] Build status: STARTED
[18:01:11.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:36:0) after 5m29s
[18:06:40.611] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:36:0)
[18:06:40.648] Build status: STARTED
[18:06:40.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:37:0) after 9m45s
[18:16:25.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:37:0)
[18:16:25.749] Build status: STARTED
[18:16:25.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:38:0) after 6m12s
[18:22:37.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:38:0)
[18:22:37.854] Build status: STARTED
[18:22:37.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:39:0) after 4m51s
[18:27:28.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:39:0)
[18:27:28.896] Build status: STARTED
[18:27:28.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:40:0) after 4m32s
[18:32:01.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:40:0)
[18:32:01.059] Build status: STARTED
[18:32:01.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:41:0) after 6m26s
[18:38:27.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:41:0)
[18:38:27.095] Build status: STARTED
[18:38:27.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:42:0) after 6m50s
[18:45:17.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:42:0)
[18:45:17.133] Build status: STARTED
[18:45:17.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:43:0) after 7m11s
[18:52:28.174] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:43:0)
[18:52:28.191] Build status: STARTED
[18:52:28.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:44:0) after 2m55s
[18:55:23.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:44:0)
[18:55:23.240] Build status: STARTED
[18:55:23.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:45:0) after 1m49s
[18:57:12.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:45:0)
[18:57:12.274] Build status: STARTED
[18:57:12.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:46:0) after 3m17s
[19:00:29.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:46:0)
[19:00:29.349] Build status: STARTED
[19:00:29.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:47:0) after 9m46s
[19:10:15.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:47:0)
[19:10:15.552] Build status: STARTED
[19:10:15.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:48:0) after 1m1s
[19:11:16.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:48:0)
[19:11:16.646] Build status: STARTED
[19:11:16.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:49:0) after 7m10s
[19:18:27.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:49:0)
[19:18:27.031] Build status: STARTED
[19:18:27.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:50:0) after 9m50s
[19:28:17.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:50:0)
[19:28:17.083] Build status: STARTED
[19:28:17.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:51:0) after 3m18s
[19:31:35.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:51:0)
[19:31:35.126] Build status: STARTED
[19:31:35.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8853046051759820096:52:0) after 7m37s
[19:32:55.181] Received PubSub notification, asking Buildbucket for the build status
[19:32:55.197] Build:
{
"id": "8687615989881799665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 2054,
"createdBy": "project:chromium",
"createTime": "2026-03-11T14:53:01.857511570Z",
"startTime": "2026-03-11T14:53:05.450546641Z",
"endTime": "2026-03-11T19:32:54.380968005Z",
"updateTime": "2026-03-11T19:32:54.380968005Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38d6ef2be1d566290c2476e8a061cb3da0017bd5",
"ref": "refs/heads/main"
}
}
}
[19:32:55.197] Invocation finished in 4h39m54.514950569s with status FAILED