[10:19:26.213] New invocation is queued and will start shortly
[10:19:28.942] Starting the invocation (attempt 1)
[10:19:28.963] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/107721a594e60389ca2f310fd1d9e456af35be90"
[10:19:28.963] Popped gitiles commit info from properties and tags
[10:19:28.963] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:19:28.963] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:19:28.963] Buildbucket request:
{
"requestId": "8846902669868019808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "107721a594e60389ca2f310fd1d9e456af35be90",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846902669868019808"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:19:29.669] Scheduled build:
{
"id": "8681472606271431825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3131,
"createdBy": "project:chromium",
"createTime": "2026-05-18T10:19:29.022580753Z",
"updateTime": "2026-05-18T10:19:29.022580753Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "107721a594e60389ca2f310fd1d9e456af35be90",
"ref": "refs/heads/main"
}
}
}
[10:19:29.669] Task URL: https://cr-buildbucket.appspot.com/build/8681472606271431825
[10:19:29.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:2:0) after 8m1s
[10:19:30.507] Received PubSub notification, asking Buildbucket for the build status
[10:19:30.528] Build status: SCHEDULED
[10:19:32.925] Received PubSub notification, asking Buildbucket for the build status
[10:19:32.940] Build status: STARTED
[10:27:30.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:2:0)
[10:27:30.728] Build status: STARTED
[10:27:30.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:5:0) after 8m17s
[10:35:47.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:5:0)
[10:35:47.814] Build status: STARTED
[10:35:47.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:6:0) after 8m57s
[10:44:44.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:6:0)
[10:44:45.010] Build status: STARTED
[10:44:45.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:7:0) after 8m0s
[10:52:45.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:7:0)
[10:52:45.125] Build status: STARTED
[10:52:45.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:8:0) after 6m41s
[10:59:26.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:8:0)
[10:59:26.719] Build status: STARTED
[10:59:26.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:9:0) after 5m55s
[11:05:21.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:9:0)
[11:05:21.759] Build status: STARTED
[11:05:21.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:10:0) after 3m53s
[11:09:14.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:10:0)
[11:09:14.766] Build status: STARTED
[11:09:14.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:11:0) after 7m36s
[11:16:50.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:11:0)
[11:16:50.769] Build status: STARTED
[11:16:50.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:12:0) after 5m36s
[11:22:26.959] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:12:0)
[11:22:26.977] Build status: STARTED
[11:22:26.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:13:0) after 5m39s
[11:28:06.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:13:0)
[11:28:06.317] Build status: STARTED
[11:28:06.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:14:0) after 4m19s
[11:32:25.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:14:0)
[11:32:25.437] Build status: STARTED
[11:32:25.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:15:0) after 7m10s
[11:39:35.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:15:0)
[11:39:35.689] Build status: STARTED
[11:39:35.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:16:0) after 6m44s
[11:46:19.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:16:0)
[11:46:19.734] Build status: STARTED
[11:46:19.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:17:0) after 6m47s
[11:53:06.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:17:0)
[11:53:06.763] Build status: STARTED
[11:53:06.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:18:0) after 1m48s
[11:54:54.778] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:18:0)
[11:54:54.802] Build status: STARTED
[11:54:54.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:19:0) after 6m22s
[12:01:16.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:19:0)
[12:01:16.881] Build status: STARTED
[12:01:16.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:20:0) after 4m35s
[12:05:51.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:20:0)
[12:05:52.171] Build status: STARTED
[12:05:52.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:21:0) after 7m5s
[12:12:57.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:21:0)
[12:12:57.303] Build status: STARTED
[12:12:57.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:22:0) after 5m23s
[12:18:20.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:22:0)
[12:18:20.335] Build status: STARTED
[12:18:20.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:23:0) after 7m31s
[12:25:51.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:23:0)
[12:25:51.359] Build status: STARTED
[12:25:51.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:24:0) after 1m57s
[12:27:48.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:24:0)
[12:27:48.751] Build status: STARTED
[12:27:48.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:25:0) after 6m36s
[12:34:24.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:25:0)
[12:34:24.784] Build status: STARTED
[12:34:24.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:26:0) after 3m18s
[12:37:42.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:26:0)
[12:37:42.816] Build status: STARTED
[12:37:42.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:27:0) after 9m25s
[12:47:07.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:27:0)
[12:47:07.857] Build status: STARTED
[12:47:07.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:28:0) after 9m51s
[12:56:58.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:28:0)
[12:56:58.964] Build status: STARTED
[12:56:58.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:29:0) after 5m32s
[13:02:31.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:29:0)
[13:02:31.061] Build status: STARTED
[13:02:31.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:30:0) after 5m7s
[13:07:38.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:30:0)
[13:07:38.130] Build status: STARTED
[13:07:38.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:31:0) after 5m23s
[13:13:01.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:31:0)
[13:13:01.232] Build status: STARTED
[13:13:01.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:32:0) after 4m17s
[13:17:18.331] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:32:0)
[13:17:18.355] Build status: STARTED
[13:17:18.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:33:0) after 1m39s
[13:18:57.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:33:0)
[13:18:57.416] Build status: STARTED
[13:18:57.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:34:0) after 1m9s
[13:20:06.433] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:34:0)
[13:20:06.472] Build status: STARTED
[13:20:06.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:35:0) after 2m4s
[13:22:10.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:35:0)
[13:22:10.504] Build status: STARTED
[13:22:10.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:36:0) after 3m17s
[13:25:27.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:36:0)
[13:25:27.535] Build status: STARTED
[13:25:27.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:37:0) after 8m45s
[13:34:12.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:37:0)
[13:34:12.569] Build status: STARTED
[13:34:12.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:38:0) after 3m30s
[13:37:42.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:38:0)
[13:37:42.637] Build status: STARTED
[13:37:42.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:39:0) after 6m47s
[13:44:29.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:39:0)
[13:44:29.725] Build status: STARTED
[13:44:29.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:40:0) after 8m36s
[13:53:06.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:40:0)
[13:53:06.046] Build status: STARTED
[13:53:06.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:41:0) after 8m50s
[14:01:56.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:41:0)
[14:01:56.078] Build status: STARTED
[14:01:56.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:42:0) after 1m39s
[14:03:35.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:42:0)
[14:03:35.118] Build status: STARTED
[14:03:35.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:43:0) after 5m46s
[14:09:21.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:43:0)
[14:09:21.177] Build status: STARTED
[14:09:21.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:44:0) after 3m21s
[14:12:42.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:44:0)
[14:12:42.435] Build status: STARTED
[14:12:42.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:45:0) after 2m9s
[14:14:51.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:45:0)
[14:14:51.473] Build status: STARTED
[14:14:51.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:46:0) after 8m50s
[14:23:41.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:46:0)
[14:23:41.513] Build status: STARTED
[14:23:41.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:47:0) after 4m1s
[14:27:42.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:47:0)
[14:27:42.587] Build status: STARTED
[14:27:42.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:48:0) after 4m40s
[14:32:22.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:48:0)
[14:32:22.616] Build status: STARTED
[14:32:22.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:49:0) after 6m46s
[14:39:08.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:49:0)
[14:39:08.706] Build status: STARTED
[14:39:08.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:50:0) after 5m50s
[14:44:58.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:50:0)
[14:44:58.742] Build status: STARTED
[14:44:58.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64:8846902669868019808:51:0) after 2m33s
[14:45:37.491] Received PubSub notification, asking Buildbucket for the build status
[14:45:37.514] Build:
{
"id": "8681472606271431825",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64"
},
"number": 3131,
"createdBy": "project:chromium",
"createTime": "2026-05-18T10:19:29.022580753Z",
"startTime": "2026-05-18T10:19:32.739776083Z",
"endTime": "2026-05-18T14:45:31.815981780Z",
"updateTime": "2026-05-18T14:45:31.815981780Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "107721a594e60389ca2f310fd1d9e456af35be90",
"ref": "refs/heads/main"
}
}
}
[14:45:37.514] Invocation finished in 4h26m11.305603611s with status FAILED