[06:49:52.586] New invocation is queued and will start shortly
[06:49:53.696] Starting the invocation (attempt 1)
[06:49:53.730] Ignoring gitiles_ref tag without the buildset tag
[06:49:53.730] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:49:53.730] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:49:53.730] Buildbucket request:
{
"requestId": "8852985851028256320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852985851028256320"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:49:54.197] Scheduled build:
{
"id": "8687555789103492929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 626,
"createdBy": "project:chromium",
"createTime": "2026-03-12T06:49:53.793875991Z",
"updateTime": "2026-03-12T06:49:53.793875991Z",
"status": "SCHEDULED",
"input": {
},
"canary": true
}
[06:49:54.197] Task URL: https://cr-buildbucket.appspot.com/build/8687555789103492929
[06:49:54.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:2:0) after 5m24s
[06:49:55.123] Received PubSub notification, asking Buildbucket for the build status
[06:49:55.147] Build status: SCHEDULED
[06:49:59.262] Received PubSub notification, asking Buildbucket for the build status
[06:49:59.281] Build status: STARTED
[06:55:18.275] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:2:0)
[06:55:18.353] Build status: STARTED
[06:55:18.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:5:0) after 5m31s
[07:00:49.366] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:5:0)
[07:00:49.385] Build status: STARTED
[07:00:49.385] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:6:0) after 3m40s
[07:04:29.396] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:6:0)
[07:04:29.504] Build status: STARTED
[07:04:29.504] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:7:0) after 8m51s
[07:13:20.485] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:7:0)
[07:13:20.505] Build status: STARTED
[07:13:20.505] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:8:0) after 1m18s
[07:14:38.515] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:8:0)
[07:14:38.542] Build status: STARTED
[07:14:38.542] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:9:0) after 6m28s
[07:21:06.559] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:9:0)
[07:21:06.588] Build status: STARTED
[07:21:06.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:10:0) after 5m12s
[07:26:18.601] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:10:0)
[07:26:18.619] Build status: STARTED
[07:26:18.619] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:11:0) after 4m54s
[07:31:12.608] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:11:0)
[07:31:12.622] Build status: STARTED
[07:31:12.622] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:12:0) after 9m25s
[07:40:37.636] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:12:0)
[07:40:37.654] Build status: STARTED
[07:40:37.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:13:0) after 1m47s
[07:42:24.768] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:13:0)
[07:42:24.783] Build status: STARTED
[07:42:24.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:14:0) after 4m12s
[07:46:36.821] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:14:0)
[07:46:36.851] Build status: STARTED
[07:46:36.852] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:15:0) after 4m3s
[07:50:39.909] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:15:0)
[07:50:39.935] Build status: STARTED
[07:50:39.935] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:16:0) after 6m31s
[07:57:10.991] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:16:0)
[07:57:11.011] Build status: STARTED
[07:57:11.011] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:17:0) after 4m48s
[08:01:59.110] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:17:0)
[08:01:59.129] Build status: STARTED
[08:01:59.129] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:18:0) after 9m29s
[08:11:28.141] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:18:0)
[08:11:28.166] Build status: STARTED
[08:11:28.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:19:0) after 6m47s
[08:18:15.193] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:19:0)
[08:18:15.214] Build status: STARTED
[08:18:15.214] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:20:0) after 2m4s
[08:20:19.280] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:20:0)
[08:20:19.302] Build status: STARTED
[08:20:19.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:21:0) after 7m42s
[08:28:01.395] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:21:0)
[08:28:01.414] Build status: STARTED
[08:28:01.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:22:0) after 3m6s
[08:31:07.453] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:22:0)
[08:31:07.473] Build status: STARTED
[08:31:07.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:23:0) after 8m3s
[08:39:10.544] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:23:0)
[08:39:10.630] Build status: STARTED
[08:39:10.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:24:0) after 7m26s
[08:46:36.700] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:24:0)
[08:46:37.704] Build status: STARTED
[08:46:37.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:25:0) after 9m57s
[08:56:34.718] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:25:0)
[08:56:34.734] Build status: STARTED
[08:56:34.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:26:0) after 8m55s
[09:05:29.801] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:26:0)
[09:05:29.820] Build status: STARTED
[09:05:29.820] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:27:0) after 4m34s
[09:10:03.835] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:27:0)
[09:10:03.919] Build status: STARTED
[09:10:03.919] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:28:0) after 6m23s
[09:16:26.966] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:28:0)
[09:16:27.003] Build status: STARTED
[09:16:27.004] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:29:0) after 2m29s
[09:18:56.018] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:29:0)
[09:18:56.039] Build status: STARTED
[09:18:56.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:30:0) after 3m37s
[09:22:33.061] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:30:0)
[09:22:33.092] Build status: STARTED
[09:22:33.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:31:0) after 2m59s
[09:25:32.108] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:31:0)
[09:25:32.124] Build status: STARTED
[09:25:32.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:32:0) after 7m3s
[09:32:35.168] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:32:0)
[09:32:35.189] Build status: STARTED
[09:32:35.189] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:33:0) after 5m18s
[09:37:53.296] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:33:0)
[09:37:53.342] Build status: STARTED
[09:37:53.342] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:34:0) after 5m27s
[09:43:20.367] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:34:0)
[09:43:20.389] Build status: STARTED
[09:43:20.389] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:35:0) after 4m38s
[09:47:58.501] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:35:0)
[09:47:58.532] Build status: STARTED
[09:47:58.532] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:36:0) after 2m25s
[09:50:23.622] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:36:0)
[09:50:23.639] Build status: STARTED
[09:50:23.639] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:37:0) after 5m14s
[09:55:37.686] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:37:0)
[09:55:37.705] Build status: STARTED
[09:55:37.705] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:38:0) after 5m55s
[10:01:32.720] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:38:0)
[10:01:32.741] Build status: STARTED
[10:01:32.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:39:0) after 6m28s
[10:08:00.742] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:39:0)
[10:08:00.758] Build status: STARTED
[10:08:00.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:40:0) after 8m56s
[10:16:56.821] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:40:0)
[10:16:56.839] Build status: STARTED
[10:16:56.839] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:41:0) after 9m26s
[10:26:23.000] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:41:0)
[10:26:23.024] Build status: STARTED
[10:26:23.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:42:0) after 8m56s
[10:35:19.146] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:42:0)
[10:35:19.167] Build status: STARTED
[10:35:19.167] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:43:0) after 1m30s
[10:36:49.135] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:43:0)
[10:36:49.162] Build status: STARTED
[10:36:49.163] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:44:0) after 9m8s
[10:45:57.247] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:44:0)
[10:45:57.261] Build status: STARTED
[10:45:57.261] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:45:0) after 9m44s
[10:55:41.405] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:45:0)
[10:55:41.423] Build status: STARTED
[10:55:41.423] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:46:0) after 8m59s
[11:04:40.437] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:46:0)
[11:04:40.500] Build status: STARTED
[11:04:40.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:47:0) after 2m58s
[11:07:38.558] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:47:0)
[11:07:38.603] Build status: STARTED
[11:07:38.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:48:0) after 7m10s
[11:14:48.667] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:48:0)
[11:14:48.728] Build status: STARTED
[11:14:48.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:49:0) after 4m55s
[11:19:43.812] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:49:0)
[11:19:43.828] Build status: STARTED
[11:19:43.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:50:0) after 4m9s
[11:23:52.846] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:50:0)
[11:23:52.867] Build status: STARTED
[11:23:52.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:51:0) after 7m18s
[11:31:10.893] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:51:0)
[11:31:10.918] Build status: STARTED
[11:31:10.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:52:0) after 2m59s
[11:34:09.943] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:52:0)
[11:34:09.965] Build status: STARTED
[11:34:09.965] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:53:0) after 5m32s
[11:39:41.968] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:53:0)
[11:39:41.981] Build status: STARTED
[11:39:41.981] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:54:0) after 6m19s
[11:46:00.998] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:54:0)
[11:46:01.019] Build status: STARTED
[11:46:01.019] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:55:0) after 1m8s
[11:47:09.084] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:55:0)
[11:47:09.103] Build status: STARTED
[11:47:09.103] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:56:0) after 5m54s
[11:53:03.125] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:56:0)
[11:53:03.144] Build status: STARTED
[11:53:03.145] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852985851028256320:57:0) after 4m24s
[11:55:28.111] Received PubSub notification, asking Buildbucket for the build status
[11:55:28.130] Build:
{
"id": "8687555789103492929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 626,
"createdBy": "project:chromium",
"createTime": "2026-03-12T06:49:53.793875991Z",
"startTime": "2026-03-12T06:49:59.124239924Z",
"endTime": "2026-03-12T11:55:27.771548601Z",
"updateTime": "2026-03-12T11:55:27.771548601Z",
"status": "FAILURE",
"input": {
},
"canary": true
}
[11:55:28.130] Invocation finished in 5h5m35.556106252s with status FAILED