[11:55:36.896] New invocation is queued and will start shortly
[11:55:41.404] Starting the invocation (attempt 1)
[11:55:41.432] Ignoring gitiles_ref tag without the buildset tag
[11:55:41.432] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:55:41.432] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:55:41.432] Buildbucket request:
{
"requestId": "8852876018661591392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852876018661591392"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:55:41.914] Scheduled build:
{
"id": "8687445953185433105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 627,
"createdBy": "project:chromium",
"createTime": "2026-03-13T11:55:41.487615531Z",
"updateTime": "2026-03-13T11:55:41.487615531Z",
"status": "SCHEDULED",
"input": {
}
}
[11:55:41.914] Task URL: https://cr-buildbucket.appspot.com/build/8687445953185433105
[11:55:41.914] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:2:0) after 3m31s
[11:55:43.521] Received PubSub notification, asking Buildbucket for the build status
[11:55:43.650] Build status: SCHEDULED
[11:55:51.031] Received PubSub notification, asking Buildbucket for the build status
[11:55:51.051] Build status: STARTED
[11:59:12.977] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:2:0)
[11:59:12.992] Build status: STARTED
[11:59:12.992] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:5:0) after 3m35s
[12:02:47.984] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:5:0)
[12:02:48.014] Build status: STARTED
[12:02:48.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:6:0) after 5m46s
[12:08:34.027] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:6:0)
[12:08:34.045] Build status: STARTED
[12:08:34.045] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:7:0) after 1m43s
[12:10:17.106] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:7:0)
[12:10:17.125] Build status: STARTED
[12:10:17.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:8:0) after 9m0s
[12:19:17.189] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:8:0)
[12:19:17.207] Build status: STARTED
[12:19:17.207] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:9:0) after 6m2s
[12:25:19.224] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:9:0)
[12:25:19.257] Build status: STARTED
[12:25:19.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:10:0) after 1m34s
[12:26:53.272] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:10:0)
[12:26:53.289] Build status: STARTED
[12:26:53.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:11:0) after 7m8s
[12:34:01.384] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:11:0)
[12:34:01.411] Build status: STARTED
[12:34:01.411] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:12:0) after 8m40s
[12:42:41.476] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:12:0)
[12:42:41.503] Build status: STARTED
[12:42:41.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:13:0) after 6m2s
[12:48:43.519] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:13:0)
[12:48:43.536] Build status: STARTED
[12:48:43.536] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:14:0) after 5m27s
[12:54:10.599] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:14:0)
[12:54:10.621] Build status: STARTED
[12:54:10.621] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:15:0) after 2m5s
[12:56:15.623] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:15:0)
[12:56:15.642] Build status: STARTED
[12:56:15.642] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:16:0) after 9m53s
[13:06:08.921] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:16:0)
[13:06:09.025] Build status: STARTED
[13:06:09.025] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:17:0) after 9m40s
[13:15:49.039] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:17:0)
[13:15:49.060] Build status: STARTED
[13:15:49.060] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:18:0) after 1m14s
[13:17:03.103] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:18:0)
[13:17:03.135] Build status: STARTED
[13:17:03.135] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:19:0) after 4m27s
[13:21:30.167] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:19:0)
[13:21:30.200] Build status: STARTED
[13:21:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:20:0) after 8m20s
[13:29:50.236] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:20:0)
[13:29:50.285] Build status: STARTED
[13:29:50.286] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:21:0) after 2m2s
[13:31:52.299] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:21:0)
[13:31:52.383] Build status: STARTED
[13:31:52.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:22:0) after 6m53s
[13:38:45.396] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:22:0)
[13:38:45.426] Build status: STARTED
[13:38:45.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:23:0) after 4m34s
[13:43:19.445] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:23:0)
[13:43:20.491] Build status: STARTED
[13:43:20.491] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:24:0) after 9m29s
[13:52:49.556] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:24:0)
[13:52:49.576] Build status: STARTED
[13:52:49.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:25:0) after 7m58s
[14:00:47.655] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:25:0)
[14:00:47.682] Build status: STARTED
[14:00:47.682] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:26:0) after 4m20s
[14:05:07.739] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:26:0)
[14:05:07.760] Build status: STARTED
[14:05:07.760] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:27:0) after 5m32s
[14:10:39.775] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:27:0)
[14:10:39.794] Build status: STARTED
[14:10:39.794] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:28:0) after 7m12s
[14:17:51.801] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:28:0)
[14:17:51.818] Build status: STARTED
[14:17:51.818] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:29:0) after 2m57s
[14:20:48.829] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:29:0)
[14:20:48.851] Build status: STARTED
[14:20:48.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:30:0) after 4m23s
[14:25:11.907] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:30:0)
[14:25:11.991] Build status: STARTED
[14:25:11.991] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:31:0) after 7m41s
[14:32:53.057] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:31:0)
[14:32:53.074] Build status: STARTED
[14:32:53.074] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:32:0) after 6m11s
[14:39:04.061] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:32:0)
[14:39:04.082] Build status: STARTED
[14:39:04.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:33:0) after 1m39s
[14:40:43.144] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:33:0)
[14:40:43.159] Build status: STARTED
[14:40:43.159] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:34:0) after 4m54s
[14:45:37.177] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:34:0)
[14:45:37.196] Build status: STARTED
[14:45:37.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:35:0) after 7m50s
[14:53:27.254] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:35:0)
[14:53:27.280] Build status: STARTED
[14:53:27.280] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:36:0) after 4m27s
[14:57:54.301] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:36:0)
[14:57:54.316] Build status: STARTED
[14:57:54.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:37:0) after 1m22s
[14:59:16.380] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:37:0)
[14:59:16.397] Build status: STARTED
[14:59:16.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:38:0) after 1m27s
[15:00:43.523] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:38:0)
[15:00:43.550] Build status: STARTED
[15:00:43.550] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:39:0) after 1m49s
[15:02:32.567] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:39:0)
[15:02:32.583] Build status: STARTED
[15:02:32.583] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:40:0) after 3m50s
[15:06:22.737] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:40:0)
[15:06:22.785] Build status: STARTED
[15:06:22.786] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:41:0) after 3m32s
[15:09:54.901] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:41:0)
[15:09:54.916] Build status: STARTED
[15:09:54.916] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:42:0) after 3m41s
[15:13:35.934] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:42:0)
[15:13:35.957] Build status: STARTED
[15:13:35.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:43:0) after 3m18s
[15:16:53.961] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:43:0)
[15:16:53.983] Build status: STARTED
[15:16:53.983] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:44:0) after 7m13s
[15:24:07.045] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:44:0)
[15:24:07.062] Build status: STARTED
[15:24:07.062] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:45:0) after 1m52s
[15:25:59.074] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:45:0)
[15:25:59.088] Build status: STARTED
[15:25:59.088] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:46:0) after 6m59s
[15:32:58.097] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:46:0)
[15:32:58.151] Build status: STARTED
[15:32:58.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:47:0) after 5m4s
[15:38:02.204] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:47:0)
[15:38:02.220] Build status: STARTED
[15:38:02.220] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:48:0) after 5m40s
[15:43:42.237] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:48:0)
[15:43:42.257] Build status: STARTED
[15:43:42.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:49:0) after 4m30s
[15:48:12.339] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:49:0)
[15:48:12.355] Build status: STARTED
[15:48:12.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:50:0) after 6m20s
[15:54:32.371] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:50:0)
[15:54:32.390] Build status: STARTED
[15:54:32.390] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:51:0) after 9m0s
[16:03:32.411] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:51:0)
[16:03:32.431] Build status: STARTED
[16:03:32.431] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:52:0) after 1m41s
[16:05:13.447] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:52:0)
[16:05:13.476] Build status: STARTED
[16:05:13.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:53:0) after 2m3s
[16:07:16.511] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:53:0)
[16:07:16.528] Build status: STARTED
[16:07:16.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:54:0) after 4m32s
[16:11:48.656] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:54:0)
[16:11:48.790] Build status: STARTED
[16:11:48.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:55:0) after 8m28s
[16:20:16.810] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:55:0)
[16:20:16.830] Build status: STARTED
[16:20:16.830] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:56:0) after 4m41s
[16:24:57.845] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:56:0)
[16:24:57.862] Build status: STARTED
[16:24:57.862] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:57:0) after 2m7s
[16:27:04.880] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:57:0)
[16:27:04.970] Build status: STARTED
[16:27:04.970] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:58:0) after 7m45s
[16:34:50.095] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:58:0)
[16:34:50.118] Build status: STARTED
[16:34:50.118] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:59:0) after 7m12s
[16:42:02.169] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:59:0)
[16:42:02.202] Build status: STARTED
[16:42:02.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:60:0) after 3m17s
[16:45:19.325] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:60:0)
[16:45:19.404] Build status: STARTED
[16:45:19.404] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852876018661591392:61:0) after 9m23s
[16:51:47.389] Received PubSub notification, asking Buildbucket for the build status
[16:51:47.454] Build:
{
"id": "8687445953185433105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 627,
"createdBy": "project:chromium",
"createTime": "2026-03-13T11:55:41.487615531Z",
"startTime": "2026-03-13T11:55:50.846608534Z",
"endTime": "2026-03-13T16:51:47.037229254Z",
"updateTime": "2026-03-13T16:51:47.037229254Z",
"status": "FAILURE",
"input": {
}
}
[16:51:47.454] Invocation finished in 4h56m10.572757326s with status FAILED