[22:59:50.869] New invocation is queued and will start shortly
[22:59:52.702] Starting the invocation (attempt 1)
[22:59:52.733] Ignoring gitiles_ref tag without the buildset tag
[22:59:52.733] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:59:52.733] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:59:52.734] Buildbucket request:
{
"requestId": "8850569304579341968",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850569304579341968"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:59:53.346] Scheduled build:
{
"id": "8685139241894872017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 648,
"createdBy": "project:chromium",
"createTime": "2026-04-07T22:59:52.800798545Z",
"updateTime": "2026-04-07T22:59:52.800798545Z",
"status": "SCHEDULED",
"input": {
}
}
[22:59:53.346] Task URL: https://cr-buildbucket.appspot.com/build/8685139241894872017
[22:59:53.346] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:2:0) after 4m40s
[22:59:58.777] Received PubSub notification, asking Buildbucket for the build status
[22:59:58.800] Build status: STARTED
[23:00:04.489] Received PubSub notification, asking Buildbucket for the build status
[23:00:04.508] Build status: STARTED
[23:04:33.603] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:2:0)
[23:04:33.637] Build status: STARTED
[23:04:33.637] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:5:0) after 5m59s
[23:10:32.699] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:5:0)
[23:10:32.726] Build status: STARTED
[23:10:32.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:6:0) after 4m44s
[23:15:16.830] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:6:0)
[23:15:16.850] Build status: STARTED
[23:15:16.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:7:0) after 3m22s
[23:18:38.915] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:7:0)
[23:18:38.941] Build status: STARTED
[23:18:38.941] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:8:0) after 4m12s
[23:22:51.131] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:8:0)
[23:22:51.161] Build status: STARTED
[23:22:51.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:9:0) after 8m46s
[23:31:37.211] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:9:0)
[23:31:37.242] Build status: STARTED
[23:31:37.242] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:10:0) after 8m27s
[23:40:04.432] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:10:0)
[23:40:04.453] Build status: STARTED
[23:40:04.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:11:0) after 7m25s
[23:47:29.522] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:11:0)
[23:47:29.553] Build status: STARTED
[23:47:29.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:12:0) after 1m0s
[23:48:29.609] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:12:0)
[23:48:29.625] Build status: STARTED
[23:48:29.625] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:13:0) after 6m22s
[23:54:51.718] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:13:0)
[23:54:51.739] Build status: STARTED
[23:54:51.739] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:14:0) after 8m38s
[00:03:29.803] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:14:0)
[00:03:29.821] Build status: STARTED
[00:03:29.821] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:15:0) after 3m21s
[00:06:50.849] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:15:0)
[00:06:50.874] Build status: STARTED
[00:06:50.874] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:16:0) after 7m33s
[00:14:23.880] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:16:0)
[00:14:23.915] Build status: STARTED
[00:14:23.915] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:17:0) after 5m31s
[00:19:55.036] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:17:0)
[00:19:55.071] Build status: STARTED
[00:19:55.071] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:18:0) after 1m36s
[00:21:31.102] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:18:0)
[00:21:31.146] Build status: STARTED
[00:21:31.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:19:0) after 5m38s
[00:27:09.320] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:19:0)
[00:27:09.352] Build status: STARTED
[00:27:09.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:20:0) after 9m37s
[00:36:46.367] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:20:0)
[00:36:46.386] Build status: STARTED
[00:36:46.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:21:0) after 5m15s
[00:42:01.508] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:21:0)
[00:42:01.535] Build status: STARTED
[00:42:01.535] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:22:0) after 5m24s
[00:47:25.530] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:22:0)
[00:47:25.545] Build status: STARTED
[00:47:25.545] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:23:0) after 5m0s
[00:52:25.754] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:23:0)
[00:52:25.775] Build status: STARTED
[00:52:25.775] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:24:0) after 3m27s
[00:55:52.819] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:24:0)
[00:55:52.847] Build status: STARTED
[00:55:52.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:25:0) after 8m0s
[01:03:52.931] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:25:0)
[01:03:52.948] Build status: STARTED
[01:03:52.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:26:0) after 5m5s
[01:08:57.990] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:26:0)
[01:08:58.024] Build status: STARTED
[01:08:58.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:27:0) after 4m33s
[01:13:31.087] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:27:0)
[01:13:31.107] Build status: STARTED
[01:13:31.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:28:0) after 9m33s
[01:23:04.145] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:28:0)
[01:23:04.163] Build status: STARTED
[01:23:04.163] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:29:0) after 3m28s
[01:26:32.140] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:29:0)
[01:26:32.159] Build status: STARTED
[01:26:32.159] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:30:0) after 3m49s
[01:30:21.449] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:30:0)
[01:30:21.514] Build status: STARTED
[01:30:21.514] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:31:0) after 8m8s
[01:38:29.533] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:31:0)
[01:38:29.551] Build status: STARTED
[01:38:29.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:32:0) after 7m13s
[01:45:42.883] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:32:0)
[01:45:42.899] Build status: STARTED
[01:45:42.899] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:33:0) after 9m34s
[01:55:16.980] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:33:0)
[01:55:17.039] Build status: STARTED
[01:55:17.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:34:0) after 8m11s
[02:03:28.060] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:34:0)
[02:03:28.086] Build status: STARTED
[02:03:28.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:35:0) after 4m30s
[02:07:58.117] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:35:0)
[02:07:58.136] Build status: STARTED
[02:07:58.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:36:0) after 2m47s
[02:10:45.536] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:36:0)
[02:10:45.562] Build status: STARTED
[02:10:45.562] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:37:0) after 4m33s
[02:15:18.624] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:37:0)
[02:15:18.641] Build status: STARTED
[02:15:18.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:38:0) after 2m11s
[02:17:29.695] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:38:0)
[02:17:29.712] Build status: STARTED
[02:17:29.712] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:39:0) after 3m51s
[02:21:20.782] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:39:0)
[02:21:20.798] Build status: STARTED
[02:21:20.798] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:40:0) after 5m50s
[02:27:10.888] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:40:0)
[02:27:11.039] Build status: STARTED
[02:27:11.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:41:0) after 8m38s
[02:35:49.024] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:41:0)
[02:35:49.043] Build status: STARTED
[02:35:49.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:42:0) after 1m28s
[02:37:17.317] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:42:0)
[02:37:17.387] Build status: STARTED
[02:37:17.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:43:0) after 5m16s
[02:42:33.645] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:43:0)
[02:42:33.678] Build status: STARTED
[02:42:33.678] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:44:0) after 5m29s
[02:48:02.829] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:44:0)
[02:48:02.845] Build status: STARTED
[02:48:02.845] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:45:0) after 4m40s
[02:52:42.861] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:45:0)
[02:52:42.881] Build status: STARTED
[02:52:42.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:46:0) after 1m4s
[02:53:47.097] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:46:0)
[02:53:47.116] Build status: STARTED
[02:53:47.116] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:47:0) after 6m27s
[03:00:14.232] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:47:0)
[03:00:14.329] Build status: STARTED
[03:00:14.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:48:0) after 6m10s
[03:06:24.320] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:48:0)
[03:06:24.393] Build status: STARTED
[03:06:24.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:49:0) after 3m50s
[03:10:14.548] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:49:0)
[03:10:14.565] Build status: STARTED
[03:10:14.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:50:0) after 7m53s
[03:18:07.578] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:50:0)
[03:18:07.599] Build status: STARTED
[03:18:07.599] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:51:0) after 8m5s
[03:26:12.670] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:51:0)
[03:26:12.688] Build status: STARTED
[03:26:12.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:52:0) after 6m17s
[03:32:29.717] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:52:0)
[03:32:29.735] Build status: STARTED
[03:32:29.735] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:53:0) after 9m42s
[03:42:11.804] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:53:0)
[03:42:11.825] Build status: STARTED
[03:42:11.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:54:0) after 7m19s
[03:49:30.840] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:54:0)
[03:49:30.860] Build status: STARTED
[03:49:30.860] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:55:0) after 4m12s
[03:53:42.922] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:55:0)
[03:53:42.943] Build status: STARTED
[03:53:42.943] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:56:0) after 2m12s
[03:55:55.104] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:56:0)
[03:55:55.122] Build status: STARTED
[03:55:55.122] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:57:0) after 3m5s
[03:59:00.088] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:57:0)
[03:59:00.109] Build status: STARTED
[03:59:00.109] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:58:0) after 1m43s
[04:00:43.105] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:58:0)
[04:00:43.131] Build status: STARTED
[04:00:43.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:59:0) after 4m45s
[04:05:28.220] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:59:0)
[04:05:28.249] Build status: STARTED
[04:05:28.250] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:60:0) after 5m48s
[04:11:16.267] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:60:0)
[04:11:16.318] Build status: STARTED
[04:11:16.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:61:0) after 5m12s
[04:16:28.337] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:61:0)
[04:16:28.356] Build status: STARTED
[04:16:28.356] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:62:0) after 4m39s
[04:21:07.370] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:62:0)
[04:21:07.443] Build status: STARTED
[04:21:07.443] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8850569304579341968:63:0) after 8m18s
[04:25:25.858] Received PubSub notification, asking Buildbucket for the build status
[04:25:25.878] Build:
{
"id": "8685139241894872017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 648,
"createdBy": "project:chromium",
"createTime": "2026-04-07T22:59:52.800798545Z",
"startTime": "2026-04-07T22:59:58.476651506Z",
"endTime": "2026-04-08T04:25:25.417474487Z",
"updateTime": "2026-04-08T04:25:25.417474487Z",
"status": "FAILURE",
"input": {
}
}
[04:25:25.879] Invocation finished in 5h25m35.021312981s with status FAILED