[00:13:39.242] New invocation is queued and will start shortly
[00:13:40.337] Starting the invocation (attempt 1)
[00:13:40.363] Ignoring gitiles_ref tag without the buildset tag
[00:13:40.363] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:13:40.363] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:13:40.363] Buildbucket request:
{
"requestId": "8853191973111267616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853191973111267616"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:13:40.862] Scheduled build:
{
"id": "8687761911204762001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 624,
"createdBy": "project:chromium",
"createTime": "2026-03-10T00:13:40.439991632Z",
"updateTime": "2026-03-10T00:13:40.439991632Z",
"status": "SCHEDULED",
"input": {
}
}
[00:13:40.862] Task URL: https://cr-buildbucket.appspot.com/build/8687761911204762001
[00:13:40.862] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:2:0) after 6m31s
[00:13:41.400] Received PubSub notification, asking Buildbucket for the build status
[00:13:41.420] Build status: SCHEDULED
[00:13:53.438] Received PubSub notification, asking Buildbucket for the build status
[00:13:53.465] Build status: STARTED
[00:20:11.875] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:2:0)
[00:20:11.892] Build status: STARTED
[00:20:11.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:5:0) after 9m48s
[00:29:59.949] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:5:0)
[00:29:59.967] Build status: STARTED
[00:29:59.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:6:0) after 2m34s
[00:32:33.983] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:6:0)
[00:32:34.009] Build status: STARTED
[00:32:34.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:7:0) after 5m4s
[00:37:38.095] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:7:0)
[00:37:38.111] Build status: STARTED
[00:37:38.111] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:8:0) after 8m34s
[00:46:12.242] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:8:0)
[00:46:12.263] Build status: STARTED
[00:46:12.263] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:9:0) after 1m42s
[00:47:54.284] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:9:0)
[00:47:54.307] Build status: STARTED
[00:47:54.307] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:10:0) after 3m22s
[00:51:16.370] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:10:0)
[00:51:16.388] Build status: STARTED
[00:51:16.388] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:11:0) after 5m4s
[00:56:20.463] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:11:0)
[00:56:20.493] Build status: STARTED
[00:56:20.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:12:0) after 8m59s
[01:05:19.560] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:12:0)
[01:05:19.577] Build status: STARTED
[01:05:19.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:13:0) after 1m25s
[01:06:44.638] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:13:0)
[01:06:44.658] Build status: STARTED
[01:06:44.658] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:14:0) after 6m43s
[01:13:27.816] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:14:0)
[01:13:27.843] Build status: STARTED
[01:13:27.843] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:15:0) after 7m32s
[01:20:59.903] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:15:0)
[01:20:59.922] Build status: STARTED
[01:20:59.922] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:16:0) after 1m53s
[01:22:52.937] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:16:0)
[01:22:52.967] Build status: STARTED
[01:22:52.967] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:17:0) after 2m11s
[01:25:03.982] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:17:0)
[01:25:04.008] Build status: STARTED
[01:25:04.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:18:0) after 6m27s
[01:31:31.026] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:18:0)
[01:31:31.043] Build status: STARTED
[01:31:31.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:19:0) after 7m1s
[01:38:32.024] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:19:0)
[01:38:32.067] Build status: STARTED
[01:38:32.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:20:0) after 3m38s
[01:42:10.123] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:20:0)
[01:42:10.145] Build status: STARTED
[01:42:10.145] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:21:0) after 4m11s
[01:46:21.242] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:21:0)
[01:46:21.264] Build status: STARTED
[01:46:21.264] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:22:0) after 1m36s
[01:47:57.373] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:22:0)
[01:47:57.391] Build status: STARTED
[01:47:57.391] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:23:0) after 9m18s
[01:57:15.446] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:23:0)
[01:57:15.463] Build status: STARTED
[01:57:15.463] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:24:0) after 7m28s
[02:04:43.475] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:24:0)
[02:04:43.516] Build status: STARTED
[02:04:43.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:25:0) after 2m16s
[02:06:59.531] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:25:0)
[02:06:59.546] Build status: STARTED
[02:06:59.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:26:0) after 8m51s
[02:15:50.563] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:26:0)
[02:15:50.581] Build status: STARTED
[02:15:50.581] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:27:0) after 2m39s
[02:18:29.643] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:27:0)
[02:18:29.662] Build status: STARTED
[02:18:29.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:28:0) after 2m46s
[02:21:15.692] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:28:0)
[02:21:15.706] Build status: STARTED
[02:21:15.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:29:0) after 5m21s
[02:26:36.719] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:29:0)
[02:26:36.734] Build status: STARTED
[02:26:36.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:30:0) after 2m18s
[02:28:54.749] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:30:0)
[02:28:54.778] Build status: STARTED
[02:28:54.778] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:31:0) after 1m1s
[02:29:55.794] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:31:0)
[02:29:55.817] Build status: STARTED
[02:29:55.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:32:0) after 4m30s
[02:34:25.835] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:32:0)
[02:34:25.869] Build status: STARTED
[02:34:25.869] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:33:0) after 1m49s
[02:36:14.984] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:33:0)
[02:36:15.003] Build status: STARTED
[02:36:15.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:34:0) after 1m21s
[02:37:36.019] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:34:0)
[02:37:36.036] Build status: STARTED
[02:37:36.036] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:35:0) after 4m11s
[02:41:47.102] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:35:0)
[02:41:47.160] Build status: STARTED
[02:41:47.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:36:0) after 5m15s
[02:47:02.169] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:36:0)
[02:47:02.194] Build status: STARTED
[02:47:02.194] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:37:0) after 6m33s
[02:53:35.212] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:37:0)
[02:53:35.244] Build status: STARTED
[02:53:35.244] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:38:0) after 9m56s
[03:03:31.257] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:38:0)
[03:03:31.273] Build status: STARTED
[03:03:31.273] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:39:0) after 2m20s
[03:05:51.285] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:39:0)
[03:05:51.318] Build status: STARTED
[03:05:51.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:40:0) after 4m53s
[03:10:44.388] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:40:0)
[03:10:44.458] Build status: STARTED
[03:10:44.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:41:0) after 8m11s
[03:18:55.472] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:41:0)
[03:18:55.490] Build status: STARTED
[03:18:55.490] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:42:0) after 3m44s
[03:22:39.552] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:42:0)
[03:22:39.569] Build status: STARTED
[03:22:39.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:43:0) after 8m5s
[03:30:44.583] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:43:0)
[03:30:44.659] Build status: STARTED
[03:30:44.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:44:0) after 6m2s
[03:36:46.643] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:44:0)
[03:36:46.662] Build status: STARTED
[03:36:46.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:45:0) after 3m48s
[03:40:34.723] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:45:0)
[03:40:34.741] Build status: STARTED
[03:40:34.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:46:0) after 9m45s
[03:50:19.790] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:46:0)
[03:50:19.807] Build status: STARTED
[03:50:19.807] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:47:0) after 3m43s
[03:54:02.818] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:47:0)
[03:54:02.834] Build status: STARTED
[03:54:02.834] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:48:0) after 4m27s
[03:58:29.858] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:48:0)
[03:58:29.888] Build status: STARTED
[03:58:29.888] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:49:0) after 7m19s
[04:05:49.007] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:49:0)
[04:05:49.027] Build status: STARTED
[04:05:49.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:50:0) after 5m14s
[04:11:02.993] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:50:0)
[04:11:03.009] Build status: STARTED
[04:11:03.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:51:0) after 9m16s
[04:20:19.046] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:51:0)
[04:20:19.071] Build status: STARTED
[04:20:19.071] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:52:0) after 3m31s
[04:23:50.175] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:52:0)
[04:23:50.196] Build status: STARTED
[04:23:50.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:53:0) after 7m5s
[04:30:55.213] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:53:0)
[04:30:55.231] Build status: STARTED
[04:30:55.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:54:0) after 2m5s
[04:33:00.379] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:54:0)
[04:33:00.398] Build status: STARTED
[04:33:00.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:55:0) after 9m22s
[04:42:22.425] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:55:0)
[04:42:22.521] Build status: STARTED
[04:42:22.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:56:0) after 8m37s
[04:50:59.537] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:56:0)
[04:50:59.630] Build status: STARTED
[04:50:59.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:57:0) after 2m45s
[04:53:44.645] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:57:0)
[04:53:44.659] Build status: STARTED
[04:53:44.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:58:0) after 3m56s
[04:57:40.726] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:58:0)
[04:57:40.747] Build status: STARTED
[04:57:40.747] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:59:0) after 2m17s
[04:59:57.808] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:59:0)
[04:59:57.826] Build status: STARTED
[04:59:57.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8853191973111267616:60:0) after 2m43s
[05:00:38.969] Received PubSub notification, asking Buildbucket for the build status
[05:00:38.992] Build:
{
"id": "8687761911204762001",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 624,
"createdBy": "project:chromium",
"createTime": "2026-03-10T00:13:40.439991632Z",
"startTime": "2026-03-10T00:13:51.953777148Z",
"endTime": "2026-03-10T05:00:30.157717480Z",
"updateTime": "2026-03-10T05:00:30.157717480Z",
"status": "FAILURE",
"input": {
}
}
[05:00:38.992] Invocation finished in 4h46m59.75494349s with status FAILED