[23:34:36.059] New invocation is queued and will start shortly
[23:34:37.159] Starting the invocation (attempt 1)
[23:34:37.215] Ignoring gitiles_ref tag without the buildset tag
[23:34:37.215] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:34:37.215] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:34:37.216] Buildbucket request:
{
"requestId": "8859445620798306160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8859445620798306160"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:34:37.671] Scheduled build:
{
"id": "8694015558876248609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 567,
"createdBy": "project:chromium",
"createTime": "2025-12-30T23:34:37.271920974Z",
"updateTime": "2025-12-30T23:34:37.271920974Z",
"status": "SCHEDULED",
"input": {
}
}
[23:34:37.671] Task URL: https://cr-buildbucket.appspot.com/build/8694015558876248609
[23:34:37.671] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:2:0) after 7m47s
[23:34:37.986] Received PubSub notification, asking Buildbucket for the build status
[23:34:38.002] Build status: SCHEDULED
[23:34:42.800] Received PubSub notification, asking Buildbucket for the build status
[23:34:42.838] Build status: STARTED
[23:42:24.664] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:2:0)
[23:42:24.698] Build status: STARTED
[23:42:24.698] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:5:0) after 3m58s
[23:46:22.708] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:5:0)
[23:46:22.797] Build status: STARTED
[23:46:22.797] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:6:0) after 1m22s
[23:47:44.814] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:6:0)
[23:47:44.832] Build status: STARTED
[23:47:44.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:7:0) after 1m44s
[23:49:28.845] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:7:0)
[23:49:28.860] Build status: STARTED
[23:49:28.860] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:8:0) after 7m8s
[23:56:37.001] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:8:0)
[23:56:37.019] Build status: STARTED
[23:56:37.019] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:9:0) after 1m32s
[23:58:09.714] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:9:0)
[23:58:09.728] Build status: STARTED
[23:58:09.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:10:0) after 3m4s
[00:01:14.334] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:10:0)
[00:01:14.411] Build status: STARTED
[00:01:14.411] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:11:0) after 2m33s
[00:03:47.424] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:11:0)
[00:03:47.439] Build status: STARTED
[00:03:47.439] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:12:0) after 1m23s
[00:05:10.435] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:12:0)
[00:05:10.448] Build status: STARTED
[00:05:10.448] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:13:0) after 4m8s
[00:09:18.465] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:13:0)
[00:09:18.487] Build status: STARTED
[00:09:18.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:14:0) after 6m48s
[00:16:06.541] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:14:0)
[00:16:06.562] Build status: STARTED
[00:16:06.562] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:15:0) after 5m14s
[00:21:20.819] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:15:0)
[00:21:20.845] Build status: STARTED
[00:21:20.845] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:16:0) after 4m14s
[00:25:35.149] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:16:0)
[00:25:35.174] Build status: STARTED
[00:25:35.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:17:0) after 2m42s
[00:28:17.313] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:17:0)
[00:28:17.340] Build status: STARTED
[00:28:17.340] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:18:0) after 2m26s
[00:30:43.771] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:18:0)
[00:30:43.790] Build status: STARTED
[00:30:43.791] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:19:0) after 1m2s
[00:31:45.974] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:19:0)
[00:31:45.991] Build status: STARTED
[00:31:45.991] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:20:0) after 3m37s
[00:35:23.060] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:20:0)
[00:35:23.093] Build status: STARTED
[00:35:23.093] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:21:0) after 9m28s
[00:44:51.109] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:21:0)
[00:44:51.146] Build status: STARTED
[00:44:51.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:22:0) after 9m0s
[00:53:51.345] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:22:0)
[00:53:51.362] Build status: STARTED
[00:53:51.362] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:23:0) after 7m23s
[01:01:14.427] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:23:0)
[01:01:14.449] Build status: STARTED
[01:01:14.449] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:24:0) after 3m56s
[01:05:10.539] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:24:0)
[01:05:10.559] Build status: STARTED
[01:05:10.559] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:25:0) after 6m55s
[01:12:05.569] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:25:0)
[01:12:05.587] Build status: STARTED
[01:12:05.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:26:0) after 5m50s
[01:17:55.648] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:26:0)
[01:17:55.662] Build status: STARTED
[01:17:55.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:27:0) after 4m45s
[01:22:40.862] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:27:0)
[01:22:40.877] Build status: STARTED
[01:22:40.877] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:28:0) after 3m16s
[01:25:56.891] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:28:0)
[01:25:56.912] Build status: STARTED
[01:25:56.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:29:0) after 6m13s
[01:32:09.929] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:29:0)
[01:32:09.945] Build status: STARTED
[01:32:09.945] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:30:0) after 3m34s
[01:35:44.059] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:30:0)
[01:35:44.075] Build status: STARTED
[01:35:44.075] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:31:0) after 5m46s
[01:41:30.138] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:31:0)
[01:41:30.162] Build status: STARTED
[01:41:30.162] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:32:0) after 9m27s
[01:50:57.934] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:32:0)
[01:50:57.957] Build status: STARTED
[01:50:57.957] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:33:0) after 7m12s
[01:58:10.022] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:33:0)
[01:58:10.056] Build status: STARTED
[01:58:10.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:34:0) after 1m30s
[01:59:40.068] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:34:0)
[01:59:40.136] Build status: STARTED
[01:59:40.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:35:0) after 9m39s
[02:09:19.151] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:35:0)
[02:09:19.166] Build status: STARTED
[02:09:19.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:36:0) after 3m52s
[02:13:11.207] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:36:0)
[02:13:11.228] Build status: STARTED
[02:13:11.228] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:37:0) after 9m24s
[02:22:35.238] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:37:0)
[02:22:35.304] Build status: STARTED
[02:22:35.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:38:0) after 2m21s
[02:24:56.291] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:38:0)
[02:24:56.306] Build status: STARTED
[02:24:56.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:39:0) after 7m27s
[02:32:23.445] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:39:0)
[02:32:23.463] Build status: STARTED
[02:32:23.463] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:40:0) after 1m18s
[02:33:41.768] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:40:0)
[02:33:41.801] Build status: STARTED
[02:33:41.801] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:41:0) after 9m47s
[02:43:28.993] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:41:0)
[02:43:29.017] Build status: STARTED
[02:43:29.017] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:42:0) after 7m1s
[02:50:30.096] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:42:0)
[02:50:30.114] Build status: STARTED
[02:50:30.114] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:43:0) after 1m33s
[02:52:03.645] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:43:0)
[02:52:03.662] Build status: STARTED
[02:52:03.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:44:0) after 8m42s
[03:00:46.061] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:44:0)
[03:00:46.075] Build status: STARTED
[03:00:46.075] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:45:0) after 1m53s
[03:02:39.087] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:45:0)
[03:02:39.102] Build status: STARTED
[03:02:39.102] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:46:0) after 9m7s
[03:11:46.313] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:46:0)
[03:11:46.342] Build status: STARTED
[03:11:46.342] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:47:0) after 2m47s
[03:14:33.419] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:47:0)
[03:14:33.472] Build status: STARTED
[03:14:33.472] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:48:0) after 8m14s
[03:22:47.516] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:48:0)
[03:22:47.530] Build status: STARTED
[03:22:47.530] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:49:0) after 7m50s
[03:30:37.548] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:49:0)
[03:30:37.679] Build status: STARTED
[03:30:37.679] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:50:0) after 6m31s
[03:37:09.049] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:50:0)
[03:37:09.061] Build status: STARTED
[03:37:09.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:51:0) after 6m8s
[03:43:17.272] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:51:0)
[03:43:17.282] Build status: STARTED
[03:43:17.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:52:0) after 6m13s
[03:49:30.399] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:52:0)
[03:49:30.415] Build status: STARTED
[03:49:30.415] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:53:0) after 4m18s
[03:53:48.385] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:53:0)
[03:53:48.403] Build status: STARTED
[03:53:48.403] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:54:0) after 1m53s
[03:55:41.511] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:54:0)
[03:55:41.550] Build status: STARTED
[03:55:41.550] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:55:0) after 4m29s
[04:00:10.582] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:55:0)
[04:00:10.606] Build status: STARTED
[04:00:10.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:56:0) after 6m14s
[04:06:25.009] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:56:0)
[04:06:25.029] Build status: STARTED
[04:06:25.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:57:0) after 5m15s
[04:11:40.460] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:57:0)
[04:11:40.481] Build status: STARTED
[04:11:40.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:58:0) after 2m4s
[04:13:45.103] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:58:0)
[04:13:45.121] Build status: STARTED
[04:13:45.121] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:59:0) after 3m8s
[04:16:53.134] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:59:0)
[04:16:53.155] Build status: STARTED
[04:16:53.155] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:60:0) after 3m51s
[04:20:44.174] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:60:0)
[04:20:44.189] Build status: STARTED
[04:20:44.189] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:61:0) after 3m2s
[04:23:46.435] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:61:0)
[04:23:46.448] Build status: STARTED
[04:23:46.448] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:62:0) after 4m48s
[04:28:34.470] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:62:0)
[04:28:34.482] Build status: STARTED
[04:28:34.482] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:63:0) after 1m38s
[04:30:12.496] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:63:0)
[04:30:12.508] Build status: STARTED
[04:30:12.509] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:64:0) after 9m40s
[04:39:52.843] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:64:0)
[04:39:53.120] Build status: STARTED
[04:39:53.120] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:65:0) after 1m38s
[04:41:31.309] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:65:0)
[04:41:31.328] Build status: STARTED
[04:41:31.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8859445620798306160:66:0) after 8m33s
[04:45:29.154] Received PubSub notification, asking Buildbucket for the build status
[04:45:29.171] Build:
{
"id": "8694015558876248609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 567,
"createdBy": "project:chromium",
"createTime": "2025-12-30T23:34:37.271920974Z",
"startTime": "2025-12-30T23:34:42.661888708Z",
"endTime": "2025-12-31T04:44:41.794796335Z",
"updateTime": "2025-12-31T04:44:41.794796335Z",
"status": "FAILURE",
"input": {
}
}
[04:45:29.171] Invocation finished in 5h10m53.11718278s with status FAILED