[01:51:52.160] New invocation is queued and will start shortly
[01:51:53.268] Starting the invocation (attempt 1)
[01:51:53.294] Ignoring gitiles_ref tag without the buildset tag
[01:51:53.295] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:51:53.295] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:51:53.295] Buildbucket request:
{
"requestId": "8852551615180751920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852551615180751920"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:51:53.847] Scheduled build:
{
"id": "8687121553266669457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 630,
"createdBy": "project:chromium",
"createTime": "2026-03-17T01:51:53.358177485Z",
"updateTime": "2026-03-17T01:51:53.358177485Z",
"status": "SCHEDULED",
"input": {
}
}
[01:51:53.847] Task URL: https://cr-buildbucket.appspot.com/build/8687121553266669457
[01:51:53.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:2:0) after 8m11s
[01:51:54.748] Received PubSub notification, asking Buildbucket for the build status
[01:51:54.831] Build status: SCHEDULED
[01:51:59.638] Received PubSub notification, asking Buildbucket for the build status
[01:51:59.657] Build status: STARTED
[02:00:04.900] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:2:0)
[02:00:04.922] Build status: STARTED
[02:00:04.922] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:5:0) after 5m23s
[02:05:27.983] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:5:0)
[02:05:28.010] Build status: STARTED
[02:05:28.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:6:0) after 4m43s
[02:10:11.024] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:6:0)
[02:10:11.072] Build status: STARTED
[02:10:11.072] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:7:0) after 3m23s
[02:13:34.185] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:7:0)
[02:13:34.212] Build status: STARTED
[02:13:34.213] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:8:0) after 3m39s
[02:17:13.265] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:8:0)
[02:17:13.284] Build status: STARTED
[02:17:13.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:9:0) after 4m16s
[02:21:29.302] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:9:0)
[02:21:29.417] Build status: STARTED
[02:21:29.417] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:10:0) after 3m2s
[02:24:31.418] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:10:0)
[02:24:31.440] Build status: STARTED
[02:24:31.441] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:11:0) after 1m49s
[02:26:20.423] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:11:0)
[02:26:20.447] Build status: STARTED
[02:26:20.447] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:12:0) after 4m18s
[02:30:38.496] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:12:0)
[02:30:38.523] Build status: STARTED
[02:30:38.523] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:13:0) after 8m0s
[02:38:38.542] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:13:0)
[02:38:38.569] Build status: STARTED
[02:38:38.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:14:0) after 2m19s
[02:40:57.585] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:14:0)
[02:40:57.615] Build status: STARTED
[02:40:57.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:15:0) after 5m58s
[02:46:55.579] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:15:0)
[02:46:55.675] Build status: STARTED
[02:46:55.675] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:16:0) after 6m23s
[02:53:18.857] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:16:0)
[02:53:18.876] Build status: STARTED
[02:53:18.876] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:17:0) after 9m26s
[03:02:45.001] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:17:0)
[03:02:45.020] Build status: STARTED
[03:02:45.020] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:18:0) after 8m38s
[03:11:23.035] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:18:0)
[03:11:23.055] Build status: STARTED
[03:11:23.055] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:19:0) after 3m54s
[03:15:17.021] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:19:0)
[03:15:17.108] Build status: STARTED
[03:15:17.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:20:0) after 1m30s
[03:16:47.154] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:20:0)
[03:16:47.166] Build status: STARTED
[03:16:47.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:21:0) after 3m11s
[03:19:58.182] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:21:0)
[03:19:58.206] Build status: STARTED
[03:19:58.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:22:0) after 9m42s
[03:29:40.225] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:22:0)
[03:29:40.314] Build status: STARTED
[03:29:40.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:23:0) after 8m4s
[03:37:44.396] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:23:0)
[03:37:44.416] Build status: STARTED
[03:37:44.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:24:0) after 5m2s
[03:42:46.430] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:24:0)
[03:42:46.445] Build status: STARTED
[03:42:46.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:25:0) after 4m44s
[03:47:30.461] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:25:0)
[03:47:30.477] Build status: STARTED
[03:47:30.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:26:0) after 6m0s
[03:53:30.563] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:26:0)
[03:53:30.580] Build status: STARTED
[03:53:30.580] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:27:0) after 1m53s
[03:55:23.697] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:27:0)
[03:55:23.713] Build status: STARTED
[03:55:23.713] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:28:0) after 3m14s
[03:58:37.730] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:28:0)
[03:58:37.747] Build status: STARTED
[03:58:37.747] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:29:0) after 2m46s
[04:01:23.755] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:29:0)
[04:01:23.820] Build status: STARTED
[04:01:23.820] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:30:0) after 2m26s
[04:03:49.832] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:30:0)
[04:03:49.855] Build status: STARTED
[04:03:49.855] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:31:0) after 1m31s
[04:05:21.003] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:31:0)
[04:05:21.024] Build status: STARTED
[04:05:21.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:32:0) after 1m9s
[04:06:30.145] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:32:0)
[04:06:30.304] Build status: STARTED
[04:06:30.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:33:0) after 6m45s
[04:13:15.294] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:33:0)
[04:13:15.331] Build status: STARTED
[04:13:15.331] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:34:0) after 7m47s
[04:21:02.345] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:34:0)
[04:21:02.366] Build status: STARTED
[04:21:02.366] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:35:0) after 1m50s
[04:22:52.394] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:35:0)
[04:22:52.472] Build status: STARTED
[04:22:52.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:36:0) after 3m50s
[04:26:42.488] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:36:0)
[04:26:42.504] Build status: STARTED
[04:26:42.505] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:37:0) after 3m29s
[04:30:11.518] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:37:0)
[04:30:11.532] Build status: STARTED
[04:30:11.532] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:38:0) after 9m25s
[04:39:36.548] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:38:0)
[04:39:36.565] Build status: STARTED
[04:39:36.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:39:0) after 7m8s
[04:46:44.613] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:39:0)
[04:46:44.632] Build status: STARTED
[04:46:44.632] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:40:0) after 7m29s
[04:54:13.746] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:40:0)
[04:54:13.770] Build status: STARTED
[04:54:13.770] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:41:0) after 7m48s
[05:02:01.790] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:41:0)
[05:02:01.815] Build status: STARTED
[05:02:01.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:42:0) after 4m56s
[05:06:57.833] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:42:0)
[05:06:57.847] Build status: STARTED
[05:06:57.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:43:0) after 9m34s
[05:16:31.861] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:43:0)
[05:16:31.885] Build status: STARTED
[05:16:31.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:44:0) after 5m58s
[05:22:29.917] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:44:0)
[05:22:29.933] Build status: STARTED
[05:22:29.933] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:45:0) after 5m0s
[05:27:29.963] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:45:0)
[05:27:29.982] Build status: STARTED
[05:27:29.982] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:46:0) after 2m56s
[05:30:25.999] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:46:0)
[05:30:26.014] Build status: STARTED
[05:30:26.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:47:0) after 1m4s
[05:31:30.029] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:47:0)
[05:31:30.046] Build status: STARTED
[05:31:30.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:48:0) after 4m14s
[05:35:44.064] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:48:0)
[05:35:44.111] Build status: STARTED
[05:35:44.111] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:49:0) after 3m2s
[05:38:46.129] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:49:0)
[05:38:46.147] Build status: STARTED
[05:38:46.147] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:50:0) after 4m37s
[05:43:23.243] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:50:0)
[05:43:23.258] Build status: STARTED
[05:43:23.258] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:51:0) after 7m49s
[05:51:12.292] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:51:0)
[05:51:12.315] Build status: STARTED
[05:51:12.315] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:52:0) after 7m8s
[05:58:20.285] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:52:0)
[05:58:20.320] Build status: STARTED
[05:58:20.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:53:0) after 1m14s
[05:59:34.335] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:53:0)
[05:59:34.366] Build status: STARTED
[05:59:34.366] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:54:0) after 4m57s
[06:04:31.436] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:54:0)
[06:04:31.465] Build status: STARTED
[06:04:31.465] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:55:0) after 9m27s
[06:13:58.490] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:55:0)
[06:13:58.511] Build status: STARTED
[06:13:58.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:56:0) after 1m56s
[06:15:54.528] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:56:0)
[06:15:54.541] Build status: STARTED
[06:15:54.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:57:0) after 9m3s
[06:24:57.597] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:57:0)
[06:24:57.660] Build status: STARTED
[06:24:57.660] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:58:0) after 1m52s
[06:26:49.674] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:58:0)
[06:26:49.690] Build status: STARTED
[06:26:49.690] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:59:0) after 3m21s
[06:30:10.754] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:59:0)
[06:30:10.840] Build status: STARTED
[06:30:10.840] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:60:0) after 7m33s
[06:37:43.866] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:60:0)
[06:37:43.884] Build status: STARTED
[06:37:43.884] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:61:0) after 7m51s
[06:45:34.938] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:61:0)
[06:45:34.963] Build status: STARTED
[06:45:34.963] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:62:0) after 5m49s
[06:51:23.981] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:62:0)
[06:51:24.146] Build status: STARTED
[06:51:24.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:63:0) after 5m29s
[06:56:53.129] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:63:0)
[06:56:53.145] Build status: STARTED
[06:56:53.145] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8852551615180751920:64:0) after 6m27s
[06:58:08.764] Received PubSub notification, asking Buildbucket for the build status
[06:58:08.786] Build:
{
"id": "8687121553266669457",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 630,
"createdBy": "project:chromium",
"createTime": "2026-03-17T01:51:53.358177485Z",
"startTime": "2026-03-17T01:51:59.148818225Z",
"endTime": "2026-03-17T06:58:08.430233091Z",
"updateTime": "2026-03-17T06:58:08.430233091Z",
"status": "FAILURE",
"input": {
}
}
[06:58:08.786] Invocation finished in 5h6m16.636841768s with status FAILED