[01:55:00.124] New invocation is queued and will start shortly
[01:55:01.209] Starting the invocation (attempt 1)
[01:55:01.278] Ignoring gitiles_ref tag without the buildset tag
[01:55:01.278] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:55:01.278] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:55:01.278] Buildbucket request:
{
"requestId": "8848565151560115952",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848565151560115952"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:55:02.003] Scheduled build:
{
"id": "8683135089640937553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 666,
"createdBy": "project:chromium",
"createTime": "2026-04-30T01:55:01.331152758Z",
"updateTime": "2026-04-30T01:55:01.331152758Z",
"status": "SCHEDULED",
"input": {
}
}
[01:55:02.004] Task URL: https://cr-buildbucket.appspot.com/build/8683135089640937553
[01:55:02.004] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:2:0) after 6m46s
[01:55:02.656] Received PubSub notification, asking Buildbucket for the build status
[01:55:02.673] Build status: SCHEDULED
[01:55:08.045] Received PubSub notification, asking Buildbucket for the build status
[01:55:08.072] Build status: STARTED
[02:01:48.018] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:2:0)
[02:01:48.043] Build status: STARTED
[02:01:48.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:5:0) after 7m46s
[02:09:34.153] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:5:0)
[02:09:34.190] Build status: STARTED
[02:09:34.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:6:0) after 8m48s
[02:18:22.290] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:6:0)
[02:18:22.307] Build status: STARTED
[02:18:22.307] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:7:0) after 7m46s
[02:26:08.321] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:7:0)
[02:26:08.338] Build status: STARTED
[02:26:08.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:8:0) after 8m29s
[02:34:37.393] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:8:0)
[02:34:37.489] Build status: STARTED
[02:34:37.489] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:9:0) after 5m7s
[02:39:44.507] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:9:0)
[02:39:44.526] Build status: STARTED
[02:39:44.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:10:0) after 8m55s
[02:48:39.609] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:10:0)
[02:48:39.624] Build status: STARTED
[02:48:39.624] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:11:0) after 3m59s
[02:52:38.681] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:11:0)
[02:52:38.710] Build status: STARTED
[02:52:38.710] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:12:0) after 7m54s
[03:00:32.887] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:12:0)
[03:00:32.914] Build status: STARTED
[03:00:32.914] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:13:0) after 9m29s
[03:10:02.034] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:13:0)
[03:10:02.050] Build status: STARTED
[03:10:02.050] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:14:0) after 5m26s
[03:15:28.114] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:14:0)
[03:15:28.148] Build status: STARTED
[03:15:28.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:15:0) after 7m50s
[03:23:18.227] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:15:0)
[03:23:18.244] Build status: STARTED
[03:23:18.244] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:16:0) after 8m2s
[03:31:20.341] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:16:0)
[03:31:20.366] Build status: STARTED
[03:31:20.366] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:17:0) after 3m41s
[03:35:01.545] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:17:0)
[03:35:01.627] Build status: STARTED
[03:35:01.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:18:0) after 6m41s
[03:41:42.684] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:18:0)
[03:41:42.699] Build status: STARTED
[03:41:42.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:19:0) after 2m34s
[03:44:16.710] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:19:0)
[03:44:16.724] Build status: STARTED
[03:44:16.724] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:20:0) after 1m7s
[03:45:23.739] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:20:0)
[03:45:23.818] Build status: STARTED
[03:45:23.818] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:21:0) after 3m54s
[03:49:17.845] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:21:0)
[03:49:17.862] Build status: STARTED
[03:49:17.862] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:22:0) after 3m30s
[03:52:47.838] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:22:0)
[03:52:47.865] Build status: STARTED
[03:52:47.865] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:23:0) after 8m30s
[04:01:17.924] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:23:0)
[04:01:17.945] Build status: STARTED
[04:01:17.945] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:24:0) after 1m22s
[04:02:39.958] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:24:0)
[04:02:40.084] Build status: STARTED
[04:02:40.084] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:25:0) after 8m58s
[04:11:38.145] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:25:0)
[04:11:38.167] Build status: STARTED
[04:11:38.167] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:26:0) after 2m28s
[04:14:06.281] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:26:0)
[04:14:06.311] Build status: STARTED
[04:14:06.311] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:27:0) after 1m12s
[04:15:18.335] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:27:0)
[04:15:18.390] Build status: STARTED
[04:15:18.390] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:28:0) after 3m3s
[04:18:21.456] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:28:0)
[04:18:21.481] Build status: STARTED
[04:18:21.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:29:0) after 2m11s
[04:20:32.492] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:29:0)
[04:20:32.507] Build status: STARTED
[04:20:32.507] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:30:0) after 1m15s
[04:21:47.569] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:30:0)
[04:21:47.587] Build status: STARTED
[04:21:47.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:31:0) after 4m52s
[04:26:39.600] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:31:0)
[04:26:39.618] Build status: STARTED
[04:26:39.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:32:0) after 8m54s
[04:35:33.755] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:32:0)
[04:35:33.772] Build status: STARTED
[04:35:33.772] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:33:0) after 5m8s
[04:40:41.820] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:33:0)
[04:40:41.838] Build status: STARTED
[04:40:41.838] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:34:0) after 3m26s
[04:44:07.851] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:34:0)
[04:44:07.870] Build status: STARTED
[04:44:07.870] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:35:0) after 3m4s
[04:47:11.997] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:35:0)
[04:47:12.016] Build status: STARTED
[04:47:12.016] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:36:0) after 2m58s
[04:50:10.029] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:36:0)
[04:50:10.045] Build status: STARTED
[04:50:10.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:37:0) after 3m49s
[04:53:59.013] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:37:0)
[04:53:59.035] Build status: STARTED
[04:53:59.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:38:0) after 4m45s
[04:58:44.158] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:38:0)
[04:58:44.178] Build status: STARTED
[04:58:44.178] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:39:0) after 9m52s
[05:08:36.192] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:39:0)
[05:08:36.211] Build status: STARTED
[05:08:36.211] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:40:0) after 2m13s
[05:10:49.252] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:40:0)
[05:10:49.264] Build status: STARTED
[05:10:49.264] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:41:0) after 5m18s
[05:16:07.284] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:41:0)
[05:16:07.302] Build status: STARTED
[05:16:07.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:42:0) after 8m3s
[05:24:10.411] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:42:0)
[05:24:10.437] Build status: STARTED
[05:24:10.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:43:0) after 2m46s
[05:26:56.451] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:43:0)
[05:26:56.477] Build status: STARTED
[05:26:56.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:44:0) after 8m37s
[05:35:33.537] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:44:0)
[05:35:33.585] Build status: STARTED
[05:35:33.585] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:45:0) after 4m9s
[05:39:42.600] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:45:0)
[05:39:42.688] Build status: STARTED
[05:39:42.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:46:0) after 1m30s
[05:41:12.712] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:46:0)
[05:41:12.730] Build status: STARTED
[05:41:12.730] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:47:0) after 8m54s
[05:50:06.747] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:47:0)
[05:50:06.763] Build status: STARTED
[05:50:06.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:48:0) after 7m1s
[05:57:07.848] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:48:0)
[05:57:07.866] Build status: STARTED
[05:57:07.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:49:0) after 4m0s
[06:01:07.926] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:49:0)
[06:01:07.951] Build status: STARTED
[06:01:07.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:50:0) after 4m48s
[06:05:55.967] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:50:0)
[06:05:56.016] Build status: STARTED
[06:05:56.016] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:51:0) after 9m9s
[06:15:05.077] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:51:0)
[06:15:05.104] Build status: STARTED
[06:15:05.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:52:0) after 6m41s
[06:21:46.122] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:52:0)
[06:21:46.153] Build status: STARTED
[06:21:46.153] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:53:0) after 9m16s
[06:31:02.225] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:53:0)
[06:31:02.242] Build status: STARTED
[06:31:02.242] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:54:0) after 1m34s
[06:32:36.264] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:54:0)
[06:32:36.284] Build status: STARTED
[06:32:36.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:55:0) after 9m19s
[06:41:55.384] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:55:0)
[06:41:55.404] Build status: STARTED
[06:41:55.404] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:56:0) after 6m10s
[06:48:05.597] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:56:0)
[06:48:05.617] Build status: STARTED
[06:48:05.617] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:57:0) after 4m51s
[06:52:56.659] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:57:0)
[06:52:56.746] Build status: STARTED
[06:52:56.746] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:58:0) after 6m16s
[06:59:12.863] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:58:0)
[06:59:12.894] Build status: STARTED
[06:59:12.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:59:0) after 2m6s
[07:01:18.947] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:59:0)
[07:01:19.022] Build status: STARTED
[07:01:19.022] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:60:0) after 2m35s
[07:03:54.057] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:60:0)
[07:03:54.074] Build status: STARTED
[07:03:54.074] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:61:0) after 5m19s
[07:09:13.138] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:61:0)
[07:09:13.153] Build status: STARTED
[07:09:13.153] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:62:0) after 2m49s
[07:12:02.175] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:62:0)
[07:12:02.194] Build status: STARTED
[07:12:02.194] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:63:0) after 1m51s
[07:13:53.409] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:63:0)
[07:13:53.481] Build status: STARTED
[07:13:53.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8848565151560115952:64:0) after 5m11s
[07:14:13.887] Received PubSub notification, asking Buildbucket for the build status
[07:14:13.907] Build:
{
"id": "8683135089640937553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 666,
"createdBy": "project:chromium",
"createTime": "2026-04-30T01:55:01.331152758Z",
"startTime": "2026-04-30T01:55:07.047257990Z",
"endTime": "2026-04-30T07:14:13.521104914Z",
"updateTime": "2026-04-30T07:14:13.521104914Z",
"status": "FAILURE",
"input": {
}
}
[07:14:13.907] Invocation finished in 5h19m13.789625502s with status FAILED