[10:52:00.484] New invocation is queued and will start shortly
[10:52:01.526] Starting the invocation (attempt 1)
[10:52:01.553] Ignoring gitiles_ref tag without the buildset tag
[10:52:01.553] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:52:01.553] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:52:01.553] Buildbucket request:
{
"requestId": "8864295238223453184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8864295238223453184"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:52:02.192] Scheduled build:
{
"id": "8698865176377668737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 523,
"createdBy": "project:chromium",
"createTime": "2025-11-07T10:52:01.615659347Z",
"updateTime": "2025-11-07T10:52:01.615659347Z",
"status": "SCHEDULED",
"input": {
}
}
[10:52:02.192] Task URL: https://cr-buildbucket.appspot.com/build/8698865176377668737
[10:52:02.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:2:0) after 3m51s
[10:52:03.195] Received PubSub notification, asking Buildbucket for the build status
[10:52:03.216] Build status: SCHEDULED
[10:52:07.015] Received PubSub notification, asking Buildbucket for the build status
[10:52:07.032] Build status: STARTED
[10:55:53.180] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:2:0)
[10:55:53.195] Build status: STARTED
[10:55:53.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:5:0) after 6m32s
[11:02:25.210] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:5:0)
[11:02:25.277] Build status: STARTED
[11:02:25.277] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:6:0) after 3m2s
[11:05:27.357] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:6:0)
[11:05:27.380] Build status: STARTED
[11:05:27.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:7:0) after 3m43s
[11:09:10.397] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:7:0)
[11:09:10.418] Build status: STARTED
[11:09:10.418] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:8:0) after 8m36s
[11:17:46.435] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:8:0)
[11:17:46.451] Build status: STARTED
[11:17:46.451] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:9:0) after 2m31s
[11:20:17.468] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:9:0)
[11:20:17.486] Build status: STARTED
[11:20:17.486] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:10:0) after 3m5s
[11:23:22.502] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:10:0)
[11:23:22.519] Build status: STARTED
[11:23:22.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:11:0) after 1m32s
[11:24:54.510] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:11:0)
[11:24:54.526] Build status: STARTED
[11:24:54.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:12:0) after 6m48s
[11:31:42.555] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:12:0)
[11:31:42.573] Build status: STARTED
[11:31:42.573] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:13:0) after 4m41s
[11:36:23.588] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:13:0)
[11:36:23.606] Build status: STARTED
[11:36:23.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:14:0) after 2m34s
[11:38:57.622] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:14:0)
[11:38:57.691] Build status: STARTED
[11:38:57.691] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:15:0) after 2m41s
[11:41:38.704] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:15:0)
[11:41:38.726] Build status: STARTED
[11:41:38.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:16:0) after 7m9s
[11:48:47.742] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:16:0)
[11:48:47.759] Build status: STARTED
[11:48:47.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:17:0) after 7m41s
[11:56:28.774] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:17:0)
[11:56:28.789] Build status: STARTED
[11:56:28.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:18:0) after 2m22s
[11:58:50.809] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:18:0)
[11:58:50.825] Build status: STARTED
[11:58:50.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:19:0) after 6m57s
[12:05:47.841] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:19:0)
[12:05:47.856] Build status: STARTED
[12:05:47.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:20:0) after 2m32s
[12:08:19.871] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:20:0)
[12:08:19.924] Build status: STARTED
[12:08:19.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:21:0) after 8m25s
[12:16:44.948] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:21:0)
[12:16:44.972] Build status: STARTED
[12:16:44.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:22:0) after 8m42s
[12:25:27.076] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:22:0)
[12:25:27.098] Build status: STARTED
[12:25:27.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:23:0) after 9m42s
[12:35:09.169] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:23:0)
[12:35:09.184] Build status: STARTED
[12:35:09.184] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:24:0) after 5m49s
[12:40:58.243] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:24:0)
[12:40:58.263] Build status: STARTED
[12:40:58.263] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:25:0) after 3m38s
[12:44:36.391] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:25:0)
[12:44:36.411] Build status: STARTED
[12:44:36.411] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:26:0) after 4m29s
[12:49:05.492] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:26:0)
[12:49:05.517] Build status: STARTED
[12:49:05.517] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:27:0) after 8m3s
[12:57:08.635] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:27:0)
[12:57:08.648] Build status: STARTED
[12:57:08.648] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:28:0) after 2m18s
[12:59:26.665] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:28:0)
[12:59:26.682] Build status: STARTED
[12:59:26.682] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:29:0) after 2m51s
[13:02:17.695] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:29:0)
[13:02:17.711] Build status: STARTED
[13:02:17.711] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:30:0) after 2m23s
[13:04:40.887] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:30:0)
[13:04:40.904] Build status: STARTED
[13:04:40.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:31:0) after 4m20s
[13:09:00.928] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:31:0)
[13:09:00.943] Build status: STARTED
[13:09:00.943] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:32:0) after 7m45s
[13:16:45.963] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:32:0)
[13:16:45.976] Build status: STARTED
[13:16:45.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:33:0) after 2m34s
[13:19:20.014] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:33:0)
[13:19:20.036] Build status: STARTED
[13:19:20.036] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:34:0) after 3m1s
[13:22:21.061] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:34:0)
[13:22:21.103] Build status: STARTED
[13:22:21.103] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:35:0) after 9m5s
[13:31:26.193] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:35:0)
[13:31:26.218] Build status: STARTED
[13:31:26.219] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:36:0) after 8m54s
[13:40:20.241] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:36:0)
[13:40:20.292] Build status: STARTED
[13:40:20.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:37:0) after 4m13s
[13:44:33.368] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:37:0)
[13:44:33.382] Build status: STARTED
[13:44:33.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:38:0) after 3m25s
[13:47:58.407] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:38:0)
[13:47:58.422] Build status: STARTED
[13:47:58.422] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:39:0) after 2m45s
[13:50:43.438] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:39:0)
[13:50:43.457] Build status: STARTED
[13:50:43.457] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:40:0) after 3m28s
[13:54:11.463] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:40:0)
[13:54:11.501] Build status: STARTED
[13:54:11.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:41:0) after 3m5s
[13:57:16.575] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:41:0)
[13:57:16.588] Build status: STARTED
[13:57:16.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:42:0) after 4m14s
[14:01:30.609] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:42:0)
[14:01:30.627] Build status: STARTED
[14:01:30.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:43:0) after 9m10s
[14:10:40.690] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:43:0)
[14:10:40.703] Build status: STARTED
[14:10:40.703] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:44:0) after 4m57s
[14:15:37.770] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:44:0)
[14:15:37.790] Build status: STARTED
[14:15:37.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:45:0) after 2m52s
[14:18:29.806] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:45:0)
[14:18:29.885] Build status: STARTED
[14:18:29.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:46:0) after 3m45s
[14:22:15.055] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:46:0)
[14:22:15.105] Build status: STARTED
[14:22:15.105] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:47:0) after 1m13s
[14:23:28.083] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:47:0)
[14:23:28.099] Build status: STARTED
[14:23:28.099] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:48:0) after 5m33s
[14:29:01.209] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:48:0)
[14:29:01.227] Build status: STARTED
[14:29:01.227] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:49:0) after 1m38s
[14:30:39.261] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:49:0)
[14:30:39.308] Build status: STARTED
[14:30:39.308] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:50:0) after 3m47s
[14:34:26.291] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:50:0)
[14:34:26.308] Build status: STARTED
[14:34:26.308] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:51:0) after 9m54s
[14:44:20.328] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:51:0)
[14:44:20.343] Build status: STARTED
[14:44:20.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:52:0) after 9m11s
[14:53:31.415] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:52:0)
[14:53:31.446] Build status: STARTED
[14:53:31.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:53:0) after 6m6s
[14:59:37.466] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:53:0)
[14:59:37.487] Build status: STARTED
[14:59:37.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:54:0) after 9m23s
[15:09:00.501] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:54:0)
[15:09:00.514] Build status: STARTED
[15:09:00.514] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:55:0) after 8m28s
[15:17:28.540] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:55:0)
[15:17:28.575] Build status: STARTED
[15:17:28.575] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:56:0) after 1m53s
[15:19:21.622] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:56:0)
[15:19:21.641] Build status: STARTED
[15:19:21.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:57:0) after 5m26s
[15:24:47.828] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:57:0)
[15:24:47.842] Build status: STARTED
[15:24:47.842] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:58:0) after 5m35s
[15:30:22.831] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:58:0)
[15:30:22.863] Build status: STARTED
[15:30:22.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:59:0) after 6m29s
[15:36:51.884] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:59:0)
[15:36:51.924] Build status: STARTED
[15:36:51.924] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:60:0) after 8m26s
[15:45:17.913] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:60:0)
[15:45:17.974] Build status: STARTED
[15:45:17.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:61:0) after 9m28s
[15:54:45.998] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:61:0)
[15:54:46.023] Build status: STARTED
[15:54:46.023] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:62:0) after 1m45s
[15:56:31.039] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:62:0)
[15:56:31.067] Build status: STARTED
[15:56:31.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:63:0) after 9m19s
[16:05:50.147] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:63:0)
[16:05:50.169] Build status: STARTED
[16:05:50.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8864295238223453184:64:0) after 9m30s
[16:07:09.022] Received PubSub notification, asking Buildbucket for the build status
[16:07:09.039] Build:
{
"id": "8698865176377668737",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 523,
"createdBy": "project:chromium",
"createTime": "2025-11-07T10:52:01.615659347Z",
"startTime": "2025-11-07T10:52:06.650994604Z",
"endTime": "2025-11-07T16:07:08.614270827Z",
"updateTime": "2025-11-07T16:07:08.614270827Z",
"status": "FAILURE",
"input": {
}
}
[16:07:09.039] Invocation finished in 5h15m8.567367559s with status FAILED