[07:16:12.953] New invocation is queued and will start shortly
[07:16:14.311] Starting the invocation (attempt 1)
[07:16:14.337] Ignoring gitiles_ref tag without the buildset tag
[07:16:14.337] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:16:14.337] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:16:14.337] Buildbucket request:
{
"requestId": "8851353448491633168",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851353448491633168"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:16:14.869] Scheduled build:
{
"id": "8685923386317163761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 641,
"createdBy": "project:chromium",
"createTime": "2026-03-30T07:16:14.404497823Z",
"updateTime": "2026-03-30T07:16:14.404497823Z",
"status": "SCHEDULED",
"input": {
}
}
[07:16:14.869] Task URL: https://cr-buildbucket.appspot.com/build/8685923386317163761
[07:16:14.869] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:2:0) after 6m43s
[07:16:15.845] Received PubSub notification, asking Buildbucket for the build status
[07:16:15.887] Build status: SCHEDULED
[07:16:22.754] Received PubSub notification, asking Buildbucket for the build status
[07:16:22.774] Build status: STARTED
[07:22:57.880] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:2:0)
[07:22:57.898] Build status: STARTED
[07:22:57.898] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:5:0) after 4m12s
[07:27:09.941] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:5:0)
[07:27:09.958] Build status: STARTED
[07:27:09.958] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:6:0) after 2m18s
[07:29:27.973] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:6:0)
[07:29:27.986] Build status: STARTED
[07:29:27.987] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:7:0) after 4m15s
[07:33:43.029] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:7:0)
[07:33:43.079] Build status: STARTED
[07:33:43.079] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:8:0) after 7m33s
[07:41:16.095] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:8:0)
[07:41:16.123] Build status: STARTED
[07:41:16.123] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:9:0) after 5m22s
[07:46:38.153] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:9:0)
[07:46:38.200] Build status: STARTED
[07:46:38.200] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:10:0) after 7m23s
[07:54:01.235] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:10:0)
[07:54:01.255] Build status: STARTED
[07:54:01.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:11:0) after 7m36s
[08:01:37.269] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:11:0)
[08:01:37.294] Build status: STARTED
[08:01:37.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:12:0) after 4m46s
[08:06:23.286] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:12:0)
[08:06:23.336] Build status: STARTED
[08:06:23.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:13:0) after 4m14s
[08:10:37.347] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:13:0)
[08:10:37.363] Build status: STARTED
[08:10:37.363] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:14:0) after 1m58s
[08:12:35.347] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:14:0)
[08:12:35.369] Build status: STARTED
[08:12:35.369] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:15:0) after 2m1s
[08:14:36.390] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:15:0)
[08:14:36.456] Build status: STARTED
[08:14:36.456] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:16:0) after 3m6s
[08:17:42.452] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:16:0)
[08:17:42.471] Build status: STARTED
[08:17:42.471] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:17:0) after 4m41s
[08:22:23.483] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:17:0)
[08:22:23.540] Build status: STARTED
[08:22:23.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:18:0) after 1m32s
[08:23:55.557] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:18:0)
[08:23:55.575] Build status: STARTED
[08:23:55.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:19:0) after 1m3s
[08:24:58.633] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:19:0)
[08:24:58.650] Build status: STARTED
[08:24:58.650] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:20:0) after 1m57s
[08:26:55.663] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:20:0)
[08:26:55.679] Build status: STARTED
[08:26:55.679] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:21:0) after 1m12s
[08:28:07.736] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:21:0)
[08:28:07.754] Build status: STARTED
[08:28:07.754] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:22:0) after 8m41s
[08:36:48.844] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:22:0)
[08:36:48.867] Build status: STARTED
[08:36:48.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:23:0) after 6m45s
[08:43:33.883] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:23:0)
[08:43:33.907] Build status: STARTED
[08:43:33.907] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:24:0) after 2m59s
[08:46:32.919] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:24:0)
[08:46:32.974] Build status: STARTED
[08:46:32.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:25:0) after 3m23s
[08:49:56.041] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:25:0)
[08:49:56.056] Build status: STARTED
[08:49:56.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:26:0) after 9m35s
[08:59:31.034] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:26:0)
[08:59:31.050] Build status: STARTED
[08:59:31.050] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:27:0) after 7m29s
[09:07:00.064] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:27:0)
[09:07:00.081] Build status: STARTED
[09:07:00.081] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:28:0) after 6m42s
[09:13:42.145] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:28:0)
[09:13:42.250] Build status: STARTED
[09:13:42.250] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:29:0) after 2m11s
[09:15:53.284] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:29:0)
[09:15:53.299] Build status: STARTED
[09:15:53.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:30:0) after 4m27s
[09:20:20.336] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:30:0)
[09:20:20.353] Build status: STARTED
[09:20:20.353] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:31:0) after 2m12s
[09:22:32.367] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:31:0)
[09:22:32.434] Build status: STARTED
[09:22:32.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:32:0) after 5m31s
[09:28:03.584] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:32:0)
[09:28:03.608] Build status: STARTED
[09:28:03.608] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:33:0) after 9m45s
[09:37:48.619] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:33:0)
[09:37:48.638] Build status: STARTED
[09:37:48.638] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:34:0) after 4m21s
[09:42:09.656] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:34:0)
[09:42:09.672] Build status: STARTED
[09:42:09.672] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:35:0) after 3m0s
[09:45:09.686] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:35:0)
[09:45:09.708] Build status: STARTED
[09:45:09.708] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:36:0) after 8m23s
[09:53:32.772] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:36:0)
[09:53:32.788] Build status: STARTED
[09:53:32.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:37:0) after 3m17s
[09:56:49.848] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:37:0)
[09:56:49.934] Build status: STARTED
[09:56:49.934] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:38:0) after 6m41s
[10:03:31.033] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:38:0)
[10:03:31.068] Build status: STARTED
[10:03:31.068] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:39:0) after 9m8s
[10:12:39.122] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:39:0)
[10:12:39.136] Build status: STARTED
[10:12:39.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:40:0) after 8m21s
[10:21:00.171] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:40:0)
[10:21:00.187] Build status: STARTED
[10:21:00.188] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:41:0) after 3m13s
[10:24:13.206] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:41:0)
[10:24:13.237] Build status: STARTED
[10:24:13.237] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:42:0) after 6m37s
[10:30:50.302] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:42:0)
[10:30:50.327] Build status: STARTED
[10:30:50.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:43:0) after 7m30s
[10:38:20.411] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:43:0)
[10:38:20.458] Build status: STARTED
[10:38:20.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:44:0) after 4m44s
[10:43:04.475] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:44:0)
[10:43:04.501] Build status: STARTED
[10:43:04.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:45:0) after 7m48s
[10:50:52.540] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:45:0)
[10:50:52.577] Build status: STARTED
[10:50:52.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:46:0) after 8m34s
[10:59:26.596] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:46:0)
[10:59:26.610] Build status: STARTED
[10:59:26.611] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:47:0) after 9m26s
[11:08:52.720] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:47:0)
[11:08:52.736] Build status: STARTED
[11:08:52.736] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:48:0) after 7m3s
[11:15:55.785] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:48:0)
[11:15:55.801] Build status: STARTED
[11:15:55.801] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:49:0) after 3m48s
[11:19:43.822] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:49:0)
[11:19:43.841] Build status: STARTED
[11:19:43.841] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:50:0) after 6m55s
[11:26:38.863] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:50:0)
[11:26:38.894] Build status: STARTED
[11:26:38.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:51:0) after 3m30s
[11:30:08.910] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:51:0)
[11:30:08.928] Build status: STARTED
[11:30:08.928] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:52:0) after 6m48s
[11:36:57.078] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:52:0)
[11:36:57.100] Build status: STARTED
[11:36:57.100] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:53:0) after 8m30s
[11:45:27.115] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:53:0)
[11:45:27.137] Build status: STARTED
[11:45:27.137] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:54:0) after 7m53s
[11:53:20.193] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:54:0)
[11:53:20.221] Build status: STARTED
[11:53:20.221] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:55:0) after 9m51s
[12:03:11.189] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:55:0)
[12:03:11.208] Build status: STARTED
[12:03:11.208] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:56:0) after 6m29s
[12:09:40.269] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:56:0)
[12:09:40.287] Build status: STARTED
[12:09:40.287] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851353448491633168:57:0) after 5m19s
[12:13:26.700] Received PubSub notification, asking Buildbucket for the build status
[12:13:26.716] Build:
{
"id": "8685923386317163761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 641,
"createdBy": "project:chromium",
"createTime": "2026-03-30T07:16:14.404497823Z",
"startTime": "2026-03-30T07:16:22.065214106Z",
"endTime": "2026-03-30T12:13:25.972187587Z",
"updateTime": "2026-03-30T12:13:25.972187587Z",
"status": "FAILURE",
"input": {
}
}
[12:13:26.716] Invocation finished in 4h57m13.769245604s with status FAILED