[04:18:11.760] New invocation is queued and will start shortly
[04:18:13.000] Starting the invocation (attempt 1)
[04:18:13.026] Ignoring gitiles_ref tag without the buildset tag
[04:18:13.026] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:18:13.026] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:18:13.026] Buildbucket request:
{
"requestId": "8857253451355598768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857253451355598768"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:18:13.664] Scheduled build:
{
"id": "8691823389319528241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 587,
"createdBy": "project:chromium",
"createTime": "2026-01-24T04:18:13.074977197Z",
"updateTime": "2026-01-24T04:18:13.074977197Z",
"status": "SCHEDULED",
"input": {
},
"canary": true
}
[04:18:13.664] Task URL: https://cr-buildbucket.appspot.com/build/8691823389319528241
[04:18:13.665] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:2:0) after 7m38s
[04:18:14.575] Received PubSub notification, asking Buildbucket for the build status
[04:18:14.611] Build status: SCHEDULED
[04:18:18.761] Received PubSub notification, asking Buildbucket for the build status
[04:18:18.783] Build status: STARTED
[04:25:51.635] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:2:0)
[04:25:51.659] Build status: STARTED
[04:25:51.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:5:0) after 6m43s
[04:32:34.681] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:5:0)
[04:32:34.699] Build status: STARTED
[04:32:34.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:6:0) after 5m53s
[04:38:27.713] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:6:0)
[04:38:27.734] Build status: STARTED
[04:38:27.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:7:0) after 1m52s
[04:40:19.774] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:7:0)
[04:40:19.795] Build status: STARTED
[04:40:19.795] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:8:0) after 5m3s
[04:45:22.844] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:8:0)
[04:45:22.955] Build status: STARTED
[04:45:22.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:9:0) after 9m26s
[04:54:49.017] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:9:0)
[04:54:49.031] Build status: STARTED
[04:54:49.031] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:10:0) after 4m7s
[04:58:56.050] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:10:0)
[04:58:56.067] Build status: STARTED
[04:58:56.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:11:0) after 1m45s
[05:00:41.082] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:11:0)
[05:00:41.119] Build status: STARTED
[05:00:41.119] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:12:0) after 5m4s
[05:05:45.175] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:12:0)
[05:05:45.196] Build status: STARTED
[05:05:45.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:13:0) after 4m6s
[05:09:51.211] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:13:0)
[05:09:51.234] Build status: STARTED
[05:09:51.234] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:14:0) after 1m4s
[05:10:55.248] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:14:0)
[05:10:55.260] Build status: STARTED
[05:10:55.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:15:0) after 6m27s
[05:17:22.270] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:15:0)
[05:17:22.295] Build status: STARTED
[05:17:22.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:16:0) after 7m25s
[05:24:47.348] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:16:0)
[05:24:47.361] Build status: STARTED
[05:24:47.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:17:0) after 3m0s
[05:27:47.326] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:17:0)
[05:27:47.343] Build status: STARTED
[05:27:47.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:18:0) after 6m43s
[05:34:30.407] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:18:0)
[05:34:30.431] Build status: STARTED
[05:34:30.431] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:19:0) after 3m57s
[05:38:27.482] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:19:0)
[05:38:27.503] Build status: STARTED
[05:38:27.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:20:0) after 8m40s
[05:47:07.515] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:20:0)
[05:47:07.529] Build status: STARTED
[05:47:07.529] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:21:0) after 8m12s
[05:55:19.544] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:21:0)
[05:55:19.563] Build status: STARTED
[05:55:19.563] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:22:0) after 9m49s
[06:05:08.578] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:22:0)
[06:05:08.604] Build status: STARTED
[06:05:08.604] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:23:0) after 3m12s
[06:08:20.660] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:23:0)
[06:08:20.684] Build status: STARTED
[06:08:20.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:24:0) after 3m47s
[06:12:07.660] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:24:0)
[06:12:07.674] Build status: STARTED
[06:12:07.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:25:0) after 4m11s
[06:16:18.691] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:25:0)
[06:16:18.705] Build status: STARTED
[06:16:18.705] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:26:0) after 3m44s
[06:20:02.720] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:26:0)
[06:20:02.740] Build status: STARTED
[06:20:02.740] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:27:0) after 2m28s
[06:22:30.783] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:27:0)
[06:22:30.808] Build status: STARTED
[06:22:30.808] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:28:0) after 9m23s
[06:31:53.871] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:28:0)
[06:31:53.887] Build status: STARTED
[06:31:53.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:29:0) after 6m58s
[06:38:51.881] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:29:0)
[06:38:51.899] Build status: STARTED
[06:38:51.899] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:30:0) after 8m1s
[06:46:52.913] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:30:0)
[06:46:52.931] Build status: STARTED
[06:46:52.931] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:31:0) after 7m48s
[06:54:40.944] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:31:0)
[06:54:40.979] Build status: STARTED
[06:54:40.979] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:32:0) after 1m31s
[06:56:11.994] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:32:0)
[06:56:12.048] Build status: STARTED
[06:56:12.048] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:33:0) after 5m28s
[07:01:40.095] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:33:0)
[07:01:40.114] Build status: STARTED
[07:01:40.114] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:34:0) after 1m26s
[07:03:06.129] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:34:0)
[07:03:06.146] Build status: STARTED
[07:03:06.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:35:0) after 2m28s
[07:05:34.185] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:35:0)
[07:05:34.211] Build status: STARTED
[07:05:34.211] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:36:0) after 8m25s
[07:13:59.225] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:36:0)
[07:13:59.245] Build status: STARTED
[07:13:59.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:37:0) after 1m12s
[07:15:11.428] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:37:0)
[07:15:11.445] Build status: STARTED
[07:15:11.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:38:0) after 1m6s
[07:16:17.468] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:38:0)
[07:16:17.564] Build status: STARTED
[07:16:17.564] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:39:0) after 4m54s
[07:21:11.610] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:39:0)
[07:21:11.627] Build status: STARTED
[07:21:11.628] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:40:0) after 8m19s
[07:29:30.672] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:40:0)
[07:29:30.687] Build status: STARTED
[07:29:30.689] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:41:0) after 1m1s
[07:30:31.796] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:41:0)
[07:30:31.812] Build status: STARTED
[07:30:31.812] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:42:0) after 5m56s
[07:36:27.973] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:42:0)
[07:36:27.985] Build status: STARTED
[07:36:27.985] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:43:0) after 6m22s
[07:42:49.996] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:43:0)
[07:42:50.009] Build status: STARTED
[07:42:50.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:44:0) after 4m27s
[07:47:17.024] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:44:0)
[07:47:17.071] Build status: STARTED
[07:47:17.071] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:45:0) after 4m40s
[07:51:57.109] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:45:0)
[07:51:57.124] Build status: STARTED
[07:51:57.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:46:0) after 2m5s
[07:54:02.269] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:46:0)
[07:54:02.282] Build status: STARTED
[07:54:02.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:47:0) after 2m38s
[07:56:40.296] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:47:0)
[07:56:40.435] Build status: STARTED
[07:56:40.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:48:0) after 8m31s
[08:05:11.453] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:48:0)
[08:05:11.506] Build status: STARTED
[08:05:11.506] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:49:0) after 5m11s
[08:10:22.524] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:49:0)
[08:10:22.536] Build status: STARTED
[08:10:22.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:50:0) after 5m5s
[08:15:28.147] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:50:0)
[08:15:28.162] Build status: STARTED
[08:15:28.163] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:51:0) after 4m18s
[08:19:46.229] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:51:0)
[08:19:46.245] Build status: STARTED
[08:19:46.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:52:0) after 8m22s
[08:28:08.362] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:52:0)
[08:28:08.381] Build status: STARTED
[08:28:08.381] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:53:0) after 1m47s
[08:29:55.395] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:53:0)
[08:29:55.414] Build status: STARTED
[08:29:55.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:54:0) after 1m29s
[08:31:24.548] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:54:0)
[08:31:24.589] Build status: STARTED
[08:31:24.589] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:55:0) after 2m12s
[08:33:36.758] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:55:0)
[08:33:36.789] Build status: STARTED
[08:33:36.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:56:0) after 8m15s
[08:41:51.908] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:56:0)
[08:41:51.940] Build status: STARTED
[08:41:51.940] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:57:0) after 3m3s
[08:44:55.007] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:57:0)
[08:44:55.023] Build status: STARTED
[08:44:55.023] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:58:0) after 8m14s
[08:53:09.040] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:58:0)
[08:53:09.054] Build status: STARTED
[08:53:09.054] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:59:0) after 9m38s
[09:02:47.294] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:59:0)
[09:02:47.308] Build status: STARTED
[09:02:47.308] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:60:0) after 9m59s
[09:12:46.534] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:60:0)
[09:12:46.572] Build status: STARTED
[09:12:46.572] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8857253451355598768:61:0) after 2m29s
[09:12:52.170] Received PubSub notification, asking Buildbucket for the build status
[09:12:52.255] Build:
{
"id": "8691823389319528241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 587,
"createdBy": "project:chromium",
"createTime": "2026-01-24T04:18:13.074977197Z",
"startTime": "2026-01-24T04:18:18.581575933Z",
"endTime": "2026-01-24T09:12:51.780830792Z",
"updateTime": "2026-01-24T09:12:51.780830792Z",
"status": "FAILURE",
"input": {
},
"canary": true
}
[09:12:52.255] Invocation finished in 4h54m40.506837462s with status FAILED