[02:09:58.595] New invocation is queued and will start shortly
[02:09:59.693] Starting the invocation (attempt 1)
[02:09:59.713] Ignoring gitiles_ref tag without the buildset tag
[02:09:59.713] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:09:59.713] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:09:59.714] Buildbucket request:
{
"requestId": "8851463312368010896",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851463312368010896"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:10:00.329] Scheduled build:
{
"id": "8686033250493929569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 640,
"createdBy": "project:chromium",
"createTime": "2026-03-29T02:09:59.761646658Z",
"updateTime": "2026-03-29T02:09:59.761646658Z",
"status": "SCHEDULED",
"input": {
}
}
[02:10:00.329] Task URL: https://cr-buildbucket.appspot.com/build/8686033250493929569
[02:10:00.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:2:0) after 6m39s
[02:10:01.220] Received PubSub notification, asking Buildbucket for the build status
[02:10:01.240] Build status: SCHEDULED
[02:12:11.786] Received PubSub notification, asking Buildbucket for the build status
[02:12:11.836] Build status: STARTED
[02:16:39.391] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:2:0)
[02:16:39.417] Build status: STARTED
[02:16:39.417] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:5:0) after 1m31s
[02:18:10.437] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:5:0)
[02:18:10.469] Build status: STARTED
[02:18:10.469] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:6:0) after 4m10s
[02:22:20.529] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:6:0)
[02:22:20.641] Build status: STARTED
[02:22:20.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:7:0) after 7m35s
[02:29:55.780] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:7:0)
[02:29:55.828] Build status: STARTED
[02:29:55.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:8:0) after 8m25s
[02:38:20.919] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:8:0)
[02:38:20.942] Build status: STARTED
[02:38:20.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:9:0) after 7m23s
[02:45:44.406] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:9:0)
[02:45:44.444] Build status: STARTED
[02:45:44.444] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:10:0) after 5m11s
[02:50:55.458] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:10:0)
[02:50:55.563] Build status: STARTED
[02:50:55.563] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:11:0) after 3m24s
[02:54:19.656] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:11:0)
[02:54:19.674] Build status: STARTED
[02:54:19.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:12:0) after 6m52s
[03:01:11.732] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:12:0)
[03:01:11.753] Build status: STARTED
[03:01:11.753] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:13:0) after 2m37s
[03:03:48.909] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:13:0)
[03:03:48.926] Build status: STARTED
[03:03:48.926] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:14:0) after 6m50s
[03:10:39.275] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:14:0)
[03:10:39.295] Build status: STARTED
[03:10:39.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:15:0) after 7m0s
[03:17:39.308] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:15:0)
[03:17:39.506] Build status: STARTED
[03:17:39.506] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:16:0) after 1m2s
[03:18:41.883] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:16:0)
[03:18:41.925] Build status: STARTED
[03:18:41.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:17:0) after 1m55s
[03:20:37.012] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:17:0)
[03:20:37.036] Build status: STARTED
[03:20:37.037] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:18:0) after 5m13s
[03:25:50.052] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:18:0)
[03:25:50.078] Build status: STARTED
[03:25:50.078] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:19:0) after 6m21s
[03:32:11.208] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:19:0)
[03:32:11.237] Build status: STARTED
[03:32:11.238] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:20:0) after 4m14s
[03:36:25.253] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:20:0)
[03:36:25.270] Build status: STARTED
[03:36:25.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:21:0) after 8m17s
[03:44:42.288] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:21:0)
[03:44:42.368] Build status: STARTED
[03:44:42.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:22:0) after 5m21s
[03:50:03.384] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:22:0)
[03:50:03.399] Build status: STARTED
[03:50:03.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:23:0) after 4m42s
[03:54:45.618] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:23:0)
[03:54:45.635] Build status: STARTED
[03:54:45.635] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:24:0) after 1m43s
[03:56:28.648] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:24:0)
[03:56:28.666] Build status: STARTED
[03:56:28.667] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:25:0) after 1m44s
[03:58:12.882] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:25:0)
[03:58:12.900] Build status: STARTED
[03:58:12.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:26:0) after 6m14s
[04:04:27.181] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:26:0)
[04:04:27.202] Build status: STARTED
[04:04:27.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:27:0) after 1m14s
[04:05:41.240] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:27:0)
[04:05:41.398] Build status: STARTED
[04:05:41.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:28:0) after 7m7s
[04:12:48.493] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:28:0)
[04:12:48.525] Build status: STARTED
[04:12:48.525] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:29:0) after 6m59s
[04:19:47.666] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:29:0)
[04:19:47.686] Build status: STARTED
[04:19:47.686] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:30:0) after 7m27s
[04:27:14.884] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:30:0)
[04:27:14.898] Build status: STARTED
[04:27:14.898] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:31:0) after 7m58s
[04:35:12.913] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:31:0)
[04:35:12.996] Build status: STARTED
[04:35:12.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:32:0) after 8m44s
[04:43:57.012] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:32:0)
[04:43:57.068] Build status: STARTED
[04:43:57.069] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:33:0) after 5m56s
[04:49:53.085] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:33:0)
[04:49:53.105] Build status: STARTED
[04:49:53.105] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:34:0) after 1m23s
[04:51:16.170] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:34:0)
[04:51:16.190] Build status: STARTED
[04:51:16.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:35:0) after 6m45s
[04:58:01.164] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:35:0)
[04:58:01.182] Build status: STARTED
[04:58:01.182] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:36:0) after 4m12s
[05:02:13.243] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:36:0)
[05:02:13.268] Build status: STARTED
[05:02:13.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:37:0) after 6m42s
[05:08:55.289] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:37:0)
[05:08:55.343] Build status: STARTED
[05:08:55.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:38:0) after 9m5s
[05:18:00.444] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:38:0)
[05:18:00.460] Build status: STARTED
[05:18:00.460] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:39:0) after 5m38s
[05:23:38.527] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:39:0)
[05:23:38.614] Build status: STARTED
[05:23:38.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:40:0) after 7m34s
[05:31:12.627] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:40:0)
[05:31:12.662] Build status: STARTED
[05:31:12.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:41:0) after 5m20s
[05:36:32.686] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:41:0)
[05:36:32.759] Build status: STARTED
[05:36:32.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:42:0) after 3m4s
[05:39:37.212] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:42:0)
[05:39:37.228] Build status: STARTED
[05:39:37.228] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:43:0) after 2m42s
[05:42:19.244] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:43:0)
[05:42:19.266] Build status: STARTED
[05:42:19.266] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:44:0) after 6m3s
[05:48:22.284] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:44:0)
[05:48:22.306] Build status: STARTED
[05:48:22.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:45:0) after 4m6s
[05:52:28.421] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:45:0)
[05:52:28.447] Build status: STARTED
[05:52:28.447] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:46:0) after 5m12s
[05:57:40.460] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:46:0)
[05:57:40.510] Build status: STARTED
[05:57:40.510] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:47:0) after 8m25s
[06:06:05.628] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:47:0)
[06:06:05.647] Build status: STARTED
[06:06:05.647] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:48:0) after 9m5s
[06:15:11.125] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:48:0)
[06:15:11.148] Build status: STARTED
[06:15:11.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:49:0) after 9m52s
[06:25:03.317] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:49:0)
[06:25:03.338] Build status: STARTED
[06:25:03.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:50:0) after 1m47s
[06:26:50.786] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:50:0)
[06:26:50.807] Build status: STARTED
[06:26:50.807] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:51:0) after 2m36s
[06:29:27.141] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:51:0)
[06:29:27.158] Build status: STARTED
[06:29:27.158] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:52:0) after 2m14s
[06:31:41.176] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:52:0)
[06:31:41.192] Build status: STARTED
[06:31:41.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:53:0) after 8m10s
[06:39:51.438] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:53:0)
[06:39:51.458] Build status: STARTED
[06:39:51.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:54:0) after 7m6s
[06:46:57.522] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:54:0)
[06:46:57.538] Build status: STARTED
[06:46:57.538] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:55:0) after 4m6s
[06:51:03.554] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:55:0)
[06:51:03.571] Build status: STARTED
[06:51:03.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:56:0) after 2m16s
[06:53:19.916] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:56:0)
[06:53:19.932] Build status: STARTED
[06:53:19.932] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:57:0) after 7m43s
[07:01:03.268] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:57:0)
[07:01:03.284] Build status: STARTED
[07:01:03.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:58:0) after 8m57s
[07:10:00.405] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:58:0)
[07:10:00.420] Build status: STARTED
[07:10:00.420] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8851463312368010896:59:0) after 8m58s
[07:16:08.614] Received PubSub notification, asking Buildbucket for the build status
[07:16:08.632] Build:
{
"id": "8686033250493929569",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 640,
"createdBy": "project:chromium",
"createTime": "2026-03-29T02:09:59.761646658Z",
"startTime": "2026-03-29T02:12:11.161062573Z",
"endTime": "2026-03-29T07:16:07.093087436Z",
"updateTime": "2026-03-29T07:16:07.093087436Z",
"status": "FAILURE",
"input": {
}
}
[07:16:08.632] Invocation finished in 5h6m10.041340892s with status FAILED