[04:08:56.264] New invocation is queued and will start shortly
[04:09:00.580] Starting the invocation (attempt 1)
[04:09:00.625] Ignoring gitiles_ref tag without the buildset tag
[04:09:00.625] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:09:00.625] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:09:00.625] Buildbucket request:
{
"requestId": "8846110606960614848",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846110606960614848"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-ubsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:09:01.180] Scheduled build:
{
"id": "8680680541662779265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 688,
"createdBy": "project:chromium",
"createTime": "2026-05-27T04:09:00.696492874Z",
"updateTime": "2026-05-27T04:09:00.696492874Z",
"status": "SCHEDULED",
"input": {
}
}
[04:09:01.180] Task URL: https://cr-buildbucket.appspot.com/build/8680680541662779265
[04:09:01.180] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:2:0) after 1m23s
[04:09:02.099] Received PubSub notification, asking Buildbucket for the build status
[04:09:02.119] Build status: SCHEDULED
[04:10:24.264] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:2:0)
[04:10:24.291] Build status: SCHEDULED
[04:10:24.291] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:4:0) after 5m41s
[04:11:10.779] Received PubSub notification, asking Buildbucket for the build status
[04:11:10.800] Build status: STARTED
[04:16:05.292] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:4:0)
[04:16:05.309] Build status: STARTED
[04:16:05.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:6:0) after 5m27s
[04:21:32.322] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:6:0)
[04:21:32.341] Build status: STARTED
[04:21:32.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:7:0) after 7m46s
[04:29:18.354] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:7:0)
[04:29:18.372] Build status: STARTED
[04:29:18.372] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:8:0) after 2m48s
[04:32:06.409] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:8:0)
[04:32:06.430] Build status: STARTED
[04:32:06.430] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:9:0) after 5m12s
[04:37:18.446] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:9:0)
[04:37:18.535] Build status: STARTED
[04:37:18.535] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:10:0) after 9m48s
[04:47:06.547] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:10:0)
[04:47:06.567] Build status: STARTED
[04:47:06.567] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:11:0) after 4m16s
[04:51:22.581] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:11:0)
[04:51:22.609] Build status: STARTED
[04:51:22.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:12:0) after 2m4s
[04:53:26.642] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:12:0)
[04:53:26.700] Build status: STARTED
[04:53:26.700] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:13:0) after 3m56s
[04:57:22.725] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:13:0)
[04:57:22.759] Build status: STARTED
[04:57:22.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:14:0) after 5m51s
[05:03:13.790] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:14:0)
[05:03:13.832] Build status: STARTED
[05:03:13.832] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:15:0) after 4m40s
[05:07:53.954] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:15:0)
[05:07:53.972] Build status: STARTED
[05:07:53.972] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:16:0) after 3m9s
[05:11:02.987] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:16:0)
[05:11:03.017] Build status: STARTED
[05:11:03.017] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:17:0) after 3m31s
[05:14:34.045] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:17:0)
[05:14:34.090] Build status: STARTED
[05:14:34.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:18:0) after 5m39s
[05:20:13.121] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:18:0)
[05:20:13.140] Build status: STARTED
[05:20:13.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:19:0) after 9m14s
[05:29:27.192] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:19:0)
[05:29:27.212] Build status: STARTED
[05:29:27.212] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:20:0) after 8m25s
[05:37:52.228] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:20:0)
[05:37:52.249] Build status: STARTED
[05:37:52.249] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:21:0) after 6m9s
[05:44:01.314] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:21:0)
[05:44:01.336] Build status: STARTED
[05:44:01.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:22:0) after 8m26s
[05:52:27.487] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:22:0)
[05:52:27.504] Build status: STARTED
[05:52:27.504] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:23:0) after 9m15s
[06:01:42.518] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:23:0)
[06:01:42.543] Build status: STARTED
[06:01:42.543] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:24:0) after 7m27s
[06:09:09.617] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:24:0)
[06:09:09.644] Build status: STARTED
[06:09:09.644] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:25:0) after 6m23s
[06:15:32.712] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:25:0)
[06:15:32.750] Build status: STARTED
[06:15:32.750] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:26:0) after 5m40s
[06:21:12.770] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:26:0)
[06:21:12.803] Build status: STARTED
[06:21:12.803] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:27:0) after 8m42s
[06:29:54.870] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:27:0)
[06:29:54.887] Build status: STARTED
[06:29:54.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:28:0) after 2m12s
[06:32:07.007] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:28:0)
[06:32:07.079] Build status: STARTED
[06:32:07.079] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:29:0) after 3m0s
[06:35:07.098] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:29:0)
[06:35:07.116] Build status: STARTED
[06:35:07.116] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:30:0) after 2m14s
[06:37:21.107] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:30:0)
[06:37:21.129] Build status: STARTED
[06:37:21.129] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:31:0) after 5m45s
[06:43:06.144] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:31:0)
[06:43:06.162] Build status: STARTED
[06:43:06.162] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:32:0) after 2m35s
[06:45:41.179] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:32:0)
[06:45:41.199] Build status: STARTED
[06:45:41.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:33:0) after 5m30s
[06:51:11.217] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:33:0)
[06:51:11.329] Build status: STARTED
[06:51:11.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:34:0) after 9m56s
[07:01:07.363] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:34:0)
[07:01:07.508] Build status: STARTED
[07:01:07.508] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:35:0) after 6m33s
[07:07:40.709] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:35:0)
[07:07:40.723] Build status: STARTED
[07:07:40.723] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:36:0) after 1m1s
[07:08:41.738] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:36:0)
[07:08:41.762] Build status: STARTED
[07:08:41.762] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:37:0) after 4m31s
[07:13:12.836] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:37:0)
[07:13:12.853] Build status: STARTED
[07:13:12.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:38:0) after 7m36s
[07:20:48.869] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:38:0)
[07:20:48.883] Build status: STARTED
[07:20:48.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:39:0) after 7m44s
[07:28:33.106] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:39:0)
[07:28:33.130] Build status: STARTED
[07:28:33.130] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:40:0) after 6m52s
[07:35:25.145] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:40:0)
[07:35:25.164] Build status: STARTED
[07:35:25.164] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:41:0) after 4m22s
[07:39:47.187] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:41:0)
[07:39:47.225] Build status: STARTED
[07:39:47.225] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:42:0) after 2m46s
[07:42:33.334] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:42:0)
[07:42:33.352] Build status: STARTED
[07:42:33.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:43:0) after 8m46s
[07:51:19.336] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:43:0)
[07:51:19.395] Build status: STARTED
[07:51:19.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:44:0) after 3m18s
[07:54:37.410] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:44:0)
[07:54:37.430] Build status: STARTED
[07:54:37.430] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:45:0) after 5m34s
[08:00:11.511] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:45:0)
[08:00:11.536] Build status: STARTED
[08:00:11.536] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:46:0) after 3m26s
[08:03:37.555] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:46:0)
[08:03:37.577] Build status: STARTED
[08:03:37.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:47:0) after 5m12s
[08:08:49.595] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:47:0)
[08:08:49.638] Build status: STARTED
[08:08:49.638] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:48:0) after 5m18s
[08:14:07.719] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:48:0)
[08:14:07.737] Build status: STARTED
[08:14:07.737] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:49:0) after 2m47s
[08:16:54.756] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:49:0)
[08:16:54.777] Build status: STARTED
[08:16:54.777] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:50:0) after 5m29s
[08:22:23.796] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:50:0)
[08:22:23.850] Build status: STARTED
[08:22:23.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:51:0) after 5m35s
[08:27:58.863] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:51:0)
[08:27:58.960] Build status: STARTED
[08:27:58.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:52:0) after 7m1s
[08:35:00.134] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:52:0)
[08:35:00.159] Build status: STARTED
[08:35:00.159] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:53:0) after 8m20s
[08:43:20.222] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:53:0)
[08:43:20.241] Build status: STARTED
[08:43:20.241] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:54:0) after 6m37s
[08:49:57.256] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:54:0)
[08:49:57.274] Build status: STARTED
[08:49:57.274] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:55:0) after 4m15s
[08:54:12.343] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:55:0)
[08:54:12.398] Build status: STARTED
[08:54:12.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:56:0) after 7m43s
[09:01:55.515] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:56:0)
[09:01:55.533] Build status: STARTED
[09:01:55.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:57:0) after 3m34s
[09:05:29.555] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:57:0)
[09:05:29.573] Build status: STARTED
[09:05:29.573] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:58:0) after 8m13s
[09:13:42.590] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:58:0)
[09:13:42.607] Build status: STARTED
[09:13:42.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:59:0) after 5m23s
[09:19:05.623] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:59:0)
[09:19:05.641] Build status: STARTED
[09:19:05.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:60:0) after 4m30s
[09:23:35.679] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:60:0)
[09:23:35.694] Build status: STARTED
[09:23:35.694] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:61:0) after 9m8s
[09:32:43.886] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:61:0)
[09:32:43.986] Build status: STARTED
[09:32:43.986] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:62:0) after 1m10s
[09:33:54.005] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:62:0)
[09:33:54.316] Build status: STARTED
[09:33:54.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:63:0) after 4m46s
[09:38:40.317] Handling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:63:0)
[09:38:40.443] Build status: STARTED
[09:38:40.443] Scheduling timer "check-buildbucket-build-status" (chromium/mac-ubsan-fyi-rel:8846110606960614848:64:0) after 8m39s
[09:39:59.863] Received PubSub notification, asking Buildbucket for the build status
[09:39:59.890] Build:
{
"id": "8680680541662779265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-ubsan-fyi-rel"
},
"number": 688,
"createdBy": "project:chromium",
"createTime": "2026-05-27T04:09:00.696492874Z",
"startTime": "2026-05-27T04:11:10.588771532Z",
"endTime": "2026-05-27T09:39:57.187931754Z",
"updateTime": "2026-05-27T09:39:57.187931754Z",
"status": "FAILURE",
"input": {
}
}
[09:39:59.890] Invocation finished in 5h31m3.629309111s with status FAILED