[04:00:09.762] New invocation is queued and will start shortly
[04:00:11.065] Starting the invocation (attempt 1)
[04:00:11.094] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/99ac532a592b86a1abcd6c4ff820f0ed95707a66"
[04:00:11.094] Popped gitiles commit info from properties and tags
[04:00:11.094] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:11.094] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:11.094] Buildbucket request:
{
"requestId": "8845114592409691504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99ac532a592b86a1abcd6c4ff820f0ed95707a66",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8845114592409691504"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:11.691] Scheduled build:
{
"id": "8679684530284690065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10525,
"createdBy": "project:chromium",
"createTime": "2026-06-07T04:00:11.166664582Z",
"updateTime": "2026-06-07T04:00:11.166664582Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99ac532a592b86a1abcd6c4ff820f0ed95707a66",
"ref": "refs/heads/main"
}
}
}
[04:00:11.691] Task URL: https://cr-buildbucket.appspot.com/build/8679684530284690065
[04:00:11.691] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:2:0) after 2m57s
[04:00:15.010] Received PubSub notification, asking Buildbucket for the build status
[04:00:15.025] Build status: SCHEDULED
[04:00:30.987] Received PubSub notification, asking Buildbucket for the build status
[04:00:31.010] Build status: STARTED
[04:03:08.726] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:2:0)
[04:03:08.748] Build status: STARTED
[04:03:08.748] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:5:0) after 8m51s
[04:11:59.765] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:5:0)
[04:11:59.831] Build status: STARTED
[04:11:59.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:6:0) after 6m18s
[04:18:17.862] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:6:0)
[04:18:17.886] Build status: STARTED
[04:18:17.886] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:7:0) after 7m20s
[04:25:37.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:7:0)
[04:25:37.941] Build status: STARTED
[04:25:37.941] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:8:0) after 4m16s
[04:29:53.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:8:0)
[04:29:53.974] Build status: STARTED
[04:29:53.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:9:0) after 8m19s
[04:38:12.973] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:9:0)
[04:38:13.031] Build status: STARTED
[04:38:13.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:10:0) after 2m51s
[04:41:04.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:10:0)
[04:41:04.199] Build status: STARTED
[04:41:04.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:11:0) after 5m45s
[04:46:49.231] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:11:0)
[04:46:49.257] Build status: STARTED
[04:46:49.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:12:0) after 5m59s
[04:52:48.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:12:0)
[04:52:48.307] Build status: STARTED
[04:52:48.307] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:13:0) after 1m57s
[04:54:45.320] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:13:0)
[04:54:45.336] Build status: STARTED
[04:54:45.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:14:0) after 6m0s
[05:00:45.355] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:14:0)
[05:00:45.373] Build status: STARTED
[05:00:45.373] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:15:0) after 7m22s
[05:08:07.517] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:15:0)
[05:08:07.604] Build status: STARTED
[05:08:07.604] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:16:0) after 8m39s
[05:16:46.840] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:16:0)
[05:16:46.854] Build status: STARTED
[05:16:46.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:17:0) after 8m6s
[05:24:53.014] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:17:0)
[05:24:53.083] Build status: STARTED
[05:24:53.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:18:0) after 5m34s
[05:30:27.112] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:18:0)
[05:30:27.136] Build status: STARTED
[05:30:27.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:19:0) after 5m32s
[05:35:59.174] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:19:0)
[05:35:59.198] Build status: STARTED
[05:35:59.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:20:0) after 5m4s
[05:41:03.220] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:20:0)
[05:41:03.237] Build status: STARTED
[05:41:03.237] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:21:0) after 7m23s
[05:48:26.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:21:0)
[05:48:26.292] Build status: STARTED
[05:48:26.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:22:0) after 3m7s
[05:51:33.462] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:22:0)
[05:51:33.480] Build status: STARTED
[05:51:33.480] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:23:0) after 6m36s
[05:58:09.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:23:0)
[05:58:09.512] Build status: STARTED
[05:58:09.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:24:0) after 2m14s
[06:00:23.658] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:24:0)
[06:00:23.775] Build status: STARTED
[06:00:23.775] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:25:0) after 4m55s
[06:05:18.790] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:25:0)
[06:05:18.871] Build status: STARTED
[06:05:18.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:26:0) after 4m6s
[06:09:25.096] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:26:0)
[06:09:25.111] Build status: STARTED
[06:09:25.111] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:27:0) after 5m46s
[06:15:11.129] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:27:0)
[06:15:11.153] Build status: STARTED
[06:15:11.153] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:28:0) after 2m41s
[06:17:52.170] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:28:0)
[06:17:52.192] Build status: STARTED
[06:17:52.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:29:0) after 7m40s
[06:25:32.414] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:29:0)
[06:25:32.433] Build status: STARTED
[06:25:32.433] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:30:0) after 4m19s
[06:29:51.652] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:30:0)
[06:29:51.669] Build status: STARTED
[06:29:51.669] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:31:0) after 9m35s
[06:39:26.684] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:31:0)
[06:39:26.699] Build status: STARTED
[06:39:26.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:32:0) after 6m0s
[06:45:26.759] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:32:0)
[06:45:26.778] Build status: STARTED
[06:45:26.778] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:33:0) after 1m25s
[06:46:51.795] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:33:0)
[06:46:51.815] Build status: STARTED
[06:46:51.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:34:0) after 3m6s
[06:49:57.833] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:34:0)
[06:49:57.858] Build status: STARTED
[06:49:57.858] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:35:0) after 5m27s
[06:55:24.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:35:0)
[06:55:24.968] Build status: STARTED
[06:55:24.968] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:36:0) after 5m28s
[07:00:53.631] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:36:0)
[07:00:53.647] Build status: STARTED
[07:00:53.647] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:37:0) after 3m14s
[07:04:07.667] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:37:0)
[07:04:07.707] Build status: STARTED
[07:04:07.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:38:0) after 7m8s
[07:11:15.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:38:0)
[07:11:15.866] Build status: STARTED
[07:11:15.866] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:39:0) after 1m19s
[07:12:34.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:39:0)
[07:12:34.921] Build status: STARTED
[07:12:34.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:40:0) after 5m58s
[07:18:33.163] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:40:0)
[07:18:33.184] Build status: STARTED
[07:18:33.184] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:41:0) after 3m10s
[07:21:43.298] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:41:0)
[07:21:43.324] Build status: STARTED
[07:21:43.324] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:42:0) after 2m58s
[07:24:41.869] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:42:0)
[07:24:41.892] Build status: STARTED
[07:24:41.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:43:0) after 1m58s
[07:26:40.111] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:43:0)
[07:26:40.149] Build status: STARTED
[07:26:40.149] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:44:0) after 7m54s
[07:34:34.165] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:44:0)
[07:34:34.214] Build status: STARTED
[07:34:34.214] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:45:0) after 9m31s
[07:44:05.335] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:45:0)
[07:44:05.352] Build status: STARTED
[07:44:05.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:46:0) after 4m20s
[07:48:25.476] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:46:0)
[07:48:25.499] Build status: STARTED
[07:48:25.499] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:47:0) after 4m52s
[07:53:17.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:47:0)
[07:53:17.533] Build status: STARTED
[07:53:17.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:48:0) after 8m55s
[08:02:12.733] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:48:0)
[08:02:12.751] Build status: STARTED
[08:02:12.751] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:49:0) after 7m49s
[08:10:01.796] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:49:0)
[08:10:01.818] Build status: STARTED
[08:10:01.818] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:50:0) after 3m7s
[08:13:08.859] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:50:0)
[08:13:08.882] Build status: STARTED
[08:13:08.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:51:0) after 4m1s
[08:17:09.897] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:51:0)
[08:17:09.912] Build status: STARTED
[08:17:09.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:52:0) after 5m3s
[08:22:12.960] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:52:0)
[08:22:13.157] Build status: STARTED
[08:22:13.157] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:53:0) after 5m59s
[08:28:12.398] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:53:0)
[08:28:12.421] Build status: STARTED
[08:28:12.421] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:54:0) after 6m29s
[08:34:41.440] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:54:0)
[08:34:41.464] Build status: STARTED
[08:34:41.464] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:55:0) after 1m45s
[08:36:26.507] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:55:0)
[08:36:26.546] Build status: STARTED
[08:36:26.546] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:56:0) after 4m55s
[08:41:21.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:56:0)
[08:41:21.683] Build status: STARTED
[08:41:21.683] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:57:0) after 3m8s
[08:44:29.860] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:57:0)
[08:44:29.880] Build status: STARTED
[08:44:29.880] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:58:0) after 1m41s
[08:46:10.953] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:58:0)
[08:46:11.031] Build status: STARTED
[08:46:11.031] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845114592409691504:59:0) after 4m25s
[08:48:25.400] Received PubSub notification, asking Buildbucket for the build status
[08:48:25.431] Build:
{
"id": "8679684530284690065",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10525,
"createdBy": "project:chromium",
"createTime": "2026-06-07T04:00:11.166664582Z",
"startTime": "2026-06-07T04:00:25.749177992Z",
"endTime": "2026-06-07T08:48:24.987752072Z",
"updateTime": "2026-06-07T08:48:24.987752072Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "99ac532a592b86a1abcd6c4ff820f0ed95707a66",
"ref": "refs/heads/main"
}
}
}
[08:48:25.431] Invocation finished in 4h48m15.675392038s with status FAILED