[04:00:06.564] New invocation is queued and will start shortly
[04:00:08.074] Starting the invocation (attempt 1)
[04:00:08.100] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/03585eaf196f0afec1f5e3be9791c3939121ac52"
[04:00:08.100] Popped gitiles commit info from properties and tags
[04:00:08.100] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:08.101] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:08.101] Buildbucket request:
{
"requestId": "8844933401845546416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "03585eaf196f0afec1f5e3be9791c3939121ac52",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8844933401845546416"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:08.728] Scheduled build:
{
"id": "8679503339458787537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10527,
"createdBy": "project:chromium",
"createTime": "2026-06-09T04:00:08.203312166Z",
"updateTime": "2026-06-09T04:00:08.203312166Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "03585eaf196f0afec1f5e3be9791c3939121ac52",
"ref": "refs/heads/main"
}
}
}
[04:00:08.728] Task URL: https://cr-buildbucket.appspot.com/build/8679503339458787537
[04:00:08.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:2:0) after 7m23s
[04:00:09.702] Received PubSub notification, asking Buildbucket for the build status
[04:00:09.725] Build status: SCHEDULED
[04:00:12.324] Received PubSub notification, asking Buildbucket for the build status
[04:00:12.353] Build status: STARTED
[04:07:31.759] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:2:0)
[04:07:31.785] Build status: STARTED
[04:07:31.785] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:5:0) after 1m53s
[04:09:24.792] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:5:0)
[04:09:24.811] Build status: STARTED
[04:09:24.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:6:0) after 6m4s
[04:15:28.861] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:6:0)
[04:15:28.898] Build status: STARTED
[04:15:28.899] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:7:0) after 9m4s
[04:24:32.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:7:0)
[04:24:32.942] Build status: STARTED
[04:24:32.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:8:0) after 8m16s
[04:32:49.043] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:8:0)
[04:32:49.098] Build status: STARTED
[04:32:49.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:9:0) after 7m34s
[04:40:23.118] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:9:0)
[04:40:23.152] Build status: STARTED
[04:40:23.152] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:10:0) after 8m35s
[04:48:58.218] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:10:0)
[04:48:58.273] Build status: STARTED
[04:48:58.273] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:11:0) after 8m50s
[04:57:48.250] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:11:0)
[04:57:48.272] Build status: STARTED
[04:57:48.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:12:0) after 4m52s
[05:02:40.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:12:0)
[05:02:40.434] Build status: STARTED
[05:02:40.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:13:0) after 1m38s
[05:04:18.500] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:13:0)
[05:04:18.519] Build status: STARTED
[05:04:18.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:14:0) after 8m2s
[05:12:20.537] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:14:0)
[05:12:20.574] Build status: STARTED
[05:12:20.574] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:15:0) after 2m57s
[05:15:17.627] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:15:0)
[05:15:17.641] Build status: STARTED
[05:15:17.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:16:0) after 4m20s
[05:19:37.743] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:16:0)
[05:19:37.758] Build status: STARTED
[05:19:37.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:17:0) after 2m36s
[05:22:13.846] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:17:0)
[05:22:13.866] Build status: STARTED
[05:22:13.866] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:18:0) after 3m38s
[05:25:51.908] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:18:0)
[05:25:51.925] Build status: STARTED
[05:25:51.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:19:0) after 1m29s
[05:27:20.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:19:0)
[05:27:21.027] Build status: STARTED
[05:27:21.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:20:0) after 7m0s
[05:34:21.037] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:20:0)
[05:34:21.111] Build status: STARTED
[05:34:21.111] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:21:0) after 4m38s
[05:38:59.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:21:0)
[05:38:59.204] Build status: STARTED
[05:38:59.204] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:22:0) after 6m46s
[05:45:45.223] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:22:0)
[05:45:45.249] Build status: STARTED
[05:45:45.249] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:23:0) after 3m33s
[05:49:18.266] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:23:0)
[05:49:18.281] Build status: STARTED
[05:49:18.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:24:0) after 9m41s
[05:58:59.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:24:0)
[05:58:59.304] Build status: STARTED
[05:58:59.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:25:0) after 4m19s
[06:03:18.376] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:25:0)
[06:03:18.394] Build status: STARTED
[06:03:18.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:26:0) after 8m44s
[06:12:02.410] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:26:0)
[06:12:02.426] Build status: STARTED
[06:12:02.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:27:0) after 8m40s
[06:20:42.514] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:27:0)
[06:20:42.526] Build status: STARTED
[06:20:42.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:28:0) after 7m1s
[06:27:43.540] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:28:0)
[06:27:43.577] Build status: STARTED
[06:27:43.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:29:0) after 1m0s
[06:28:43.565] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:29:0)
[06:28:43.583] Build status: STARTED
[06:28:43.583] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:30:0) after 1m2s
[06:29:45.731] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:30:0)
[06:29:45.756] Build status: STARTED
[06:29:45.756] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:31:0) after 4m51s
[06:34:36.771] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:31:0)
[06:34:36.851] Build status: STARTED
[06:34:36.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:32:0) after 2m51s
[06:37:27.867] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:32:0)
[06:37:27.891] Build status: STARTED
[06:37:27.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:33:0) after 8m55s
[06:46:23.094] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:33:0)
[06:46:23.113] Build status: STARTED
[06:46:23.113] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:34:0) after 5m0s
[06:51:23.103] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:34:0)
[06:51:23.128] Build status: STARTED
[06:51:23.128] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:35:0) after 8m48s
[07:00:11.143] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:35:0)
[07:00:11.158] Build status: STARTED
[07:00:11.158] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:36:0) after 8m43s
[07:08:54.234] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:36:0)
[07:08:54.253] Build status: STARTED
[07:08:54.253] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:37:0) after 1m46s
[07:10:40.288] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:37:0)
[07:10:40.321] Build status: STARTED
[07:10:40.321] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:38:0) after 3m14s
[07:13:54.327] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:38:0)
[07:13:54.367] Build status: STARTED
[07:13:54.367] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:39:0) after 5m24s
[07:19:18.383] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:39:0)
[07:19:18.435] Build status: STARTED
[07:19:18.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:40:0) after 6m38s
[07:25:56.501] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:40:0)
[07:25:56.524] Build status: STARTED
[07:25:56.524] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:41:0) after 6m13s
[07:32:09.591] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:41:0)
[07:32:09.620] Build status: STARTED
[07:32:09.620] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:42:0) after 3m0s
[07:35:09.633] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:42:0)
[07:35:09.653] Build status: STARTED
[07:35:09.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:43:0) after 7m55s
[07:43:04.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:43:0)
[07:43:04.696] Build status: STARTED
[07:43:04.696] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:44:0) after 1m8s
[07:44:12.715] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:44:0)
[07:44:12.736] Build status: STARTED
[07:44:12.736] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:45:0) after 4m45s
[07:48:57.761] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:45:0)
[07:48:57.778] Build status: STARTED
[07:48:57.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:46:0) after 4m11s
[07:53:08.837] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:46:0)
[07:53:08.850] Build status: STARTED
[07:53:08.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:47:0) after 3m7s
[07:56:15.869] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:47:0)
[07:56:15.886] Build status: STARTED
[07:56:15.886] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:48:0) after 8m27s
[08:04:42.916] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:48:0)
[08:04:42.934] Build status: STARTED
[08:04:42.934] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:49:0) after 1m4s
[08:05:46.947] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:49:0)
[08:05:46.978] Build status: STARTED
[08:05:46.978] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:50:0) after 7m14s
[08:13:00.999] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:50:0)
[08:13:01.064] Build status: STARTED
[08:13:01.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:51:0) after 2m59s
[08:16:00.030] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:51:0)
[08:16:00.056] Build status: STARTED
[08:16:00.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:52:0) after 9m26s
[08:25:26.130] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:52:0)
[08:25:26.222] Build status: STARTED
[08:25:26.222] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:53:0) after 6m36s
[08:32:02.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:53:0)
[08:32:02.288] Build status: STARTED
[08:32:02.288] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:54:0) after 4m44s
[08:36:46.362] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:54:0)
[08:36:46.387] Build status: STARTED
[08:36:46.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:55:0) after 5m43s
[08:42:29.409] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:55:0)
[08:42:29.429] Build status: STARTED
[08:42:29.432] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:56:0) after 9m58s
[08:52:27.447] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:56:0)
[08:52:27.486] Build status: STARTED
[08:52:27.486] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:57:0) after 2m41s
[08:55:08.501] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:57:0)
[08:55:08.562] Build status: STARTED
[08:55:08.562] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8844933401845546416:58:0) after 3m3s
[08:56:10.228] Received PubSub notification, asking Buildbucket for the build status
[08:56:10.271] Build:
{
"id": "8679503339458787537",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10527,
"createdBy": "project:chromium",
"createTime": "2026-06-09T04:00:08.203312166Z",
"startTime": "2026-06-09T04:00:12.174432300Z",
"endTime": "2026-06-09T08:56:09.813836391Z",
"updateTime": "2026-06-09T08:56:09.813836391Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "03585eaf196f0afec1f5e3be9791c3939121ac52",
"ref": "refs/heads/main"
}
}
}
[08:56:10.271] Invocation finished in 4h56m3.727212756s with status FAILED