[04:00:16.637] New invocation is queued and will start shortly
[04:00:18.600] Starting the invocation (attempt 1)
[04:00:18.626] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/38a3b7e523c2e738ec80d0a77da92e691dc0b311"
[04:00:18.626] Popped gitiles commit info from properties and tags
[04:00:18.626] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:18.627] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:18.628] Buildbucket request:
{
"requestId": "8847470106328725456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38a3b7e523c2e738ec80d0a77da92e691dc0b311",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8847470106328725456"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:19.102] Scheduled build:
{
"id": "8682040043512990897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10499,
"createdBy": "project:chromium",
"createTime": "2026-05-12T04:00:18.699453266Z",
"updateTime": "2026-05-12T04:00:18.699453266Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38a3b7e523c2e738ec80d0a77da92e691dc0b311",
"ref": "refs/heads/main"
}
}
}
[04:00:19.102] Task URL: https://cr-buildbucket.appspot.com/build/8682040043512990897
[04:00:19.102] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:2:0) after 6m32s
[04:00:20.080] Received PubSub notification, asking Buildbucket for the build status
[04:00:20.097] Build status: SCHEDULED
[04:00:24.859] Received PubSub notification, asking Buildbucket for the build status
[04:00:24.879] Build status: STARTED
[04:06:51.208] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:2:0)
[04:06:51.235] Build status: STARTED
[04:06:51.235] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:5:0) after 6m53s
[04:13:44.251] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:5:0)
[04:13:44.281] Build status: STARTED
[04:13:44.281] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:6:0) after 5m18s
[04:19:02.319] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:6:0)
[04:19:02.337] Build status: STARTED
[04:19:02.337] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:7:0) after 7m54s
[04:26:56.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:7:0)
[04:26:56.330] Build status: STARTED
[04:26:56.330] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:8:0) after 2m21s
[04:29:17.343] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:8:0)
[04:29:17.360] Build status: STARTED
[04:29:17.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:9:0) after 4m11s
[04:33:28.421] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:9:0)
[04:33:28.440] Build status: STARTED
[04:33:28.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:10:0) after 6m23s
[04:39:51.450] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:10:0)
[04:39:51.477] Build status: STARTED
[04:39:51.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:11:0) after 5m51s
[04:45:42.473] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:11:0)
[04:45:42.562] Build status: STARTED
[04:45:42.562] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:12:0) after 2m47s
[04:48:29.575] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:12:0)
[04:48:29.595] Build status: STARTED
[04:48:29.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:13:0) after 3m54s
[04:52:23.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:13:0)
[04:52:23.630] Build status: STARTED
[04:52:23.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:14:0) after 5m40s
[04:58:03.697] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:14:0)
[04:58:03.713] Build status: STARTED
[04:58:03.713] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:15:0) after 9m3s
[05:07:06.751] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:15:0)
[05:07:06.772] Build status: STARTED
[05:07:06.772] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:16:0) after 4m40s
[05:11:46.834] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:16:0)
[05:11:46.850] Build status: STARTED
[05:11:46.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:17:0) after 5m47s
[05:17:33.918] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:17:0)
[05:17:34.002] Build status: STARTED
[05:17:34.002] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:18:0) after 1m56s
[05:19:30.032] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:18:0)
[05:19:30.059] Build status: STARTED
[05:19:30.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:19:0) after 8m5s
[05:27:35.214] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:19:0)
[05:27:35.230] Build status: STARTED
[05:27:35.230] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:20:0) after 1m28s
[05:29:03.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:20:0)
[05:29:03.312] Build status: STARTED
[05:29:03.312] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:21:0) after 7m29s
[05:36:32.328] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:21:0)
[05:36:32.357] Build status: STARTED
[05:36:32.357] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:22:0) after 1m39s
[05:38:11.373] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:22:0)
[05:38:11.396] Build status: STARTED
[05:38:11.396] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:23:0) after 6m56s
[05:45:07.460] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:23:0)
[05:45:07.484] Build status: STARTED
[05:45:07.484] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:24:0) after 7m7s
[05:52:14.516] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:24:0)
[05:52:14.537] Build status: STARTED
[05:52:14.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:25:0) after 1m14s
[05:53:28.606] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:25:0)
[05:53:28.627] Build status: STARTED
[05:53:28.627] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:26:0) after 3m0s
[05:56:28.653] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:26:0)
[05:56:28.730] Build status: STARTED
[05:56:28.730] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:27:0) after 9m46s
[06:06:14.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:27:0)
[06:06:14.790] Build status: STARTED
[06:06:14.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:28:0) after 7m21s
[06:13:35.887] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:28:0)
[06:13:35.906] Build status: STARTED
[06:13:35.906] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:29:0) after 1m13s
[06:14:48.992] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:29:0)
[06:14:49.010] Build status: STARTED
[06:14:49.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:30:0) after 8m40s
[06:23:29.183] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:30:0)
[06:23:29.198] Build status: STARTED
[06:23:29.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:31:0) after 4m46s
[06:28:15.214] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:31:0)
[06:28:15.232] Build status: STARTED
[06:28:15.232] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:32:0) after 1m37s
[06:29:52.222] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:32:0)
[06:29:52.245] Build status: STARTED
[06:29:52.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:33:0) after 8m1s
[06:37:53.336] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:33:0)
[06:37:53.356] Build status: STARTED
[06:37:53.356] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:34:0) after 2m28s
[06:40:21.385] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:34:0)
[06:40:21.462] Build status: STARTED
[06:40:21.462] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:35:0) after 7m19s
[06:47:40.499] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:35:0)
[06:47:40.519] Build status: STARTED
[06:47:40.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:36:0) after 7m41s
[06:55:21.574] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:36:0)
[06:55:21.593] Build status: STARTED
[06:55:21.593] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:37:0) after 9m41s
[07:05:02.603] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:37:0)
[07:05:02.647] Build status: STARTED
[07:05:02.648] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:38:0) after 2m41s
[07:07:43.662] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:38:0)
[07:07:43.710] Build status: STARTED
[07:07:43.710] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:39:0) after 1m6s
[07:08:49.787] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:39:0)
[07:08:49.803] Build status: STARTED
[07:08:49.830] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:40:0) after 4m12s
[07:13:01.847] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:40:0)
[07:13:01.904] Build status: STARTED
[07:13:01.904] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:41:0) after 3m18s
[07:16:19.918] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:41:0)
[07:16:19.938] Build status: STARTED
[07:16:19.938] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:42:0) after 3m41s
[07:20:00.953] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:42:0)
[07:20:00.968] Build status: STARTED
[07:20:00.968] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:43:0) after 9m7s
[07:29:08.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:43:0)
[07:29:08.185] Build status: STARTED
[07:29:08.185] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:44:0) after 2m51s
[07:31:59.202] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:44:0)
[07:31:59.218] Build status: STARTED
[07:31:59.218] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:45:0) after 6m52s
[07:38:51.236] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:45:0)
[07:38:51.254] Build status: STARTED
[07:38:51.254] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8847470106328725456:46:0) after 8m18s
[07:39:10.838] Received PubSub notification, asking Buildbucket for the build status
[07:39:10.854] Build:
{
"id": "8682040043512990897",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10499,
"createdBy": "project:chromium",
"createTime": "2026-05-12T04:00:18.699453266Z",
"startTime": "2026-05-12T04:00:24.716527794Z",
"endTime": "2026-05-12T07:39:10.430431961Z",
"updateTime": "2026-05-12T07:39:10.430431961Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "38a3b7e523c2e738ec80d0a77da92e691dc0b311",
"ref": "refs/heads/main"
}
}
}
[07:39:10.854] Invocation finished in 3h38m54.223425537s with status FAILED