[04:00:06.057] New invocation is queued and will start shortly
[04:00:07.136] Starting the invocation (attempt 1)
[04:00:07.160] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/548280b703df84574e28cb89e596fed504b440ef"
[04:00:07.160] Popped gitiles commit info from properties and tags
[04:00:07.160] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.161] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.161] Buildbucket request:
{
"requestId": "8860334886649352432",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "548280b703df84574e28cb89e596fed504b440ef",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8860334886649352432"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:07.578] Scheduled build:
{
"id": "8694904824789028305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10357,
"createdBy": "project:chromium",
"createTime": "2025-12-21T04:00:07.209946277Z",
"updateTime": "2025-12-21T04:00:07.209946277Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "548280b703df84574e28cb89e596fed504b440ef",
"ref": "refs/heads/main"
}
}
}
[04:00:07.578] Task URL: https://cr-buildbucket.appspot.com/build/8694904824789028305
[04:00:07.578] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:2:0) after 1m35s
[04:00:09.948] Received PubSub notification, asking Buildbucket for the build status
[04:00:09.975] Build status: SCHEDULED
[04:00:20.181] Received PubSub notification, asking Buildbucket for the build status
[04:00:20.196] Build status: STARTED
[04:01:42.598] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:2:0)
[04:01:42.651] Build status: STARTED
[04:01:42.651] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:5:0) after 7m36s
[04:09:18.667] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:5:0)
[04:09:18.681] Build status: STARTED
[04:09:18.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:6:0) after 6m33s
[04:15:51.803] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:6:0)
[04:15:51.841] Build status: STARTED
[04:15:51.841] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:7:0) after 5m57s
[04:21:49.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:7:0)
[04:21:49.100] Build status: STARTED
[04:21:49.100] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:8:0) after 9m21s
[04:31:10.253] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:8:0)
[04:31:10.267] Build status: STARTED
[04:31:10.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:9:0) after 2m54s
[04:34:04.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:9:0)
[04:34:04.299] Build status: STARTED
[04:34:04.299] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:10:0) after 2m0s
[04:36:04.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:10:0)
[04:36:04.327] Build status: STARTED
[04:36:04.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:11:0) after 7m50s
[04:43:54.300] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:11:0)
[04:43:54.320] Build status: STARTED
[04:43:54.320] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:12:0) after 2m8s
[04:46:02.585] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:12:0)
[04:46:02.608] Build status: STARTED
[04:46:02.608] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:13:0) after 6m11s
[04:52:13.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:13:0)
[04:52:13.743] Build status: STARTED
[04:52:13.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:14:0) after 7m38s
[04:59:51.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:14:0)
[04:59:51.776] Build status: STARTED
[04:59:51.776] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:15:0) after 3m21s
[05:03:12.789] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:15:0)
[05:03:12.803] Build status: STARTED
[05:03:12.803] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:16:0) after 2m55s
[05:06:07.815] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:16:0)
[05:06:07.839] Build status: STARTED
[05:06:07.839] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:17:0) after 9m22s
[05:15:29.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:17:0)
[05:15:29.828] Build status: STARTED
[05:15:29.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:18:0) after 5m57s
[05:21:26.843] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:18:0)
[05:21:26.874] Build status: STARTED
[05:21:26.874] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:19:0) after 5m14s
[05:26:40.887] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:19:0)
[05:26:40.920] Build status: STARTED
[05:26:40.920] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:20:0) after 2m45s
[05:29:26.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:20:0)
[05:29:26.030] Build status: STARTED
[05:29:26.031] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:21:0) after 5m53s
[05:35:19.049] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:21:0)
[05:35:19.065] Build status: STARTED
[05:35:19.065] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:22:0) after 8m1s
[05:43:20.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:22:0)
[05:43:20.097] Build status: STARTED
[05:43:20.097] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:23:0) after 2m39s
[05:45:59.116] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:23:0)
[05:45:59.130] Build status: STARTED
[05:45:59.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:24:0) after 5m39s
[05:51:38.248] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:24:0)
[05:51:38.267] Build status: STARTED
[05:51:38.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:25:0) after 9m24s
[06:01:02.285] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:25:0)
[06:01:02.302] Build status: STARTED
[06:01:02.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:26:0) after 2m34s
[06:03:36.328] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:26:0)
[06:03:36.376] Build status: STARTED
[06:03:36.376] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:27:0) after 7m51s
[06:11:27.388] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:27:0)
[06:11:27.405] Build status: STARTED
[06:11:27.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:28:0) after 1m4s
[06:12:31.419] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:28:0)
[06:12:31.446] Build status: STARTED
[06:12:31.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:29:0) after 3m4s
[06:15:35.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:29:0)
[06:15:35.499] Build status: STARTED
[06:15:35.499] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:30:0) after 7m47s
[06:23:22.536] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:30:0)
[06:23:22.596] Build status: STARTED
[06:23:22.596] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:31:0) after 6m38s
[06:30:00.609] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:31:0)
[06:30:00.636] Build status: STARTED
[06:30:00.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:32:0) after 5m55s
[06:35:55.648] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:32:0)
[06:35:55.662] Build status: STARTED
[06:35:55.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:33:0) after 9m22s
[06:45:17.676] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:33:0)
[06:45:17.690] Build status: STARTED
[06:45:17.690] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:34:0) after 4m52s
[06:50:09.806] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:34:0)
[06:50:09.929] Build status: STARTED
[06:50:09.929] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:35:0) after 9m31s
[06:59:40.944] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:35:0)
[06:59:41.010] Build status: STARTED
[06:59:41.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:36:0) after 4m30s
[07:04:11.028] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:36:0)
[07:04:11.108] Build status: STARTED
[07:04:11.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:37:0) after 7m58s
[07:12:09.268] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:37:0)
[07:12:09.284] Build status: STARTED
[07:12:09.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:38:0) after 4m28s
[07:16:37.256] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:38:0)
[07:16:37.271] Build status: STARTED
[07:16:37.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:39:0) after 1m29s
[07:18:06.381] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:39:0)
[07:18:06.393] Build status: STARTED
[07:18:06.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:40:0) after 4m19s
[07:22:25.492] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:40:0)
[07:22:25.509] Build status: STARTED
[07:22:25.509] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:41:0) after 8m14s
[07:30:39.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:41:0)
[07:30:39.536] Build status: STARTED
[07:30:39.536] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:42:0) after 7m57s
[07:38:36.828] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:42:0)
[07:38:36.843] Build status: STARTED
[07:38:36.843] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:43:0) after 4m6s
[07:42:42.847] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:43:0)
[07:42:42.869] Build status: STARTED
[07:42:42.869] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:44:0) after 2m16s
[07:44:58.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:44:0)
[07:44:58.927] Build status: STARTED
[07:44:58.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:45:0) after 2m42s
[07:47:41.061] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:45:0)
[07:47:41.076] Build status: STARTED
[07:47:41.076] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:46:0) after 2m14s
[07:49:55.134] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:46:0)
[07:49:55.148] Build status: STARTED
[07:49:55.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:47:0) after 4m22s
[07:54:17.388] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:47:0)
[07:54:17.409] Build status: STARTED
[07:54:17.409] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:48:0) after 7m36s
[08:01:53.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:48:0)
[08:01:53.543] Build status: STARTED
[08:01:53.543] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:49:0) after 9m59s
[08:11:52.557] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:49:0)
[08:11:52.587] Build status: STARTED
[08:11:52.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:50:0) after 8m11s
[08:20:03.601] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:50:0)
[08:20:03.637] Build status: STARTED
[08:20:03.637] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:51:0) after 1m39s
[08:21:42.710] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:51:0)
[08:21:42.733] Build status: STARTED
[08:21:42.733] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8860334886649352432:52:0) after 8m43s
[08:28:44.058] Received PubSub notification, asking Buildbucket for the build status
[08:28:44.071] Build:
{
"id": "8694904824789028305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10357,
"createdBy": "project:chromium",
"createTime": "2025-12-21T04:00:07.209946277Z",
"startTime": "2025-12-21T04:00:15.169032019Z",
"endTime": "2025-12-21T08:28:43.390955574Z",
"updateTime": "2025-12-21T08:28:43.390955574Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "548280b703df84574e28cb89e596fed504b440ef",
"ref": "refs/heads/main"
}
}
}
[08:28:44.071] Invocation finished in 4h28m38.018660887s with status FAILED