[19:00:22.074] New invocation is queued and will start shortly
[19:00:23.153] Starting the invocation (attempt 1)
[19:00:23.179] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3ba6b8220b0eddd9f75132b5cee5e6cc88a25a16"
[19:00:23.180] Popped gitiles commit info from properties and tags
[19:00:23.180] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:00:23.180] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:00:23.180] Buildbucket request:
{
"requestId": "8835726468857136240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ba6b8220b0eddd9f75132b5cee5e6cc88a25a16",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835726468857136240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:00:24.960] Scheduled build:
{
"id": "8670296406970953697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93991,
"createdBy": "project:chromium",
"createTime": "2026-09-18T19:00:23.250102742Z",
"updateTime": "2026-09-18T19:00:23.250102742Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ba6b8220b0eddd9f75132b5cee5e6cc88a25a16",
"ref": "refs/heads/main"
}
}
}
[19:00:24.960] Task URL: https://cr-buildbucket.appspot.com/build/8670296406970953697
[19:00:24.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:2:0) after 8m7s
[19:00:40.517] Received PubSub notification, asking Buildbucket for the build status
[19:00:40.541] Build status: STARTED
[19:00:44.827] Received PubSub notification, asking Buildbucket for the build status
[19:00:44.851] Build status: STARTED
[19:08:31.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:2:0)
[19:08:32.010] Build status: STARTED
[19:08:32.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:5:0) after 3m33s
[19:12:05.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:5:0)
[19:12:05.051] Build status: STARTED
[19:12:05.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:6:0) after 1m39s
[19:13:44.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:6:0)
[19:13:44.105] Build status: STARTED
[19:13:44.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:7:0) after 4m27s
[19:18:11.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:7:0)
[19:18:11.159] Build status: STARTED
[19:18:11.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:8:0) after 6m19s
[19:24:30.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:8:0)
[19:24:30.200] Build status: STARTED
[19:24:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:9:0) after 6m55s
[19:31:25.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:9:0)
[19:31:25.267] Build status: STARTED
[19:31:25.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:10:0) after 7m43s
[19:39:08.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:10:0)
[19:39:08.361] Build status: STARTED
[19:39:08.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:11:0) after 1m31s
[19:40:39.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:11:0)
[19:40:39.405] Build status: STARTED
[19:40:39.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:12:0) after 8m18s
[19:48:57.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:12:0)
[19:48:57.459] Build status: STARTED
[19:48:57.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:13:0) after 3m0s
[19:51:57.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:13:0)
[19:51:57.520] Build status: STARTED
[19:51:57.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:14:0) after 8m13s
[20:00:10.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:14:0)
[20:00:10.541] Build status: STARTED
[20:00:10.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:15:0) after 8m27s
[20:08:37.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:15:0)
[20:08:37.663] Build status: STARTED
[20:08:37.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:16:0) after 1m42s
[20:10:19.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:16:0)
[20:10:19.718] Build status: STARTED
[20:10:19.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:17:0) after 1m53s
[20:12:12.798] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:17:0)
[20:12:12.829] Build status: STARTED
[20:12:12.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:18:0) after 2m47s
[20:15:00.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:18:0)
[20:15:00.035] Build status: STARTED
[20:15:00.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:19:0) after 6m23s
[20:21:23.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:19:0)
[20:21:23.085] Build status: STARTED
[20:21:23.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:20:0) after 9m18s
[20:30:41.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:20:0)
[20:30:41.209] Build status: STARTED
[20:30:41.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:21:0) after 5m9s
[20:35:50.224] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:21:0)
[20:35:50.244] Build status: STARTED
[20:35:50.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:22:0) after 8m12s
[20:44:02.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:22:0)
[20:44:02.556] Build status: STARTED
[20:44:02.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:23:0) after 7m9s
[20:51:11.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:23:0)
[20:51:11.692] Build status: STARTED
[20:51:11.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:24:0) after 9m55s
[21:01:06.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:24:0)
[21:01:06.982] Build status: STARTED
[21:01:06.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:25:0) after 6m33s
[21:07:40.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:25:0)
[21:07:40.199] Build status: STARTED
[21:07:40.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:26:0) after 4m15s
[21:11:55.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:26:0)
[21:11:55.310] Build status: STARTED
[21:11:55.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:27:0) after 7m14s
[21:19:09.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:27:0)
[21:19:09.380] Build status: STARTED
[21:19:09.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:28:0) after 9m6s
[21:28:15.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:28:0)
[21:28:15.425] Build status: STARTED
[21:28:15.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:29:0) after 5m46s
[21:34:01.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:29:0)
[21:34:01.504] Build status: STARTED
[21:34:01.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:30:0) after 1m2s
[21:35:03.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:30:0)
[21:35:03.716] Build status: STARTED
[21:35:03.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:31:0) after 9m35s
[21:44:38.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:31:0)
[21:44:38.763] Build status: STARTED
[21:44:38.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:32:0) after 4m0s
[21:48:38.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:32:0)
[21:48:38.796] Build status: STARTED
[21:48:38.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:33:0) after 2m50s
[21:51:28.861] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:33:0)
[21:51:28.875] Build status: STARTED
[21:51:28.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:34:0) after 1m4s
[21:52:33.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:34:0)
[21:52:33.080] Build status: STARTED
[21:52:33.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:35:0) after 3m27s
[21:56:00.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:35:0)
[21:56:00.251] Build status: STARTED
[21:56:00.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:36:0) after 5m35s
[22:01:35.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:36:0)
[22:01:35.255] Build status: STARTED
[22:01:35.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:37:0) after 1m20s
[22:02:55.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:37:0)
[22:02:55.470] Build status: STARTED
[22:02:55.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:38:0) after 5m19s
[22:08:14.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:38:0)
[22:08:14.468] Build status: STARTED
[22:08:14.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:39:0) after 1m28s
[22:09:42.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:39:0)
[22:09:42.565] Build status: STARTED
[22:09:42.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835726468857136240:40:0) after 7m53s
[22:17:14.893] Received PubSub notification, asking Buildbucket for the build status
[22:17:14.911] Build:
{
"id": "8670296406970953697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93991,
"createdBy": "project:chromium",
"createTime": "2026-09-18T19:00:23.250102742Z",
"startTime": "2026-09-18T19:00:28.695938941Z",
"endTime": "2026-09-18T22:17:14.634844047Z",
"updateTime": "2026-09-18T22:17:14.634844047Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ba6b8220b0eddd9f75132b5cee5e6cc88a25a16",
"ref": "refs/heads/main"
}
}
}
[22:17:14.911] Invocation finished in 3h16m52.842471244s with status FAILED