[01:37:13.064] New invocation is queued and will start shortly
[01:37:15.272] Starting the invocation (attempt 1)
[01:37:15.296] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fddd40bf102fe7738818a961af700e0098298f56"
[01:37:15.296] Popped gitiles commit info from properties and tags
[01:37:15.296] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:37:15.296] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:37:15.297] Buildbucket request:
{
"requestId": "8836335679990005632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fddd40bf102fe7738818a961af700e0098298f56",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836335679990005632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:37:15.800] Scheduled build:
{
"id": "8670905616926602817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93904,
"createdBy": "project:chromium",
"createTime": "2026-09-12T01:37:15.362031795Z",
"updateTime": "2026-09-12T01:37:15.362031795Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fddd40bf102fe7738818a961af700e0098298f56",
"ref": "refs/heads/main"
}
}
}
[01:37:15.800] Task URL: https://cr-buildbucket.appspot.com/build/8670905616926602817
[01:37:15.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:2:0) after 3m21s
[01:37:16.731] Received PubSub notification, asking Buildbucket for the build status
[01:37:16.750] Build status: SCHEDULED
[01:37:19.560] Received PubSub notification, asking Buildbucket for the build status
[01:37:19.583] Build status: STARTED
[01:40:36.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:2:0)
[01:40:36.956] Build status: STARTED
[01:40:36.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:5:0) after 9m30s
[01:50:06.972] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:5:0)
[01:50:06.992] Build status: STARTED
[01:50:06.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:6:0) after 8m58s
[01:59:05.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:6:0)
[01:59:05.101] Build status: STARTED
[01:59:05.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:7:0) after 9m2s
[02:08:07.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:7:0)
[02:08:07.192] Build status: STARTED
[02:08:07.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:8:0) after 3m43s
[02:11:50.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:8:0)
[02:11:50.202] Build status: STARTED
[02:11:50.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:9:0) after 9m18s
[02:21:08.332] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:9:0)
[02:21:08.473] Build status: STARTED
[02:21:08.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:10:0) after 6m46s
[02:27:54.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:10:0)
[02:27:54.644] Build status: STARTED
[02:27:54.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:11:0) after 3m44s
[02:31:38.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:11:0)
[02:31:38.732] Build status: STARTED
[02:31:38.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:12:0) after 8m54s
[02:40:32.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:12:0)
[02:40:32.792] Build status: STARTED
[02:40:32.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:13:0) after 3m5s
[02:43:37.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:13:0)
[02:43:37.880] Build status: STARTED
[02:43:37.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:14:0) after 9m49s
[02:53:26.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:14:0)
[02:53:26.935] Build status: STARTED
[02:53:26.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:15:0) after 1m20s
[02:54:47.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:15:0)
[02:54:47.230] Build status: STARTED
[02:54:47.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:16:0) after 9m24s
[03:04:11.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:16:0)
[03:04:11.274] Build status: STARTED
[03:04:11.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:17:0) after 3m29s
[03:07:40.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:17:0)
[03:07:40.323] Build status: STARTED
[03:07:40.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:18:0) after 4m5s
[03:11:45.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:18:0)
[03:11:45.661] Build status: STARTED
[03:11:45.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:19:0) after 8m14s
[03:19:59.701] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:19:0)
[03:19:59.718] Build status: STARTED
[03:19:59.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:20:0) after 2m2s
[03:22:01.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:20:0)
[03:22:01.766] Build status: STARTED
[03:22:01.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:21:0) after 7m52s
[03:29:53.808] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:21:0)
[03:29:53.827] Build status: STARTED
[03:29:53.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:22:0) after 4m32s
[03:34:26.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:22:0)
[03:34:26.050] Build status: STARTED
[03:34:26.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:23:0) after 4m0s
[03:38:26.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:23:0)
[03:38:26.181] Build status: STARTED
[03:38:26.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:24:0) after 8m17s
[03:46:43.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:24:0)
[03:46:43.339] Build status: STARTED
[03:46:43.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:25:0) after 1m38s
[03:48:21.356] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:25:0)
[03:48:21.375] Build status: STARTED
[03:48:21.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:26:0) after 8m12s
[03:56:33.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:26:0)
[03:56:33.467] Build status: STARTED
[03:56:33.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:27:0) after 2m26s
[03:58:59.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:27:0)
[03:58:59.575] Build status: STARTED
[03:58:59.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:28:0) after 1m35s
[04:00:34.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:28:0)
[04:00:34.686] Build status: STARTED
[04:00:34.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:29:0) after 2m33s
[04:03:07.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:29:0)
[04:03:07.896] Build status: STARTED
[04:03:07.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:30:0) after 4m11s
[04:07:18.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:30:0)
[04:07:19.015] Build status: STARTED
[04:07:19.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:31:0) after 7m52s
[04:15:11.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:31:0)
[04:15:11.139] Build status: STARTED
[04:15:11.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:32:0) after 6m52s
[04:22:03.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:32:0)
[04:22:03.174] Build status: STARTED
[04:22:03.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:33:0) after 4m29s
[04:26:32.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:33:0)
[04:26:32.538] Build status: STARTED
[04:26:32.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:34:0) after 5m35s
[04:32:07.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:34:0)
[04:32:07.661] Build status: STARTED
[04:32:07.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:35:0) after 2m35s
[04:34:42.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:35:0)
[04:34:42.837] Build status: STARTED
[04:34:42.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:36:0) after 7m48s
[04:42:30.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:36:0)
[04:42:30.927] Build status: STARTED
[04:42:30.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:37:0) after 7m35s
[04:50:06.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:37:0)
[04:50:06.102] Build status: STARTED
[04:50:06.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:38:0) after 3m23s
[04:53:29.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:38:0)
[04:53:29.311] Build status: STARTED
[04:53:29.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:39:0) after 1m16s
[04:54:45.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:39:0)
[04:54:45.397] Build status: STARTED
[04:54:45.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836335679990005632:40:0) after 8m48s
[05:03:28.228] Received PubSub notification, asking Buildbucket for the build status
[05:03:28.247] Build:
{
"id": "8670905616926602817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93904,
"createdBy": "project:chromium",
"createTime": "2026-09-12T01:37:15.362031795Z",
"startTime": "2026-09-12T01:37:19.364479826Z",
"endTime": "2026-09-12T05:03:27.004469066Z",
"updateTime": "2026-09-12T05:03:27.004469066Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fddd40bf102fe7738818a961af700e0098298f56",
"ref": "refs/heads/main"
}
}
}
[05:03:28.247] Invocation finished in 3h26m15.189842121s with status FAILED