[17:53:48.346] New invocation is queued and will start shortly
[17:53:49.575] Starting the invocation (attempt 1)
[17:53:49.607] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cdfb22b0bf60f2fdba467587cd967be24d80828a"
[17:53:49.607] Popped gitiles commit info from properties and tags
[17:53:49.608] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:53:49.608] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:53:49.608] Buildbucket request:
{
"requestId": "8834371702086989184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cdfb22b0bf60f2fdba467587cd967be24d80828a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8834371702086989184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:53:50.459] Scheduled build:
{
"id": "8668941640027919297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 94663,
"createdBy": "project:chromium",
"createTime": "2026-10-03T17:53:49.688260110Z",
"updateTime": "2026-10-03T17:53:49.688260110Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cdfb22b0bf60f2fdba467587cd967be24d80828a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:53:50.459] Task URL: https://cr-buildbucket.appspot.com/build/8668941640027919297
[17:53:50.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:2:0) after 4m40s
[17:53:53.116] Received PubSub notification, asking Buildbucket for the build status
[17:53:53.186] Build status: SCHEDULED
[17:54:15.972] Received PubSub notification, asking Buildbucket for the build status
[17:54:15.992] Build status: STARTED
[17:58:30.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:2:0)
[17:58:30.667] Build status: STARTED
[17:58:30.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:5:0) after 7m47s
[18:06:17.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:5:0)
[18:06:17.727] Build status: STARTED
[18:06:17.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:6:0) after 7m12s
[18:13:29.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:6:0)
[18:13:29.800] Build status: STARTED
[18:13:29.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:7:0) after 1m7s
[18:14:36.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:7:0)
[18:14:36.833] Build status: STARTED
[18:14:36.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:8:0) after 5m46s
[18:20:22.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:8:0)
[18:20:22.915] Build status: STARTED
[18:20:22.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:9:0) after 6m17s
[18:26:39.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:9:0)
[18:26:39.997] Build status: STARTED
[18:26:39.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:10:0) after 6m40s
[18:33:20.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:10:0)
[18:33:20.111] Build status: STARTED
[18:33:20.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:11:0) after 4m24s
[18:37:44.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:11:0)
[18:37:44.105] Build status: STARTED
[18:37:44.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:12:0) after 1m44s
[18:39:28.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:12:0)
[18:39:28.139] Build status: STARTED
[18:39:28.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:13:0) after 3m56s
[18:43:24.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:13:0)
[18:43:24.214] Build status: STARTED
[18:43:24.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:14:0) after 2m15s
[18:45:39.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:14:0)
[18:45:39.335] Build status: STARTED
[18:45:39.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:15:0) after 2m9s
[18:47:48.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:15:0)
[18:47:48.385] Build status: STARTED
[18:47:48.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:16:0) after 2m9s
[18:49:57.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:16:0)
[18:49:57.444] Build status: STARTED
[18:49:57.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:17:0) after 4m4s
[18:54:01.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:17:0)
[18:54:01.493] Build status: STARTED
[18:54:01.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:18:0) after 4m0s
[18:58:01.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:18:0)
[18:58:01.528] Build status: STARTED
[18:58:01.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:19:0) after 2m51s
[19:00:52.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:19:0)
[19:00:52.560] Build status: STARTED
[19:00:52.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:20:0) after 1m52s
[19:02:44.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:20:0)
[19:02:44.634] Build status: STARTED
[19:02:44.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:21:0) after 4m13s
[19:06:57.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:21:0)
[19:06:57.694] Build status: STARTED
[19:06:57.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:22:0) after 1m41s
[19:08:38.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:22:0)
[19:08:38.949] Build status: STARTED
[19:08:38.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:23:0) after 3m31s
[19:12:09.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:23:0)
[19:12:09.947] Build status: STARTED
[19:12:09.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:24:0) after 1m39s
[19:13:48.963] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:24:0)
[19:13:48.984] Build status: STARTED
[19:13:48.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:25:0) after 1m17s
[19:15:06.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:25:0)
[19:15:06.047] Build status: STARTED
[19:15:06.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:26:0) after 5m44s
[19:20:50.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:26:0)
[19:20:50.131] Build status: STARTED
[19:20:50.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:27:0) after 7m28s
[19:28:18.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:27:0)
[19:28:18.178] Build status: STARTED
[19:28:18.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:28:0) after 3m24s
[19:31:42.194] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:28:0)
[19:31:42.229] Build status: STARTED
[19:31:42.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:29:0) after 3m11s
[19:34:53.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:29:0)
[19:34:53.286] Build status: STARTED
[19:34:53.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:30:0) after 1m0s
[19:35:53.299] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:30:0)
[19:35:53.316] Build status: STARTED
[19:35:53.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:31:0) after 1m38s
[19:37:31.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:31:0)
[19:37:31.400] Build status: STARTED
[19:37:31.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:32:0) after 4m32s
[19:42:03.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:32:0)
[19:42:03.513] Build status: STARTED
[19:42:03.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:33:0) after 7m17s
[19:49:20.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:33:0)
[19:49:20.547] Build status: STARTED
[19:49:20.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:34:0) after 2m41s
[19:52:01.623] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:34:0)
[19:52:01.641] Build status: STARTED
[19:52:01.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:35:0) after 4m45s
[19:56:46.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:35:0)
[19:56:46.708] Build status: STARTED
[19:56:46.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:36:0) after 9m30s
[20:06:16.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:36:0)
[20:06:16.831] Build status: STARTED
[20:06:16.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:37:0) after 7m14s
[20:13:30.961] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:37:0)
[20:13:31.011] Build status: STARTED
[20:13:31.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:38:0) after 2m3s
[20:15:34.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:38:0)
[20:15:34.128] Build status: STARTED
[20:15:34.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:39:0) after 2m58s
[20:18:32.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:39:0)
[20:18:32.274] Build status: STARTED
[20:18:32.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:40:0) after 4m59s
[20:23:31.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:40:0)
[20:23:31.303] Build status: STARTED
[20:23:31.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:41:0) after 4m49s
[20:28:20.336] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:41:0)
[20:28:20.380] Build status: STARTED
[20:28:20.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:42:0) after 9m23s
[20:37:43.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:42:0)
[20:37:43.513] Build status: STARTED
[20:37:43.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:43:0) after 6m14s
[20:43:57.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:43:0)
[20:43:57.622] Build status: STARTED
[20:43:57.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8834371702086989184:44:0) after 3m14s
[20:45:47.913] Received PubSub notification, asking Buildbucket for the build status
[20:45:47.935] Build:
{
"id": "8668941640027919297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 94663,
"createdBy": "project:chromium",
"createTime": "2026-10-03T17:53:49.688260110Z",
"startTime": "2026-10-03T17:54:13.730301042Z",
"endTime": "2026-10-03T20:45:47.087890365Z",
"updateTime": "2026-10-03T20:45:47.087890365Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cdfb22b0bf60f2fdba467587cd967be24d80828a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[20:45:47.935] Invocation finished in 2h51m59.593950483s with status FAILED