[00:55:22.700] New invocation is queued and will start shortly
[00:55:23.788] Starting the invocation (attempt 1)
[00:55:23.810] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d9687b8cd9866b12d5c553630505fc5fb963f59d"
[00:55:23.810] Popped gitiles commit info from properties and tags
[00:55:23.810] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:55:23.810] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:55:23.810] Buildbucket request:
{
"requestId": "8836791297128013184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d9687b8cd9866b12d5c553630505fc5fb963f59d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8836791297128013184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:55:24.374] Scheduled build:
{
"id": "8671361235240228657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93860,
"createdBy": "project:chromium",
"createTime": "2026-09-07T00:55:23.878268556Z",
"updateTime": "2026-09-07T00:55:23.878268556Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d9687b8cd9866b12d5c553630505fc5fb963f59d",
"ref": "refs/heads/main"
}
}
}
[00:55:24.374] Task URL: https://cr-buildbucket.appspot.com/build/8671361235240228657
[00:55:24.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:2:0) after 8m9s
[00:55:25.293] Received PubSub notification, asking Buildbucket for the build status
[00:55:25.313] Build status: SCHEDULED
[00:55:27.999] Received PubSub notification, asking Buildbucket for the build status
[00:55:28.016] Build status: STARTED
[01:03:33.352] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:2:0)
[01:03:33.381] Build status: STARTED
[01:03:33.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:5:0) after 1m15s
[01:04:48.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:5:0)
[01:04:48.414] Build status: STARTED
[01:04:48.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:6:0) after 7m59s
[01:12:47.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:6:0)
[01:12:47.615] Build status: STARTED
[01:12:47.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:7:0) after 6m31s
[01:19:18.629] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:7:0)
[01:19:18.668] Build status: STARTED
[01:19:18.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:8:0) after 1m26s
[01:20:44.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:8:0)
[01:20:44.710] Build status: STARTED
[01:20:44.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:9:0) after 7m39s
[01:28:23.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:9:0)
[01:28:23.741] Build status: STARTED
[01:28:23.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:10:0) after 3m14s
[01:31:37.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:10:0)
[01:31:37.942] Build status: STARTED
[01:31:37.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:11:0) after 5m32s
[01:37:09.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:11:0)
[01:37:09.938] Build status: STARTED
[01:37:09.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:12:0) after 4m38s
[01:41:47.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:12:0)
[01:41:48.024] Build status: STARTED
[01:41:48.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:13:0) after 6m25s
[01:48:13.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:13:0)
[01:48:13.109] Build status: STARTED
[01:48:13.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:14:0) after 5m53s
[01:54:06.613] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:14:0)
[01:54:06.635] Build status: STARTED
[01:54:06.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:15:0) after 2m11s
[01:56:18.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:15:0)
[01:56:18.029] Build status: STARTED
[01:56:18.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:16:0) after 4m22s
[02:00:40.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:16:0)
[02:00:40.291] Build status: STARTED
[02:00:40.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:17:0) after 2m41s
[02:03:21.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:17:0)
[02:03:21.505] Build status: STARTED
[02:03:21.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:18:0) after 2m9s
[02:05:30.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:18:0)
[02:05:30.835] Build status: STARTED
[02:05:30.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:19:0) after 9m51s
[02:15:22.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:19:0)
[02:15:22.119] Build status: STARTED
[02:15:22.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:20:0) after 1m33s
[02:16:55.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:20:0)
[02:16:55.162] Build status: STARTED
[02:16:55.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:21:0) after 3m13s
[02:20:08.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:21:0)
[02:20:08.499] Build status: STARTED
[02:20:08.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:22:0) after 2m43s
[02:22:51.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:22:0)
[02:22:51.536] Build status: STARTED
[02:22:51.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:23:0) after 5m40s
[02:28:31.554] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:23:0)
[02:28:31.573] Build status: STARTED
[02:28:31.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:24:0) after 3m58s
[02:32:29.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:24:0)
[02:32:29.784] Build status: STARTED
[02:32:29.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:25:0) after 4m39s
[02:37:08.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:25:0)
[02:37:08.886] Build status: STARTED
[02:37:08.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:26:0) after 4m43s
[02:41:51.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:26:0)
[02:41:51.983] Build status: STARTED
[02:41:51.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:27:0) after 4m35s
[02:46:26.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:27:0)
[02:46:27.029] Build status: STARTED
[02:46:27.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:28:0) after 6m35s
[02:53:02.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:28:0)
[02:53:02.065] Build status: STARTED
[02:53:02.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:29:0) after 5m17s
[02:58:19.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:29:0)
[02:58:19.176] Build status: STARTED
[02:58:19.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:30:0) after 9m2s
[03:07:21.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:30:0)
[03:07:21.298] Build status: STARTED
[03:07:21.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:31:0) after 6m6s
[03:13:27.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:31:0)
[03:13:27.381] Build status: STARTED
[03:13:27.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:32:0) after 4m10s
[03:17:37.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:32:0)
[03:17:37.434] Build status: STARTED
[03:17:37.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:33:0) after 8m11s
[03:25:48.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:33:0)
[03:25:48.562] Build status: STARTED
[03:25:48.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:34:0) after 1m3s
[03:26:51.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:34:0)
[03:26:51.570] Build status: STARTED
[03:26:51.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:35:0) after 7m24s
[03:34:15.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:35:0)
[03:34:15.585] Build status: STARTED
[03:34:15.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:36:0) after 1m27s
[03:35:42.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:36:0)
[03:35:42.698] Build status: STARTED
[03:35:42.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:37:0) after 7m48s
[03:43:30.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:37:0)
[03:43:30.731] Build status: STARTED
[03:43:30.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:38:0) after 8m49s
[03:52:19.750] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:38:0)
[03:52:19.801] Build status: STARTED
[03:52:19.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:39:0) after 9m45s
[04:02:04.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:39:0)
[04:02:04.859] Build status: STARTED
[04:02:04.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:40:0) after 5m9s
[04:07:13.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:40:0)
[04:07:14.012] Build status: STARTED
[04:07:14.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:41:0) after 6m56s
[04:14:10.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:41:0)
[04:14:10.050] Build status: STARTED
[04:14:10.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:42:0) after 3m32s
[04:17:42.103] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:42:0)
[04:17:42.121] Build status: STARTED
[04:17:42.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8836791297128013184:43:0) after 6m31s
[04:23:06.305] Received PubSub notification, asking Buildbucket for the build status
[04:23:06.345] Build:
{
"id": "8671361235240228657",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93860,
"createdBy": "project:chromium",
"createTime": "2026-09-07T00:55:23.878268556Z",
"startTime": "2026-09-07T00:55:27.848501623Z",
"endTime": "2026-09-07T04:23:05.106059163Z",
"updateTime": "2026-09-07T04:23:05.106059163Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d9687b8cd9866b12d5c553630505fc5fb963f59d",
"ref": "refs/heads/main"
}
}
}
[04:23:06.345] Invocation finished in 3h27m43.650285499s with status FAILED