[14:42:20.329] New invocation is queued and will start shortly
[14:42:21.533] Starting the invocation (attempt 1)
[14:42:21.557] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c91a173190cb80ceb3def8865c597e71f07f4dad"
[14:42:21.557] Popped gitiles commit info from properties and tags
[14:42:21.557] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:42:21.557] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:42:21.557] Buildbucket request:
{
"requestId": "8835652105675767216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c91a173190cb80ceb3def8865c597e71f07f4dad",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835652105675767216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacCoverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:42:22.165] Scheduled build:
{
"id": "8670222043653836817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93999,
"createdBy": "project:chromium",
"createTime": "2026-09-19T14:42:21.636759310Z",
"updateTime": "2026-09-19T14:42:21.636759310Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c91a173190cb80ceb3def8865c597e71f07f4dad",
"ref": "refs/heads/main"
}
}
}
[14:42:22.165] Task URL: https://cr-buildbucket.appspot.com/build/8670222043653836817
[14:42:22.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:2:0) after 6m30s
[14:42:23.152] Received PubSub notification, asking Buildbucket for the build status
[14:42:23.180] Build status: SCHEDULED
[14:42:25.899] Received PubSub notification, asking Buildbucket for the build status
[14:42:25.974] Build status: STARTED
[14:48:52.182] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:2:0)
[14:48:52.204] Build status: STARTED
[14:48:52.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:5:0) after 6m17s
[14:55:09.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:5:0)
[14:55:09.530] Build status: STARTED
[14:55:09.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:6:0) after 6m7s
[15:01:16.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:6:0)
[15:01:16.612] Build status: STARTED
[15:01:16.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:7:0) after 5m38s
[15:06:54.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:7:0)
[15:06:54.711] Build status: STARTED
[15:06:54.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:8:0) after 8m39s
[15:15:33.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:8:0)
[15:15:33.869] Build status: STARTED
[15:15:33.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:9:0) after 5m10s
[15:20:43.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:9:0)
[15:20:44.008] Build status: STARTED
[15:20:44.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:10:0) after 3m18s
[15:24:02.189] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:10:0)
[15:24:02.216] Build status: STARTED
[15:24:02.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:11:0) after 9m2s
[15:33:04.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:11:0)
[15:33:04.434] Build status: STARTED
[15:33:04.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:12:0) after 1m2s
[15:34:06.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:12:0)
[15:34:06.695] Build status: STARTED
[15:34:06.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:13:0) after 4m38s
[15:38:44.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:13:0)
[15:38:44.914] Build status: STARTED
[15:38:44.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:14:0) after 4m35s
[15:43:19.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:14:0)
[15:43:20.009] Build status: STARTED
[15:43:20.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:15:0) after 8m29s
[15:51:49.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:15:0)
[15:51:49.236] Build status: STARTED
[15:51:49.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:16:0) after 8m39s
[16:00:28.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:16:0)
[16:00:28.413] Build status: STARTED
[16:00:28.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:17:0) after 5m10s
[16:05:38.513] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:17:0)
[16:05:38.648] Build status: STARTED
[16:05:38.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:18:0) after 9m25s
[16:15:03.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:18:0)
[16:15:03.812] Build status: STARTED
[16:15:03.812] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:19:0) after 1m4s
[16:16:08.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:19:0)
[16:16:08.096] Build status: STARTED
[16:16:08.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:20:0) after 2m4s
[16:18:12.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:20:0)
[16:18:12.343] Build status: STARTED
[16:18:12.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:21:0) after 2m1s
[16:20:13.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:21:0)
[16:20:13.545] Build status: STARTED
[16:20:13.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:22:0) after 5m45s
[16:25:58.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:22:0)
[16:25:58.837] Build status: STARTED
[16:25:58.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:23:0) after 4m47s
[16:30:45.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:23:0)
[16:30:46.017] Build status: STARTED
[16:30:46.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:24:0) after 9m37s
[16:40:22.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:24:0)
[16:40:23.007] Build status: STARTED
[16:40:23.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:25:0) after 6m39s
[16:47:02.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:25:0)
[16:47:02.062] Build status: STARTED
[16:47:02.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:26:0) after 8m23s
[16:55:25.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:26:0)
[16:55:25.244] Build status: STARTED
[16:55:25.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:27:0) after 4m59s
[17:00:24.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:27:0)
[17:00:24.285] Build status: STARTED
[17:00:24.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:28:0) after 5m51s
[17:06:15.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:28:0)
[17:06:15.330] Build status: STARTED
[17:06:15.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:29:0) after 4m34s
[17:10:49.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:29:0)
[17:10:49.367] Build status: STARTED
[17:10:49.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:30:0) after 5m8s
[17:15:57.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:30:0)
[17:15:57.732] Build status: STARTED
[17:15:57.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:31:0) after 5m43s
[17:21:40.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:31:0)
[17:21:40.767] Build status: STARTED
[17:21:40.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:32:0) after 6m56s
[17:28:37.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:32:0)
[17:28:37.423] Build status: STARTED
[17:28:37.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:33:0) after 1m26s
[17:30:03.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:33:0)
[17:30:03.804] Build status: STARTED
[17:30:03.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:34:0) after 7m28s
[17:37:31.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:34:0)
[17:37:31.841] Build status: STARTED
[17:37:31.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:35:0) after 7m30s
[17:45:01.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:35:0)
[17:45:02.133] Build status: STARTED
[17:45:02.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:36:0) after 5m35s
[17:50:37.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:36:0)
[17:50:37.180] Build status: STARTED
[17:50:37.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:37:0) after 5m8s
[17:55:45.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:37:0)
[17:55:45.218] Build status: STARTED
[17:55:45.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:38:0) after 8m55s
[18:04:40.235] Handling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:38:0)
[18:04:40.254] Build status: STARTED
[18:04:40.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacCoverage:8835652105675767216:39:0) after 8m43s
[18:06:17.660] Received PubSub notification, asking Buildbucket for the build status
[18:06:17.678] Build:
{
"id": "8670222043653836817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacCoverage"
},
"number": 93999,
"createdBy": "project:chromium",
"createTime": "2026-09-19T14:42:21.636759310Z",
"startTime": "2026-09-19T14:42:25.683148116Z",
"endTime": "2026-09-19T18:06:17.377522233Z",
"updateTime": "2026-09-19T18:06:17.377522233Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c91a173190cb80ceb3def8865c597e71f07f4dad",
"ref": "refs/heads/main"
}
}
}
[18:06:17.678] Invocation finished in 3h23m57.353968897s with status FAILED