[04:00:18.088] New invocation is queued and will start shortly
[04:00:19.324] Starting the invocation (attempt 1)
[04:00:19.351] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ca3d7886d84d752a784eabef033792cba2d2b6ec"
[04:00:19.351] Popped gitiles commit info from properties and tags
[04:00:19.351] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:19.351] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:19.352] Buildbucket request:
{
"requestId": "8851093983468376656",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca3d7886d84d752a784eabef033792cba2d2b6ec",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851093983468376656"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:19.919] Scheduled build:
{
"id": "8685663921409055105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10459,
"createdBy": "project:chromium",
"createTime": "2026-04-02T04:00:19.423897775Z",
"updateTime": "2026-04-02T04:00:19.423897775Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca3d7886d84d752a784eabef033792cba2d2b6ec",
"ref": "refs/heads/main"
}
}
}
[04:00:19.919] Task URL: https://cr-buildbucket.appspot.com/build/8685663921409055105
[04:00:19.919] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:2:0) after 8m25s
[04:00:20.970] Received PubSub notification, asking Buildbucket for the build status
[04:00:20.992] Build status: SCHEDULED
[04:00:31.952] Received PubSub notification, asking Buildbucket for the build status
[04:00:35.425] Build status: STARTED
[04:08:44.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:2:0)
[04:08:44.930] Build status: STARTED
[04:08:44.930] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:5:0) after 4m15s
[04:13:00.010] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:5:0)
[04:13:00.069] Build status: STARTED
[04:13:00.070] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:6:0) after 7m23s
[04:20:23.097] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:6:0)
[04:20:23.121] Build status: STARTED
[04:20:23.121] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:7:0) after 1m2s
[04:21:25.098] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:7:0)
[04:21:25.198] Build status: STARTED
[04:21:25.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:8:0) after 3m4s
[04:24:29.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:8:0)
[04:24:29.332] Build status: STARTED
[04:24:29.332] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:9:0) after 5m33s
[04:30:02.379] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:9:0)
[04:30:02.399] Build status: STARTED
[04:30:02.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:10:0) after 2m14s
[04:32:16.533] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:10:0)
[04:32:16.553] Build status: STARTED
[04:32:16.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:11:0) after 9m26s
[04:41:42.572] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:11:0)
[04:41:42.590] Build status: STARTED
[04:41:42.590] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:12:0) after 3m42s
[04:45:24.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:12:0)
[04:45:24.699] Build status: STARTED
[04:45:24.700] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:13:0) after 1m41s
[04:47:05.716] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:13:0)
[04:47:05.734] Build status: STARTED
[04:47:05.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:14:0) after 6m40s
[04:53:45.749] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:14:0)
[04:53:45.763] Build status: STARTED
[04:53:45.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:15:0) after 8m20s
[05:02:05.829] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:15:0)
[05:02:05.846] Build status: STARTED
[05:02:05.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:16:0) after 1m53s
[05:03:58.821] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:16:0)
[05:03:58.839] Build status: STARTED
[05:03:58.839] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:17:0) after 1m59s
[05:05:57.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:17:0)
[05:05:57.972] Build status: STARTED
[05:05:57.972] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:18:0) after 1m18s
[05:07:16.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:18:0)
[05:07:16.135] Build status: STARTED
[05:07:16.135] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:19:0) after 9m42s
[05:16:58.149] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:19:0)
[05:16:58.196] Build status: STARTED
[05:16:58.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:20:0) after 7m29s
[05:24:27.211] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:20:0)
[05:24:27.240] Build status: STARTED
[05:24:27.240] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:21:0) after 6m18s
[05:30:45.257] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:21:0)
[05:30:45.278] Build status: STARTED
[05:30:45.278] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:22:0) after 1m19s
[05:32:04.316] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:22:0)
[05:32:04.339] Build status: STARTED
[05:32:04.339] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:23:0) after 1m40s
[05:33:44.421] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:23:0)
[05:33:44.458] Build status: STARTED
[05:33:44.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:24:0) after 9m8s
[05:42:52.478] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:24:0)
[05:42:52.494] Build status: STARTED
[05:42:52.494] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:25:0) after 7m15s
[05:50:07.510] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:25:0)
[05:50:07.529] Build status: STARTED
[05:50:07.529] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:26:0) after 3m56s
[05:54:03.631] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:26:0)
[05:54:03.649] Build status: STARTED
[05:54:03.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:27:0) after 8m28s
[06:02:31.666] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:27:0)
[06:02:31.697] Build status: STARTED
[06:02:31.697] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:28:0) after 7m15s
[06:09:46.748] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:28:0)
[06:09:46.764] Build status: STARTED
[06:09:46.764] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:29:0) after 1m36s
[06:11:22.782] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:29:0)
[06:11:22.797] Build status: STARTED
[06:11:22.797] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:30:0) after 2m47s
[06:14:09.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:30:0)
[06:14:09.834] Build status: STARTED
[06:14:09.834] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:31:0) after 9m14s
[06:23:23.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:31:0)
[06:23:23.881] Build status: STARTED
[06:23:23.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:32:0) after 5m40s
[06:29:03.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:32:0)
[06:29:03.917] Build status: STARTED
[06:29:03.917] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:33:0) after 1m4s
[06:30:08.038] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:33:0)
[06:30:08.056] Build status: STARTED
[06:30:08.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:34:0) after 3m38s
[06:33:46.115] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:34:0)
[06:33:46.131] Build status: STARTED
[06:33:46.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:35:0) after 5m30s
[06:39:16.148] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:35:0)
[06:39:16.163] Build status: STARTED
[06:39:16.163] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:36:0) after 4m19s
[06:43:35.180] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:36:0)
[06:43:35.198] Build status: STARTED
[06:43:35.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:37:0) after 7m47s
[06:51:22.212] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:37:0)
[06:51:22.240] Build status: STARTED
[06:51:22.240] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:38:0) after 2m33s
[06:53:55.262] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:38:0)
[06:53:55.281] Build status: STARTED
[06:53:55.281] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:39:0) after 2m19s
[06:56:14.345] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:39:0)
[06:56:14.369] Build status: STARTED
[06:56:14.369] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:40:0) after 7m16s
[07:03:30.383] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:40:0)
[07:03:30.400] Build status: STARTED
[07:03:30.400] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:41:0) after 7m40s
[07:11:10.453] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:41:0)
[07:11:10.497] Build status: STARTED
[07:11:10.497] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:42:0) after 4m52s
[07:16:02.490] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:42:0)
[07:16:02.506] Build status: STARTED
[07:16:02.506] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:43:0) after 3m23s
[07:19:25.522] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:43:0)
[07:19:25.560] Build status: STARTED
[07:19:25.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:44:0) after 4m2s
[07:23:27.614] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:44:0)
[07:23:27.630] Build status: STARTED
[07:23:27.630] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:45:0) after 5m27s
[07:28:54.611] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:45:0)
[07:28:54.650] Build status: STARTED
[07:28:54.650] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:46:0) after 8m54s
[07:37:48.688] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:46:0)
[07:37:48.742] Build status: STARTED
[07:37:48.742] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:47:0) after 7m24s
[07:45:12.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:47:0)
[07:45:12.840] Build status: STARTED
[07:45:12.840] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:48:0) after 2m6s
[07:47:18.904] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:48:0)
[07:47:18.921] Build status: STARTED
[07:47:18.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:49:0) after 3m40s
[07:50:58.899] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:49:0)
[07:50:58.916] Build status: STARTED
[07:50:58.916] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:50:0) after 6m7s
[07:57:05.983] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:50:0)
[07:57:06.003] Build status: STARTED
[07:57:06.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:51:0) after 5m33s
[08:02:39.039] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:51:0)
[08:02:39.088] Build status: STARTED
[08:02:39.088] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:52:0) after 9m33s
[08:12:12.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:52:0)
[08:12:12.105] Build status: STARTED
[08:12:12.105] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:53:0) after 8m8s
[08:20:20.247] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:53:0)
[08:20:20.270] Build status: STARTED
[08:20:20.270] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:54:0) after 2m2s
[08:22:22.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:54:0)
[08:22:22.316] Build status: STARTED
[08:22:22.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:55:0) after 7m4s
[08:29:26.334] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:55:0)
[08:29:26.352] Build status: STARTED
[08:29:26.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:56:0) after 5m31s
[08:34:57.372] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:56:0)
[08:34:57.392] Build status: STARTED
[08:34:57.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:57:0) after 2m10s
[08:37:07.408] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:57:0)
[08:37:07.425] Build status: STARTED
[08:37:07.425] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:58:0) after 2m27s
[08:39:34.509] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:58:0)
[08:39:34.529] Build status: STARTED
[08:39:34.529] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:59:0) after 3m2s
[08:42:36.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:59:0)
[08:42:36.618] Build status: STARTED
[08:42:36.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:60:0) after 8m26s
[08:51:02.635] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:60:0)
[08:51:02.652] Build status: STARTED
[08:51:02.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851093983468376656:61:0) after 5m15s
[08:52:54.737] Received PubSub notification, asking Buildbucket for the build status
[08:52:54.773] Build:
{
"id": "8685663921409055105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10459,
"createdBy": "project:chromium",
"createTime": "2026-04-02T04:00:19.423897775Z",
"startTime": "2026-04-02T04:00:31.751505095Z",
"endTime": "2026-04-02T08:52:54.403900879Z",
"updateTime": "2026-04-02T08:52:54.403900879Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ca3d7886d84d752a784eabef033792cba2d2b6ec",
"ref": "refs/heads/main"
}
}
}
[08:52:54.773] Invocation finished in 4h52m36.696857544s with status FAILED