[04:00:08.219] New invocation is queued and will start shortly
[04:00:09.373] Starting the invocation (attempt 1)
[04:00:09.405] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3ec4bd0e9029816cf021beb9a82b08981f5e8ce5"
[04:00:09.405] Popped gitiles commit info from properties and tags
[04:00:09.405] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:09.405] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:09.405] Buildbucket request:
{
"requestId": "8845295787958380352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ec4bd0e9029816cf021beb9a82b08981f5e8ce5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8845295787958380352"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:10.274] Scheduled build:
{
"id": "8679865725928119313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10523,
"createdBy": "project:chromium",
"createTime": "2026-06-05T04:00:09.535181672Z",
"updateTime": "2026-06-05T04:00:09.535181672Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ec4bd0e9029816cf021beb9a82b08981f5e8ce5",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:10.274] Task URL: https://cr-buildbucket.appspot.com/build/8679865725928119313
[04:00:10.274] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:2:0) after 3m53s
[04:00:11.246] Received PubSub notification, asking Buildbucket for the build status
[04:00:11.263] Build status: SCHEDULED
[04:00:13.557] Received PubSub notification, asking Buildbucket for the build status
[04:00:13.575] Build status: STARTED
[04:04:03.369] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:2:0)
[04:04:03.443] Build status: STARTED
[04:04:03.443] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:5:0) after 7m47s
[04:11:50.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:5:0)
[04:11:50.518] Build status: STARTED
[04:11:50.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:6:0) after 1m19s
[04:13:09.537] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:6:0)
[04:13:09.596] Build status: STARTED
[04:13:09.596] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:7:0) after 5m38s
[04:18:47.695] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:7:0)
[04:18:47.713] Build status: STARTED
[04:18:47.713] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:8:0) after 8m37s
[04:27:24.874] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:8:0)
[04:27:24.893] Build status: STARTED
[04:27:24.893] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:9:0) after 3m52s
[04:31:16.906] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:9:0)
[04:31:16.994] Build status: STARTED
[04:31:16.994] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:10:0) after 1m23s
[04:32:40.007] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:10:0)
[04:32:40.028] Build status: STARTED
[04:32:40.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:11:0) after 6m36s
[04:39:16.045] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:11:0)
[04:39:16.135] Build status: STARTED
[04:39:16.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:12:0) after 2m50s
[04:42:06.157] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:12:0)
[04:42:06.266] Build status: STARTED
[04:42:06.266] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:13:0) after 3m21s
[04:45:27.338] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:13:0)
[04:45:27.366] Build status: STARTED
[04:45:27.366] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:14:0) after 3m22s
[04:48:49.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:14:0)
[04:48:49.426] Build status: STARTED
[04:48:49.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:15:0) after 7m24s
[04:56:13.460] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:15:0)
[04:56:13.479] Build status: STARTED
[04:56:13.479] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:16:0) after 7m48s
[05:04:01.497] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:16:0)
[05:04:01.521] Build status: STARTED
[05:04:01.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:17:0) after 9m50s
[05:13:51.552] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:17:0)
[05:13:51.571] Build status: STARTED
[05:13:51.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:18:0) after 8m28s
[05:22:19.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:18:0)
[05:22:19.732] Build status: STARTED
[05:22:19.732] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:19:0) after 9m8s
[05:31:27.761] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:19:0)
[05:31:27.816] Build status: STARTED
[05:31:27.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:20:0) after 5m33s
[05:37:00.832] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:20:0)
[05:37:00.901] Build status: STARTED
[05:37:00.901] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:21:0) after 9m52s
[05:46:52.883] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:21:0)
[05:46:52.906] Build status: STARTED
[05:46:52.906] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:22:0) after 8m18s
[05:55:11.022] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:22:0)
[05:55:11.038] Build status: STARTED
[05:55:11.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:23:0) after 5m24s
[06:00:35.056] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:23:0)
[06:00:35.080] Build status: STARTED
[06:00:35.080] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:24:0) after 9m4s
[06:09:39.208] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:24:0)
[06:09:39.237] Build status: STARTED
[06:09:39.237] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:25:0) after 8m16s
[06:17:55.254] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:25:0)
[06:17:55.274] Build status: STARTED
[06:17:55.274] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:26:0) after 3m28s
[06:21:23.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:26:0)
[06:21:23.434] Build status: STARTED
[06:21:23.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:27:0) after 1m45s
[06:23:08.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:27:0)
[06:23:08.539] Build status: STARTED
[06:23:08.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:28:0) after 7m26s
[06:30:34.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:28:0)
[06:30:34.693] Build status: STARTED
[06:30:34.693] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:29:0) after 8m51s
[06:39:25.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:29:0)
[06:39:25.792] Build status: STARTED
[06:39:25.792] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:30:0) after 7m29s
[06:46:54.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:30:0)
[06:46:54.802] Build status: STARTED
[06:46:54.802] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:31:0) after 2m22s
[06:49:16.864] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:31:0)
[06:49:16.883] Build status: STARTED
[06:49:16.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:32:0) after 5m22s
[06:54:38.897] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:32:0)
[06:54:38.917] Build status: STARTED
[06:54:38.917] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:33:0) after 7m42s
[07:02:20.901] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:33:0)
[07:02:20.919] Build status: STARTED
[07:02:20.919] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:34:0) after 8m14s
[07:10:34.990] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:34:0)
[07:10:35.009] Build status: STARTED
[07:10:35.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:35:0) after 5m34s
[07:16:09.027] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:35:0)
[07:16:09.043] Build status: STARTED
[07:16:09.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:36:0) after 4m16s
[07:20:25.042] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:36:0)
[07:20:25.057] Build status: STARTED
[07:20:25.057] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:37:0) after 5m45s
[07:26:10.137] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:37:0)
[07:26:10.153] Build status: STARTED
[07:26:10.153] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:38:0) after 3m7s
[07:29:17.170] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:38:0)
[07:29:17.191] Build status: STARTED
[07:29:17.191] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:39:0) after 7m46s
[07:37:03.262] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:39:0)
[07:37:03.280] Build status: STARTED
[07:37:03.280] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:40:0) after 4m20s
[07:41:23.335] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:40:0)
[07:41:23.352] Build status: STARTED
[07:41:23.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:41:0) after 5m12s
[07:46:35.418] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:41:0)
[07:46:35.441] Build status: STARTED
[07:46:35.441] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:42:0) after 7m14s
[07:53:49.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:42:0)
[07:53:49.527] Build status: STARTED
[07:53:49.527] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:43:0) after 7m26s
[08:01:15.682] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:43:0)
[08:01:15.702] Build status: STARTED
[08:01:15.702] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:44:0) after 5m24s
[08:06:39.741] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:44:0)
[08:06:39.757] Build status: STARTED
[08:06:39.757] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:45:0) after 6m6s
[08:12:45.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:45:0)
[08:12:45.790] Build status: STARTED
[08:12:45.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:46:0) after 4m21s
[08:17:06.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:46:0)
[08:17:06.956] Build status: STARTED
[08:17:06.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:47:0) after 9m45s
[08:26:52.067] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:47:0)
[08:26:52.085] Build status: STARTED
[08:26:52.085] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:48:0) after 5m59s
[08:32:51.149] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:48:0)
[08:32:51.165] Build status: STARTED
[08:32:51.165] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845295787958380352:49:0) after 2m25s
[08:34:46.249] Received PubSub notification, asking Buildbucket for the build status
[08:34:46.268] Build:
{
"id": "8679865725928119313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10523,
"createdBy": "project:chromium",
"createTime": "2026-06-05T04:00:09.535181672Z",
"startTime": "2026-06-05T04:00:13.394828254Z",
"endTime": "2026-06-05T08:34:27.201613532Z",
"updateTime": "2026-06-05T08:34:27.201613532Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ec4bd0e9029816cf021beb9a82b08981f5e8ce5",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:34:46.268] Invocation finished in 4h34m38.05273011s with status FAILED