[04:00:10.791] New invocation is queued and will start shortly
[04:00:11.926] Starting the invocation (attempt 1)
[04:00:11.961] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1902694295dcaa1851ff2cc6de146415939bdef5"
[04:00:11.961] Popped gitiles commit info from properties and tags
[04:00:11.961] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:11.961] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:11.961] Buildbucket request:
{
"requestId": "8851003394151361808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1902694295dcaa1851ff2cc6de146415939bdef5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851003394151361808"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:12.678] Scheduled build:
{
"id": "8685573332177320353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10460,
"createdBy": "project:chromium",
"createTime": "2026-04-03T04:00:12.047862105Z",
"updateTime": "2026-04-03T04:00:12.047862105Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1902694295dcaa1851ff2cc6de146415939bdef5",
"ref": "refs/heads/main"
}
}
}
[04:00:12.678] Task URL: https://cr-buildbucket.appspot.com/build/8685573332177320353
[04:00:12.678] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:2:0) after 6m27s
[04:00:13.299] Received PubSub notification, asking Buildbucket for the build status
[04:00:13.321] Build status: SCHEDULED
[04:00:17.900] Received PubSub notification, asking Buildbucket for the build status
[04:00:17.921] Build status: STARTED
[04:06:39.741] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:2:0)
[04:06:39.757] Build status: STARTED
[04:06:39.757] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:5:0) after 7m40s
[04:14:19.746] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:5:0)
[04:14:19.764] Build status: STARTED
[04:14:19.764] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:6:0) after 6m26s
[04:20:45.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:6:0)
[04:20:45.796] Build status: STARTED
[04:20:45.796] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:7:0) after 3m34s
[04:24:19.877] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:7:0)
[04:24:19.904] Build status: STARTED
[04:24:19.904] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:8:0) after 8m59s
[04:33:18.972] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:8:0)
[04:33:18.996] Build status: STARTED
[04:33:18.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:9:0) after 3m40s
[04:36:59.014] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:9:0)
[04:36:59.042] Build status: STARTED
[04:36:59.042] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:10:0) after 1m5s
[04:38:04.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:10:0)
[04:38:04.089] Build status: STARTED
[04:38:04.089] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:11:0) after 2m31s
[04:40:35.515] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:11:0)
[04:40:35.541] Build status: STARTED
[04:40:35.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:12:0) after 9m41s
[04:50:16.556] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:12:0)
[04:50:16.629] Build status: STARTED
[04:50:16.629] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:13:0) after 3m25s
[04:53:41.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:13:0)
[04:53:41.658] Build status: STARTED
[04:53:41.658] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:14:0) after 2m41s
[04:56:22.677] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:14:0)
[04:56:22.711] Build status: STARTED
[04:56:22.711] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:15:0) after 7m11s
[05:03:33.807] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:15:0)
[05:03:33.831] Build status: STARTED
[05:03:33.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:16:0) after 9m28s
[05:13:01.861] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:16:0)
[05:13:01.875] Build status: STARTED
[05:13:01.875] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:17:0) after 2m48s
[05:15:49.973] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:17:0)
[05:15:49.990] Build status: STARTED
[05:15:49.990] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:18:0) after 2m31s
[05:18:21.007] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:18:0)
[05:18:21.027] Build status: STARTED
[05:18:21.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:19:0) after 7m58s
[05:26:19.289] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:19:0)
[05:26:19.311] Build status: STARTED
[05:26:19.311] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:20:0) after 8m49s
[05:35:08.338] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:20:0)
[05:35:08.356] Build status: STARTED
[05:35:08.356] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:21:0) after 1m44s
[05:36:52.352] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:21:0)
[05:36:52.394] Build status: STARTED
[05:36:52.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:22:0) after 8m52s
[05:45:44.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:22:0)
[05:45:44.494] Build status: STARTED
[05:45:44.494] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:23:0) after 5m18s
[05:51:02.511] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:23:0)
[05:51:02.528] Build status: STARTED
[05:51:02.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:24:0) after 5m34s
[05:56:36.588] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:24:0)
[05:56:36.617] Build status: STARTED
[05:56:36.617] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:25:0) after 9m26s
[06:06:02.683] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:25:0)
[06:06:02.706] Build status: STARTED
[06:06:02.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:26:0) after 5m5s
[06:11:07.747] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:26:0)
[06:11:07.767] Build status: STARTED
[06:11:07.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:27:0) after 3m1s
[06:14:08.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:27:0)
[06:14:08.837] Build status: STARTED
[06:14:08.837] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:28:0) after 9m1s
[06:23:09.850] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:28:0)
[06:23:09.870] Build status: STARTED
[06:23:09.870] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:29:0) after 8m44s
[06:31:53.847] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:29:0)
[06:31:53.920] Build status: STARTED
[06:31:53.920] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:30:0) after 1m21s
[06:33:15.000] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:30:0)
[06:33:15.020] Build status: STARTED
[06:33:15.021] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:31:0) after 6m5s
[06:39:20.010] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:31:0)
[06:39:20.038] Build status: STARTED
[06:39:20.038] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:32:0) after 5m36s
[06:44:56.125] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:32:0)
[06:44:56.142] Build status: STARTED
[06:44:56.143] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:33:0) after 8m27s
[06:53:23.161] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:33:0)
[06:53:23.181] Build status: STARTED
[06:53:23.181] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:34:0) after 2m54s
[06:56:17.233] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:34:0)
[06:56:17.252] Build status: STARTED
[06:56:17.252] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:35:0) after 2m22s
[06:58:39.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:35:0)
[06:58:39.507] Build status: STARTED
[06:58:39.507] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:36:0) after 6m26s
[07:05:05.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:36:0)
[07:05:05.544] Build status: STARTED
[07:05:05.544] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:37:0) after 8m45s
[07:13:50.559] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:37:0)
[07:13:50.576] Build status: STARTED
[07:13:50.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:38:0) after 2m29s
[07:16:19.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:38:0)
[07:16:19.669] Build status: STARTED
[07:16:19.669] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:39:0) after 7m28s
[07:23:47.688] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:39:0)
[07:23:47.706] Build status: STARTED
[07:23:47.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:40:0) after 9m5s
[07:32:52.777] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:40:0)
[07:32:52.795] Build status: STARTED
[07:32:52.795] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:41:0) after 8m19s
[07:41:11.867] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:41:0)
[07:41:11.885] Build status: STARTED
[07:41:11.886] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:42:0) after 2m48s
[07:44:00.299] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:42:0)
[07:44:00.321] Build status: STARTED
[07:44:00.321] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:43:0) after 7m4s
[07:51:04.377] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:43:0)
[07:51:04.396] Build status: STARTED
[07:51:04.397] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:44:0) after 2m37s
[07:53:41.412] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:44:0)
[07:53:41.428] Build status: STARTED
[07:53:41.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:45:0) after 1m58s
[07:55:39.486] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:45:0)
[07:55:39.522] Build status: STARTED
[07:55:39.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:46:0) after 9m31s
[08:05:10.788] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:46:0)
[08:05:10.803] Build status: STARTED
[08:05:10.803] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:47:0) after 5m2s
[08:10:13.117] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:47:0)
[08:10:13.133] Build status: STARTED
[08:10:13.133] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:48:0) after 7m24s
[08:17:37.149] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:48:0)
[08:17:37.183] Build status: STARTED
[08:17:37.183] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:49:0) after 3m41s
[08:21:18.226] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:49:0)
[08:21:18.250] Build status: STARTED
[08:21:18.251] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:50:0) after 8m20s
[08:29:38.783] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:50:0)
[08:29:38.811] Build status: STARTED
[08:29:38.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:51:0) after 8m29s
[08:38:07.932] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:51:0)
[08:38:07.946] Build status: STARTED
[08:38:07.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:52:0) after 1m16s
[08:39:24.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:52:0)
[08:39:24.285] Build status: STARTED
[08:39:24.285] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:53:0) after 2m16s
[08:41:40.373] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:53:0)
[08:41:40.393] Build status: STARTED
[08:41:40.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:54:0) after 6m10s
[08:47:50.931] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:54:0)
[08:47:50.949] Build status: STARTED
[08:47:50.949] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:55:0) after 3m46s
[08:51:36.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:55:0)
[08:51:36.998] Build status: STARTED
[08:51:36.998] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8851003394151361808:56:0) after 8m5s
[08:54:12.065] Received PubSub notification, asking Buildbucket for the build status
[08:54:12.086] Build:
{
"id": "8685573332177320353",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10460,
"createdBy": "project:chromium",
"createTime": "2026-04-03T04:00:12.047862105Z",
"startTime": "2026-04-03T04:00:16.869849009Z",
"endTime": "2026-04-03T08:54:11.546354635Z",
"updateTime": "2026-04-03T08:54:11.546354635Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1902694295dcaa1851ff2cc6de146415939bdef5",
"ref": "refs/heads/main"
}
}
}
[08:54:12.086] Invocation finished in 4h54m1.304918818s with status FAILED