[04:00:06.565] New invocation is queued and will start shortly
[04:00:07.873] Starting the invocation (attempt 1)
[04:00:07.899] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dfb8bf4b9f8f29128fc9cc4b6e126994b8f50c98"
[04:00:07.900] Popped gitiles commit info from properties and tags
[04:00:07.900] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.900] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.901] Buildbucket request:
{
"requestId": "8845658177559716320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dfb8bf4b9f8f29128fc9cc4b6e126994b8f50c98",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8845658177559716320"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:08.402] Scheduled build:
{
"id": "8680228115434220865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10519,
"createdBy": "project:chromium",
"createTime": "2026-06-01T04:00:07.970835389Z",
"updateTime": "2026-06-01T04:00:07.970835389Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dfb8bf4b9f8f29128fc9cc4b6e126994b8f50c98",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:08.402] Task URL: https://cr-buildbucket.appspot.com/build/8680228115434220865
[04:00:08.402] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:2:0) after 2m57s
[04:00:08.952] Received PubSub notification, asking Buildbucket for the build status
[04:00:09.043] Build status: SCHEDULED
[04:00:12.449] Received PubSub notification, asking Buildbucket for the build status
[04:00:12.472] Build status: STARTED
[04:03:05.476] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:2:0)
[04:03:05.520] Build status: STARTED
[04:03:05.520] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:5:0) after 8m48s
[04:11:53.533] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:5:0)
[04:11:53.555] Build status: STARTED
[04:11:53.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:6:0) after 2m25s
[04:14:18.573] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:6:0)
[04:14:18.593] Build status: STARTED
[04:14:18.593] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:7:0) after 7m49s
[04:22:07.615] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:7:0)
[04:22:07.690] Build status: STARTED
[04:22:07.690] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:8:0) after 8m16s
[04:30:23.707] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:8:0)
[04:30:23.723] Build status: STARTED
[04:30:23.723] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:9:0) after 7m7s
[04:37:30.730] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:9:0)
[04:37:30.747] Build status: STARTED
[04:37:30.747] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:10:0) after 5m10s
[04:42:40.762] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:10:0)
[04:42:40.779] Build status: STARTED
[04:42:40.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:11:0) after 7m11s
[04:49:51.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:11:0)
[04:49:51.894] Build status: STARTED
[04:49:51.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:12:0) after 2m12s
[04:52:03.930] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:12:0)
[04:52:03.950] Build status: STARTED
[04:52:03.950] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:13:0) after 4m30s
[04:56:33.971] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:13:0)
[04:56:34.077] Build status: STARTED
[04:56:34.077] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:14:0) after 2m46s
[04:59:20.091] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:14:0)
[04:59:20.114] Build status: STARTED
[04:59:20.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:15:0) after 1m28s
[05:00:48.233] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:15:0)
[05:00:48.277] Build status: STARTED
[05:00:48.277] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:16:0) after 8m53s
[05:09:41.481] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:16:0)
[05:09:41.502] Build status: STARTED
[05:09:41.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:17:0) after 4m1s
[05:13:42.550] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:17:0)
[05:13:42.699] Build status: STARTED
[05:13:42.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:18:0) after 6m0s
[05:19:42.790] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:18:0)
[05:19:42.806] Build status: STARTED
[05:19:42.806] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:19:0) after 2m47s
[05:22:29.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:19:0)
[05:22:29.885] Build status: STARTED
[05:22:29.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:20:0) after 7m24s
[05:29:53.905] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:20:0)
[05:29:53.924] Build status: STARTED
[05:29:53.924] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:21:0) after 8m40s
[05:38:34.027] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:21:0)
[05:38:34.044] Build status: STARTED
[05:38:34.044] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:22:0) after 4m58s
[05:43:32.172] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:22:0)
[05:43:32.217] Build status: STARTED
[05:43:32.217] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:23:0) after 3m56s
[05:47:28.227] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:23:0)
[05:47:28.246] Build status: STARTED
[05:47:28.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:24:0) after 1m46s
[05:49:14.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:24:0)
[05:49:14.578] Build status: STARTED
[05:49:14.578] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:25:0) after 7m58s
[05:57:12.998] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:25:0)
[05:57:13.018] Build status: STARTED
[05:57:13.018] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:26:0) after 6m20s
[06:03:33.156] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:26:0)
[06:03:33.177] Build status: STARTED
[06:03:33.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:27:0) after 3m59s
[06:07:32.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:27:0)
[06:07:32.220] Build status: STARTED
[06:07:32.220] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:28:0) after 4m39s
[06:12:11.234] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:28:0)
[06:12:11.250] Build status: STARTED
[06:12:11.250] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:29:0) after 1m4s
[06:13:15.280] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:29:0)
[06:13:15.294] Build status: STARTED
[06:13:15.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:30:0) after 3m9s
[06:16:24.918] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:30:0)
[06:16:24.936] Build status: STARTED
[06:16:24.936] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:31:0) after 7m4s
[06:23:29.348] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:31:0)
[06:23:29.382] Build status: STARTED
[06:23:29.382] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:32:0) after 4m41s
[06:28:10.424] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:32:0)
[06:28:10.446] Build status: STARTED
[06:28:10.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:33:0) after 8m54s
[06:37:04.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:33:0)
[06:37:04.581] Build status: STARTED
[06:37:04.581] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:34:0) after 1m47s
[06:38:51.650] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:34:0)
[06:38:51.665] Build status: STARTED
[06:38:51.665] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:35:0) after 8m53s
[06:47:44.746] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:35:0)
[06:47:44.763] Build status: STARTED
[06:47:44.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:36:0) after 8m6s
[06:55:50.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:36:0)
[06:55:50.805] Build status: STARTED
[06:55:50.805] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:37:0) after 6m40s
[07:02:30.825] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:37:0)
[07:02:30.846] Build status: STARTED
[07:02:30.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:38:0) after 8m54s
[07:11:24.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:38:0)
[07:11:24.879] Build status: STARTED
[07:11:24.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:39:0) after 1m47s
[07:13:11.897] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:39:0)
[07:13:11.920] Build status: STARTED
[07:13:11.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8845658177559716320:40:0) after 6m15s
[07:16:17.607] Received PubSub notification, asking Buildbucket for the build status
[07:16:17.657] Build:
{
"id": "8680228115434220865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 10519,
"createdBy": "project:chromium",
"createTime": "2026-06-01T04:00:07.970835389Z",
"startTime": "2026-06-01T04:00:11.961261455Z",
"endTime": "2026-06-01T07:16:17.053496835Z",
"updateTime": "2026-06-01T07:16:17.053496835Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dfb8bf4b9f8f29128fc9cc4b6e126994b8f50c98",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:16:17.657] Invocation finished in 3h16m11.096770559s with status FAILED