[14:02:22.550] New invocation is queued and will start shortly
[14:02:23.988] Starting the invocation (attempt 1)
[14:02:24.050] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/878f011a6627a3eccedc62828bc2533d123d71bd"
[14:02:24.050] Popped gitiles commit info from properties and tags
[14:02:24.050] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:02:24.050] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:02:24.050] Buildbucket request:
{
"requestId": "8960044254800620112",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "878f011a6627a3eccedc62828bc2533d123d71bd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8960044254800620112"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:02:24.554] Scheduled build:
{
"id": "8794614192441262241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8912,
"createdBy": "project:chromium",
"createTime": "2022-12-16T14:02:24.174176525Z",
"updateTime": "2022-12-16T14:02:24.174176525Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "878f011a6627a3eccedc62828bc2533d123d71bd",
"ref": "refs/heads/main"
}
}
}
[14:02:24.554] Task URL: https://cr-buildbucket.appspot.com/build/8794614192441262241
[14:02:24.554] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:2:0) after 1m41s
[14:04:05.705] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:2:0)
[14:04:05.744] Build status: SCHEDULED
[14:04:05.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:3:0) after 5m47s
[14:09:52.768] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:3:0)
[14:09:52.789] Build status: SCHEDULED
[14:09:52.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:4:0) after 5m29s
[14:15:21.815] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:4:0)
[14:15:21.833] Build status: SCHEDULED
[14:15:21.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:5:0) after 2m59s
[14:18:20.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:5:0)
[14:18:20.974] Build status: SCHEDULED
[14:18:20.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:6:0) after 7m35s
[14:25:56.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:6:0)
[14:25:56.055] Build status: SCHEDULED
[14:25:56.055] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:7:0) after 7m37s
[14:33:33.081] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:7:0)
[14:33:33.123] Build status: SCHEDULED
[14:33:33.123] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:8:0) after 5m44s
[14:39:17.144] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:8:0)
[14:39:17.167] Build status: SCHEDULED
[14:39:17.167] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:9:0) after 9m55s
[14:49:12.207] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:9:0)
[14:49:12.235] Build status: SCHEDULED
[14:49:12.235] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:10:0) after 2m53s
[14:52:05.256] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:10:0)
[14:52:05.305] Build status: SCHEDULED
[14:52:05.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:11:0) after 8m5s
[15:00:10.364] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:11:0)
[15:00:10.427] Build status: SCHEDULED
[15:00:10.427] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:12:0) after 2m49s
[15:01:19.418] Received PubSub notification, asking Buildbucket for the build status
[15:01:19.528] Build status: STARTED
[15:02:59.776] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:12:0)
[15:02:59.797] Build status: STARTED
[15:02:59.797] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:14:0) after 8m15s
[15:11:14.836] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:14:0)
[15:11:14.860] Build status: STARTED
[15:11:14.860] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:15:0) after 1m7s
[15:12:21.877] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:15:0)
[15:12:21.902] Build status: STARTED
[15:12:21.902] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:16:0) after 7m18s
[15:19:40.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:16:0)
[15:19:40.103] Build status: STARTED
[15:19:40.103] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:17:0) after 1m58s
[15:21:38.347] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:17:0)
[15:21:38.370] Build status: STARTED
[15:21:38.370] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:18:0) after 7m55s
[15:29:33.392] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:18:0)
[15:29:33.414] Build status: STARTED
[15:29:33.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:19:0) after 4m27s
[15:34:00.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:19:0)
[15:34:00.512] Build status: STARTED
[15:34:00.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:20:0) after 7m23s
[15:41:23.666] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:20:0)
[15:41:23.700] Build status: STARTED
[15:41:23.700] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:21:0) after 9m44s
[15:51:07.744] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:21:0)
[15:51:07.768] Build status: STARTED
[15:51:07.768] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:22:0) after 3m49s
[15:54:57.228] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:22:0)
[15:54:57.252] Build status: STARTED
[15:54:57.252] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:23:0) after 9m16s
[16:04:13.255] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:23:0)
[16:04:13.278] Build status: STARTED
[16:04:13.278] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:24:0) after 6m46s
[16:10:59.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:24:0)
[16:10:59.545] Build status: STARTED
[16:10:59.545] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:25:0) after 2m0s
[16:12:59.602] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:25:0)
[16:12:59.626] Build status: STARTED
[16:12:59.626] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:26:0) after 9m33s
[16:22:32.850] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:26:0)
[16:22:32.869] Build status: STARTED
[16:22:32.869] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:27:0) after 8m46s
[16:31:18.861] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:27:0)
[16:31:18.884] Build status: STARTED
[16:31:18.884] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:28:0) after 9m23s
[16:40:41.912] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:28:0)
[16:40:41.943] Build status: STARTED
[16:40:41.943] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:29:0) after 6m14s
[16:46:56.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:29:0)
[16:46:56.537] Build status: STARTED
[16:46:56.537] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:30:0) after 4m20s
[16:51:16.557] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:30:0)
[16:51:16.634] Build status: STARTED
[16:51:16.634] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:31:0) after 3m25s
[16:54:41.747] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:31:0)
[16:54:41.833] Build status: STARTED
[16:54:41.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:32:0) after 9m23s
[17:04:04.856] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:32:0)
[17:04:04.925] Build status: STARTED
[17:04:04.925] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:33:0) after 5m38s
[17:09:43.047] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:33:0)
[17:09:43.110] Build status: STARTED
[17:09:43.110] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:34:0) after 1m12s
[17:10:55.418] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:34:0)
[17:10:55.441] Build status: STARTED
[17:10:55.441] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:35:0) after 7m31s
[17:18:26.566] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:35:0)
[17:18:26.588] Build status: STARTED
[17:18:26.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:36:0) after 9m9s
[17:27:35.887] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:36:0)
[17:27:35.935] Build status: STARTED
[17:27:35.935] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:37:0) after 4m41s
[17:32:17.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:37:0)
[17:32:17.239] Build status: STARTED
[17:32:17.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:38:0) after 5m5s
[17:37:22.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:38:0)
[17:37:22.282] Build status: STARTED
[17:37:22.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:39:0) after 8m35s
[17:45:57.384] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:39:0)
[17:45:57.415] Build status: STARTED
[17:45:57.415] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:40:0) after 3m2s
[17:48:59.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:40:0)
[17:48:59.626] Build status: STARTED
[17:48:59.626] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:41:0) after 8m44s
[17:57:43.750] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:41:0)
[17:57:43.774] Build status: STARTED
[17:57:43.774] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:42:0) after 6m49s
[18:04:33.026] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:42:0)
[18:04:33.047] Build status: STARTED
[18:04:33.047] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:43:0) after 4m35s
[18:09:08.111] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:43:0)
[18:09:08.152] Build status: STARTED
[18:09:08.152] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:44:0) after 2m24s
[18:11:32.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:44:0)
[18:11:32.953] Build status: STARTED
[18:11:32.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:45:0) after 8m48s
[18:20:21.031] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:45:0)
[18:20:21.086] Build status: STARTED
[18:20:21.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:46:0) after 6m21s
[18:26:42.357] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:46:0)
[18:26:42.378] Build status: STARTED
[18:26:42.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:47:0) after 3m17s
[18:29:59.568] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:47:0)
[18:29:59.594] Build status: STARTED
[18:29:59.594] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:48:0) after 6m47s
[18:36:46.638] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:48:0)
[18:36:46.662] Build status: STARTED
[18:36:46.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:49:0) after 7m29s
[18:44:15.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:49:0)
[18:44:15.949] Build status: STARTED
[18:44:15.949] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:50:0) after 6m11s
[18:50:27.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:50:0)
[18:50:27.303] Build status: STARTED
[18:50:27.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:51:0) after 9m8s
[18:59:35.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:51:0)
[18:59:35.599] Build status: STARTED
[18:59:35.599] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:52:0) after 7m39s
[19:07:14.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:52:0)
[19:07:14.794] Build status: STARTED
[19:07:14.794] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:53:0) after 8m47s
[19:16:02.138] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:53:0)
[19:16:02.165] Build status: STARTED
[19:16:02.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:54:0) after 3m45s
[19:19:47.190] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:54:0)
[19:19:47.212] Build status: STARTED
[19:19:47.212] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:55:0) after 5m28s
[19:25:15.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:55:0)
[19:25:15.322] Build status: STARTED
[19:25:15.322] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:56:0) after 1m1s
[19:26:16.356] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:56:0)
[19:26:16.381] Build status: STARTED
[19:26:16.381] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:57:0) after 2m11s
[19:28:27.598] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:57:0)
[19:28:27.621] Build status: STARTED
[19:28:27.621] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:58:0) after 4m47s
[19:33:14.742] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:58:0)
[19:33:14.767] Build status: STARTED
[19:33:14.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:59:0) after 5m37s
[19:38:51.739] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:59:0)
[19:38:51.758] Build status: STARTED
[19:38:51.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:60:0) after 1m28s
[19:40:19.792] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:60:0)
[19:40:19.827] Build status: STARTED
[19:40:19.827] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:61:0) after 4m17s
[19:44:37.698] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:61:0)
[19:44:37.724] Build status: STARTED
[19:44:37.724] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:62:0) after 6m49s
[19:51:26.803] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:62:0)
[19:51:26.835] Build status: STARTED
[19:51:26.835] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:63:0) after 8m22s
[19:59:48.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:63:0)
[19:59:48.933] Build status: STARTED
[19:59:48.933] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:64:0) after 5m12s
[20:05:00.958] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:64:0)
[20:05:01.030] Build status: STARTED
[20:05:01.030] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:65:0) after 5m37s
[20:10:38.153] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:65:0)
[20:10:38.176] Build status: STARTED
[20:10:38.176] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8960044254800620112:66:0) after 9m51s
[20:17:31.032] Received PubSub notification, asking Buildbucket for the build status
[20:17:31.056] Build:
{
"id": "8794614192441262241",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8912,
"createdBy": "project:chromium",
"createTime": "2022-12-16T14:02:24.174176525Z",
"startTime": "2022-12-16T15:01:18.640386Z",
"endTime": "2022-12-16T20:17:30.612626054Z",
"updateTime": "2022-12-16T20:17:30.612626054Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "878f011a6627a3eccedc62828bc2533d123d71bd",
"ref": "refs/heads/main"
}
}
}
[20:17:31.056] Invocation finished in 6h15m8.514302904s with status FAILED