[13:11:46.276] New invocation is queued and will start shortly
[13:11:47.360] Starting the invocation (attempt 1)
[13:11:47.395] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5efcbbf2b5910d48bd90a0780e5f5b27d203a7fd"
[13:11:47.395] Popped gitiles commit info from properties and tags
[13:11:47.395] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:11:47.397] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:11:47.397] Buildbucket request:
{
"requestId": "8969378926114517680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5efcbbf2b5910d48bd90a0780e5f5b27d203a7fd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8969378926114517680"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:11:47.993] Scheduled build:
{
"id": "8803948864188798113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8274,
"createdBy": "project:chromium",
"createTime": "2022-09-04T13:11:47.477953494Z",
"updateTime": "2022-09-04T13:11:47.477953494Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5efcbbf2b5910d48bd90a0780e5f5b27d203a7fd",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:11:47.993] Task URL: https://cr-buildbucket.appspot.com/build/8803948864188798113
[13:11:47.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:2:0) after 6m46s
[13:18:34.011] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:2:0)
[13:18:34.034] Build status: SCHEDULED
[13:18:34.034] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:3:0) after 3m21s
[13:21:55.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:3:0)
[13:21:55.312] Build status: SCHEDULED
[13:21:55.312] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:4:0) after 8m31s
[13:30:26.330] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:4:0)
[13:30:26.357] Build status: SCHEDULED
[13:30:26.357] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:5:0) after 8m40s
[13:39:06.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:5:0)
[13:39:06.399] Build status: SCHEDULED
[13:39:06.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:6:0) after 6m12s
[13:45:18.741] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:6:0)
[13:45:18.846] Build status: SCHEDULED
[13:45:18.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:7:0) after 9m33s
[13:54:52.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:7:0)
[13:54:52.519] Build status: SCHEDULED
[13:54:52.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:8:0) after 5m6s
[13:59:58.892] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:8:0)
[13:59:58.913] Build status: SCHEDULED
[13:59:58.913] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:9:0) after 4m11s
[14:04:10.167] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:9:0)
[14:04:10.204] Build status: SCHEDULED
[14:04:10.204] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:10:0) after 7m54s
[14:12:04.422] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:10:0)
[14:12:04.459] Build status: SCHEDULED
[14:12:04.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:11:0) after 1m51s
[14:13:55.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:11:0)
[14:13:55.513] Build status: SCHEDULED
[14:13:55.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:12:0) after 5m22s
[14:19:17.542] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:12:0)
[14:19:17.566] Build status: SCHEDULED
[14:19:17.566] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:13:0) after 8m45s
[14:28:03.057] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:13:0)
[14:28:03.076] Build status: SCHEDULED
[14:28:03.076] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:14:0) after 3m44s
[14:31:47.095] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:14:0)
[14:31:47.123] Build status: SCHEDULED
[14:31:47.123] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:15:0) after 8m33s
[14:40:20.162] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:15:0)
[14:40:20.183] Build status: SCHEDULED
[14:40:20.183] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:16:0) after 1m0s
[14:41:20.673] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:16:0)
[14:41:20.697] Build status: SCHEDULED
[14:41:20.697] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:17:0) after 8m34s
[14:49:54.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:17:0)
[14:49:54.949] Build status: SCHEDULED
[14:49:54.949] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:18:0) after 3m10s
[14:53:04.969] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:18:0)
[14:53:04.996] Build status: SCHEDULED
[14:53:04.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:19:0) after 6m28s
[14:59:33.210] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:19:0)
[14:59:33.288] Build status: SCHEDULED
[14:59:33.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:20:0) after 8m48s
[15:08:21.307] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:20:0)
[15:08:21.334] Build status: SCHEDULED
[15:08:21.334] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:21:0) after 2m11s
[15:10:33.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:21:0)
[15:10:33.108] Build status: SCHEDULED
[15:10:33.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:22:0) after 1m2s
[15:11:35.989] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:22:0)
[15:11:36.010] Build status: SCHEDULED
[15:11:36.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:23:0) after 4m37s
[15:16:13.239] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:23:0)
[15:16:13.269] Build status: SCHEDULED
[15:16:13.269] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:24:0) after 9m1s
[15:25:14.988] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:24:0)
[15:25:15.020] Build status: SCHEDULED
[15:25:15.020] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:25:0) after 8m17s
[15:33:32.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:25:0)
[15:33:32.315] Build status: SCHEDULED
[15:33:32.315] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:26:0) after 2m26s
[15:35:58.608] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:26:0)
[15:35:58.628] Build status: SCHEDULED
[15:35:58.628] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:27:0) after 4m3s
[15:40:02.013] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:27:0)
[15:40:02.034] Build status: SCHEDULED
[15:40:02.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:28:0) after 5m28s
[15:45:30.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:28:0)
[15:45:30.087] Build status: SCHEDULED
[15:45:30.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:29:0) after 6m1s
[15:51:31.105] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:29:0)
[15:51:31.129] Build status: SCHEDULED
[15:51:31.129] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:30:0) after 2m45s
[15:54:16.151] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:30:0)
[15:54:16.176] Build status: SCHEDULED
[15:54:16.176] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:31:0) after 8m10s
[16:02:26.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:31:0)
[16:02:26.351] Build status: SCHEDULED
[16:02:26.351] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:32:0) after 2m34s
[16:05:00.367] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:32:0)
[16:05:00.392] Build status: SCHEDULED
[16:05:00.392] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:33:0) after 9m20s
[16:14:20.409] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:33:0)
[16:14:20.440] Build status: SCHEDULED
[16:14:20.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:34:0) after 8m45s
[16:23:05.458] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:34:0)
[16:23:05.487] Build status: SCHEDULED
[16:23:05.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:35:0) after 3m18s
[16:26:23.511] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:35:0)
[16:26:23.533] Build status: SCHEDULED
[16:26:23.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:36:0) after 3m2s
[16:29:25.656] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:36:0)
[16:29:25.697] Build status: SCHEDULED
[16:29:25.697] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:37:0) after 5m6s
[16:34:31.733] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:37:0)
[16:34:31.761] Build status: SCHEDULED
[16:34:31.761] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:38:0) after 1m26s
[16:35:57.820] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:38:0)
[16:35:57.847] Build status: SCHEDULED
[16:35:57.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:39:0) after 6m13s
[16:42:10.936] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:39:0)
[16:42:10.958] Build status: SCHEDULED
[16:42:10.958] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:40:0) after 9m50s
[16:52:01.017] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:40:0)
[16:52:01.054] Build status: SCHEDULED
[16:52:01.054] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:41:0) after 2m5s
[16:54:06.094] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:41:0)
[16:54:06.124] Build status: SCHEDULED
[16:54:06.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:42:0) after 6m56s
[17:01:02.200] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:42:0)
[17:01:02.275] Build status: SCHEDULED
[17:01:02.275] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:43:0) after 9m40s
[17:10:42.348] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:43:0)
[17:10:42.378] Build status: SCHEDULED
[17:10:42.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:44:0) after 7m50s
[17:18:32.492] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:44:0)
[17:18:32.522] Build status: SCHEDULED
[17:18:32.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:45:0) after 2m48s
[17:21:20.529] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:45:0)
[17:21:20.560] Build status: SCHEDULED
[17:21:20.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:46:0) after 9m48s
[17:31:08.581] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:46:0)
[17:31:08.602] Build status: SCHEDULED
[17:31:08.602] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:47:0) after 6m10s
[17:37:18.626] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:47:0)
[17:37:18.649] Build status: SCHEDULED
[17:37:18.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:48:0) after 6m27s
[17:43:45.799] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:48:0)
[17:43:45.888] Build status: SCHEDULED
[17:43:45.888] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:49:0) after 2m57s
[17:46:42.952] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:49:0)
[17:46:42.989] Build status: SCHEDULED
[17:46:42.989] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:50:0) after 8m20s
[17:55:03.075] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:50:0)
[17:55:03.101] Build status: SCHEDULED
[17:55:03.101] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:51:0) after 7m37s
[18:02:40.210] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:51:0)
[18:02:40.250] Build status: SCHEDULED
[18:02:40.250] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:52:0) after 1m55s
[18:04:35.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:52:0)
[18:04:35.293] Build status: SCHEDULED
[18:04:35.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:53:0) after 3m54s
[18:08:29.312] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:53:0)
[18:08:29.344] Build status: SCHEDULED
[18:08:29.344] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:54:0) after 6m36s
[18:15:05.377] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:54:0)
[18:15:05.402] Build status: SCHEDULED
[18:15:05.402] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:55:0) after 5m2s
[18:20:07.483] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:55:0)
[18:20:07.515] Build status: SCHEDULED
[18:20:07.515] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:56:0) after 5m4s
[18:25:11.597] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:56:0)
[18:25:11.618] Build status: SCHEDULED
[18:25:11.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:57:0) after 1m34s
[18:26:45.833] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:57:0)
[18:26:45.859] Build status: SCHEDULED
[18:26:45.859] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:58:0) after 7m46s
[18:34:31.832] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:58:0)
[18:34:31.905] Build status: SCHEDULED
[18:34:31.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:59:0) after 9m26s
[18:43:57.933] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:59:0)
[18:43:57.953] Build status: SCHEDULED
[18:43:57.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:60:0) after 9m19s
[18:53:17.283] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:60:0)
[18:53:17.305] Build status: SCHEDULED
[18:53:17.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:61:0) after 9m34s
[19:02:51.425] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:61:0)
[19:02:51.446] Build status: SCHEDULED
[19:02:51.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:62:0) after 2m56s
[19:05:47.566] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:62:0)
[19:05:47.588] Build status: SCHEDULED
[19:05:47.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8969378926114517680:63:0) after 8m44s
[19:12:10.744] Received PubSub notification, asking Buildbucket for the build status
[19:12:10.768] Build:
{
"id": "8803948864188798113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8274,
"createdBy": "project:chromium",
"createTime": "2022-09-04T13:11:47.477953494Z",
"endTime": "2022-09-04T19:12:04.735370Z",
"updateTime": "2022-09-04T19:12:04.735370Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5efcbbf2b5910d48bd90a0780e5f5b27d203a7fd",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:12:10.768] Invocation finished in 6h0m24.5110031s with status FAILED