[16:44:10.252] New invocation is queued and will start shortly
[16:44:12.178] Starting the invocation (attempt 1)
[16:44:12.222] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1650d65e01254df4f66ec70875ea915284d42970"
[16:44:12.222] Popped gitiles commit info from properties and tags
[16:44:12.222] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:44:12.222] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:44:12.222] Buildbucket request:
{
"requestId": "8968368996446131088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1650d65e01254df4f66ec70875ea915284d42970",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8968368996446131088"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:44:12.810] Scheduled build:
{
"id": "8802938933657682545",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8335,
"createdBy": "project:chromium",
"createTime": "2022-09-15T16:44:12.286542664Z",
"updateTime": "2022-09-15T16:44:12.286542664Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1650d65e01254df4f66ec70875ea915284d42970",
"ref": "refs/heads/main"
}
}
}
[16:44:12.810] Task URL: https://cr-buildbucket.appspot.com/build/8802938933657682545
[16:44:12.810] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:2:0) after 2m1s
[16:46:13.837] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:2:0)
[16:46:13.871] Build status: SCHEDULED
[16:46:13.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:3:0) after 4m23s
[16:50:36.949] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:3:0)
[16:50:37.001] Build status: SCHEDULED
[16:50:37.001] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:4:0) after 5m12s
[16:55:49.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:4:0)
[16:55:49.587] Build status: SCHEDULED
[16:55:49.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:5:0) after 7m17s
[17:03:06.825] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:5:0)
[17:03:06.850] Build status: SCHEDULED
[17:03:06.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:6:0) after 7m33s
[17:10:39.894] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:6:0)
[17:10:39.918] Build status: SCHEDULED
[17:10:39.918] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:7:0) after 7m29s
[17:18:08.945] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:7:0)
[17:18:08.974] Build status: SCHEDULED
[17:18:08.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:8:0) after 8m34s
[17:26:43.002] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:8:0)
[17:26:43.076] Build status: SCHEDULED
[17:26:43.076] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:9:0) after 5m18s
[17:32:01.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:9:0)
[17:32:01.095] Build status: SCHEDULED
[17:32:01.095] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:10:0) after 9m53s
[17:41:54.151] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:10:0)
[17:41:54.186] Build status: SCHEDULED
[17:41:54.186] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:11:0) after 9m55s
[17:51:49.281] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:11:0)
[17:51:49.422] Build status: SCHEDULED
[17:51:49.422] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:12:0) after 4m10s
[17:55:59.431] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:12:0)
[17:55:59.481] Build status: SCHEDULED
[17:55:59.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:13:0) after 9m16s
[18:05:15.529] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:13:0)
[18:05:15.559] Build status: SCHEDULED
[18:05:15.559] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:14:0) after 1m45s
[18:07:00.634] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:14:0)
[18:07:00.674] Build status: SCHEDULED
[18:07:00.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:15:0) after 7m30s
[18:14:30.780] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:15:0)
[18:14:30.809] Build status: SCHEDULED
[18:14:30.809] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:16:0) after 4m29s
[18:18:59.939] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:16:0)
[18:18:59.965] Build status: SCHEDULED
[18:18:59.965] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:17:0) after 5m29s
[18:24:28.994] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:17:0)
[18:24:29.014] Build status: SCHEDULED
[18:24:29.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:18:0) after 2m41s
[18:27:10.148] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:18:0)
[18:27:10.173] Build status: SCHEDULED
[18:27:10.173] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:19:0) after 6m20s
[18:33:30.298] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:19:0)
[18:33:30.318] Build status: SCHEDULED
[18:33:30.319] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:20:0) after 4m5s
[18:37:35.343] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:20:0)
[18:37:35.372] Build status: SCHEDULED
[18:37:35.372] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:21:0) after 3m55s
[18:41:30.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:21:0)
[18:41:30.668] Build status: SCHEDULED
[18:41:30.668] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:22:0) after 1m26s
[18:42:56.869] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:22:0)
[18:42:57.031] Build status: SCHEDULED
[18:42:57.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:23:0) after 9m32s
[18:52:29.085] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:23:0)
[18:52:29.126] Build status: SCHEDULED
[18:52:29.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:24:0) after 7m36s
[19:00:05.229] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:24:0)
[19:00:05.267] Build status: SCHEDULED
[19:00:05.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:25:0) after 4m16s
[19:04:21.292] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:25:0)
[19:04:21.321] Build status: SCHEDULED
[19:04:21.321] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:26:0) after 3m2s
[19:07:23.568] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:26:0)
[19:07:23.596] Build status: SCHEDULED
[19:07:23.596] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:27:0) after 7m24s
[19:14:47.723] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:27:0)
[19:14:47.751] Build status: SCHEDULED
[19:14:47.751] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:28:0) after 5m0s
[19:19:47.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:28:0)
[19:19:47.803] Build status: SCHEDULED
[19:19:47.803] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:29:0) after 9m50s
[19:29:37.898] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:29:0)
[19:29:37.944] Build status: SCHEDULED
[19:29:37.944] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:30:0) after 5m3s
[19:34:40.981] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:30:0)
[19:34:41.022] Build status: SCHEDULED
[19:34:41.022] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:31:0) after 8m6s
[19:42:47.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:31:0)
[19:42:47.122] Build status: SCHEDULED
[19:42:47.122] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:32:0) after 7m21s
[19:50:08.157] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:32:0)
[19:50:08.189] Build status: SCHEDULED
[19:50:08.189] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:33:0) after 8m33s
[19:58:41.300] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:33:0)
[19:58:41.403] Build status: SCHEDULED
[19:58:41.403] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:34:0) after 2m18s
[20:00:59.604] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:34:0)
[20:00:59.626] Build status: SCHEDULED
[20:00:59.626] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:35:0) after 5m38s
[20:06:37.649] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:35:0)
[20:06:37.680] Build status: SCHEDULED
[20:06:37.680] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:36:0) after 8m29s
[20:15:07.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:36:0)
[20:15:07.092] Build status: SCHEDULED
[20:15:07.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:37:0) after 8m16s
[20:23:23.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:37:0)
[20:23:23.152] Build status: SCHEDULED
[20:23:23.152] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:38:0) after 9m1s
[20:32:24.198] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:38:0)
[20:32:24.226] Build status: SCHEDULED
[20:32:24.226] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:39:0) after 2m12s
[20:34:36.532] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:39:0)
[20:34:36.560] Build status: SCHEDULED
[20:34:36.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:40:0) after 4m32s
[20:39:08.569] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:40:0)
[20:39:08.594] Build status: SCHEDULED
[20:39:08.594] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:41:0) after 6m59s
[20:46:07.625] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:41:0)
[20:46:07.650] Build status: SCHEDULED
[20:46:07.650] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:42:0) after 9m1s
[20:55:08.975] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:42:0)
[20:55:09.003] Build status: SCHEDULED
[20:55:09.003] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:43:0) after 9m51s
[21:05:00.237] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:43:0)
[21:05:00.272] Build status: SCHEDULED
[21:05:00.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:44:0) after 1m27s
[21:06:27.796] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:44:0)
[21:06:27.827] Build status: SCHEDULED
[21:06:27.827] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:45:0) after 6m54s
[21:13:21.938] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:45:0)
[21:13:21.964] Build status: SCHEDULED
[21:13:21.964] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:46:0) after 7m28s
[21:20:50.101] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:46:0)
[21:20:50.140] Build status: SCHEDULED
[21:20:50.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:47:0) after 8m7s
[21:28:57.860] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:47:0)
[21:28:57.897] Build status: SCHEDULED
[21:28:57.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:48:0) after 1m23s
[21:30:21.045] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:48:0)
[21:30:21.081] Build status: SCHEDULED
[21:30:21.081] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:49:0) after 2m23s
[21:32:44.123] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:49:0)
[21:32:44.151] Build status: SCHEDULED
[21:32:44.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:50:0) after 5m3s
[21:37:47.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:50:0)
[21:37:47.249] Build status: SCHEDULED
[21:37:47.249] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:51:0) after 7m6s
[21:44:53.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:51:0)
[21:44:53.497] Build status: SCHEDULED
[21:44:53.497] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:52:0) after 3m6s
[21:47:59.523] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:52:0)
[21:47:59.583] Build status: SCHEDULED
[21:47:59.583] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:53:0) after 6m34s
[21:54:33.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:53:0)
[21:54:33.877] Build status: SCHEDULED
[21:54:33.878] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:54:0) after 5m13s
[21:59:47.002] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:54:0)
[21:59:47.031] Build status: SCHEDULED
[21:59:47.031] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:55:0) after 5m41s
[22:05:28.163] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:55:0)
[22:05:28.190] Build status: SCHEDULED
[22:05:28.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:56:0) after 5m41s
[22:11:09.329] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:56:0)
[22:11:09.357] Build status: SCHEDULED
[22:11:09.357] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:57:0) after 9m50s
[22:20:59.395] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:57:0)
[22:20:59.426] Build status: SCHEDULED
[22:20:59.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:58:0) after 3m47s
[22:24:46.747] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:58:0)
[22:24:46.772] Build status: SCHEDULED
[22:24:46.772] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:59:0) after 6m22s
[22:31:09.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:59:0)
[22:31:09.079] Build status: SCHEDULED
[22:31:09.079] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:60:0) after 8m42s
[22:39:51.335] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:60:0)
[22:39:51.360] Build status: SCHEDULED
[22:39:51.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8968368996446131088:61:0) after 6m23s
[22:45:10.607] Received PubSub notification, asking Buildbucket for the build status
[22:45:10.637] Build:
{
"id": "8802938933657682545",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8335,
"createdBy": "project:chromium",
"createTime": "2022-09-15T16:44:12.286542664Z",
"endTime": "2022-09-15T22:45:09.906357Z",
"updateTime": "2022-09-15T22:45:09.906357Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1650d65e01254df4f66ec70875ea915284d42970",
"ref": "refs/heads/main"
}
}
}
[22:45:10.637] Invocation finished in 6h1m0.393910846s with status FAILED