[20:22:06.705] New invocation is queued and will start shortly
[20:22:07.772] Starting the invocation (attempt 1)
[20:22:07.803] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ba72b36c3250380e0cf4ef0f534c72975e636c87"
[20:22:07.803] Popped gitiles commit info from properties and tags
[20:22:07.804] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:22:07.806] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:22:07.806] Buildbucket request:
{
"requestId": "8953587979266306256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba72b36c3250380e0cf4ef0f534c72975e636c87",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953587979266306256"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:22:08.284] Scheduled build:
{
"id": "8788157917325547745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60368,
"createdBy": "project:chromium",
"createTime": "2023-02-25T20:22:07.932531868Z",
"updateTime": "2023-02-25T20:22:07.932531868Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba72b36c3250380e0cf4ef0f534c72975e636c87",
"ref": "refs/heads/main"
}
}
}
[20:22:08.284] Task URL: https://cr-buildbucket.appspot.com/build/8788157917325547745
[20:22:08.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:2:0) after 6m17s
[20:28:25.420] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:2:0)
[20:28:25.455] Build status: SCHEDULED
[20:28:25.455] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:3:0) after 5m51s
[20:34:16.446] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:3:0)
[20:34:16.468] Build status: SCHEDULED
[20:34:16.468] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:4:0) after 8m24s
[20:42:40.521] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:4:0)
[20:42:40.543] Build status: SCHEDULED
[20:42:40.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:5:0) after 8m4s
[20:50:44.599] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:5:0)
[20:50:44.619] Build status: SCHEDULED
[20:50:44.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:6:0) after 1m0s
[20:51:44.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:6:0)
[20:51:44.658] Build status: SCHEDULED
[20:51:44.658] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:7:0) after 3m27s
[20:55:11.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:7:0)
[20:55:11.768] Build status: SCHEDULED
[20:55:11.768] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:8:0) after 5m32s
[21:00:43.800] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:8:0)
[21:00:43.837] Build status: SCHEDULED
[21:00:43.837] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:9:0) after 3m4s
[21:03:47.900] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:9:0)
[21:03:47.920] Build status: SCHEDULED
[21:03:47.920] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:10:0) after 9m16s
[21:13:03.944] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:10:0)
[21:13:03.984] Build status: SCHEDULED
[21:13:03.984] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:11:0) after 5m25s
[21:18:29.006] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:11:0)
[21:18:29.025] Build status: SCHEDULED
[21:18:29.025] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:12:0) after 9m31s
[21:28:00.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:12:0)
[21:28:00.102] Build status: SCHEDULED
[21:28:00.102] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:13:0) after 8m1s
[21:36:01.104] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:13:0)
[21:36:01.159] Build status: SCHEDULED
[21:36:01.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:14:0) after 4m8s
[21:40:09.216] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:14:0)
[21:40:09.238] Build status: SCHEDULED
[21:40:09.238] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:15:0) after 5m17s
[21:45:26.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:15:0)
[21:45:26.373] Build status: SCHEDULED
[21:45:26.373] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:16:0) after 5m13s
[21:50:39.397] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:16:0)
[21:50:39.442] Build status: SCHEDULED
[21:50:39.442] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:17:0) after 6m58s
[21:57:37.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:17:0)
[21:57:37.490] Build status: SCHEDULED
[21:57:37.490] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:18:0) after 1m2s
[21:58:39.615] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:18:0)
[21:58:39.639] Build status: SCHEDULED
[21:58:39.639] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:19:0) after 6m37s
[22:05:16.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:19:0)
[22:05:16.689] Build status: SCHEDULED
[22:05:16.689] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:20:0) after 9m35s
[22:14:51.803] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:20:0)
[22:14:51.825] Build status: SCHEDULED
[22:14:51.825] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:21:0) after 7m36s
[22:22:27.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:21:0)
[22:22:27.977] Build status: SCHEDULED
[22:22:27.977] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:22:0) after 6m26s
[22:28:54.342] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:22:0)
[22:28:54.361] Build status: SCHEDULED
[22:28:54.361] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:23:0) after 3m9s
[22:32:03.380] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:23:0)
[22:32:03.401] Build status: SCHEDULED
[22:32:03.401] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:24:0) after 4m51s
[22:36:54.511] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:24:0)
[22:36:54.531] Build status: SCHEDULED
[22:36:54.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:25:0) after 2m54s
[22:39:48.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:25:0)
[22:39:48.571] Build status: SCHEDULED
[22:39:48.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:26:0) after 3m53s
[22:43:41.595] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:26:0)
[22:43:41.616] Build status: SCHEDULED
[22:43:41.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:27:0) after 9m10s
[22:52:51.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:27:0)
[22:52:51.686] Build status: SCHEDULED
[22:52:51.686] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:28:0) after 8m7s
[23:00:58.833] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:28:0)
[23:00:59.153] Build status: SCHEDULED
[23:00:59.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:29:0) after 5m5s
[23:06:04.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:29:0)
[23:06:04.277] Build status: SCHEDULED
[23:06:04.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:30:0) after 9m41s
[23:15:45.286] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:30:0)
[23:15:45.309] Build status: SCHEDULED
[23:15:45.310] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:31:0) after 2m1s
[23:17:46.457] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:31:0)
[23:17:46.500] Build status: SCHEDULED
[23:17:46.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:32:0) after 1m12s
[23:18:58.534] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:32:0)
[23:18:58.551] Build status: SCHEDULED
[23:18:58.551] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:33:0) after 6m49s
[23:25:47.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:33:0)
[23:25:47.596] Build status: SCHEDULED
[23:25:47.596] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:34:0) after 1m39s
[23:27:26.662] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:34:0)
[23:27:26.705] Build status: SCHEDULED
[23:27:26.705] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:35:0) after 6m11s
[23:33:37.916] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:35:0)
[23:33:37.937] Build status: SCHEDULED
[23:33:37.937] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:36:0) after 1m26s
[23:35:04.132] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:36:0)
[23:35:04.153] Build status: SCHEDULED
[23:35:04.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:37:0) after 6m38s
[23:41:42.173] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:37:0)
[23:41:42.191] Build status: SCHEDULED
[23:41:42.191] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:38:0) after 6m41s
[23:48:23.826] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:38:0)
[23:48:23.850] Build status: SCHEDULED
[23:48:23.850] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:39:0) after 7m19s
[23:55:43.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:39:0)
[23:55:43.155] Build status: SCHEDULED
[23:55:43.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:40:0) after 9m18s
[00:05:01.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:40:0)
[00:05:01.201] Build status: SCHEDULED
[00:05:01.201] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:41:0) after 3m52s
[00:08:53.327] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:41:0)
[00:08:53.356] Build status: SCHEDULED
[00:08:53.356] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:42:0) after 1m34s
[00:10:27.475] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:42:0)
[00:10:27.503] Build status: SCHEDULED
[00:10:27.503] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:43:0) after 6m40s
[00:17:07.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:43:0)
[00:17:07.548] Build status: SCHEDULED
[00:17:07.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:44:0) after 3m16s
[00:20:23.655] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:44:0)
[00:20:23.674] Build status: SCHEDULED
[00:20:23.674] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:45:0) after 3m30s
[00:23:53.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:45:0)
[00:23:53.713] Build status: SCHEDULED
[00:23:53.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:46:0) after 6m41s
[00:30:34.743] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:46:0)
[00:30:34.775] Build status: SCHEDULED
[00:30:34.775] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:47:0) after 8m39s
[00:39:13.806] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:47:0)
[00:39:13.832] Build status: SCHEDULED
[00:39:13.832] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:48:0) after 5m59s
[00:45:12.857] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:48:0)
[00:45:12.881] Build status: SCHEDULED
[00:45:12.881] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:49:0) after 2m17s
[00:47:30.067] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:49:0)
[00:47:30.097] Build status: SCHEDULED
[00:47:30.097] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:50:0) after 6m52s
[00:54:22.292] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:50:0)
[00:54:22.316] Build status: SCHEDULED
[00:54:22.316] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:51:0) after 7m13s
[01:01:35.547] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:51:0)
[01:01:35.572] Build status: SCHEDULED
[01:01:35.572] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:52:0) after 5m28s
[01:07:04.151] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:52:0)
[01:07:04.176] Build status: SCHEDULED
[01:07:04.176] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:53:0) after 1m52s
[01:08:56.639] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:53:0)
[01:08:56.666] Build status: SCHEDULED
[01:08:56.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:54:0) after 1m37s
[01:10:33.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:54:0)
[01:10:33.757] Build status: SCHEDULED
[01:10:33.757] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:55:0) after 7m9s
[01:17:43.337] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:55:0)
[01:17:43.359] Build status: SCHEDULED
[01:17:43.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:56:0) after 9m27s
[01:27:10.659] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:56:0)
[01:27:10.686] Build status: SCHEDULED
[01:27:10.686] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:57:0) after 5m0s
[01:32:12.066] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:57:0)
[01:32:12.087] Build status: SCHEDULED
[01:32:12.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:58:0) after 9m35s
[01:41:47.109] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:58:0)
[01:41:47.168] Build status: SCHEDULED
[01:41:47.168] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:59:0) after 9m27s
[01:51:14.201] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:59:0)
[01:51:14.219] Build status: SCHEDULED
[01:51:14.219] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:60:0) after 9m13s
[02:00:27.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:60:0)
[02:00:27.523] Build status: SCHEDULED
[02:00:27.523] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:61:0) after 4m38s
[02:05:05.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:61:0)
[02:05:05.591] Build status: SCHEDULED
[02:05:05.591] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:62:0) after 5m51s
[02:10:56.945] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:62:0)
[02:10:56.966] Build status: SCHEDULED
[02:10:56.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:63:0) after 1m36s
[02:12:33.323] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:63:0)
[02:12:33.403] Build status: SCHEDULED
[02:12:33.403] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:64:0) after 1m29s
[02:14:02.628] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:64:0)
[02:14:02.657] Build status: SCHEDULED
[02:14:02.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:65:0) after 7m51s
[02:21:54.151] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:65:0)
[02:21:54.214] Build status: SCHEDULED
[02:21:54.214] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953587979266306256:66:0) after 6m44s
[02:23:05.839] Received PubSub notification, asking Buildbucket for the build status
[02:23:05.862] Build:
{
"id": "8788157917325547745",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60368,
"createdBy": "project:chromium",
"createTime": "2023-02-25T20:22:07.932531868Z",
"endTime": "2023-02-26T02:23:05.119714Z",
"updateTime": "2023-02-26T02:23:05.119714Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ba72b36c3250380e0cf4ef0f534c72975e636c87",
"ref": "refs/heads/main"
}
}
}
[02:23:05.862] Invocation finished in 6h0m59.164980158s with status FAILED