[19:25:07.268] New invocation is queued and will start shortly
[19:25:08.398] Starting the invocation (attempt 1)
[19:25:08.444] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d415a005103311c8216f598310ee49bba9457623"
[19:25:08.444] Popped gitiles commit info from properties and tags
[19:25:08.444] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:25:08.445] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:25:08.445] Buildbucket request:
{
"requestId": "8978958715406296880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d415a005103311c8216f598310ee49bba9457623",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8978958715406296880"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:25:09.069] Scheduled build:
{
"id": "8813528653353826465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 55886,
"createdBy": "project:chromium",
"createTime": "2022-05-21T19:25:08.593422244Z",
"updateTime": "2022-05-21T19:25:08.593422244Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d415a005103311c8216f598310ee49bba9457623",
"ref": "refs/heads/main"
}
}
}
[19:25:09.069] Task URL: https://cr-buildbucket.appspot.com/build/8813528653353826465
[19:25:09.069] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:2:0) after 2m26s
[19:27:35.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:2:0)
[19:27:35.114] Build status: SCHEDULED
[19:27:35.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:3:0) after 9m7s
[19:36:42.130] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:3:0)
[19:36:42.171] Build status: SCHEDULED
[19:36:42.171] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:4:0) after 9m34s
[19:46:16.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:4:0)
[19:46:16.284] Build status: SCHEDULED
[19:46:16.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:5:0) after 2m49s
[19:49:05.556] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:5:0)
[19:49:05.594] Build status: SCHEDULED
[19:49:05.594] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:6:0) after 1m49s
[19:50:54.707] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:6:0)
[19:50:54.744] Build status: SCHEDULED
[19:50:54.744] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:7:0) after 8m0s
[19:58:54.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:7:0)
[19:58:54.984] Build status: SCHEDULED
[19:58:54.984] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:8:0) after 9m54s
[20:08:49.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:8:0)
[20:08:49.022] Build status: SCHEDULED
[20:08:49.022] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:9:0) after 6m6s
[20:14:55.042] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:9:0)
[20:14:55.072] Build status: SCHEDULED
[20:14:55.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:10:0) after 4m57s
[20:19:52.088] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:10:0)
[20:19:52.108] Build status: SCHEDULED
[20:19:52.108] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:11:0) after 6m50s
[20:26:42.139] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:11:0)
[20:26:42.166] Build status: SCHEDULED
[20:26:42.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:12:0) after 1m27s
[20:28:09.186] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:12:0)
[20:28:09.235] Build status: SCHEDULED
[20:28:09.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:13:0) after 1m11s
[20:29:20.268] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:13:0)
[20:29:20.289] Build status: SCHEDULED
[20:29:20.289] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:14:0) after 6m29s
[20:35:49.264] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:14:0)
[20:35:49.302] Build status: SCHEDULED
[20:35:49.302] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:15:0) after 5m21s
[20:41:10.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:15:0)
[20:41:10.343] Build status: SCHEDULED
[20:41:10.343] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:16:0) after 9m5s
[20:50:15.641] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:16:0)
[20:50:15.696] Build status: SCHEDULED
[20:50:15.696] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:17:0) after 9m16s
[20:59:31.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:17:0)
[20:59:31.862] Build status: SCHEDULED
[20:59:31.862] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:18:0) after 7m4s
[21:06:35.944] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:18:0)
[21:06:35.964] Build status: SCHEDULED
[21:06:35.964] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:19:0) after 7m50s
[21:14:25.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:19:0)
[21:14:26.015] Build status: SCHEDULED
[21:14:26.015] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:20:0) after 8m48s
[21:23:14.032] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:20:0)
[21:23:14.071] Build status: SCHEDULED
[21:23:14.071] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:21:0) after 2m11s
[21:25:25.153] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:21:0)
[21:25:25.182] Build status: SCHEDULED
[21:25:25.182] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:22:0) after 9m34s
[21:34:59.298] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:22:0)
[21:34:59.351] Build status: SCHEDULED
[21:34:59.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:23:0) after 4m26s
[21:39:25.369] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:23:0)
[21:39:25.397] Build status: SCHEDULED
[21:39:25.397] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:24:0) after 8m57s
[21:48:22.419] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:24:0)
[21:48:22.439] Build status: SCHEDULED
[21:48:22.439] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:25:0) after 3m28s
[21:51:51.496] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:25:0)
[21:51:51.531] Build status: SCHEDULED
[21:51:51.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:26:0) after 1m27s
[21:53:19.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:26:0)
[21:53:19.303] Build status: SCHEDULED
[21:53:19.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:27:0) after 9m56s
[22:03:15.327] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:27:0)
[22:03:15.476] Build status: SCHEDULED
[22:03:15.476] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:28:0) after 9m24s
[22:12:40.117] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:28:0)
[22:12:40.221] Build status: SCHEDULED
[22:12:40.221] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:29:0) after 9m41s
[22:22:21.241] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:29:0)
[22:22:21.270] Build status: SCHEDULED
[22:22:21.270] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:30:0) after 7m47s
[22:30:08.792] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:30:0)
[22:30:08.850] Build status: SCHEDULED
[22:30:08.850] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:31:0) after 9m33s
[22:39:41.899] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:31:0)
[22:39:41.927] Build status: SCHEDULED
[22:39:41.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:32:0) after 6m45s
[22:46:26.967] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:32:0)
[22:46:27.025] Build status: SCHEDULED
[22:46:27.025] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:33:0) after 6m29s
[22:52:56.162] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:33:0)
[22:52:56.196] Build status: SCHEDULED
[22:52:56.196] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:34:0) after 8m59s
[23:01:55.394] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:34:0)
[23:01:55.415] Build status: SCHEDULED
[23:01:55.415] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:35:0) after 3m18s
[23:05:13.498] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:35:0)
[23:05:13.525] Build status: SCHEDULED
[23:05:13.525] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:36:0) after 1m41s
[23:06:54.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:36:0)
[23:06:54.567] Build status: SCHEDULED
[23:06:54.567] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:37:0) after 3m34s
[23:10:28.585] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:37:0)
[23:10:28.603] Build status: SCHEDULED
[23:10:28.603] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:38:0) after 6m50s
[23:17:18.623] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:38:0)
[23:17:18.653] Build status: SCHEDULED
[23:17:18.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:39:0) after 3m46s
[23:21:04.761] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:39:0)
[23:21:04.793] Build status: SCHEDULED
[23:21:04.793] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:40:0) after 1m59s
[23:23:03.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:40:0)
[23:23:03.857] Build status: SCHEDULED
[23:23:03.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:41:0) after 1m53s
[23:24:56.972] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:41:0)
[23:24:56.993] Build status: SCHEDULED
[23:24:56.993] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:42:0) after 7m41s
[23:32:38.011] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:42:0)
[23:32:38.178] Build status: SCHEDULED
[23:32:38.178] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:43:0) after 1m59s
[23:34:37.201] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:43:0)
[23:34:37.279] Build status: SCHEDULED
[23:34:37.279] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:44:0) after 1m54s
[23:36:31.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:44:0)
[23:36:31.368] Build status: SCHEDULED
[23:36:31.368] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:45:0) after 8m14s
[23:44:45.860] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:45:0)
[23:44:45.894] Build status: SCHEDULED
[23:44:45.894] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:46:0) after 8m12s
[23:52:58.123] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:46:0)
[23:52:58.151] Build status: SCHEDULED
[23:52:58.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:47:0) after 4m32s
[23:57:30.462] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:47:0)
[23:57:30.481] Build status: SCHEDULED
[23:57:30.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:48:0) after 1m8s
[23:58:38.514] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:48:0)
[23:58:38.598] Build status: SCHEDULED
[23:58:38.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:49:0) after 3m27s
[00:02:05.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:49:0)
[00:02:05.658] Build status: SCHEDULED
[00:02:05.658] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:50:0) after 8m6s
[00:10:11.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:50:0)
[00:10:11.797] Build status: SCHEDULED
[00:10:11.797] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:51:0) after 9m22s
[00:19:33.836] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:51:0)
[00:19:33.856] Build status: SCHEDULED
[00:19:33.856] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:52:0) after 6m5s
[00:25:38.884] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:52:0)
[00:25:38.908] Build status: SCHEDULED
[00:25:38.909] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:53:0) after 6m2s
[00:31:41.006] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:53:0)
[00:31:41.035] Build status: SCHEDULED
[00:31:41.035] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:54:0) after 4m36s
[00:36:17.059] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:54:0)
[00:36:17.093] Build status: SCHEDULED
[00:36:17.093] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:55:0) after 2m21s
[00:38:38.116] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:55:0)
[00:38:38.135] Build status: SCHEDULED
[00:38:38.135] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:56:0) after 5m59s
[00:44:37.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:56:0)
[00:44:37.302] Build status: SCHEDULED
[00:44:37.302] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:57:0) after 7m55s
[00:52:32.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:57:0)
[00:52:32.383] Build status: SCHEDULED
[00:52:32.383] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:58:0) after 6m21s
[00:58:53.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:58:0)
[00:58:53.421] Build status: SCHEDULED
[00:58:53.421] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:59:0) after 7m33s
[01:06:26.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:59:0)
[01:06:26.588] Build status: SCHEDULED
[01:06:26.588] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:60:0) after 5m34s
[01:12:00.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:60:0)
[01:12:00.681] Build status: SCHEDULED
[01:12:00.681] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:61:0) after 3m18s
[01:15:19.026] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:61:0)
[01:15:19.074] Build status: SCHEDULED
[01:15:19.074] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:62:0) after 6m14s
[01:21:33.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:62:0)
[01:21:33.128] Build status: SCHEDULED
[01:21:33.128] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8978958715406296880:63:0) after 9m34s
[01:26:10.743] Received PubSub notification, asking Buildbucket for the build status
[01:26:10.779] Build:
{
"id": "8813528653353826465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 55886,
"createdBy": "project:chromium",
"createTime": "2022-05-21T19:25:08.593422244Z",
"endTime": "2022-05-22T01:26:02.930537Z",
"updateTime": "2022-05-22T01:26:09.912972Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d415a005103311c8216f598310ee49bba9457623",
"ref": "refs/heads/main"
}
}
}
[01:26:10.779] Invocation finished in 6h1m3.527420686s with status FAILED