[15:22:14.835] New invocation is queued and will start shortly
[15:22:16.342] Starting the invocation (attempt 1)
[15:22:16.374] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2d864d931a71fd81156b2e257b751d84b0442628"
[15:22:16.374] Popped gitiles commit info from properties and tags
[15:22:16.374] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:22:16.374] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:22:16.374] Buildbucket request:
{
"requestId": "8949982966468497680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2d864d931a71fd81156b2e257b751d84b0442628",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949982966468497680"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:22:17.119] Scheduled build:
{
"id": "8784552904079171281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60545,
"createdBy": "project:chromium",
"createTime": "2023-04-06T15:22:16.475446665Z",
"updateTime": "2023-04-06T15:22:16.475446665Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2d864d931a71fd81156b2e257b751d84b0442628",
"ref": "refs/heads/main"
}
}
}
[15:22:17.119] Task URL: https://cr-buildbucket.appspot.com/build/8784552904079171281
[15:22:17.120] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:2:0) after 8m36s
[15:30:53.277] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:2:0)
[15:30:53.343] Build status: SCHEDULED
[15:30:53.343] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:3:0) after 9m26s
[15:40:20.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:3:0)
[15:40:20.337] Build status: SCHEDULED
[15:40:20.337] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:4:0) after 8m48s
[15:49:08.698] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:4:0)
[15:49:08.720] Build status: SCHEDULED
[15:49:08.720] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:5:0) after 4m34s
[15:53:42.756] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:5:0)
[15:53:42.778] Build status: SCHEDULED
[15:53:42.778] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:6:0) after 3m35s
[15:57:17.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:6:0)
[15:57:17.934] Build status: SCHEDULED
[15:57:17.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:7:0) after 3m49s
[16:01:07.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:7:0)
[16:01:07.336] Build status: SCHEDULED
[16:01:07.336] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:8:0) after 3m43s
[16:04:50.961] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:8:0)
[16:04:50.985] Build status: SCHEDULED
[16:04:50.985] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:9:0) after 3m35s
[16:08:26.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:9:0)
[16:08:26.303] Build status: SCHEDULED
[16:08:26.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:10:0) after 5m56s
[16:14:22.325] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:10:0)
[16:14:22.352] Build status: SCHEDULED
[16:14:22.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:11:0) after 4m48s
[16:19:10.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:11:0)
[16:19:10.401] Build status: SCHEDULED
[16:19:10.401] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:12:0) after 1m17s
[16:20:27.449] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:12:0)
[16:20:27.472] Build status: SCHEDULED
[16:20:27.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:13:0) after 6m50s
[16:27:17.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:13:0)
[16:27:17.613] Build status: SCHEDULED
[16:27:17.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:14:0) after 5m1s
[16:32:18.688] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:14:0)
[16:32:18.710] Build status: SCHEDULED
[16:32:18.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:15:0) after 5m27s
[16:37:45.722] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:15:0)
[16:37:45.795] Build status: SCHEDULED
[16:37:45.795] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:16:0) after 9m26s
[16:47:11.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:16:0)
[16:47:11.908] Build status: SCHEDULED
[16:47:11.908] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:17:0) after 4m37s
[16:51:48.932] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:17:0)
[16:51:48.952] Build status: SCHEDULED
[16:51:48.952] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:18:0) after 5m15s
[16:57:03.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:18:0)
[16:57:03.999] Build status: SCHEDULED
[16:57:03.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:19:0) after 9m20s
[17:06:24.326] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:19:0)
[17:06:24.416] Build status: SCHEDULED
[17:06:24.416] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:20:0) after 6m30s
[17:12:54.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:20:0)
[17:12:54.698] Build status: SCHEDULED
[17:12:54.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:21:0) after 9m12s
[17:22:06.997] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:21:0)
[17:22:07.021] Build status: SCHEDULED
[17:22:07.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:22:0) after 3m51s
[17:25:58.045] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:22:0)
[17:25:58.068] Build status: SCHEDULED
[17:25:58.069] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:23:0) after 7m41s
[17:33:39.335] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:23:0)
[17:33:39.360] Build status: SCHEDULED
[17:33:39.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:24:0) after 9m8s
[17:42:47.587] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:24:0)
[17:42:47.607] Build status: SCHEDULED
[17:42:47.608] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:25:0) after 2m33s
[17:45:20.653] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:25:0)
[17:45:20.676] Build status: SCHEDULED
[17:45:20.676] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:26:0) after 6m55s
[17:52:15.702] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:26:0)
[17:52:15.724] Build status: SCHEDULED
[17:52:15.724] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:27:0) after 1m48s
[17:54:03.884] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:27:0)
[17:54:03.907] Build status: SCHEDULED
[17:54:03.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:28:0) after 3m41s
[17:57:45.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:28:0)
[17:57:45.106] Build status: SCHEDULED
[17:57:45.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:29:0) after 9m49s
[18:07:34.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:29:0)
[18:07:34.301] Build status: SCHEDULED
[18:07:34.301] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:30:0) after 3m23s
[18:10:57.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:30:0)
[18:10:57.346] Build status: SCHEDULED
[18:10:57.346] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:31:0) after 6m59s
[18:17:56.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:31:0)
[18:17:56.488] Build status: SCHEDULED
[18:17:56.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:32:0) after 7m26s
[18:25:22.619] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:32:0)
[18:25:22.654] Build status: SCHEDULED
[18:25:22.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:33:0) after 4m46s
[18:30:08.683] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:33:0)
[18:30:08.706] Build status: SCHEDULED
[18:30:08.706] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:34:0) after 8m46s
[18:38:54.863] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:34:0)
[18:38:54.886] Build status: SCHEDULED
[18:38:54.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:35:0) after 6m47s
[18:45:42.068] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:35:0)
[18:45:42.142] Build status: SCHEDULED
[18:45:42.142] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:36:0) after 1m29s
[18:47:11.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:36:0)
[18:47:11.382] Build status: SCHEDULED
[18:47:11.382] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:37:0) after 3m23s
[18:50:34.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:37:0)
[18:50:34.563] Build status: SCHEDULED
[18:50:34.563] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:38:0) after 7m28s
[18:58:02.600] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:38:0)
[18:58:02.628] Build status: SCHEDULED
[18:58:02.628] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:39:0) after 1m40s
[18:59:42.756] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:39:0)
[18:59:42.786] Build status: SCHEDULED
[18:59:42.786] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:40:0) after 6m25s
[19:06:07.821] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:40:0)
[19:06:08.217] Build status: SCHEDULED
[19:06:08.217] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:41:0) after 2m42s
[19:08:50.966] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:41:0)
[19:08:50.995] Build status: SCHEDULED
[19:08:50.995] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:42:0) after 8m0s
[19:16:51.231] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:42:0)
[19:16:51.253] Build status: SCHEDULED
[19:16:51.253] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:43:0) after 8m49s
[19:25:40.272] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:43:0)
[19:25:40.298] Build status: SCHEDULED
[19:25:40.298] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:44:0) after 2m35s
[19:28:15.325] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:44:0)
[19:28:15.346] Build status: SCHEDULED
[19:28:15.347] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:45:0) after 8m28s
[19:36:43.661] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:45:0)
[19:36:43.685] Build status: SCHEDULED
[19:36:43.685] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:46:0) after 3m7s
[19:39:51.319] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:46:0)
[19:39:51.341] Build status: SCHEDULED
[19:39:51.341] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:47:0) after 7m10s
[19:47:01.382] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:47:0)
[19:47:01.414] Build status: SCHEDULED
[19:47:01.414] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:48:0) after 7m24s
[19:54:25.537] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:48:0)
[19:54:25.560] Build status: SCHEDULED
[19:54:25.560] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:49:0) after 6m49s
[20:01:15.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:49:0)
[20:01:15.030] Build status: SCHEDULED
[20:01:15.030] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:50:0) after 2m50s
[20:04:05.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:50:0)
[20:04:05.095] Build status: SCHEDULED
[20:04:05.095] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:51:0) after 9m9s
[20:13:14.372] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:51:0)
[20:13:14.436] Build status: SCHEDULED
[20:13:14.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:52:0) after 1m28s
[20:14:42.568] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:52:0)
[20:14:42.601] Build status: SCHEDULED
[20:14:42.601] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:53:0) after 4m28s
[20:19:10.958] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:53:0)
[20:19:10.981] Build status: SCHEDULED
[20:19:10.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:54:0) after 7m36s
[20:26:47.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:54:0)
[20:26:47.032] Build status: SCHEDULED
[20:26:47.032] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:55:0) after 7m5s
[20:33:52.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:55:0)
[20:33:52.086] Build status: SCHEDULED
[20:33:52.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:56:0) after 8m31s
[20:42:23.111] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:56:0)
[20:42:23.162] Build status: SCHEDULED
[20:42:23.162] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:57:0) after 7m44s
[20:50:07.217] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:57:0)
[20:50:07.282] Build status: SCHEDULED
[20:50:07.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:58:0) after 4m9s
[20:54:16.326] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:58:0)
[20:54:16.351] Build status: SCHEDULED
[20:54:16.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:59:0) after 4m26s
[20:58:42.395] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:59:0)
[20:58:42.424] Build status: SCHEDULED
[20:58:42.424] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:60:0) after 5m33s
[21:04:15.449] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:60:0)
[21:04:15.472] Build status: SCHEDULED
[21:04:15.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:61:0) after 8m19s
[21:12:34.751] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:61:0)
[21:12:34.791] Build status: SCHEDULED
[21:12:34.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:62:0) after 3m0s
[21:15:35.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:62:0)
[21:15:35.664] Build status: SCHEDULED
[21:15:35.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949982966468497680:63:0) after 8m56s
[21:23:08.933] Received PubSub notification, asking Buildbucket for the build status
[21:23:08.956] Build:
{
"id": "8784552904079171281",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60545,
"createdBy": "project:chromium",
"createTime": "2023-04-06T15:22:16.475446665Z",
"endTime": "2023-04-06T21:23:05.800408Z",
"updateTime": "2023-04-06T21:23:05.800408Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2d864d931a71fd81156b2e257b751d84b0442628",
"ref": "refs/heads/main"
}
}
}
[21:23:08.956] Invocation finished in 6h0m54.143229541s with status FAILED