[20:42:12.766] New invocation is queued and will start shortly
[20:42:14.200] Starting the invocation (attempt 1)
[20:42:14.240] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5c89eb0fac7c3162259c365c47985c27818d09c4"
[20:42:14.240] Popped gitiles commit info from properties and tags
[20:42:14.240] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:42:14.240] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:42:14.240] Buildbucket request:
{
"requestId": "8958207159920083200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c89eb0fac7c3162259c365c47985c27818d09c4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958207159920083200"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:42:14.687] Scheduled build:
{
"id": "8792777097608916817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60169,
"createdBy": "project:chromium",
"createTime": "2023-01-05T20:42:14.333590980Z",
"updateTime": "2023-01-05T20:42:14.333590980Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c89eb0fac7c3162259c365c47985c27818d09c4",
"ref": "refs/heads/main"
}
}
}
[20:42:14.687] Task URL: https://cr-buildbucket.appspot.com/build/8792777097608916817
[20:42:14.687] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:2:0) after 1m12s
[20:43:26.713] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:2:0)
[20:43:26.778] Build status: SCHEDULED
[20:43:26.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:3:0) after 9m1s
[20:52:27.910] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:3:0)
[20:52:27.934] Build status: SCHEDULED
[20:52:27.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:4:0) after 5m25s
[20:57:53.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:4:0)
[20:57:53.131] Build status: SCHEDULED
[20:57:53.131] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:5:0) after 8m27s
[21:06:20.597] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:5:0)
[21:06:20.619] Build status: SCHEDULED
[21:06:20.620] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:6:0) after 6m33s
[21:12:53.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:6:0)
[21:12:53.744] Build status: SCHEDULED
[21:12:53.744] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:7:0) after 2m24s
[21:15:17.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:7:0)
[21:15:17.874] Build status: SCHEDULED
[21:15:17.874] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:8:0) after 8m29s
[21:23:47.317] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:8:0)
[21:23:47.346] Build status: SCHEDULED
[21:23:47.346] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:9:0) after 8m9s
[21:31:56.467] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:9:0)
[21:31:56.501] Build status: SCHEDULED
[21:31:56.501] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:10:0) after 9m46s
[21:41:42.670] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:10:0)
[21:41:42.701] Build status: SCHEDULED
[21:41:42.701] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:11:0) after 7m36s
[21:49:19.121] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:11:0)
[21:49:19.162] Build status: SCHEDULED
[21:49:19.162] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:12:0) after 1m47s
[21:51:06.183] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:12:0)
[21:51:06.245] Build status: SCHEDULED
[21:51:06.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:13:0) after 1m10s
[21:52:16.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:13:0)
[21:52:16.393] Build status: SCHEDULED
[21:52:16.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:14:0) after 6m54s
[21:59:10.415] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:14:0)
[21:59:10.437] Build status: SCHEDULED
[21:59:10.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:15:0) after 8m23s
[22:07:33.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:15:0)
[22:07:33.573] Build status: SCHEDULED
[22:07:33.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:16:0) after 2m33s
[22:10:06.611] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:16:0)
[22:10:06.639] Build status: SCHEDULED
[22:10:06.639] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:17:0) after 4m41s
[22:14:48.415] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:17:0)
[22:14:48.439] Build status: SCHEDULED
[22:14:48.439] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:18:0) after 9m37s
[22:24:25.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:18:0)
[22:24:25.561] Build status: SCHEDULED
[22:24:25.561] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:19:0) after 2m55s
[22:27:20.583] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:19:0)
[22:27:20.627] Build status: SCHEDULED
[22:27:20.627] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:20:0) after 5m0s
[22:32:20.750] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:20:0)
[22:32:20.778] Build status: SCHEDULED
[22:32:20.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:21:0) after 4m11s
[22:36:31.900] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:21:0)
[22:36:31.932] Build status: SCHEDULED
[22:36:31.932] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:22:0) after 4m30s
[22:41:01.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:22:0)
[22:41:02.004] Build status: SCHEDULED
[22:41:02.004] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:23:0) after 9m34s
[22:50:36.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:23:0)
[22:50:36.347] Build status: SCHEDULED
[22:50:36.347] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:24:0) after 2m22s
[22:52:58.549] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:24:0)
[22:52:58.569] Build status: SCHEDULED
[22:52:58.569] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:25:0) after 9m45s
[23:02:43.600] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:25:0)
[23:02:43.653] Build status: SCHEDULED
[23:02:43.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:26:0) after 7m54s
[23:10:38.070] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:26:0)
[23:10:38.098] Build status: SCHEDULED
[23:10:38.098] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:27:0) after 5m53s
[23:16:31.127] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:27:0)
[23:16:31.151] Build status: SCHEDULED
[23:16:31.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:28:0) after 2m39s
[23:19:10.763] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:28:0)
[23:19:10.791] Build status: SCHEDULED
[23:19:10.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:29:0) after 1m10s
[23:20:20.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:29:0)
[23:20:20.860] Build status: SCHEDULED
[23:20:20.860] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:30:0) after 6m17s
[23:26:37.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:30:0)
[23:26:37.917] Build status: SCHEDULED
[23:26:37.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:31:0) after 9m0s
[23:35:38.038] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:31:0)
[23:35:38.074] Build status: SCHEDULED
[23:35:38.074] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:32:0) after 4m33s
[23:40:11.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:32:0)
[23:40:11.235] Build status: SCHEDULED
[23:40:11.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:33:0) after 4m54s
[23:45:05.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:33:0)
[23:45:05.659] Build status: SCHEDULED
[23:45:05.660] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:34:0) after 2m49s
[23:47:54.684] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:34:0)
[23:47:54.707] Build status: SCHEDULED
[23:47:54.707] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:35:0) after 6m53s
[23:54:47.734] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:35:0)
[23:54:47.753] Build status: SCHEDULED
[23:54:47.753] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:36:0) after 3m30s
[23:58:17.784] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:36:0)
[23:58:17.819] Build status: SCHEDULED
[23:58:17.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:37:0) after 1m9s
[23:59:26.905] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:37:0)
[23:59:26.927] Build status: SCHEDULED
[23:59:26.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:38:0) after 9m58s
[00:09:25.123] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:38:0)
[00:09:25.152] Build status: SCHEDULED
[00:09:25.152] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:39:0) after 2m30s
[00:11:55.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:39:0)
[00:11:55.206] Build status: SCHEDULED
[00:11:55.207] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:40:0) after 2m13s
[00:14:09.119] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:40:0)
[00:14:09.144] Build status: SCHEDULED
[00:14:09.144] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:41:0) after 8m20s
[00:22:29.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:41:0)
[00:22:29.803] Build status: SCHEDULED
[00:22:29.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:42:0) after 9m2s
[00:31:31.818] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:42:0)
[00:31:31.848] Build status: SCHEDULED
[00:31:31.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:43:0) after 1m38s
[00:33:09.872] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:43:0)
[00:33:09.897] Build status: SCHEDULED
[00:33:09.897] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:44:0) after 7m55s
[00:41:04.932] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:44:0)
[00:41:04.956] Build status: SCHEDULED
[00:41:04.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:45:0) after 7m41s
[00:48:45.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:45:0)
[00:48:46.005] Build status: SCHEDULED
[00:48:46.005] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:46:0) after 6m46s
[00:55:32.043] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:46:0)
[00:55:32.064] Build status: SCHEDULED
[00:55:32.064] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:47:0) after 3m29s
[00:59:01.171] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:47:0)
[00:59:01.193] Build status: SCHEDULED
[00:59:01.193] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:48:0) after 3m34s
[01:02:35.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:48:0)
[01:02:35.301] Build status: SCHEDULED
[01:02:35.301] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:49:0) after 7m58s
[01:10:33.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:49:0)
[01:10:33.542] Build status: SCHEDULED
[01:10:33.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:50:0) after 3m49s
[01:14:22.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:50:0)
[01:14:22.629] Build status: SCHEDULED
[01:14:22.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:51:0) after 1m17s
[01:15:39.652] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:51:0)
[01:15:39.825] Build status: SCHEDULED
[01:15:39.825] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:52:0) after 4m51s
[01:20:31.011] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:52:0)
[01:20:31.033] Build status: SCHEDULED
[01:20:31.033] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:53:0) after 9m1s
[01:29:32.307] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:53:0)
[01:29:32.330] Build status: SCHEDULED
[01:29:32.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:54:0) after 9m44s
[01:39:16.628] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:54:0)
[01:39:16.704] Build status: SCHEDULED
[01:39:16.704] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:55:0) after 2m44s
[01:42:00.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:55:0)
[01:42:00.866] Build status: SCHEDULED
[01:42:00.866] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:56:0) after 6m27s
[01:48:28.585] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:56:0)
[01:48:28.611] Build status: SCHEDULED
[01:48:28.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:57:0) after 3m22s
[01:51:50.644] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:57:0)
[01:51:50.666] Build status: SCHEDULED
[01:51:50.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:58:0) after 8m38s
[02:00:28.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:58:0)
[02:00:28.892] Build status: SCHEDULED
[02:00:28.892] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:59:0) after 9m42s
[02:10:10.918] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:59:0)
[02:10:10.942] Build status: SCHEDULED
[02:10:10.942] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:60:0) after 3m12s
[02:13:22.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:60:0)
[02:13:23.013] Build status: SCHEDULED
[02:13:23.013] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:61:0) after 5m31s
[02:18:54.102] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:61:0)
[02:18:54.125] Build status: SCHEDULED
[02:18:54.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:62:0) after 4m17s
[02:23:11.755] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:62:0)
[02:23:11.777] Build status: SCHEDULED
[02:23:11.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:63:0) after 9m14s
[02:32:26.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:63:0)
[02:32:26.178] Build status: SCHEDULED
[02:32:26.178] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:64:0) after 5m29s
[02:37:55.310] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:64:0)
[02:37:55.352] Build status: SCHEDULED
[02:37:55.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958207159920083200:65:0) after 5m13s
[02:43:07.538] Received PubSub notification, asking Buildbucket for the build status
[02:43:07.559] Build:
{
"id": "8792777097608916817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60169,
"createdBy": "project:chromium",
"createTime": "2023-01-05T20:42:14.333590980Z",
"endTime": "2023-01-06T02:43:06.809375Z",
"updateTime": "2023-01-06T02:43:06.809375Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5c89eb0fac7c3162259c365c47985c27818d09c4",
"ref": "refs/heads/main"
}
}
}
[02:43:07.559] Invocation finished in 6h0m54.814197069s with status FAILED