[14:33:17.014] New invocation is queued and will start shortly
[14:33:18.660] Starting the invocation (attempt 1)
[14:33:18.695] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/451229762614ebb5c2c1028a7a0f4207ca9ee114"
[14:33:18.695] Popped gitiles commit info from properties and tags
[14:33:18.695] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:33:18.696] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:33:18.697] Buildbucket request:
{
"requestId": "8958411564860115136",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "451229762614ebb5c2c1028a7a0f4207ca9ee114",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958411564860115136"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:33:19.148] Scheduled build:
{
"id": "8792981502369006561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60160,
"createdBy": "project:chromium",
"createTime": "2023-01-03T14:33:18.763101494Z",
"updateTime": "2023-01-03T14:33:18.763101494Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "451229762614ebb5c2c1028a7a0f4207ca9ee114",
"ref": "refs/heads/main"
}
}
}
[14:33:19.148] Task URL: https://cr-buildbucket.appspot.com/build/8792981502369006561
[14:33:19.148] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:2:0) after 7m30s
[14:40:49.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:2:0)
[14:40:49.555] Build status: SCHEDULED
[14:40:49.555] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:3:0) after 9m36s
[14:50:25.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:3:0)
[14:50:25.704] Build status: SCHEDULED
[14:50:25.705] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:4:0) after 7m37s
[14:58:02.808] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:4:0)
[14:58:02.830] Build status: SCHEDULED
[14:58:02.830] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:5:0) after 1m28s
[14:59:30.839] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:5:0)
[14:59:30.866] Build status: SCHEDULED
[14:59:30.866] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:6:0) after 8m11s
[15:07:41.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:6:0)
[15:07:41.992] Build status: SCHEDULED
[15:07:41.993] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:7:0) after 5m8s
[15:12:50.014] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:7:0)
[15:12:50.325] Build status: SCHEDULED
[15:12:50.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:8:0) after 9m1s
[15:21:51.437] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:8:0)
[15:21:51.457] Build status: SCHEDULED
[15:21:51.457] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:9:0) after 9m28s
[15:31:19.547] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:9:0)
[15:31:19.578] Build status: SCHEDULED
[15:31:19.578] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:10:0) after 5m13s
[15:36:32.802] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:10:0)
[15:36:32.828] Build status: SCHEDULED
[15:36:32.828] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:11:0) after 2m25s
[15:38:57.889] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:11:0)
[15:38:57.912] Build status: SCHEDULED
[15:38:57.912] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:12:0) after 3m26s
[15:42:23.934] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:12:0)
[15:42:23.963] Build status: SCHEDULED
[15:42:23.963] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:13:0) after 1m29s
[15:43:53.112] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:13:0)
[15:43:53.158] Build status: SCHEDULED
[15:43:53.158] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:14:0) after 7m51s
[15:51:44.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:14:0)
[15:51:44.231] Build status: SCHEDULED
[15:51:44.231] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:15:0) after 9m58s
[16:01:42.317] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:15:0)
[16:01:42.340] Build status: SCHEDULED
[16:01:42.340] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:16:0) after 3m27s
[16:05:09.371] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:16:0)
[16:05:09.393] Build status: SCHEDULED
[16:05:09.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:17:0) after 8m51s
[16:14:00.413] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:17:0)
[16:14:00.436] Build status: SCHEDULED
[16:14:00.436] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:18:0) after 9m33s
[16:23:33.478] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:18:0)
[16:23:33.498] Build status: SCHEDULED
[16:23:33.498] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:19:0) after 9m5s
[16:32:39.108] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:19:0)
[16:32:39.184] Build status: SCHEDULED
[16:32:39.184] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:20:0) after 7m22s
[16:40:01.378] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:20:0)
[16:40:01.451] Build status: SCHEDULED
[16:40:01.451] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:21:0) after 9m54s
[16:49:55.714] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:21:0)
[16:49:55.776] Build status: SCHEDULED
[16:49:55.776] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:22:0) after 2m59s
[16:52:54.905] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:22:0)
[16:52:54.927] Build status: SCHEDULED
[16:52:54.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:23:0) after 7m2s
[16:59:57.120] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:23:0)
[16:59:57.141] Build status: SCHEDULED
[16:59:57.141] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:24:0) after 2m36s
[17:02:33.490] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:24:0)
[17:02:33.513] Build status: SCHEDULED
[17:02:33.513] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:25:0) after 1m6s
[17:03:39.721] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:25:0)
[17:03:39.744] Build status: SCHEDULED
[17:03:39.744] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:26:0) after 3m34s
[17:07:13.815] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:26:0)
[17:07:13.835] Build status: SCHEDULED
[17:07:13.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:27:0) after 2m55s
[17:10:08.856] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:27:0)
[17:10:08.879] Build status: SCHEDULED
[17:10:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:28:0) after 6m48s
[17:16:56.909] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:28:0)
[17:16:56.930] Build status: SCHEDULED
[17:16:56.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:29:0) after 3m33s
[17:20:30.288] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:29:0)
[17:20:30.308] Build status: SCHEDULED
[17:20:30.308] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:30:0) after 6m12s
[17:26:42.331] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:30:0)
[17:26:42.352] Build status: SCHEDULED
[17:26:42.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:31:0) after 3m11s
[17:29:53.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:31:0)
[17:29:53.426] Build status: SCHEDULED
[17:29:53.426] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:32:0) after 2m20s
[17:32:13.585] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:32:0)
[17:32:13.613] Build status: SCHEDULED
[17:32:13.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:33:0) after 7m43s
[17:39:57.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:33:0)
[17:39:57.283] Build status: SCHEDULED
[17:39:57.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:34:0) after 7m41s
[17:47:38.420] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:34:0)
[17:47:38.441] Build status: SCHEDULED
[17:47:38.441] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:35:0) after 4m1s
[17:51:39.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:35:0)
[17:51:39.615] Build status: SCHEDULED
[17:51:39.615] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:36:0) after 5m0s
[17:56:40.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:36:0)
[17:56:40.138] Build status: SCHEDULED
[17:56:40.138] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:37:0) after 3m54s
[18:00:34.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:37:0)
[18:00:34.293] Build status: SCHEDULED
[18:00:34.293] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:38:0) after 2m32s
[18:03:06.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:38:0)
[18:03:06.365] Build status: SCHEDULED
[18:03:06.366] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:39:0) after 5m4s
[18:08:10.659] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:39:0)
[18:08:10.681] Build status: SCHEDULED
[18:08:10.681] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:40:0) after 7m40s
[18:15:50.736] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:40:0)
[18:15:50.759] Build status: SCHEDULED
[18:15:50.759] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:41:0) after 8m51s
[18:24:41.799] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:41:0)
[18:24:41.826] Build status: SCHEDULED
[18:24:41.826] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:42:0) after 4m14s
[18:28:56.110] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:42:0)
[18:28:56.138] Build status: SCHEDULED
[18:28:56.138] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:43:0) after 7m56s
[18:36:52.202] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:43:0)
[18:36:52.248] Build status: SCHEDULED
[18:36:52.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:44:0) after 4m21s
[18:41:13.440] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:44:0)
[18:41:13.464] Build status: SCHEDULED
[18:41:13.464] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:45:0) after 4m52s
[18:46:05.657] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:45:0)
[18:46:05.759] Build status: SCHEDULED
[18:46:05.759] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:46:0) after 4m31s
[18:50:36.916] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:46:0)
[18:50:36.974] Build status: SCHEDULED
[18:50:36.974] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:47:0) after 4m43s
[18:55:20.055] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:47:0)
[18:55:20.075] Build status: SCHEDULED
[18:55:20.075] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:48:0) after 1m9s
[18:56:29.103] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:48:0)
[18:56:29.134] Build status: SCHEDULED
[18:56:29.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:49:0) after 4m2s
[19:00:31.317] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:49:0)
[19:00:31.468] Build status: SCHEDULED
[19:00:31.468] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:50:0) after 2m41s
[19:03:12.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:50:0)
[19:03:12.561] Build status: SCHEDULED
[19:03:12.561] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:51:0) after 7m29s
[19:10:41.938] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:51:0)
[19:10:41.959] Build status: SCHEDULED
[19:10:41.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:52:0) after 9m40s
[19:20:22.445] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:52:0)
[19:20:22.489] Build status: SCHEDULED
[19:20:22.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:53:0) after 7m36s
[19:27:58.688] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:53:0)
[19:27:58.715] Build status: SCHEDULED
[19:27:58.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:54:0) after 2m53s
[19:30:52.074] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:54:0)
[19:30:52.208] Build status: SCHEDULED
[19:30:52.208] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:55:0) after 1m9s
[19:32:01.514] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:55:0)
[19:32:01.551] Build status: SCHEDULED
[19:32:01.551] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:56:0) after 4m39s
[19:36:40.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:56:0)
[19:36:40.718] Build status: SCHEDULED
[19:36:40.718] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:57:0) after 7m30s
[19:44:10.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:57:0)
[19:44:10.900] Build status: SCHEDULED
[19:44:10.900] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:58:0) after 5m15s
[19:49:25.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:58:0)
[19:49:25.947] Build status: SCHEDULED
[19:49:25.947] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:59:0) after 7m34s
[19:57:00.188] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:59:0)
[19:57:00.211] Build status: SCHEDULED
[19:57:00.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:60:0) after 5m3s
[20:02:03.239] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:60:0)
[20:02:03.318] Build status: SCHEDULED
[20:02:03.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:61:0) after 4m8s
[20:06:11.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:61:0)
[20:06:11.628] Build status: SCHEDULED
[20:06:11.628] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:62:0) after 6m23s
[20:12:34.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:62:0)
[20:12:34.781] Build status: SCHEDULED
[20:12:34.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:63:0) after 7m50s
[20:20:24.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:63:0)
[20:20:24.955] Build status: SCHEDULED
[20:20:24.955] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:64:0) after 9m12s
[20:29:37.028] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:64:0)
[20:29:37.054] Build status: SCHEDULED
[20:29:37.054] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:65:0) after 3m31s
[20:33:08.216] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:65:0)
[20:33:08.258] Build status: SCHEDULED
[20:33:08.258] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958411564860115136:66:0) after 7m37s
[20:34:09.508] Received PubSub notification, asking Buildbucket for the build status
[20:34:09.532] Build:
{
"id": "8792981502369006561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60160,
"createdBy": "project:chromium",
"createTime": "2023-01-03T14:33:18.763101494Z",
"endTime": "2023-01-03T20:34:09.002424Z",
"updateTime": "2023-01-03T20:34:09.002424Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "451229762614ebb5c2c1028a7a0f4207ca9ee114",
"ref": "refs/heads/main"
}
}
}
[20:34:09.532] Invocation finished in 6h0m52.528623104s with status FAILED