[16:22:05.109] New invocation is queued and will start shortly
[16:22:06.705] Starting the invocation (attempt 1)
[16:22:06.740] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4fc98403403b5990e7baea7bc58e28c4f60f39ff"
[16:22:06.741] Popped gitiles commit info from properties and tags
[16:22:06.741] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:22:06.741] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:22:06.741] Buildbucket request:
{
"requestId": "8948620247289612512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fc98403403b5990e7baea7bc58e28c4f60f39ff",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948620247289612512"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:22:07.204] Scheduled build:
{
"id": "8783190184832129521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60605,
"createdBy": "project:chromium",
"createTime": "2023-04-21T16:22:06.822211428Z",
"updateTime": "2023-04-21T16:22:06.822211428Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fc98403403b5990e7baea7bc58e28c4f60f39ff",
"ref": "refs/heads/main"
}
}
}
[16:22:07.204] Task URL: https://cr-buildbucket.appspot.com/build/8783190184832129521
[16:22:07.204] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:2:0) after 1m17s
[16:23:24.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:2:0)
[16:23:24.340] Build status: SCHEDULED
[16:23:24.340] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:3:0) after 6m27s
[16:29:51.648] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:3:0)
[16:29:51.675] Build status: SCHEDULED
[16:29:51.675] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:4:0) after 8m13s
[16:38:04.799] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:4:0)
[16:38:04.833] Build status: SCHEDULED
[16:38:04.833] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:5:0) after 4m57s
[16:43:01.946] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:5:0)
[16:43:01.961] Build status: SCHEDULED
[16:43:01.962] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:6:0) after 9m43s
[16:52:45.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:6:0)
[16:52:45.033] Build status: SCHEDULED
[16:52:45.033] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:7:0) after 6m19s
[16:59:04.056] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:7:0)
[16:59:04.126] Build status: SCHEDULED
[16:59:04.126] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:8:0) after 6m11s
[17:05:15.185] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:8:0)
[17:05:15.210] Build status: SCHEDULED
[17:05:15.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:9:0) after 8m15s
[17:13:30.396] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:9:0)
[17:13:30.443] Build status: SCHEDULED
[17:13:30.444] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:10:0) after 9m25s
[17:22:55.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:10:0)
[17:22:55.535] Build status: SCHEDULED
[17:22:55.535] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:11:0) after 2m15s
[17:25:10.716] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:11:0)
[17:25:10.746] Build status: SCHEDULED
[17:25:10.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:12:0) after 4m39s
[17:29:49.769] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:12:0)
[17:29:49.795] Build status: SCHEDULED
[17:29:49.795] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:13:0) after 8m44s
[17:38:33.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:13:0)
[17:38:33.979] Build status: SCHEDULED
[17:38:33.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:14:0) after 3m43s
[17:42:17.081] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:14:0)
[17:42:17.105] Build status: SCHEDULED
[17:42:17.105] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:15:0) after 5m15s
[17:47:32.459] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:15:0)
[17:47:32.483] Build status: SCHEDULED
[17:47:32.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:16:0) after 6m33s
[17:54:05.883] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:16:0)
[17:54:05.904] Build status: SCHEDULED
[17:54:05.904] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:17:0) after 7m18s
[18:01:24.322] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:17:0)
[18:01:24.344] Build status: SCHEDULED
[18:01:24.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:18:0) after 2m26s
[18:03:50.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:18:0)
[18:03:50.425] Build status: SCHEDULED
[18:03:50.426] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:19:0) after 6m44s
[18:10:34.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:19:0)
[18:10:34.533] Build status: SCHEDULED
[18:10:34.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:20:0) after 1m50s
[18:12:24.542] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:20:0)
[18:12:24.565] Build status: SCHEDULED
[18:12:24.565] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:21:0) after 1m33s
[18:13:57.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:21:0)
[18:13:57.698] Build status: SCHEDULED
[18:13:57.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:22:0) after 1m36s
[18:15:33.773] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:22:0)
[18:15:33.805] Build status: SCHEDULED
[18:15:33.805] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:23:0) after 9m59s
[18:25:32.888] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:23:0)
[18:25:32.907] Build status: SCHEDULED
[18:25:32.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:24:0) after 1m43s
[18:27:15.989] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:24:0)
[18:27:16.014] Build status: SCHEDULED
[18:27:16.014] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:25:0) after 9m6s
[18:36:22.223] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:25:0)
[18:36:22.246] Build status: SCHEDULED
[18:36:22.246] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:26:0) after 8m55s
[18:45:17.533] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:26:0)
[18:45:17.565] Build status: SCHEDULED
[18:45:17.565] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:27:0) after 3m42s
[18:48:59.592] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:27:0)
[18:48:59.610] Build status: SCHEDULED
[18:48:59.610] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:28:0) after 7m31s
[18:56:30.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:28:0)
[18:56:30.808] Build status: SCHEDULED
[18:56:30.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:29:0) after 7m32s
[19:04:02.983] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:29:0)
[19:04:03.007] Build status: SCHEDULED
[19:04:03.007] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:30:0) after 9m50s
[19:13:53.668] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:30:0)
[19:13:53.690] Build status: SCHEDULED
[19:13:53.690] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:31:0) after 6m44s
[19:20:37.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:31:0)
[19:20:37.925] Build status: SCHEDULED
[19:20:37.925] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:32:0) after 8m45s
[19:29:23.315] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:32:0)
[19:29:23.355] Build status: SCHEDULED
[19:29:23.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:33:0) after 7m11s
[19:36:34.379] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:33:0)
[19:36:34.400] Build status: SCHEDULED
[19:36:34.400] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:34:0) after 6m24s
[19:42:58.458] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:34:0)
[19:42:58.485] Build status: SCHEDULED
[19:42:58.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:35:0) after 2m0s
[19:44:58.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:35:0)
[19:44:58.526] Build status: SCHEDULED
[19:44:58.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:36:0) after 4m0s
[19:48:58.689] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:36:0)
[19:48:58.709] Build status: SCHEDULED
[19:48:58.709] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:37:0) after 3m26s
[19:52:24.952] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:37:0)
[19:52:24.973] Build status: SCHEDULED
[19:52:24.973] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:38:0) after 5m12s
[19:57:37.277] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:38:0)
[19:57:37.300] Build status: SCHEDULED
[19:57:37.300] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:39:0) after 1m39s
[19:59:16.327] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:39:0)
[19:59:16.347] Build status: SCHEDULED
[19:59:16.347] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:40:0) after 3m40s
[20:02:56.417] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:40:0)
[20:02:56.472] Build status: SCHEDULED
[20:02:56.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:41:0) after 9m31s
[20:12:27.532] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:41:0)
[20:12:27.555] Build status: SCHEDULED
[20:12:27.555] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:42:0) after 4m58s
[20:17:25.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:42:0)
[20:17:25.779] Build status: SCHEDULED
[20:17:25.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:43:0) after 7m50s
[20:25:15.807] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:43:0)
[20:25:15.829] Build status: SCHEDULED
[20:25:15.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:44:0) after 4m50s
[20:30:05.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:44:0)
[20:30:05.917] Build status: SCHEDULED
[20:30:05.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:45:0) after 8m39s
[20:38:45.293] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:45:0)
[20:38:45.313] Build status: SCHEDULED
[20:38:45.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:46:0) after 1m5s
[20:39:50.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:46:0)
[20:39:50.376] Build status: SCHEDULED
[20:39:50.376] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:47:0) after 1m4s
[20:40:54.397] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:47:0)
[20:40:54.417] Build status: SCHEDULED
[20:40:54.417] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:48:0) after 4m6s
[20:45:00.448] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:48:0)
[20:45:00.485] Build status: SCHEDULED
[20:45:00.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:49:0) after 9m22s
[20:54:22.514] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:49:0)
[20:54:22.661] Build status: SCHEDULED
[20:54:22.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:50:0) after 8m58s
[21:03:20.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:50:0)
[21:03:20.845] Build status: SCHEDULED
[21:03:20.846] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:51:0) after 6m5s
[21:09:25.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:51:0)
[21:09:26.005] Build status: SCHEDULED
[21:09:26.005] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:52:0) after 5m22s
[21:14:48.250] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:52:0)
[21:14:48.291] Build status: SCHEDULED
[21:14:48.291] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:53:0) after 1m16s
[21:16:04.399] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:53:0)
[21:16:04.421] Build status: SCHEDULED
[21:16:04.421] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:54:0) after 3m37s
[21:19:42.201] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:54:0)
[21:19:42.227] Build status: SCHEDULED
[21:19:42.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:55:0) after 6m59s
[21:26:41.294] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:55:0)
[21:26:41.585] Build status: SCHEDULED
[21:26:41.585] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:56:0) after 1m28s
[21:28:09.898] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:56:0)
[21:28:09.933] Build status: SCHEDULED
[21:28:09.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:57:0) after 8m22s
[21:36:32.907] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:57:0)
[21:36:32.928] Build status: SCHEDULED
[21:36:32.928] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:58:0) after 8m58s
[21:45:31.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:58:0)
[21:45:31.073] Build status: SCHEDULED
[21:45:31.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:59:0) after 9m57s
[21:55:28.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:59:0)
[21:55:28.116] Build status: SCHEDULED
[21:55:28.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:60:0) after 9m8s
[22:04:36.247] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:60:0)
[22:04:36.266] Build status: SCHEDULED
[22:04:36.266] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:61:0) after 8m31s
[22:13:07.713] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:61:0)
[22:13:07.738] Build status: SCHEDULED
[22:13:07.738] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:62:0) after 8m4s
[22:21:11.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:62:0)
[22:21:11.800] Build status: SCHEDULED
[22:21:11.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948620247289612512:63:0) after 8m19s
[22:23:06.139] Received PubSub notification, asking Buildbucket for the build status
[22:23:06.161] Build:
{
"id": "8783190184832129521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60605,
"createdBy": "project:chromium",
"createTime": "2023-04-21T16:22:06.822211428Z",
"endTime": "2023-04-21T22:23:05.544866Z",
"updateTime": "2023-04-21T22:23:05.544866Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fc98403403b5990e7baea7bc58e28c4f60f39ff",
"ref": "refs/heads/main"
}
}
}
[22:23:06.161] Invocation finished in 6h1m1.067077645s with status FAILED