[08:15:12.752] New invocation is queued and will start shortly
[08:15:14.103] Starting the invocation (attempt 1)
[08:15:14.183] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e9dab59fd933a8216b7403913a76f2a0f093139b"
[08:15:14.183] Popped gitiles commit info from properties and tags
[08:15:14.183] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:15:14.184] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:15:14.184] Buildbucket request:
{
"requestId": "8972115492966759280",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9dab59fd933a8216b7403913a76f2a0f093139b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972115492966759280"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:15:15.896] Scheduled build:
{
"id": "8806685430713107793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 57000,
"createdBy": "project:chromium",
"createTime": "2022-08-05T08:15:14.267771026Z",
"updateTime": "2022-08-05T08:15:14.267771026Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9dab59fd933a8216b7403913a76f2a0f093139b",
"ref": "refs/heads/main"
}
}
}
[08:15:15.896] Task URL: https://cr-buildbucket.appspot.com/build/8806685430713107793
[08:15:15.896] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:2:0) after 5m56s
[08:21:11.964] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:2:0)
[08:21:11.982] Build status: SCHEDULED
[08:21:11.982] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:3:0) after 9m1s
[08:30:13.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:3:0)
[08:30:13.025] Build status: SCHEDULED
[08:30:13.025] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:4:0) after 6m20s
[08:36:33.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:4:0)
[08:36:33.073] Build status: SCHEDULED
[08:36:33.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:5:0) after 6m22s
[08:42:55.094] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:5:0)
[08:42:55.114] Build status: SCHEDULED
[08:42:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:6:0) after 8m29s
[08:51:24.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:6:0)
[08:51:24.538] Build status: SCHEDULED
[08:51:24.538] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:7:0) after 6m46s
[08:58:10.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:7:0)
[08:58:10.736] Build status: SCHEDULED
[08:58:10.736] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:8:0) after 7m36s
[09:05:46.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:8:0)
[09:05:46.833] Build status: SCHEDULED
[09:05:46.833] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:9:0) after 1m20s
[09:07:06.862] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:9:0)
[09:07:06.908] Build status: SCHEDULED
[09:07:06.908] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:10:0) after 9m44s
[09:16:51.032] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:10:0)
[09:16:51.055] Build status: SCHEDULED
[09:16:51.055] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:11:0) after 8m19s
[09:25:10.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:11:0)
[09:25:10.212] Build status: SCHEDULED
[09:25:10.212] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:12:0) after 1m26s
[09:26:36.346] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:12:0)
[09:26:36.376] Build status: SCHEDULED
[09:26:36.376] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:13:0) after 5m11s
[09:31:47.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:13:0)
[09:31:47.608] Build status: SCHEDULED
[09:31:47.608] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:14:0) after 4m30s
[09:36:17.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:14:0)
[09:36:17.791] Build status: SCHEDULED
[09:36:17.792] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:15:0) after 4m57s
[09:41:14.817] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:15:0)
[09:41:14.837] Build status: SCHEDULED
[09:41:14.837] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:16:0) after 4m56s
[09:46:10.861] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:16:0)
[09:46:10.942] Build status: SCHEDULED
[09:46:10.942] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:17:0) after 8m23s
[09:54:33.966] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:17:0)
[09:54:33.996] Build status: SCHEDULED
[09:54:33.996] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:18:0) after 9m18s
[10:03:52.024] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:18:0)
[10:03:52.078] Build status: SCHEDULED
[10:03:52.078] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:19:0) after 6m19s
[10:10:11.248] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:19:0)
[10:10:11.313] Build status: SCHEDULED
[10:10:11.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:20:0) after 6m40s
[10:16:51.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:20:0)
[10:16:51.436] Build status: SCHEDULED
[10:16:51.436] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:21:0) after 1m23s
[10:18:14.466] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:21:0)
[10:18:14.524] Build status: SCHEDULED
[10:18:14.524] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:22:0) after 3m14s
[10:21:28.675] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:22:0)
[10:21:28.719] Build status: SCHEDULED
[10:21:28.719] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:23:0) after 9m17s
[10:30:45.969] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:23:0)
[10:30:46.006] Build status: SCHEDULED
[10:30:46.006] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:24:0) after 1m35s
[10:32:21.114] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:24:0)
[10:32:21.145] Build status: SCHEDULED
[10:32:21.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:25:0) after 3m18s
[10:35:39.203] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:25:0)
[10:35:39.225] Build status: SCHEDULED
[10:35:39.225] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:26:0) after 7m11s
[10:42:50.401] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:26:0)
[10:42:50.431] Build status: SCHEDULED
[10:42:50.431] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:27:0) after 4m33s
[10:47:23.420] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:27:0)
[10:47:23.439] Build status: SCHEDULED
[10:47:23.439] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:28:0) after 6m53s
[10:54:16.537] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:28:0)
[10:54:16.585] Build status: SCHEDULED
[10:54:16.585] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:29:0) after 4m27s
[10:58:43.738] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:29:0)
[10:58:43.758] Build status: SCHEDULED
[10:58:43.758] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:30:0) after 7m2s
[11:05:46.106] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:30:0)
[11:05:46.130] Build status: SCHEDULED
[11:05:46.130] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:31:0) after 3m51s
[11:09:37.166] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:31:0)
[11:09:37.185] Build status: SCHEDULED
[11:09:37.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:32:0) after 9m0s
[11:18:37.277] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:32:0)
[11:18:37.423] Build status: SCHEDULED
[11:18:37.423] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:33:0) after 1m43s
[11:20:20.477] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:33:0)
[11:20:20.500] Build status: SCHEDULED
[11:20:20.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:34:0) after 6m13s
[11:26:33.539] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:34:0)
[11:26:33.571] Build status: SCHEDULED
[11:26:33.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:35:0) after 9m36s
[11:36:09.718] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:35:0)
[11:36:09.753] Build status: SCHEDULED
[11:36:09.753] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:36:0) after 2m22s
[11:38:31.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:36:0)
[11:38:31.846] Build status: SCHEDULED
[11:38:31.846] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:37:0) after 9m0s
[11:47:31.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:37:0)
[11:47:31.890] Build status: SCHEDULED
[11:47:31.890] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:38:0) after 3m5s
[11:50:36.915] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:38:0)
[11:50:36.942] Build status: SCHEDULED
[11:50:36.942] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:39:0) after 4m31s
[11:55:08.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:39:0)
[11:55:08.052] Build status: SCHEDULED
[11:55:08.052] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:40:0) after 8m9s
[12:03:17.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:40:0)
[12:03:17.213] Build status: SCHEDULED
[12:03:17.213] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:41:0) after 7m33s
[12:10:50.345] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:41:0)
[12:10:50.364] Build status: SCHEDULED
[12:10:50.364] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:42:0) after 8m33s
[12:19:23.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:42:0)
[12:19:23.418] Build status: SCHEDULED
[12:19:23.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:43:0) after 5m1s
[12:24:24.490] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:43:0)
[12:24:24.528] Build status: SCHEDULED
[12:24:24.528] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:44:0) after 9m17s
[12:33:41.561] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:44:0)
[12:33:41.586] Build status: SCHEDULED
[12:33:41.586] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:45:0) after 4m56s
[12:38:37.838] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:45:0)
[12:38:37.871] Build status: SCHEDULED
[12:38:37.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:46:0) after 6m5s
[12:44:43.123] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:46:0)
[12:44:43.143] Build status: SCHEDULED
[12:44:43.144] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:47:0) after 1m34s
[12:46:17.279] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:47:0)
[12:46:17.422] Build status: SCHEDULED
[12:46:17.422] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:48:0) after 9m1s
[12:55:18.450] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:48:0)
[12:55:18.515] Build status: SCHEDULED
[12:55:18.515] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:49:0) after 7m50s
[13:03:08.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:49:0)
[13:03:08.625] Build status: SCHEDULED
[13:03:08.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:50:0) after 3m46s
[13:06:54.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:50:0)
[13:06:54.865] Build status: SCHEDULED
[13:06:54.865] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:51:0) after 1m41s
[13:08:35.971] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:51:0)
[13:08:36.005] Build status: SCHEDULED
[13:08:36.006] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:52:0) after 7m55s
[13:16:31.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:52:0)
[13:16:31.078] Build status: SCHEDULED
[13:16:31.078] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:53:0) after 1m37s
[13:18:08.155] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:53:0)
[13:18:08.174] Build status: SCHEDULED
[13:18:08.174] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:54:0) after 6m3s
[13:24:11.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:54:0)
[13:24:11.232] Build status: SCHEDULED
[13:24:11.232] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:55:0) after 4m59s
[13:29:10.255] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:55:0)
[13:29:10.288] Build status: SCHEDULED
[13:29:10.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:56:0) after 3m3s
[13:32:13.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:56:0)
[13:32:13.583] Build status: SCHEDULED
[13:32:13.583] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:57:0) after 2m12s
[13:34:25.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:57:0)
[13:34:25.681] Build status: SCHEDULED
[13:34:25.682] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:58:0) after 2m29s
[13:36:54.707] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:58:0)
[13:36:54.727] Build status: SCHEDULED
[13:36:54.727] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:59:0) after 6m35s
[13:43:29.849] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:59:0)
[13:43:29.869] Build status: SCHEDULED
[13:43:29.869] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:60:0) after 4m22s
[13:47:52.168] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:60:0)
[13:47:52.204] Build status: SCHEDULED
[13:47:52.204] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:61:0) after 4m2s
[13:51:54.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:61:0)
[13:51:54.597] Build status: SCHEDULED
[13:51:54.597] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:62:0) after 4m44s
[13:56:38.857] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:62:0)
[13:56:38.910] Build status: SCHEDULED
[13:56:38.910] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:63:0) after 4m42s
[14:01:21.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:63:0)
[14:01:21.309] Build status: SCHEDULED
[14:01:21.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:64:0) after 2m1s
[14:03:22.502] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:64:0)
[14:03:22.524] Build status: SCHEDULED
[14:03:22.524] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:65:0) after 5m50s
[14:09:12.740] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:65:0)
[14:09:12.761] Build status: SCHEDULED
[14:09:12.761] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:66:0) after 1m40s
[14:10:52.790] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:66:0)
[14:10:52.815] Build status: SCHEDULED
[14:10:52.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972115492966759280:67:0) after 7m27s
[14:16:11.551] Received PubSub notification, asking Buildbucket for the build status
[14:16:11.580] Build:
{
"id": "8806685430713107793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 57000,
"createdBy": "project:chromium",
"createTime": "2022-08-05T08:15:14.267771026Z",
"endTime": "2022-08-05T14:16:10.755020Z",
"updateTime": "2022-08-05T14:16:11.167726Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e9dab59fd933a8216b7403913a76f2a0f093139b",
"ref": "refs/heads/main"
}
}
}
[14:16:11.580] Invocation finished in 6h0m58.844394921s with status FAILED