[05:27:12.083] New invocation is queued and will start shortly
[05:27:13.171] Starting the invocation (attempt 1)
[05:27:13.209] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/793d3a0521418985718f3bac3490e2fa8c15b2a6"
[05:27:13.209] Popped gitiles commit info from properties and tags
[05:27:13.209] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:27:13.209] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:27:13.209] Buildbucket request:
{
"requestId": "8973485017808866816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "793d3a0521418985718f3bac3490e2fa8c15b2a6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973485017808866816"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:27:13.921] Scheduled build:
{
"id": "8808054955898907761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56940,
"createdBy": "project:chromium",
"createTime": "2022-07-21T05:27:13.272828959Z",
"updateTime": "2022-07-21T05:27:13.272828959Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "793d3a0521418985718f3bac3490e2fa8c15b2a6",
"ref": "refs/heads/main"
}
}
}
[05:27:13.921] Task URL: https://cr-buildbucket.appspot.com/build/8808054955898907761
[05:27:13.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:2:0) after 5m59s
[05:33:12.951] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:2:0)
[05:33:12.970] Build status: SCHEDULED
[05:33:12.970] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:3:0) after 3m56s
[05:37:08.992] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:3:0)
[05:37:09.031] Build status: SCHEDULED
[05:37:09.031] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:4:0) after 5m54s
[05:43:03.223] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:4:0)
[05:43:03.242] Build status: SCHEDULED
[05:43:03.242] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:5:0) after 5m0s
[05:48:03.263] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:5:0)
[05:48:03.283] Build status: SCHEDULED
[05:48:03.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:6:0) after 8m57s
[05:57:00.304] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:6:0)
[05:57:00.342] Build status: SCHEDULED
[05:57:00.342] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:7:0) after 4m46s
[06:01:46.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:7:0)
[06:01:46.491] Build status: SCHEDULED
[06:01:46.491] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:8:0) after 4m22s
[06:06:08.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:8:0)
[06:06:08.531] Build status: SCHEDULED
[06:06:08.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:9:0) after 3m34s
[06:09:42.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:9:0)
[06:09:42.934] Build status: SCHEDULED
[06:09:42.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:10:0) after 5m11s
[06:14:54.151] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:10:0)
[06:14:54.224] Build status: SCHEDULED
[06:14:54.224] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:11:0) after 4m48s
[06:19:42.244] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:11:0)
[06:19:42.265] Build status: SCHEDULED
[06:19:42.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:12:0) after 9m29s
[06:29:11.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:12:0)
[06:29:11.437] Build status: SCHEDULED
[06:29:11.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:13:0) after 4m42s
[06:33:53.493] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:13:0)
[06:33:53.524] Build status: SCHEDULED
[06:33:53.524] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:14:0) after 5m38s
[06:39:31.598] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:14:0)
[06:39:31.616] Build status: SCHEDULED
[06:39:31.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:15:0) after 1m33s
[06:41:04.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:15:0)
[06:41:04.729] Build status: SCHEDULED
[06:41:04.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:16:0) after 4m17s
[06:45:21.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:16:0)
[06:45:21.931] Build status: SCHEDULED
[06:45:21.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:17:0) after 5m34s
[06:50:56.497] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:17:0)
[06:50:56.517] Build status: SCHEDULED
[06:50:56.517] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:18:0) after 4m49s
[06:55:45.553] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:18:0)
[06:55:45.573] Build status: SCHEDULED
[06:55:45.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:19:0) after 9m26s
[07:05:11.597] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:19:0)
[07:05:11.643] Build status: SCHEDULED
[07:05:11.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:20:0) after 9m7s
[07:14:18.686] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:20:0)
[07:14:18.706] Build status: SCHEDULED
[07:14:18.706] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:21:0) after 1m58s
[07:16:16.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:21:0)
[07:16:16.830] Build status: SCHEDULED
[07:16:16.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:22:0) after 1m10s
[07:17:26.858] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:22:0)
[07:17:26.882] Build status: SCHEDULED
[07:17:26.882] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:23:0) after 2m18s
[07:19:44.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:23:0)
[07:19:44.936] Build status: SCHEDULED
[07:19:44.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:24:0) after 7m50s
[07:27:34.907] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:24:0)
[07:27:34.929] Build status: SCHEDULED
[07:27:34.929] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:25:0) after 4m39s
[07:32:13.952] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:25:0)
[07:32:13.980] Build status: SCHEDULED
[07:32:13.980] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:26:0) after 7m33s
[07:39:47.084] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:26:0)
[07:39:47.115] Build status: SCHEDULED
[07:39:47.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:27:0) after 8m2s
[07:47:49.129] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:27:0)
[07:47:49.153] Build status: SCHEDULED
[07:47:49.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:28:0) after 6m46s
[07:54:35.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:28:0)
[07:54:35.339] Build status: SCHEDULED
[07:54:35.339] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:29:0) after 9m2s
[08:03:37.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:29:0)
[08:03:37.393] Build status: SCHEDULED
[08:03:37.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:30:0) after 4m6s
[08:07:43.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:30:0)
[08:07:43.459] Build status: SCHEDULED
[08:07:43.460] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:31:0) after 8m27s
[08:16:10.486] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:31:0)
[08:16:10.520] Build status: SCHEDULED
[08:16:10.520] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:32:0) after 4m9s
[08:20:19.628] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:32:0)
[08:20:19.670] Build status: SCHEDULED
[08:20:19.670] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:33:0) after 4m20s
[08:24:39.807] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:33:0)
[08:24:39.831] Build status: SCHEDULED
[08:24:39.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:34:0) after 7m59s
[08:32:39.346] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:34:0)
[08:32:39.377] Build status: SCHEDULED
[08:32:39.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:35:0) after 7m21s
[08:40:00.405] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:35:0)
[08:40:00.436] Build status: SCHEDULED
[08:40:00.436] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:36:0) after 2m6s
[08:42:06.532] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:36:0)
[08:42:06.555] Build status: SCHEDULED
[08:42:06.555] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:37:0) after 1m44s
[08:43:50.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:37:0)
[08:43:50.995] Build status: SCHEDULED
[08:43:50.995] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:38:0) after 3m6s
[08:46:57.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:38:0)
[08:46:57.056] Build status: SCHEDULED
[08:46:57.056] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:39:0) after 8m36s
[08:55:33.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:39:0)
[08:55:33.322] Build status: SCHEDULED
[08:55:33.322] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:40:0) after 8m47s
[09:04:20.352] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:40:0)
[09:04:20.404] Build status: SCHEDULED
[09:04:20.404] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:41:0) after 1m9s
[09:05:29.428] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:41:0)
[09:05:29.455] Build status: SCHEDULED
[09:05:29.456] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:42:0) after 6m5s
[09:11:34.565] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:42:0)
[09:11:34.599] Build status: SCHEDULED
[09:11:34.599] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:43:0) after 6m14s
[09:17:48.744] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:43:0)
[09:17:48.781] Build status: SCHEDULED
[09:17:48.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:44:0) after 7m26s
[09:25:14.847] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:44:0)
[09:25:14.879] Build status: SCHEDULED
[09:25:14.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:45:0) after 5m35s
[09:30:49.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:45:0)
[09:30:49.902] Build status: SCHEDULED
[09:30:49.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:46:0) after 7m42s
[09:38:32.152] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:46:0)
[09:38:32.177] Build status: SCHEDULED
[09:38:32.177] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:47:0) after 6m50s
[09:45:22.454] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:47:0)
[09:45:22.529] Build status: SCHEDULED
[09:45:22.529] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:48:0) after 8m51s
[09:54:13.600] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:48:0)
[09:54:13.623] Build status: SCHEDULED
[09:54:13.623] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:49:0) after 8m26s
[10:02:39.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:49:0)
[10:02:39.794] Build status: SCHEDULED
[10:02:39.794] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:50:0) after 2m9s
[10:04:48.770] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:50:0)
[10:04:48.789] Build status: SCHEDULED
[10:04:48.789] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:51:0) after 5m58s
[10:10:46.811] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:51:0)
[10:10:46.835] Build status: SCHEDULED
[10:10:46.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:52:0) after 9m55s
[10:20:41.860] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:52:0)
[10:20:41.900] Build status: SCHEDULED
[10:20:41.900] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:53:0) after 9m28s
[10:30:09.982] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:53:0)
[10:30:10.005] Build status: SCHEDULED
[10:30:10.005] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:54:0) after 3m33s
[10:33:43.155] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:54:0)
[10:33:43.175] Build status: SCHEDULED
[10:33:43.175] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:55:0) after 1m55s
[10:35:38.196] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:55:0)
[10:35:38.317] Build status: SCHEDULED
[10:35:38.317] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:56:0) after 7m47s
[10:43:25.366] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:56:0)
[10:43:25.524] Build status: SCHEDULED
[10:43:25.524] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:57:0) after 4m25s
[10:47:50.547] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:57:0)
[10:47:50.571] Build status: SCHEDULED
[10:47:50.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:58:0) after 4m34s
[10:52:24.765] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:58:0)
[10:52:24.784] Build status: SCHEDULED
[10:52:24.784] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:59:0) after 7m0s
[10:59:24.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:59:0)
[10:59:24.786] Build status: SCHEDULED
[10:59:24.786] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:60:0) after 8m53s
[11:08:17.946] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:60:0)
[11:08:17.986] Build status: SCHEDULED
[11:08:17.986] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:61:0) after 3m49s
[11:12:07.112] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:61:0)
[11:12:07.152] Build status: SCHEDULED
[11:12:07.152] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:62:0) after 3m11s
[11:15:18.197] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:62:0)
[11:15:18.259] Build status: SCHEDULED
[11:15:18.259] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:63:0) after 5m51s
[11:21:09.294] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:63:0)
[11:21:09.313] Build status: SCHEDULED
[11:21:09.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:64:0) after 1m25s
[11:22:34.348] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:64:0)
[11:22:34.374] Build status: SCHEDULED
[11:22:34.374] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:65:0) after 3m6s
[11:25:40.467] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:65:0)
[11:25:40.487] Build status: SCHEDULED
[11:25:40.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:66:0) after 1m24s
[11:27:04.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:66:0)
[11:27:04.557] Build status: SCHEDULED
[11:27:04.557] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973485017808866816:67:0) after 1m14s
[11:28:05.412] Received PubSub notification, asking Buildbucket for the build status
[11:28:05.461] Build:
{
"id": "8808054955898907761",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56940,
"createdBy": "project:chromium",
"createTime": "2022-07-21T05:27:13.272828959Z",
"endTime": "2022-07-21T11:28:02.398484Z",
"updateTime": "2022-07-21T11:28:02.898571Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "793d3a0521418985718f3bac3490e2fa8c15b2a6",
"ref": "refs/heads/main"
}
}
}
[11:28:05.461] Invocation finished in 6h0m53.393560221s with status FAILED