[06:44:08.406] New invocation is queued and will start shortly
[06:44:09.512] Starting the invocation (attempt 1)
[06:44:09.543] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bfbebaca363c7c26df6da0eeb6a08c2e033f776a"
[06:44:09.543] Popped gitiles commit info from properties and tags
[06:44:09.543] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:44:09.543] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:44:09.543] Buildbucket request:
{
"requestId": "8945304520683793584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bfbebaca363c7c26df6da0eeb6a08c2e033f776a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945304520683793584"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:44:09.950] Scheduled build:
{
"id": "8779874458755545937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60751,
"createdBy": "project:chromium",
"createTime": "2023-05-28T06:44:09.621685754Z",
"updateTime": "2023-05-28T06:44:09.621685754Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bfbebaca363c7c26df6da0eeb6a08c2e033f776a",
"ref": "refs/heads/main"
}
}
}
[06:44:09.950] Task URL: https://cr-buildbucket.appspot.com/build/8779874458755545937
[06:44:09.950] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:2:0) after 6m36s
[06:50:45.965] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:2:0)
[06:50:45.988] Build status: SCHEDULED
[06:50:45.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:3:0) after 7m8s
[06:57:54.076] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:3:0)
[06:57:54.096] Build status: SCHEDULED
[06:57:54.096] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:4:0) after 6m36s
[07:04:30.218] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:4:0)
[07:04:30.241] Build status: SCHEDULED
[07:04:30.241] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:5:0) after 6m23s
[07:10:53.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:5:0)
[07:10:53.864] Build status: SCHEDULED
[07:10:53.864] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:6:0) after 5m10s
[07:16:03.878] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:6:0)
[07:16:03.899] Build status: SCHEDULED
[07:16:03.899] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:7:0) after 8m27s
[07:24:30.926] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:7:0)
[07:24:30.949] Build status: SCHEDULED
[07:24:30.949] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:8:0) after 7m25s
[07:31:55.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:8:0)
[07:31:55.984] Build status: SCHEDULED
[07:31:55.984] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:9:0) after 4m47s
[07:36:43.140] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:9:0)
[07:36:43.264] Build status: SCHEDULED
[07:36:43.264] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:10:0) after 1m14s
[07:37:57.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:10:0)
[07:37:57.421] Build status: SCHEDULED
[07:37:57.421] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:11:0) after 5m39s
[07:43:36.470] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:11:0)
[07:43:36.503] Build status: SCHEDULED
[07:43:36.503] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:12:0) after 6m51s
[07:50:27.520] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:12:0)
[07:50:27.539] Build status: SCHEDULED
[07:50:27.539] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:13:0) after 1m12s
[07:51:39.555] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:13:0)
[07:51:39.577] Build status: SCHEDULED
[07:51:39.577] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:14:0) after 6m41s
[07:58:20.595] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:14:0)
[07:58:20.620] Build status: SCHEDULED
[07:58:20.620] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:15:0) after 6m46s
[08:05:06.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:15:0)
[08:05:06.713] Build status: SCHEDULED
[08:05:06.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:16:0) after 2m32s
[08:07:38.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:16:0)
[08:07:38.752] Build status: SCHEDULED
[08:07:38.752] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:17:0) after 3m32s
[08:11:10.769] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:17:0)
[08:11:10.794] Build status: SCHEDULED
[08:11:10.794] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:18:0) after 8m57s
[08:20:07.993] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:18:0)
[08:20:08.010] Build status: SCHEDULED
[08:20:08.010] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:19:0) after 9m39s
[08:29:47.396] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:19:0)
[08:29:47.418] Build status: SCHEDULED
[08:29:47.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:20:0) after 8m19s
[08:38:06.437] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:20:0)
[08:38:06.472] Build status: SCHEDULED
[08:38:06.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:21:0) after 8m40s
[08:46:46.569] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:21:0)
[08:46:46.589] Build status: SCHEDULED
[08:46:46.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:22:0) after 6m3s
[08:52:49.589] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:22:0)
[08:52:49.609] Build status: SCHEDULED
[08:52:49.609] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:23:0) after 5m35s
[08:58:24.581] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:23:0)
[08:58:24.654] Build status: SCHEDULED
[08:58:24.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:24:0) after 5m45s
[09:04:09.802] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:24:0)
[09:04:09.822] Build status: SCHEDULED
[09:04:09.822] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:25:0) after 9m12s
[09:13:21.896] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:25:0)
[09:13:21.930] Build status: SCHEDULED
[09:13:21.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:26:0) after 9m37s
[09:22:58.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:26:0)
[09:22:59.014] Build status: SCHEDULED
[09:22:59.014] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:27:0) after 3m53s
[09:26:52.277] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:27:0)
[09:26:52.299] Build status: SCHEDULED
[09:26:52.299] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:28:0) after 6m34s
[09:33:26.325] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:28:0)
[09:33:26.342] Build status: SCHEDULED
[09:33:26.342] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:29:0) after 3m19s
[09:36:45.362] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:29:0)
[09:36:45.379] Build status: SCHEDULED
[09:36:45.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:30:0) after 7m4s
[09:43:49.392] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:30:0)
[09:43:49.411] Build status: SCHEDULED
[09:43:49.411] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:31:0) after 7m0s
[09:50:49.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:31:0)
[09:50:49.469] Build status: SCHEDULED
[09:50:49.469] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:32:0) after 4m54s
[09:55:43.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:32:0)
[09:55:43.589] Build status: SCHEDULED
[09:55:43.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:33:0) after 7m32s
[10:03:15.625] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:33:0)
[10:03:15.647] Build status: SCHEDULED
[10:03:15.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:34:0) after 4m16s
[10:07:31.754] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:34:0)
[10:07:31.816] Build status: SCHEDULED
[10:07:31.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:35:0) after 3m42s
[10:11:13.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:35:0)
[10:11:13.975] Build status: SCHEDULED
[10:11:13.975] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:36:0) after 2m45s
[10:13:58.990] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:36:0)
[10:13:59.006] Build status: SCHEDULED
[10:13:59.006] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:37:0) after 9m12s
[10:23:11.130] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:37:0)
[10:23:11.152] Build status: SCHEDULED
[10:23:11.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:38:0) after 4m41s
[10:27:52.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:38:0)
[10:27:52.692] Build status: SCHEDULED
[10:27:52.692] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:39:0) after 6m59s
[10:34:51.709] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:39:0)
[10:34:51.730] Build status: SCHEDULED
[10:34:51.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:40:0) after 9m47s
[10:44:39.160] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:40:0)
[10:44:39.202] Build status: SCHEDULED
[10:44:39.202] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:41:0) after 2m48s
[10:47:27.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:41:0)
[10:47:27.307] Build status: SCHEDULED
[10:47:27.307] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:42:0) after 2m16s
[10:49:43.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:42:0)
[10:49:43.350] Build status: SCHEDULED
[10:49:43.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:43:0) after 6m52s
[10:56:35.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:43:0)
[10:56:35.540] Build status: SCHEDULED
[10:56:35.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:44:0) after 8m28s
[11:05:03.638] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:44:0)
[11:05:03.673] Build status: SCHEDULED
[11:05:03.673] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:45:0) after 5m28s
[11:10:31.931] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:45:0)
[11:10:31.951] Build status: SCHEDULED
[11:10:31.951] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:46:0) after 1m2s
[11:11:34.352] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:46:0)
[11:11:34.375] Build status: SCHEDULED
[11:11:34.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:47:0) after 2m55s
[11:14:29.492] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:47:0)
[11:14:29.513] Build status: SCHEDULED
[11:14:29.513] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:48:0) after 7m28s
[11:21:57.530] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:48:0)
[11:21:57.549] Build status: SCHEDULED
[11:21:57.549] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:49:0) after 7m24s
[11:29:21.580] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:49:0)
[11:29:21.596] Build status: SCHEDULED
[11:29:21.596] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:50:0) after 9m22s
[11:38:43.861] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:50:0)
[11:38:43.878] Build status: SCHEDULED
[11:38:43.878] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:51:0) after 2m21s
[11:41:05.210] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:51:0)
[11:41:05.229] Build status: SCHEDULED
[11:41:05.229] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:52:0) after 9m49s
[11:50:54.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:52:0)
[11:50:54.477] Build status: SCHEDULED
[11:50:54.477] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:53:0) after 5m47s
[11:56:41.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:53:0)
[11:56:41.694] Build status: SCHEDULED
[11:56:41.694] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:54:0) after 2m59s
[11:59:40.716] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:54:0)
[11:59:40.734] Build status: SCHEDULED
[11:59:40.734] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:55:0) after 3m4s
[12:02:44.755] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:55:0)
[12:02:44.779] Build status: SCHEDULED
[12:02:44.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:56:0) after 7m13s
[12:09:58.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:56:0)
[12:09:58.541] Build status: SCHEDULED
[12:09:58.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:57:0) after 8m24s
[12:18:22.598] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:57:0)
[12:18:22.618] Build status: SCHEDULED
[12:18:22.618] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:58:0) after 2m13s
[12:20:35.647] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:58:0)
[12:20:35.717] Build status: SCHEDULED
[12:20:35.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:59:0) after 6m25s
[12:27:00.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:59:0)
[12:27:00.755] Build status: SCHEDULED
[12:27:00.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:60:0) after 2m54s
[12:29:54.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:60:0)
[12:29:54.797] Build status: SCHEDULED
[12:29:54.797] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:61:0) after 1m32s
[12:31:26.812] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:61:0)
[12:31:26.831] Build status: SCHEDULED
[12:31:26.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:62:0) after 3m20s
[12:34:47.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:62:0)
[12:34:47.274] Build status: SCHEDULED
[12:34:47.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:63:0) after 6m43s
[12:41:30.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:63:0)
[12:41:30.335] Build status: SCHEDULED
[12:41:30.335] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:64:0) after 2m13s
[12:43:43.354] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:64:0)
[12:43:43.370] Build status: SCHEDULED
[12:43:43.370] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945304520683793584:65:0) after 7m41s
[12:45:07.050] Received PubSub notification, asking Buildbucket for the build status
[12:45:07.069] Build:
{
"id": "8779874458755545937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60751,
"createdBy": "project:chromium",
"createTime": "2023-05-28T06:44:09.621685754Z",
"endTime": "2023-05-28T12:45:05.931759Z",
"updateTime": "2023-05-28T12:45:05.931759Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bfbebaca363c7c26df6da0eeb6a08c2e033f776a",
"ref": "refs/heads/main"
}
}
}
[12:45:07.069] Invocation finished in 6h0m58.67010411s with status FAILED