[04:28:13.120] New invocation is queued and will start shortly
[04:28:14.185] Starting the invocation (attempt 1)
[04:28:14.217] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0ee2a01931f35ce7139a3875447a9d514f4ce036"
[04:28:14.217] Popped gitiles commit info from properties and tags
[04:28:14.217] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:28:14.217] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:28:14.217] Buildbucket request:
{
"requestId": "8948483965942973888",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ee2a01931f35ce7139a3875447a9d514f4ce036",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948483965942973888"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:28:14.591] Scheduled build:
{
"id": "8783053904077926081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60611,
"createdBy": "project:chromium",
"createTime": "2023-04-23T04:28:14.277501744Z",
"updateTime": "2023-04-23T04:28:14.277501744Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ee2a01931f35ce7139a3875447a9d514f4ce036",
"ref": "refs/heads/main"
}
}
}
[04:28:14.591] Task URL: https://cr-buildbucket.appspot.com/build/8783053904077926081
[04:28:14.591] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:2:0) after 4m39s
[04:32:53.607] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:2:0)
[04:32:53.637] Build status: SCHEDULED
[04:32:53.637] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:3:0) after 4m39s
[04:37:32.656] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:3:0)
[04:37:32.681] Build status: SCHEDULED
[04:37:32.681] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:4:0) after 4m36s
[04:42:08.710] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:4:0)
[04:42:08.749] Build status: SCHEDULED
[04:42:08.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:5:0) after 1m31s
[04:43:39.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:5:0)
[04:43:39.786] Build status: SCHEDULED
[04:43:39.786] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:6:0) after 9m32s
[04:53:11.856] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:6:0)
[04:53:11.902] Build status: SCHEDULED
[04:53:11.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:7:0) after 1m46s
[04:54:57.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:7:0)
[04:54:57.967] Build status: SCHEDULED
[04:54:57.967] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:8:0) after 9m34s
[05:04:32.092] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:8:0)
[05:04:32.120] Build status: SCHEDULED
[05:04:32.120] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:9:0) after 4m45s
[05:09:17.132] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:9:0)
[05:09:17.161] Build status: SCHEDULED
[05:09:17.161] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:10:0) after 3m12s
[05:12:29.181] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:10:0)
[05:12:29.201] Build status: SCHEDULED
[05:12:29.201] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:11:0) after 8m51s
[05:21:20.286] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:11:0)
[05:21:20.319] Build status: SCHEDULED
[05:21:20.319] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:12:0) after 3m5s
[05:24:25.539] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:12:0)
[05:24:25.564] Build status: SCHEDULED
[05:24:25.564] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:13:0) after 9m0s
[05:33:25.681] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:13:0)
[05:33:25.700] Build status: SCHEDULED
[05:33:25.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:14:0) after 4m4s
[05:37:29.725] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:14:0)
[05:37:29.746] Build status: SCHEDULED
[05:37:29.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:15:0) after 1m22s
[05:38:51.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:15:0)
[05:38:51.798] Build status: SCHEDULED
[05:38:51.798] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:16:0) after 8m49s
[05:47:40.918] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:16:0)
[05:47:40.936] Build status: SCHEDULED
[05:47:40.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:17:0) after 1m0s
[05:48:41.264] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:17:0)
[05:48:41.283] Build status: SCHEDULED
[05:48:41.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:18:0) after 8m20s
[05:57:01.458] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:18:0)
[05:57:01.481] Build status: SCHEDULED
[05:57:01.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:19:0) after 7m35s
[06:04:36.496] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:19:0)
[06:04:36.519] Build status: SCHEDULED
[06:04:36.519] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:20:0) after 2m6s
[06:06:42.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:20:0)
[06:06:42.573] Build status: SCHEDULED
[06:06:42.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:21:0) after 9m1s
[06:15:43.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:21:0)
[06:15:43.726] Build status: SCHEDULED
[06:15:43.726] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:22:0) after 7m54s
[06:23:37.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:22:0)
[06:23:37.802] Build status: SCHEDULED
[06:23:37.802] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:23:0) after 8m32s
[06:32:09.822] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:23:0)
[06:32:09.841] Build status: SCHEDULED
[06:32:09.841] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:24:0) after 2m12s
[06:34:21.939] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:24:0)
[06:34:22.112] Build status: SCHEDULED
[06:34:22.113] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:25:0) after 2m47s
[06:37:09.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:25:0)
[06:37:09.281] Build status: SCHEDULED
[06:37:09.281] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:26:0) after 6m3s
[06:43:12.622] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:26:0)
[06:43:12.643] Build status: SCHEDULED
[06:43:12.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:27:0) after 2m26s
[06:45:38.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:27:0)
[06:45:38.768] Build status: SCHEDULED
[06:45:38.768] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:28:0) after 4m16s
[06:49:54.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:28:0)
[06:49:54.976] Build status: SCHEDULED
[06:49:54.976] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:29:0) after 2m50s
[06:52:46.638] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:29:0)
[06:52:46.656] Build status: SCHEDULED
[06:52:46.656] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:30:0) after 6m46s
[06:59:32.673] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:30:0)
[06:59:32.713] Build status: SCHEDULED
[06:59:32.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:31:0) after 1m57s
[07:01:29.815] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:31:0)
[07:01:29.883] Build status: SCHEDULED
[07:01:29.883] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:32:0) after 9m36s
[07:11:06.067] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:32:0)
[07:11:06.091] Build status: SCHEDULED
[07:11:06.091] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:33:0) after 8m2s
[07:19:08.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:33:0)
[07:19:08.200] Build status: SCHEDULED
[07:19:08.200] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:34:0) after 8m39s
[07:27:47.218] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:34:0)
[07:27:47.237] Build status: SCHEDULED
[07:27:47.237] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:35:0) after 8m7s
[07:35:54.255] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:35:0)
[07:35:54.279] Build status: SCHEDULED
[07:35:54.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:36:0) after 5m57s
[07:41:51.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:36:0)
[07:41:51.434] Build status: SCHEDULED
[07:41:51.434] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:37:0) after 8m3s
[07:49:54.452] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:37:0)
[07:49:54.533] Build status: SCHEDULED
[07:49:54.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:38:0) after 2m15s
[07:52:09.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:38:0)
[07:52:09.581] Build status: SCHEDULED
[07:52:09.581] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:39:0) after 1m40s
[07:53:49.608] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:39:0)
[07:53:49.632] Build status: SCHEDULED
[07:53:49.632] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:40:0) after 8m40s
[08:02:29.708] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:40:0)
[08:02:29.726] Build status: SCHEDULED
[08:02:29.726] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:41:0) after 7m22s
[08:09:51.706] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:41:0)
[08:09:51.737] Build status: SCHEDULED
[08:09:51.737] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:42:0) after 3m53s
[08:13:44.864] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:42:0)
[08:13:44.883] Build status: SCHEDULED
[08:13:44.883] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:43:0) after 8m7s
[08:21:51.941] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:43:0)
[08:21:52.058] Build status: SCHEDULED
[08:21:52.058] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:44:0) after 9m41s
[08:31:33.223] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:44:0)
[08:31:33.246] Build status: SCHEDULED
[08:31:33.246] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:45:0) after 2m32s
[08:34:05.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:45:0)
[08:34:05.309] Build status: SCHEDULED
[08:34:05.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:46:0) after 1m1s
[08:35:06.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:46:0)
[08:35:06.406] Build status: SCHEDULED
[08:35:06.406] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:47:0) after 7m3s
[08:42:09.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:47:0)
[08:42:09.448] Build status: SCHEDULED
[08:42:09.448] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:48:0) after 9m21s
[08:51:30.465] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:48:0)
[08:51:30.530] Build status: SCHEDULED
[08:51:30.530] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:49:0) after 7m11s
[08:58:41.773] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:49:0)
[08:58:41.797] Build status: SCHEDULED
[08:58:41.797] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:50:0) after 3m13s
[09:01:54.982] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:50:0)
[09:01:55.004] Build status: SCHEDULED
[09:01:55.004] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:51:0) after 3m51s
[09:05:46.026] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:51:0)
[09:05:46.051] Build status: SCHEDULED
[09:05:46.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:52:0) after 2m44s
[09:08:30.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:52:0)
[09:08:30.158] Build status: SCHEDULED
[09:08:30.158] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:53:0) after 4m18s
[09:12:48.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:53:0)
[09:12:48.263] Build status: SCHEDULED
[09:12:48.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:54:0) after 6m11s
[09:18:59.288] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:54:0)
[09:18:59.306] Build status: SCHEDULED
[09:18:59.307] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:55:0) after 4m38s
[09:23:37.333] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:55:0)
[09:23:37.407] Build status: SCHEDULED
[09:23:37.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:56:0) after 6m51s
[09:30:28.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:56:0)
[09:30:28.548] Build status: SCHEDULED
[09:30:28.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:57:0) after 8m12s
[09:38:40.544] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:57:0)
[09:38:40.570] Build status: SCHEDULED
[09:38:40.570] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:58:0) after 4m55s
[09:43:35.741] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:58:0)
[09:43:35.767] Build status: SCHEDULED
[09:43:35.767] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:59:0) after 7m34s
[09:51:09.892] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:59:0)
[09:51:09.914] Build status: SCHEDULED
[09:51:09.914] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:60:0) after 6m4s
[09:57:13.936] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:60:0)
[09:57:13.958] Build status: SCHEDULED
[09:57:13.958] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:61:0) after 4m17s
[10:01:30.976] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:61:0)
[10:01:30.996] Build status: SCHEDULED
[10:01:30.996] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:62:0) after 1m30s
[10:03:01.017] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:62:0)
[10:03:01.043] Build status: SCHEDULED
[10:03:01.043] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:63:0) after 1m13s
[10:04:14.216] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:63:0)
[10:04:14.239] Build status: SCHEDULED
[10:04:14.239] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:64:0) after 6m10s
[10:10:24.352] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:64:0)
[10:10:24.376] Build status: SCHEDULED
[10:10:24.376] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:65:0) after 8m44s
[10:19:08.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:65:0)
[10:19:08.485] Build status: SCHEDULED
[10:19:08.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:66:0) after 2m24s
[10:21:32.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:66:0)
[10:21:32.666] Build status: SCHEDULED
[10:21:32.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948483965942973888:67:0) after 9m21s
[10:29:04.741] Received PubSub notification, asking Buildbucket for the build status
[10:29:04.762] Build:
{
"id": "8783053904077926081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60611,
"createdBy": "project:chromium",
"createTime": "2023-04-23T04:28:14.277501744Z",
"endTime": "2023-04-23T10:29:04.060736Z",
"updateTime": "2023-04-23T10:29:04.060736Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ee2a01931f35ce7139a3875447a9d514f4ce036",
"ref": "refs/heads/main"
}
}
}
[10:29:04.762] Invocation finished in 6h0m51.647275418s with status FAILED