[00:55:06.332] New invocation is queued and will start shortly
[00:55:07.558] Starting the invocation (attempt 1)
[00:55:07.592] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/90c1ec7d9a9c64ffa363b7565178142932e51b97"
[00:55:07.592] Popped gitiles commit info from properties and tags
[00:55:07.592] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:55:07.593] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:55:07.593] Buildbucket request:
{
"requestId": "8945054689148593664",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "90c1ec7d9a9c64ffa363b7565178142932e51b97",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945054689148593664"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:55:08.031] Scheduled build:
{
"id": "8779624627090247105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60762,
"createdBy": "project:chromium",
"createTime": "2023-05-31T00:55:07.664790468Z",
"updateTime": "2023-05-31T00:55:07.664790468Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "90c1ec7d9a9c64ffa363b7565178142932e51b97",
"ref": "refs/heads/main"
}
}
}
[00:55:08.031] Task URL: https://cr-buildbucket.appspot.com/build/8779624627090247105
[00:55:08.031] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:2:0) after 6m37s
[01:01:45.588] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:2:0)
[01:01:45.616] Build status: SCHEDULED
[01:01:45.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:3:0) after 5m53s
[01:07:39.214] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:3:0)
[01:07:39.248] Build status: SCHEDULED
[01:07:39.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:4:0) after 1m23s
[01:09:02.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:4:0)
[01:09:02.574] Build status: SCHEDULED
[01:09:02.574] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:5:0) after 9m21s
[01:18:23.845] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:5:0)
[01:18:23.865] Build status: SCHEDULED
[01:18:23.865] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:6:0) after 8m5s
[01:26:28.961] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:6:0)
[01:26:29.025] Build status: SCHEDULED
[01:26:29.025] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:7:0) after 3m35s
[01:30:04.248] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:7:0)
[01:30:04.267] Build status: SCHEDULED
[01:30:04.267] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:8:0) after 5m40s
[01:35:44.486] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:8:0)
[01:35:44.505] Build status: SCHEDULED
[01:35:44.505] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:9:0) after 3m3s
[01:38:47.820] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:9:0)
[01:38:47.844] Build status: SCHEDULED
[01:38:47.844] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:10:0) after 1m20s
[01:40:07.871] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:10:0)
[01:40:07.898] Build status: SCHEDULED
[01:40:07.898] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:11:0) after 8m37s
[01:48:44.923] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:11:0)
[01:48:44.945] Build status: SCHEDULED
[01:48:44.945] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:12:0) after 5m8s
[01:53:53.025] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:12:0)
[01:53:53.042] Build status: SCHEDULED
[01:53:53.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:13:0) after 9m49s
[02:03:42.100] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:13:0)
[02:03:42.143] Build status: SCHEDULED
[02:03:42.143] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:14:0) after 6m46s
[02:10:28.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:14:0)
[02:10:28.328] Build status: SCHEDULED
[02:10:28.328] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:15:0) after 7m54s
[02:18:22.547] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:15:0)
[02:18:22.568] Build status: SCHEDULED
[02:18:22.568] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:16:0) after 5m3s
[02:23:26.114] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:16:0)
[02:23:26.133] Build status: SCHEDULED
[02:23:26.133] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:17:0) after 9m50s
[02:33:16.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:17:0)
[02:33:16.481] Build status: SCHEDULED
[02:33:16.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:18:0) after 7m7s
[02:40:23.487] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:18:0)
[02:40:23.504] Build status: SCHEDULED
[02:40:23.504] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:19:0) after 3m19s
[02:43:42.596] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:19:0)
[02:43:42.750] Build status: SCHEDULED
[02:43:42.750] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:20:0) after 4m45s
[02:48:27.729] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:20:0)
[02:48:27.749] Build status: SCHEDULED
[02:48:27.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:21:0) after 6m18s
[02:54:45.788] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:21:0)
[02:54:45.812] Build status: SCHEDULED
[02:54:45.812] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:22:0) after 8m9s
[03:02:54.864] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:22:0)
[03:02:54.895] Build status: SCHEDULED
[03:02:54.895] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:23:0) after 8m24s
[03:11:18.916] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:23:0)
[03:11:18.982] Build status: SCHEDULED
[03:11:18.982] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:24:0) after 2m31s
[03:13:50.203] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:24:0)
[03:13:50.221] Build status: SCHEDULED
[03:13:50.221] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:25:0) after 5m16s
[03:19:06.551] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:25:0)
[03:19:06.572] Build status: SCHEDULED
[03:19:06.572] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:26:0) after 7m2s
[03:26:08.834] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:26:0)
[03:26:08.894] Build status: SCHEDULED
[03:26:08.894] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:27:0) after 8m31s
[03:34:40.187] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:27:0)
[03:34:40.206] Build status: SCHEDULED
[03:34:40.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:28:0) after 8m53s
[03:43:33.315] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:28:0)
[03:43:33.399] Build status: SCHEDULED
[03:43:33.399] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:29:0) after 4m58s
[03:48:31.864] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:29:0)
[03:48:31.926] Build status: SCHEDULED
[03:48:31.926] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:30:0) after 9m3s
[03:57:35.055] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:30:0)
[03:57:35.086] Build status: SCHEDULED
[03:57:35.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:31:0) after 1m45s
[03:59:20.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:31:0)
[03:59:20.538] Build status: SCHEDULED
[03:59:20.538] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:32:0) after 8m53s
[04:08:13.675] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:32:0)
[04:08:13.694] Build status: SCHEDULED
[04:08:13.694] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:33:0) after 1m57s
[04:10:10.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:33:0)
[04:10:10.849] Build status: SCHEDULED
[04:10:10.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:34:0) after 3m6s
[04:13:17.011] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:34:0)
[04:13:17.061] Build status: SCHEDULED
[04:13:17.061] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:35:0) after 8m54s
[04:22:11.182] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:35:0)
[04:22:11.198] Build status: SCHEDULED
[04:22:11.198] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:36:0) after 7m16s
[04:29:27.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:36:0)
[04:29:27.274] Build status: SCHEDULED
[04:29:27.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:37:0) after 7m21s
[04:36:48.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:37:0)
[04:36:48.355] Build status: SCHEDULED
[04:36:48.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:38:0) after 6m29s
[04:43:17.552] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:38:0)
[04:43:17.625] Build status: SCHEDULED
[04:43:17.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:39:0) after 2m16s
[04:45:33.791] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:39:0)
[04:45:33.867] Build status: SCHEDULED
[04:45:33.867] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:40:0) after 3m30s
[04:49:03.889] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:40:0)
[04:49:03.905] Build status: SCHEDULED
[04:49:03.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:41:0) after 6m22s
[04:55:26.135] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:41:0)
[04:55:26.153] Build status: SCHEDULED
[04:55:26.153] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:42:0) after 5m31s
[05:00:57.369] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:42:0)
[05:00:57.539] Build status: SCHEDULED
[05:00:57.539] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:43:0) after 2m9s
[05:03:06.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:43:0)
[05:03:06.562] Build status: SCHEDULED
[05:03:06.563] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:44:0) after 6m43s
[05:09:49.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:44:0)
[05:09:49.713] Build status: SCHEDULED
[05:09:49.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:45:0) after 4m50s
[05:14:39.744] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:45:0)
[05:14:39.760] Build status: SCHEDULED
[05:14:39.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:46:0) after 7m34s
[05:22:13.786] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:46:0)
[05:22:13.806] Build status: SCHEDULED
[05:22:13.806] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:47:0) after 8m35s
[05:30:48.889] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:47:0)
[05:30:48.912] Build status: SCHEDULED
[05:30:48.912] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:48:0) after 6m51s
[05:37:40.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:48:0)
[05:37:40.022] Build status: SCHEDULED
[05:37:40.022] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:49:0) after 3m24s
[05:41:04.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:49:0)
[05:41:04.074] Build status: SCHEDULED
[05:41:04.074] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:50:0) after 7m57s
[05:49:01.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:50:0)
[05:49:01.179] Build status: SCHEDULED
[05:49:01.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:51:0) after 2m47s
[05:51:48.226] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:51:0)
[05:51:48.247] Build status: SCHEDULED
[05:51:48.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:52:0) after 2m9s
[05:53:57.370] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:52:0)
[05:53:57.388] Build status: SCHEDULED
[05:53:57.388] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:53:0) after 9m47s
[06:03:44.416] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:53:0)
[06:03:44.434] Build status: SCHEDULED
[06:03:44.434] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:54:0) after 3m35s
[06:07:19.543] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:54:0)
[06:07:19.562] Build status: SCHEDULED
[06:07:19.562] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:55:0) after 1m28s
[06:08:47.663] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:55:0)
[06:08:47.682] Build status: SCHEDULED
[06:08:47.682] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:56:0) after 6m21s
[06:15:08.709] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:56:0)
[06:15:08.781] Build status: SCHEDULED
[06:15:08.782] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:57:0) after 6m11s
[06:21:20.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:57:0)
[06:21:20.022] Build status: SCHEDULED
[06:21:20.022] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:58:0) after 4m11s
[06:25:31.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:58:0)
[06:25:31.184] Build status: SCHEDULED
[06:25:31.184] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:59:0) after 6m13s
[06:31:44.210] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:59:0)
[06:31:44.248] Build status: SCHEDULED
[06:31:44.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:60:0) after 4m9s
[06:35:53.426] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:60:0)
[06:35:53.444] Build status: SCHEDULED
[06:35:53.444] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:61:0) after 6m26s
[06:42:19.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:61:0)
[06:42:19.643] Build status: SCHEDULED
[06:42:19.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:62:0) after 9m57s
[06:52:16.752] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:62:0)
[06:52:16.777] Build status: SCHEDULED
[06:52:16.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945054689148593664:63:0) after 7m28s
[06:56:03.803] Received PubSub notification, asking Buildbucket for the build status
[06:56:03.819] Build:
{
"id": "8779624627090247105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60762,
"createdBy": "project:chromium",
"createTime": "2023-05-31T00:55:07.664790468Z",
"endTime": "2023-05-31T06:56:02.921762Z",
"updateTime": "2023-05-31T06:56:02.921762Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "90c1ec7d9a9c64ffa363b7565178142932e51b97",
"ref": "refs/heads/main"
}
}
}
[06:56:03.819] Invocation finished in 6h0m57.501888008s with status FAILED