[20:14:14.749] New invocation is queued and will start shortly
[20:14:16.984] Starting the invocation (attempt 1)
[20:14:17.025] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/53b74a51f27f385bf007fced08b916d74f8c0dc2"
[20:14:17.025] Popped gitiles commit info from properties and tags
[20:14:17.025] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:14:17.026] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:14:17.026] Buildbucket request:
{
"requestId": "8953769668088703680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "53b74a51f27f385bf007fced08b916d74f8c0dc2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8953769668088703680"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:14:17.874] Scheduled build:
{
"id": "8788339604837067697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60360,
"createdBy": "project:chromium",
"createTime": "2023-02-23T20:14:17.219748045Z",
"updateTime": "2023-02-23T20:14:17.219748045Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "53b74a51f27f385bf007fced08b916d74f8c0dc2",
"ref": "refs/heads/main"
}
}
}
[20:14:17.874] Task URL: https://cr-buildbucket.appspot.com/build/8788339604837067697
[20:14:17.874] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:2:0) after 8m6s
[20:22:23.889] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:2:0)
[20:22:23.923] Build status: SCHEDULED
[20:22:23.923] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:3:0) after 6m50s
[20:29:13.947] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:3:0)
[20:29:13.968] Build status: SCHEDULED
[20:29:13.968] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:4:0) after 1m7s
[20:30:21.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:4:0)
[20:30:21.091] Build status: SCHEDULED
[20:30:21.091] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:5:0) after 4m56s
[20:35:17.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:5:0)
[20:35:17.237] Build status: SCHEDULED
[20:35:17.237] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:6:0) after 6m4s
[20:41:21.338] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:6:0)
[20:41:21.408] Build status: SCHEDULED
[20:41:21.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:7:0) after 7m7s
[20:48:28.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:7:0)
[20:48:28.513] Build status: SCHEDULED
[20:48:28.513] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:8:0) after 8m19s
[20:56:47.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:8:0)
[20:56:47.647] Build status: SCHEDULED
[20:56:47.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:9:0) after 1m3s
[20:57:50.681] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:9:0)
[20:57:50.700] Build status: SCHEDULED
[20:57:50.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:10:0) after 6m12s
[21:04:02.769] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:10:0)
[21:04:02.791] Build status: SCHEDULED
[21:04:02.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:11:0) after 6m14s
[21:10:16.814] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:11:0)
[21:10:16.834] Build status: SCHEDULED
[21:10:16.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:12:0) after 6m19s
[21:16:35.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:12:0)
[21:16:35.980] Build status: SCHEDULED
[21:16:35.980] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:13:0) after 7m26s
[21:24:02.037] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:13:0)
[21:24:02.061] Build status: SCHEDULED
[21:24:02.061] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:14:0) after 4m43s
[21:28:45.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:14:0)
[21:28:45.109] Build status: SCHEDULED
[21:28:45.109] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:15:0) after 9m20s
[21:38:05.140] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:15:0)
[21:38:05.167] Build status: SCHEDULED
[21:38:05.167] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:16:0) after 4m40s
[21:42:45.210] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:16:0)
[21:42:45.227] Build status: SCHEDULED
[21:42:45.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:17:0) after 3m20s
[21:46:05.880] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:17:0)
[21:46:05.901] Build status: SCHEDULED
[21:46:05.901] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:18:0) after 9m47s
[21:55:52.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:18:0)
[21:55:52.994] Build status: SCHEDULED
[21:55:52.994] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:19:0) after 4m15s
[22:00:08.054] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:19:0)
[22:00:08.077] Build status: SCHEDULED
[22:00:08.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:20:0) after 7m51s
[22:07:59.187] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:20:0)
[22:07:59.215] Build status: SCHEDULED
[22:07:59.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:21:0) after 4m53s
[22:12:52.209] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:21:0)
[22:12:52.232] Build status: SCHEDULED
[22:12:52.232] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:22:0) after 4m58s
[22:17:50.255] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:22:0)
[22:17:50.389] Build status: SCHEDULED
[22:17:50.389] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:23:0) after 6m25s
[22:24:15.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:23:0)
[22:24:15.479] Build status: SCHEDULED
[22:24:15.479] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:24:0) after 3m31s
[22:27:46.625] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:24:0)
[22:27:46.648] Build status: SCHEDULED
[22:27:46.648] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:25:0) after 5m8s
[22:32:54.832] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:25:0)
[22:32:54.873] Build status: SCHEDULED
[22:32:54.873] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:26:0) after 5m1s
[22:37:55.900] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:26:0)
[22:37:55.921] Build status: SCHEDULED
[22:37:55.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:27:0) after 1m6s
[22:39:01.999] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:27:0)
[22:39:02.072] Build status: SCHEDULED
[22:39:02.072] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:28:0) after 2m43s
[22:41:45.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:28:0)
[22:41:45.258] Build status: SCHEDULED
[22:41:45.258] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:29:0) after 5m33s
[22:47:18.484] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:29:0)
[22:47:18.515] Build status: SCHEDULED
[22:47:18.515] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:30:0) after 8m2s
[22:55:20.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:30:0)
[22:55:20.629] Build status: SCHEDULED
[22:55:20.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:31:0) after 9m36s
[23:04:57.406] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:31:0)
[23:04:57.428] Build status: SCHEDULED
[23:04:57.428] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:32:0) after 8m20s
[23:13:17.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:32:0)
[23:13:17.545] Build status: SCHEDULED
[23:13:17.545] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:33:0) after 6m23s
[23:19:40.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:33:0)
[23:19:41.009] Build status: SCHEDULED
[23:19:41.009] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:34:0) after 8m46s
[23:28:27.088] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:34:0)
[23:28:27.111] Build status: SCHEDULED
[23:28:27.111] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:35:0) after 1m15s
[23:29:42.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:35:0)
[23:29:42.568] Build status: SCHEDULED
[23:29:42.569] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:36:0) after 1m36s
[23:31:18.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:36:0)
[23:31:18.653] Build status: SCHEDULED
[23:31:18.653] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:37:0) after 1m59s
[23:33:17.730] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:37:0)
[23:33:17.758] Build status: SCHEDULED
[23:33:17.759] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:38:0) after 4m49s
[23:38:06.784] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:38:0)
[23:38:06.807] Build status: SCHEDULED
[23:38:06.807] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:39:0) after 1m23s
[23:39:30.264] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:39:0)
[23:39:30.296] Build status: SCHEDULED
[23:39:30.296] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:40:0) after 8m50s
[23:48:20.491] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:40:0)
[23:48:20.516] Build status: SCHEDULED
[23:48:20.516] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:41:0) after 7m54s
[23:56:14.588] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:41:0)
[23:56:14.617] Build status: SCHEDULED
[23:56:14.617] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:42:0) after 7m44s
[00:03:58.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:42:0)
[00:03:58.893] Build status: SCHEDULED
[00:03:58.894] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:43:0) after 7m40s
[00:11:38.923] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:43:0)
[00:11:38.995] Build status: SCHEDULED
[00:11:38.995] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:44:0) after 4m43s
[00:16:22.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:44:0)
[00:16:22.134] Build status: SCHEDULED
[00:16:22.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:45:0) after 2m54s
[00:19:16.198] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:45:0)
[00:19:16.221] Build status: SCHEDULED
[00:19:16.221] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:46:0) after 8m40s
[00:27:56.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:46:0)
[00:27:56.349] Build status: SCHEDULED
[00:27:56.349] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:47:0) after 3m49s
[00:31:45.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:47:0)
[00:31:45.658] Build status: SCHEDULED
[00:31:45.658] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:48:0) after 7m11s
[00:38:56.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:48:0)
[00:38:56.931] Build status: SCHEDULED
[00:38:56.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:49:0) after 9m21s
[00:48:17.998] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:49:0)
[00:48:18.027] Build status: SCHEDULED
[00:48:18.027] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:50:0) after 3m48s
[00:52:06.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:50:0)
[00:52:06.080] Build status: SCHEDULED
[00:52:06.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:51:0) after 5m39s
[00:57:45.109] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:51:0)
[00:57:45.133] Build status: SCHEDULED
[00:57:45.133] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:52:0) after 7m41s
[01:05:26.175] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:52:0)
[01:05:26.196] Build status: SCHEDULED
[01:05:26.196] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:53:0) after 9m8s
[01:14:34.422] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:53:0)
[01:14:34.444] Build status: SCHEDULED
[01:14:34.444] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:54:0) after 8m15s
[01:22:49.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:54:0)
[01:22:49.491] Build status: SCHEDULED
[01:22:49.491] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:55:0) after 3m5s
[01:25:54.502] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:55:0)
[01:25:54.521] Build status: SCHEDULED
[01:25:54.521] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:56:0) after 9m30s
[01:35:24.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:56:0)
[01:35:24.690] Build status: SCHEDULED
[01:35:24.690] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:57:0) after 4m57s
[01:40:22.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:57:0)
[01:40:22.264] Build status: SCHEDULED
[01:40:22.264] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:58:0) after 8m8s
[01:48:30.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:58:0)
[01:48:30.542] Build status: SCHEDULED
[01:48:30.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:59:0) after 7m2s
[01:55:32.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:59:0)
[01:55:32.654] Build status: SCHEDULED
[01:55:32.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:60:0) after 6m5s
[02:01:37.807] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:60:0)
[02:01:37.838] Build status: SCHEDULED
[02:01:37.838] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:61:0) after 4m45s
[02:06:22.991] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:61:0)
[02:06:23.012] Build status: SCHEDULED
[02:06:23.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:62:0) after 6m24s
[02:12:47.404] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:62:0)
[02:12:47.423] Build status: SCHEDULED
[02:12:47.423] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8953769668088703680:63:0) after 3m43s
[02:15:04.632] Received PubSub notification, asking Buildbucket for the build status
[02:15:04.657] Build:
{
"id": "8788339604837067697",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60360,
"createdBy": "project:chromium",
"createTime": "2023-02-23T20:14:17.219748045Z",
"endTime": "2023-02-24T02:15:02.465026Z",
"updateTime": "2023-02-24T02:15:02.465026Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "53b74a51f27f385bf007fced08b916d74f8c0dc2",
"ref": "refs/heads/main"
}
}
}
[02:15:04.657] Invocation finished in 6h0m49.922351645s with status FAILED