[07:39:07.004] New invocation is queued and will start shortly
[07:39:08.074] Starting the invocation (attempt 1)
[07:39:08.115] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c9495380264f467f78b44a21bf1156ada71927fd"
[07:39:08.115] Popped gitiles commit info from properties and tags
[07:39:08.115] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:39:08.115] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:39:08.115] Buildbucket request:
{
"requestId": "8972933136622492528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9495380264f467f78b44a21bf1156ada71927fd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972933136622492528"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:39:08.760] Scheduled build:
{
"id": "8807503074697641201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56964,
"createdBy": "project:chromium",
"createTime": "2022-07-27T07:39:08.199723021Z",
"updateTime": "2022-07-27T07:39:08.199723021Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9495380264f467f78b44a21bf1156ada71927fd",
"ref": "refs/heads/main"
}
}
}
[07:39:08.761] Task URL: https://cr-buildbucket.appspot.com/build/8807503074697641201
[07:39:08.761] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:2:0) after 9m49s
[07:48:57.783] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:2:0)
[07:48:57.820] Build status: SCHEDULED
[07:48:57.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:3:0) after 7m8s
[07:56:05.848] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:3:0)
[07:56:06.019] Build status: SCHEDULED
[07:56:06.019] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:4:0) after 9m42s
[08:05:48.071] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:4:0)
[08:05:48.119] Build status: SCHEDULED
[08:05:48.120] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:5:0) after 5m55s
[08:11:43.140] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:5:0)
[08:11:43.180] Build status: SCHEDULED
[08:11:43.180] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:6:0) after 1m32s
[08:13:15.201] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:6:0)
[08:13:15.239] Build status: SCHEDULED
[08:13:15.239] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:7:0) after 5m52s
[08:19:07.502] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:7:0)
[08:19:07.533] Build status: SCHEDULED
[08:19:07.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:8:0) after 9m6s
[08:28:13.652] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:8:0)
[08:28:13.683] Build status: SCHEDULED
[08:28:13.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:9:0) after 5m34s
[08:33:47.728] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:9:0)
[08:33:47.765] Build status: SCHEDULED
[08:33:47.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:10:0) after 2m31s
[08:36:18.846] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:10:0)
[08:36:18.866] Build status: SCHEDULED
[08:36:18.866] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:11:0) after 6m18s
[08:42:36.873] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:11:0)
[08:42:36.894] Build status: SCHEDULED
[08:42:36.894] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:12:0) after 1m17s
[08:43:53.917] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:12:0)
[08:43:53.953] Build status: SCHEDULED
[08:43:53.953] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:13:0) after 8m16s
[08:52:10.259] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:13:0)
[08:52:10.280] Build status: SCHEDULED
[08:52:10.280] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:14:0) after 9m52s
[09:02:02.338] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:14:0)
[09:02:02.356] Build status: SCHEDULED
[09:02:02.356] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:15:0) after 5m6s
[09:07:08.419] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:15:0)
[09:07:08.452] Build status: SCHEDULED
[09:07:08.452] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:16:0) after 6m31s
[09:13:39.473] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:16:0)
[09:13:39.492] Build status: SCHEDULED
[09:13:39.492] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:17:0) after 5m19s
[09:18:58.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:17:0)
[09:18:58.571] Build status: SCHEDULED
[09:18:58.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:18:0) after 8m29s
[09:27:27.613] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:18:0)
[09:27:27.635] Build status: SCHEDULED
[09:27:27.635] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:19:0) after 4m56s
[09:32:23.702] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:19:0)
[09:32:23.722] Build status: SCHEDULED
[09:32:23.722] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:20:0) after 4m45s
[09:37:08.741] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:20:0)
[09:37:08.760] Build status: SCHEDULED
[09:37:08.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:21:0) after 7m4s
[09:44:12.781] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:21:0)
[09:44:12.846] Build status: SCHEDULED
[09:44:12.846] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:22:0) after 9m25s
[09:53:37.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:22:0)
[09:53:37.934] Build status: SCHEDULED
[09:53:37.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:23:0) after 1m27s
[09:55:05.436] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:23:0)
[09:55:05.457] Build status: SCHEDULED
[09:55:05.457] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:24:0) after 4m40s
[09:59:45.457] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:24:0)
[09:59:45.490] Build status: SCHEDULED
[09:59:45.490] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:25:0) after 5m44s
[10:05:29.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:25:0)
[10:05:29.543] Build status: SCHEDULED
[10:05:29.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:26:0) after 1m15s
[10:06:44.624] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:26:0)
[10:06:44.699] Build status: SCHEDULED
[10:06:44.699] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:27:0) after 3m1s
[10:09:46.188] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:27:0)
[10:09:46.218] Build status: SCHEDULED
[10:09:46.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:28:0) after 3m40s
[10:13:26.240] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:28:0)
[10:13:26.262] Build status: SCHEDULED
[10:13:26.262] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:29:0) after 1m44s
[10:15:10.366] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:29:0)
[10:15:10.390] Build status: SCHEDULED
[10:15:10.390] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:30:0) after 9m26s
[10:24:36.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:30:0)
[10:24:36.665] Build status: SCHEDULED
[10:24:36.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:31:0) after 8m27s
[10:33:03.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:31:0)
[10:33:03.935] Build status: SCHEDULED
[10:33:03.935] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:32:0) after 5m17s
[10:38:20.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:32:0)
[10:38:20.999] Build status: SCHEDULED
[10:38:20.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:33:0) after 9m1s
[10:47:22.020] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:33:0)
[10:47:22.042] Build status: SCHEDULED
[10:47:22.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:34:0) after 9m45s
[10:57:07.211] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:34:0)
[10:57:07.237] Build status: SCHEDULED
[10:57:07.237] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:35:0) after 9m31s
[11:06:38.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:35:0)
[11:06:38.315] Build status: SCHEDULED
[11:06:38.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:36:0) after 3m25s
[11:10:03.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:36:0)
[11:10:03.363] Build status: SCHEDULED
[11:10:03.363] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:37:0) after 3m18s
[11:13:21.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:37:0)
[11:13:21.405] Build status: SCHEDULED
[11:13:21.405] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:38:0) after 6m37s
[11:19:58.426] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:38:0)
[11:19:58.459] Build status: SCHEDULED
[11:19:58.459] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:39:0) after 7m44s
[11:27:42.568] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:39:0)
[11:27:42.604] Build status: SCHEDULED
[11:27:42.604] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:40:0) after 8m26s
[11:36:08.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:40:0)
[11:36:08.760] Build status: SCHEDULED
[11:36:08.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:41:0) after 1m44s
[11:37:52.799] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:41:0)
[11:37:52.876] Build status: SCHEDULED
[11:37:52.876] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:42:0) after 6m38s
[11:44:30.897] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:42:0)
[11:44:30.931] Build status: SCHEDULED
[11:44:30.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:43:0) after 8m36s
[11:53:07.204] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:43:0)
[11:53:07.223] Build status: SCHEDULED
[11:53:07.223] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:44:0) after 4m13s
[11:57:20.245] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:44:0)
[11:57:20.263] Build status: SCHEDULED
[11:57:20.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:45:0) after 9m32s
[12:06:52.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:45:0)
[12:06:52.534] Build status: SCHEDULED
[12:06:52.534] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:46:0) after 3m37s
[12:10:29.558] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:46:0)
[12:10:29.578] Build status: SCHEDULED
[12:10:29.578] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:47:0) after 5m51s
[12:16:20.699] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:47:0)
[12:16:20.721] Build status: SCHEDULED
[12:16:20.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:48:0) after 2m55s
[12:19:15.757] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:48:0)
[12:19:15.777] Build status: SCHEDULED
[12:19:15.777] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:49:0) after 7m25s
[12:26:40.843] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:49:0)
[12:26:40.864] Build status: SCHEDULED
[12:26:40.864] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:50:0) after 1m33s
[12:28:14.278] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:50:0)
[12:28:14.320] Build status: SCHEDULED
[12:28:14.320] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:51:0) after 4m18s
[12:32:32.342] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:51:0)
[12:32:32.362] Build status: SCHEDULED
[12:32:32.362] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:52:0) after 9m39s
[12:42:11.386] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:52:0)
[12:42:11.407] Build status: SCHEDULED
[12:42:11.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:53:0) after 9m57s
[12:52:08.430] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:53:0)
[12:52:08.451] Build status: SCHEDULED
[12:52:08.451] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:54:0) after 6m56s
[12:59:04.533] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:54:0)
[12:59:04.554] Build status: SCHEDULED
[12:59:04.555] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:55:0) after 6m40s
[13:05:44.592] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:55:0)
[13:05:44.612] Build status: SCHEDULED
[13:05:44.612] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:56:0) after 8m19s
[13:14:03.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:56:0)
[13:14:03.709] Build status: SCHEDULED
[13:14:03.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:57:0) after 2m17s
[13:16:20.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:57:0)
[13:16:20.957] Build status: SCHEDULED
[13:16:20.957] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:58:0) after 6m4s
[13:22:25.080] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:58:0)
[13:22:25.102] Build status: SCHEDULED
[13:22:25.102] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:59:0) after 8m19s
[13:30:44.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:59:0)
[13:30:44.282] Build status: SCHEDULED
[13:30:44.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:60:0) after 5m44s
[13:36:28.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:60:0)
[13:36:28.339] Build status: SCHEDULED
[13:36:28.339] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:61:0) after 2m25s
[13:38:53.362] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:61:0)
[13:38:53.388] Build status: SCHEDULED
[13:38:53.388] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972933136622492528:62:0) after 7m0s
[13:40:03.255] Received PubSub notification, asking Buildbucket for the build status
[13:40:03.333] Build:
{
"id": "8807503074697641201",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56964,
"createdBy": "project:chromium",
"createTime": "2022-07-27T07:39:08.199723021Z",
"endTime": "2022-07-27T13:40:02.631342Z",
"updateTime": "2022-07-27T13:40:03.063210Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9495380264f467f78b44a21bf1156ada71927fd",
"ref": "refs/heads/main"
}
}
}
[13:40:03.333] Invocation finished in 6h0m56.352783307s with status FAILED