[22:04:05.431] New invocation is queued and will start shortly
[22:04:06.504] Starting the invocation (attempt 1)
[22:04:06.532] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b736271378330a0c8642ba3768329c5b7fdf4782"
[22:04:06.532] Popped gitiles commit info from properties and tags
[22:04:06.532] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:04:06.532] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:04:06.532] Buildbucket request:
{
"requestId": "8992266467977979232",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b736271378330a0c8642ba3768329c5b7fdf4782",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992266467977979232"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:04:07.028] Scheduled build:
{
"id": "8826836406085447473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 51683,
"createdBy": "project:chromium",
"createTime": "2021-12-25T22:04:06.604545185Z",
"updateTime": "2021-12-25T22:04:06.604545185Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b736271378330a0c8642ba3768329c5b7fdf4782",
"ref": "refs/heads/main"
}
}
}
[22:04:07.028] Task URL: https://cr-buildbucket.appspot.com/build/8826836406085447473
[22:04:07.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:2:0) after 2m7s
[22:06:14.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:2:0)
[22:06:14.339] Build status: SCHEDULED
[22:06:14.339] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:3:0) after 7m45s
[22:13:59.356] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:3:0)
[22:13:59.375] Build status: SCHEDULED
[22:13:59.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:4:0) after 1m16s
[22:15:15.390] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:4:0)
[22:15:15.418] Build status: SCHEDULED
[22:15:15.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:5:0) after 6m31s
[22:21:46.435] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:5:0)
[22:21:46.453] Build status: SCHEDULED
[22:21:46.453] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:6:0) after 6m9s
[22:27:55.500] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:6:0)
[22:27:55.532] Build status: SCHEDULED
[22:27:55.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:7:0) after 7m43s
[22:35:38.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:7:0)
[22:35:38.571] Build status: SCHEDULED
[22:35:38.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:8:0) after 3m1s
[22:38:39.586] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:8:0)
[22:38:39.612] Build status: SCHEDULED
[22:38:39.612] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:9:0) after 8m30s
[22:47:09.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:9:0)
[22:47:09.759] Build status: SCHEDULED
[22:47:09.759] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:10:0) after 1m28s
[22:48:37.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:10:0)
[22:48:37.798] Build status: SCHEDULED
[22:48:37.798] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:11:0) after 3m52s
[22:52:29.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:11:0)
[22:52:29.842] Build status: SCHEDULED
[22:52:29.842] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:12:0) after 6m26s
[22:58:55.857] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:12:0)
[22:58:55.877] Build status: SCHEDULED
[22:58:55.877] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:13:0) after 1m7s
[23:00:03.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:13:0)
[23:00:03.258] Build status: SCHEDULED
[23:00:03.258] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:14:0) after 2m13s
[23:02:16.276] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:14:0)
[23:02:16.292] Build status: SCHEDULED
[23:02:16.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:15:0) after 2m6s
[23:04:22.362] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:15:0)
[23:04:22.391] Build status: SCHEDULED
[23:04:22.391] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:16:0) after 7m31s
[23:11:53.469] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:16:0)
[23:11:53.500] Build status: SCHEDULED
[23:11:53.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:17:0) after 3m35s
[23:15:28.516] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:17:0)
[23:15:28.533] Build status: SCHEDULED
[23:15:28.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:18:0) after 5m10s
[23:20:38.553] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:18:0)
[23:20:38.585] Build status: SCHEDULED
[23:20:38.585] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:19:0) after 4m54s
[23:25:32.601] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:19:0)
[23:25:32.622] Build status: SCHEDULED
[23:25:32.622] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:20:0) after 3m39s
[23:29:11.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:20:0)
[23:29:11.669] Build status: SCHEDULED
[23:29:11.669] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:21:0) after 9m15s
[23:38:26.686] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:21:0)
[23:38:26.702] Build status: SCHEDULED
[23:38:26.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:22:0) after 4m15s
[23:42:41.717] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:22:0)
[23:42:41.758] Build status: SCHEDULED
[23:42:41.758] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:23:0) after 3m10s
[23:45:51.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:23:0)
[23:45:51.805] Build status: SCHEDULED
[23:45:51.805] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:24:0) after 8m26s
[23:54:17.822] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:24:0)
[23:54:17.857] Build status: SCHEDULED
[23:54:17.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:25:0) after 9m40s
[00:03:57.874] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:25:0)
[00:03:57.893] Build status: SCHEDULED
[00:03:57.893] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:26:0) after 7m28s
[00:11:25.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:26:0)
[00:11:25.953] Build status: SCHEDULED
[00:11:25.953] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:27:0) after 8m36s
[00:20:01.976] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:27:0)
[00:20:02.000] Build status: SCHEDULED
[00:20:02.000] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:28:0) after 7m11s
[00:27:13.052] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:28:0)
[00:27:13.085] Build status: SCHEDULED
[00:27:13.085] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:29:0) after 7m36s
[00:34:49.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:29:0)
[00:34:49.178] Build status: SCHEDULED
[00:34:49.178] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:30:0) after 6m35s
[00:41:24.193] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:30:0)
[00:41:24.247] Build status: SCHEDULED
[00:41:24.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:31:0) after 8m55s
[00:50:19.264] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:31:0)
[00:50:19.291] Build status: SCHEDULED
[00:50:19.291] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:32:0) after 4m17s
[00:54:36.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:32:0)
[00:54:36.329] Build status: SCHEDULED
[00:54:36.329] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:33:0) after 3m5s
[00:57:41.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:33:0)
[00:57:41.576] Build status: SCHEDULED
[00:57:41.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:34:0) after 5m7s
[01:02:48.595] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:34:0)
[01:02:48.626] Build status: SCHEDULED
[01:02:48.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:35:0) after 1m9s
[01:03:57.644] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:35:0)
[01:03:57.683] Build status: SCHEDULED
[01:03:57.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:36:0) after 2m45s
[01:06:42.750] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:36:0)
[01:06:42.788] Build status: SCHEDULED
[01:06:42.788] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:37:0) after 5m10s
[01:11:53.291] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:37:0)
[01:11:53.310] Build status: SCHEDULED
[01:11:53.310] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:38:0) after 6m11s
[01:18:04.325] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:38:0)
[01:18:04.352] Build status: SCHEDULED
[01:18:04.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:39:0) after 9m14s
[01:27:18.540] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:39:0)
[01:27:18.556] Build status: SCHEDULED
[01:27:18.556] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:40:0) after 8m6s
[01:35:24.808] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:40:0)
[01:35:24.836] Build status: SCHEDULED
[01:35:24.836] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:41:0) after 8m21s
[01:43:46.158] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:41:0)
[01:43:46.184] Build status: SCHEDULED
[01:43:46.184] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:42:0) after 9m26s
[01:53:12.216] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:42:0)
[01:53:12.262] Build status: SCHEDULED
[01:53:12.262] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:43:0) after 9m55s
[02:03:07.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:43:0)
[02:03:07.311] Build status: SCHEDULED
[02:03:07.311] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:44:0) after 8m18s
[02:11:25.387] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:44:0)
[02:11:25.419] Build status: SCHEDULED
[02:11:25.419] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:45:0) after 9m38s
[02:21:03.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:45:0)
[02:21:03.641] Build status: SCHEDULED
[02:21:03.641] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:46:0) after 7m51s
[02:28:54.658] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:46:0)
[02:28:54.677] Build status: SCHEDULED
[02:28:54.677] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:47:0) after 7m40s
[02:36:34.697] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:47:0)
[02:36:34.735] Build status: SCHEDULED
[02:36:34.735] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:48:0) after 4m16s
[02:40:50.755] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:48:0)
[02:40:50.775] Build status: SCHEDULED
[02:40:50.775] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:49:0) after 9m11s
[02:50:01.792] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:49:0)
[02:50:01.831] Build status: SCHEDULED
[02:50:01.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:50:0) after 2m0s
[02:52:01.918] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:50:0)
[02:52:01.935] Build status: SCHEDULED
[02:52:01.935] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:51:0) after 1m45s
[02:53:47.155] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:51:0)
[02:53:47.183] Build status: SCHEDULED
[02:53:47.183] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:52:0) after 5m42s
[02:59:29.209] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:52:0)
[02:59:29.242] Build status: SCHEDULED
[02:59:29.242] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:53:0) after 3m32s
[03:03:01.262] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:53:0)
[03:03:01.282] Build status: SCHEDULED
[03:03:01.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:54:0) after 6m46s
[03:09:47.304] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:54:0)
[03:09:47.334] Build status: SCHEDULED
[03:09:47.334] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:55:0) after 3m34s
[03:13:21.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:55:0)
[03:13:21.379] Build status: SCHEDULED
[03:13:21.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:56:0) after 1m25s
[03:14:46.398] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:56:0)
[03:14:46.553] Build status: SCHEDULED
[03:14:46.553] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:57:0) after 6m28s
[03:21:14.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:57:0)
[03:21:14.592] Build status: SCHEDULED
[03:21:14.592] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:58:0) after 3m31s
[03:24:45.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:58:0)
[03:24:45.666] Build status: SCHEDULED
[03:24:45.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:59:0) after 8m34s
[03:33:19.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:59:0)
[03:33:19.917] Build status: SCHEDULED
[03:33:19.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:60:0) after 3m14s
[03:36:33.948] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:60:0)
[03:36:33.967] Build status: SCHEDULED
[03:36:33.967] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:61:0) after 4m16s
[03:40:50.181] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:61:0)
[03:40:50.211] Build status: SCHEDULED
[03:40:50.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:62:0) after 8m30s
[03:49:20.236] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:62:0)
[03:49:20.273] Build status: SCHEDULED
[03:49:20.273] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:63:0) after 7m48s
[03:57:08.675] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:63:0)
[03:57:08.703] Build status: SCHEDULED
[03:57:08.703] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8992266467977979232:64:0) after 9m44s
[04:05:02.266] Received PubSub notification, asking Buildbucket for the build status
[04:05:02.285] Build:
{
"id": "8826836406085447473",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 51683,
"createdBy": "project:chromium",
"createTime": "2021-12-25T22:04:06.604545185Z",
"endTime": "2021-12-26T04:05:00.724021Z",
"updateTime": "2021-12-26T04:05:00.964807Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b736271378330a0c8642ba3768329c5b7fdf4782",
"ref": "refs/heads/main"
}
}
}
[04:05:02.285] Invocation finished in 6h0m56.868649243s with status FAILED