[01:51:08.735] New invocation is queued and will start shortly
[01:51:10.491] Starting the invocation (attempt 1)
[01:51:10.522] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c011790e80ca63eb8ac56f744bb0aeafffccb9d4"
[01:51:10.522] Popped gitiles commit info from properties and tags
[01:51:10.522] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:51:10.522] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:51:10.522] Buildbucket request:
{
"requestId": "8954292053987396240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c011790e80ca63eb8ac56f744bb0aeafffccb9d4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954292053987396240"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:51:11.282] Scheduled build:
{
"id": "8788861991014837553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60337,
"createdBy": "project:chromium",
"createTime": "2023-02-18T01:51:10.938010356Z",
"updateTime": "2023-02-18T01:51:10.938010356Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c011790e80ca63eb8ac56f744bb0aeafffccb9d4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:51:11.282] Task URL: https://cr-buildbucket.appspot.com/build/8788861991014837553
[01:51:11.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:2:0) after 8m49s
[02:00:00.658] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:2:0)
[02:00:00.697] Build status: SCHEDULED
[02:00:00.697] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:3:0) after 6m38s
[02:06:38.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:3:0)
[02:06:38.754] Build status: SCHEDULED
[02:06:38.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:4:0) after 8m26s
[02:15:04.791] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:4:0)
[02:15:04.819] Build status: SCHEDULED
[02:15:04.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:5:0) after 4m56s
[02:20:01.247] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:5:0)
[02:20:01.268] Build status: SCHEDULED
[02:20:01.268] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:6:0) after 6m55s
[02:26:56.315] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:6:0)
[02:26:56.339] Build status: SCHEDULED
[02:26:56.339] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:7:0) after 1m0s
[02:27:56.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:7:0)
[02:27:56.492] Build status: SCHEDULED
[02:27:56.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:8:0) after 2m32s
[02:30:28.921] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:8:0)
[02:30:28.945] Build status: SCHEDULED
[02:30:28.945] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:9:0) after 8m13s
[02:38:42.091] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:9:0)
[02:38:42.116] Build status: SCHEDULED
[02:38:42.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:10:0) after 5m46s
[02:44:28.625] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:10:0)
[02:44:28.648] Build status: SCHEDULED
[02:44:28.648] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:11:0) after 3m50s
[02:48:18.867] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:11:0)
[02:48:18.887] Build status: SCHEDULED
[02:48:18.887] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:12:0) after 1m15s
[02:49:33.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:12:0)
[02:49:33.986] Build status: SCHEDULED
[02:49:33.986] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:13:0) after 1m47s
[02:51:21.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:13:0)
[02:51:21.184] Build status: SCHEDULED
[02:51:21.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:14:0) after 9m35s
[03:00:56.224] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:14:0)
[03:00:56.247] Build status: SCHEDULED
[03:00:56.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:15:0) after 6m49s
[03:07:45.363] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:15:0)
[03:07:45.392] Build status: SCHEDULED
[03:07:45.392] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:16:0) after 1m12s
[03:08:57.416] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:16:0)
[03:08:57.437] Build status: SCHEDULED
[03:08:57.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:17:0) after 1m18s
[03:10:15.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:17:0)
[03:10:15.485] Build status: SCHEDULED
[03:10:15.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:18:0) after 9m23s
[03:19:38.657] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:18:0)
[03:19:38.683] Build status: SCHEDULED
[03:19:38.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:19:0) after 9m27s
[03:29:05.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:19:0)
[03:29:05.914] Build status: SCHEDULED
[03:29:05.915] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:20:0) after 5m48s
[03:34:54.186] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:20:0)
[03:34:54.230] Build status: SCHEDULED
[03:34:54.230] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:21:0) after 3m14s
[03:38:08.305] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:21:0)
[03:38:08.326] Build status: SCHEDULED
[03:38:08.326] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:22:0) after 8m1s
[03:46:09.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:22:0)
[03:46:09.667] Build status: SCHEDULED
[03:46:09.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:23:0) after 5m14s
[03:51:23.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:23:0)
[03:51:23.713] Build status: SCHEDULED
[03:51:23.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:24:0) after 5m35s
[03:56:59.108] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:24:0)
[03:56:59.129] Build status: SCHEDULED
[03:56:59.129] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:25:0) after 6m26s
[04:03:25.207] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:25:0)
[04:03:25.230] Build status: SCHEDULED
[04:03:25.230] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:26:0) after 6m25s
[04:09:50.264] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:26:0)
[04:09:50.281] Build status: SCHEDULED
[04:09:50.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:27:0) after 3m19s
[04:13:09.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:27:0)
[04:13:09.382] Build status: SCHEDULED
[04:13:09.382] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:28:0) after 9m5s
[04:22:14.366] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:28:0)
[04:22:14.385] Build status: SCHEDULED
[04:22:14.385] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:29:0) after 1m14s
[04:23:28.410] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:29:0)
[04:23:28.431] Build status: SCHEDULED
[04:23:28.431] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:30:0) after 5m59s
[04:29:27.454] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:30:0)
[04:29:27.477] Build status: SCHEDULED
[04:29:27.477] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:31:0) after 8m11s
[04:37:38.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:31:0)
[04:37:38.629] Build status: SCHEDULED
[04:37:38.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:32:0) after 7m45s
[04:45:23.736] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:32:0)
[04:45:23.756] Build status: SCHEDULED
[04:45:23.756] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:33:0) after 6m29s
[04:51:52.939] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:33:0)
[04:51:52.996] Build status: SCHEDULED
[04:51:52.996] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:34:0) after 1m3s
[04:52:56.064] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:34:0)
[04:52:56.086] Build status: SCHEDULED
[04:52:56.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:35:0) after 5m44s
[04:58:40.176] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:35:0)
[04:58:40.198] Build status: SCHEDULED
[04:58:40.204] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:36:0) after 2m50s
[05:01:30.269] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:36:0)
[05:01:30.288] Build status: SCHEDULED
[05:01:30.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:37:0) after 5m59s
[05:07:29.482] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:37:0)
[05:07:29.503] Build status: SCHEDULED
[05:07:29.503] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:38:0) after 7m56s
[05:15:25.543] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:38:0)
[05:15:25.589] Build status: SCHEDULED
[05:15:25.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:39:0) after 9m45s
[05:25:10.619] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:39:0)
[05:25:10.640] Build status: SCHEDULED
[05:25:10.640] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:40:0) after 5m8s
[05:30:18.806] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:40:0)
[05:30:18.834] Build status: SCHEDULED
[05:30:18.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:41:0) after 5m57s
[05:36:15.988] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:41:0)
[05:36:16.012] Build status: SCHEDULED
[05:36:16.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:42:0) after 4m57s
[05:41:13.120] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:42:0)
[05:41:13.497] Build status: SCHEDULED
[05:41:13.497] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:43:0) after 9m50s
[05:51:03.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:43:0)
[05:51:03.839] Build status: SCHEDULED
[05:51:03.839] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:44:0) after 7m34s
[05:58:37.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:44:0)
[05:58:37.910] Build status: SCHEDULED
[05:58:37.910] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:45:0) after 2m48s
[06:01:26.649] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:45:0)
[06:01:26.665] Build status: SCHEDULED
[06:01:26.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:46:0) after 1m11s
[06:02:37.756] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:46:0)
[06:02:37.774] Build status: SCHEDULED
[06:02:37.774] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:47:0) after 8m10s
[06:10:47.801] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:47:0)
[06:10:47.829] Build status: SCHEDULED
[06:10:47.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:48:0) after 4m5s
[06:14:53.055] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:48:0)
[06:14:53.076] Build status: SCHEDULED
[06:14:53.076] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:49:0) after 6m8s
[06:21:01.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:49:0)
[06:21:01.259] Build status: SCHEDULED
[06:21:01.259] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:50:0) after 6m30s
[06:27:31.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:50:0)
[06:27:31.719] Build status: SCHEDULED
[06:27:31.719] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:51:0) after 6m26s
[06:33:58.393] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:51:0)
[06:33:58.424] Build status: SCHEDULED
[06:33:58.424] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:52:0) after 9m7s
[06:43:05.554] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:52:0)
[06:43:05.574] Build status: SCHEDULED
[06:43:05.574] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:53:0) after 8m15s
[06:51:20.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:53:0)
[06:51:20.979] Build status: SCHEDULED
[06:51:20.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:54:0) after 2m37s
[06:53:58.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:54:0)
[06:53:58.225] Build status: SCHEDULED
[06:53:58.225] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:55:0) after 5m20s
[06:59:18.256] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:55:0)
[06:59:18.277] Build status: SCHEDULED
[06:59:18.278] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:56:0) after 3m46s
[07:03:04.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:56:0)
[07:03:04.489] Build status: SCHEDULED
[07:03:04.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:57:0) after 1m26s
[07:04:30.551] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:57:0)
[07:04:30.570] Build status: SCHEDULED
[07:04:30.570] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:58:0) after 7m23s
[07:11:53.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:58:0)
[07:11:53.754] Build status: SCHEDULED
[07:11:53.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:59:0) after 4m12s
[07:16:05.778] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:59:0)
[07:16:05.804] Build status: SCHEDULED
[07:16:05.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:60:0) after 5m17s
[07:21:22.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:60:0)
[07:21:22.862] Build status: SCHEDULED
[07:21:22.862] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:61:0) after 3m19s
[07:24:42.229] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:61:0)
[07:24:42.268] Build status: SCHEDULED
[07:24:42.268] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:62:0) after 6m48s
[07:31:30.447] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:62:0)
[07:31:30.467] Build status: SCHEDULED
[07:31:30.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:63:0) after 3m51s
[07:35:21.505] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:63:0)
[07:35:21.533] Build status: SCHEDULED
[07:35:21.533] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:64:0) after 3m31s
[07:38:52.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:64:0)
[07:38:52.793] Build status: SCHEDULED
[07:38:52.793] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:65:0) after 9m41s
[07:48:34.159] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:65:0)
[07:48:34.179] Build status: SCHEDULED
[07:48:34.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8954292053987396240:66:0) after 8m24s
[07:52:06.872] Received PubSub notification, asking Buildbucket for the build status
[07:52:06.895] Build:
{
"id": "8788861991014837553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60337,
"createdBy": "project:chromium",
"createTime": "2023-02-18T01:51:10.938010356Z",
"endTime": "2023-02-18T07:52:05.838045Z",
"updateTime": "2023-02-18T07:52:05.838045Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c011790e80ca63eb8ac56f744bb0aeafffccb9d4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[07:52:06.895] Invocation finished in 6h0m58.176360752s with status FAILED