[22:30:10.108] New invocation is queued and will start shortly
[22:30:11.201] Starting the invocation (attempt 1)
[22:30:11.236] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7030fca7eb81b16b819dd442771b9050fdeddfa7"
[22:30:11.236] Popped gitiles commit info from properties and tags
[22:30:11.236] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:30:11.236] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:30:11.236] Buildbucket request:
{
"requestId": "8955754249839779824",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7030fca7eb81b16b819dd442771b9050fdeddfa7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955754249839779824"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:30:11.750] Scheduled build:
{
"id": "8790324187848099409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60277,
"createdBy": "project:chromium",
"createTime": "2023-02-01T22:30:11.372690209Z",
"updateTime": "2023-02-01T22:30:11.372690209Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7030fca7eb81b16b819dd442771b9050fdeddfa7",
"ref": "refs/heads/main"
}
}
}
[22:30:11.750] Task URL: https://cr-buildbucket.appspot.com/build/8790324187848099409
[22:30:11.751] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:2:0) after 2m5s
[22:32:17.124] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:2:0)
[22:32:17.152] Build status: SCHEDULED
[22:32:17.152] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:3:0) after 9m14s
[22:41:31.225] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:3:0)
[22:41:31.257] Build status: SCHEDULED
[22:41:31.257] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:4:0) after 4m57s
[22:46:28.432] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:4:0)
[22:46:28.472] Build status: SCHEDULED
[22:46:28.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:5:0) after 9m8s
[22:55:36.521] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:5:0)
[22:55:36.545] Build status: SCHEDULED
[22:55:36.545] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:6:0) after 4m29s
[23:00:05.596] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:6:0)
[23:00:05.624] Build status: SCHEDULED
[23:00:05.624] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:7:0) after 1m14s
[23:01:19.662] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:7:0)
[23:01:19.747] Build status: SCHEDULED
[23:01:19.747] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:8:0) after 8m58s
[23:10:17.856] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:8:0)
[23:10:17.879] Build status: SCHEDULED
[23:10:17.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:9:0) after 6m44s
[23:17:02.234] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:9:0)
[23:17:02.272] Build status: SCHEDULED
[23:17:02.272] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:10:0) after 4m17s
[23:21:19.360] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:10:0)
[23:21:19.382] Build status: SCHEDULED
[23:21:19.382] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:11:0) after 8m54s
[23:30:13.450] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:11:0)
[23:30:13.474] Build status: SCHEDULED
[23:30:13.474] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:12:0) after 4m46s
[23:34:59.497] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:12:0)
[23:34:59.517] Build status: SCHEDULED
[23:34:59.517] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:13:0) after 7m47s
[23:42:46.944] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:13:0)
[23:42:46.983] Build status: SCHEDULED
[23:42:46.983] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:14:0) after 3m43s
[23:46:30.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:14:0)
[23:46:30.548] Build status: SCHEDULED
[23:46:30.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:15:0) after 8m58s
[23:55:28.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:15:0)
[23:55:28.597] Build status: SCHEDULED
[23:55:28.597] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:16:0) after 8m35s
[00:04:03.696] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:16:0)
[00:04:03.742] Build status: SCHEDULED
[00:04:03.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:17:0) after 4m18s
[00:08:21.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:17:0)
[00:08:21.820] Build status: SCHEDULED
[00:08:21.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:18:0) after 4m26s
[00:12:48.093] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:18:0)
[00:12:48.118] Build status: SCHEDULED
[00:12:48.118] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:19:0) after 3m27s
[00:16:15.175] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:19:0)
[00:16:15.274] Build status: SCHEDULED
[00:16:15.274] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:20:0) after 5m4s
[00:21:19.297] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:20:0)
[00:21:19.325] Build status: SCHEDULED
[00:21:19.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:21:0) after 1m47s
[00:23:06.553] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:21:0)
[00:23:06.580] Build status: SCHEDULED
[00:23:06.580] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:22:0) after 1m28s
[00:24:34.605] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:22:0)
[00:24:34.626] Build status: SCHEDULED
[00:24:34.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:23:0) after 8m14s
[00:32:48.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:23:0)
[00:32:48.782] Build status: SCHEDULED
[00:32:48.782] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:24:0) after 3m30s
[00:36:18.905] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:24:0)
[00:36:18.937] Build status: SCHEDULED
[00:36:18.938] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:25:0) after 3m35s
[00:39:54.072] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:25:0)
[00:39:54.092] Build status: SCHEDULED
[00:39:54.092] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:26:0) after 7m22s
[00:47:16.240] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:26:0)
[00:47:16.264] Build status: SCHEDULED
[00:47:16.264] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:27:0) after 7m1s
[00:54:17.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:27:0)
[00:54:17.400] Build status: SCHEDULED
[00:54:17.400] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:28:0) after 8m58s
[01:03:15.429] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:28:0)
[01:03:15.452] Build status: SCHEDULED
[01:03:15.452] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:29:0) after 7m58s
[01:11:13.602] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:29:0)
[01:11:13.629] Build status: SCHEDULED
[01:11:13.629] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:30:0) after 3m40s
[01:14:53.675] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:30:0)
[01:14:53.698] Build status: SCHEDULED
[01:14:53.698] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:31:0) after 5m28s
[01:20:21.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:31:0)
[01:20:21.820] Build status: SCHEDULED
[01:20:21.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:32:0) after 9m58s
[01:30:19.846] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:32:0)
[01:30:19.886] Build status: SCHEDULED
[01:30:19.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:33:0) after 7m36s
[01:37:56.073] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:33:0)
[01:37:56.098] Build status: SCHEDULED
[01:37:56.098] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:34:0) after 4m24s
[01:42:20.396] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:34:0)
[01:42:20.417] Build status: SCHEDULED
[01:42:20.417] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:35:0) after 4m23s
[01:46:43.651] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:35:0)
[01:46:43.672] Build status: SCHEDULED
[01:46:43.672] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:36:0) after 7m33s
[01:54:16.698] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:36:0)
[01:54:16.724] Build status: SCHEDULED
[01:54:16.724] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:37:0) after 4m8s
[01:58:24.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:37:0)
[01:58:24.786] Build status: SCHEDULED
[01:58:24.786] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:38:0) after 9m8s
[02:07:32.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:38:0)
[02:07:32.830] Build status: SCHEDULED
[02:07:32.830] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:39:0) after 9m43s
[02:17:15.948] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:39:0)
[02:17:15.974] Build status: SCHEDULED
[02:17:15.974] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:40:0) after 2m55s
[02:20:11.107] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:40:0)
[02:20:11.168] Build status: SCHEDULED
[02:20:11.168] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:41:0) after 4m4s
[02:24:15.242] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:41:0)
[02:24:15.263] Build status: SCHEDULED
[02:24:15.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:42:0) after 2m42s
[02:26:57.301] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:42:0)
[02:26:57.325] Build status: SCHEDULED
[02:26:57.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:43:0) after 6m51s
[02:33:48.359] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:43:0)
[02:33:48.383] Build status: SCHEDULED
[02:33:48.383] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:44:0) after 7m20s
[02:41:08.446] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:44:0)
[02:41:08.469] Build status: SCHEDULED
[02:41:08.469] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:45:0) after 1m57s
[02:43:05.834] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:45:0)
[02:43:05.853] Build status: SCHEDULED
[02:43:05.853] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:46:0) after 9m47s
[02:52:52.970] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:46:0)
[02:52:52.991] Build status: SCHEDULED
[02:52:52.991] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:47:0) after 4m0s
[02:56:53.014] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:47:0)
[02:56:53.034] Build status: SCHEDULED
[02:56:53.034] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:48:0) after 1m44s
[02:58:37.065] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:48:0)
[02:58:37.087] Build status: SCHEDULED
[02:58:37.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:49:0) after 7m44s
[03:06:21.140] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:49:0)
[03:06:21.164] Build status: SCHEDULED
[03:06:21.164] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:50:0) after 8m55s
[03:15:16.350] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:50:0)
[03:15:16.437] Build status: SCHEDULED
[03:15:16.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:51:0) after 9m1s
[03:24:17.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:51:0)
[03:24:17.491] Build status: SCHEDULED
[03:24:17.491] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:52:0) after 8m3s
[03:32:20.604] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:52:0)
[03:32:20.626] Build status: SCHEDULED
[03:32:20.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:53:0) after 4m33s
[03:36:53.654] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:53:0)
[03:36:53.677] Build status: SCHEDULED
[03:36:53.677] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:54:0) after 3m19s
[03:40:12.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:54:0)
[03:40:12.754] Build status: SCHEDULED
[03:40:12.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:55:0) after 4m54s
[03:45:07.039] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:55:0)
[03:45:07.063] Build status: SCHEDULED
[03:45:07.063] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:56:0) after 4m53s
[03:50:00.537] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:56:0)
[03:50:00.558] Build status: SCHEDULED
[03:50:00.558] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:57:0) after 3m16s
[03:53:16.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:57:0)
[03:53:16.913] Build status: SCHEDULED
[03:53:16.914] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:58:0) after 9m49s
[04:03:05.992] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:58:0)
[04:03:06.012] Build status: SCHEDULED
[04:03:06.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:59:0) after 2m23s
[04:05:29.209] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:59:0)
[04:05:29.253] Build status: SCHEDULED
[04:05:29.253] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:60:0) after 3m19s
[04:08:48.433] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:60:0)
[04:08:48.454] Build status: SCHEDULED
[04:08:48.454] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:61:0) after 3m33s
[04:12:21.727] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:61:0)
[04:12:21.746] Build status: SCHEDULED
[04:12:21.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:62:0) after 6m19s
[04:18:40.847] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:62:0)
[04:18:40.870] Build status: SCHEDULED
[04:18:40.870] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:63:0) after 5m45s
[04:24:25.896] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:63:0)
[04:24:25.917] Build status: SCHEDULED
[04:24:25.917] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:64:0) after 5m9s
[04:29:34.947] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:64:0)
[04:29:34.965] Build status: SCHEDULED
[04:29:34.965] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955754249839779824:65:0) after 3m50s
[04:31:03.021] Received PubSub notification, asking Buildbucket for the build status
[04:31:03.075] Build:
{
"id": "8790324187848099409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60277,
"createdBy": "project:chromium",
"createTime": "2023-02-01T22:30:11.372690209Z",
"endTime": "2023-02-02T04:31:02.036029Z",
"updateTime": "2023-02-02T04:31:02.036029Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7030fca7eb81b16b819dd442771b9050fdeddfa7",
"ref": "refs/heads/main"
}
}
}
[04:31:03.075] Invocation finished in 6h0m52.986307037s with status FAILED