[04:38:05.996] New invocation is queued and will start shortly
[04:38:08.903] Starting the invocation (attempt 1)
[04:38:08.943] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2907b12f5a6e47548016cebc7240f53159a0df94"
[04:38:08.943] Popped gitiles commit info from properties and tags
[04:38:08.943] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:38:08.944] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:38:08.944] Buildbucket request:
{
"requestId": "8955549907652402240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2907b12f5a6e47548016cebc7240f53159a0df94",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955549907652402240"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:38:09.883] Scheduled build:
{
"id": "8790119843572643441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60286,
"createdBy": "project:chromium",
"createTime": "2023-02-04T04:38:09.259965874Z",
"updateTime": "2023-02-04T04:38:09.259965874Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2907b12f5a6e47548016cebc7240f53159a0df94",
"ref": "refs/heads/main"
}
}
}
[04:38:09.883] Task URL: https://cr-buildbucket.appspot.com/build/8790119843572643441
[04:38:09.883] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:2:0) after 9m54s
[04:48:03.902] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:2:0)
[04:48:03.943] Build status: SCHEDULED
[04:48:03.943] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:3:0) after 3m47s
[04:51:51.183] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:3:0)
[04:51:51.205] Build status: SCHEDULED
[04:51:51.205] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:4:0) after 1m40s
[04:53:31.223] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:4:0)
[04:53:31.243] Build status: SCHEDULED
[04:53:31.243] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:5:0) after 5m17s
[04:58:48.266] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:5:0)
[04:58:48.286] Build status: SCHEDULED
[04:58:48.286] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:6:0) after 1m20s
[05:00:08.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:6:0)
[05:00:08.333] Build status: SCHEDULED
[05:00:08.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:7:0) after 5m11s
[05:05:19.459] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:7:0)
[05:05:19.476] Build status: SCHEDULED
[05:05:19.476] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:8:0) after 4m52s
[05:10:11.508] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:8:0)
[05:10:11.548] Build status: SCHEDULED
[05:10:11.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:9:0) after 3m21s
[05:13:32.706] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:9:0)
[05:13:32.726] Build status: SCHEDULED
[05:13:32.726] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:10:0) after 7m33s
[05:21:05.723] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:10:0)
[05:21:05.778] Build status: SCHEDULED
[05:21:05.778] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:11:0) after 9m7s
[05:30:13.099] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:11:0)
[05:30:13.255] Build status: SCHEDULED
[05:30:13.255] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:12:0) after 5m59s
[05:36:12.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:12:0)
[05:36:12.364] Build status: SCHEDULED
[05:36:12.364] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:13:0) after 3m10s
[05:39:22.384] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:13:0)
[05:39:22.404] Build status: SCHEDULED
[05:39:22.405] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:14:0) after 8m51s
[05:48:13.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:14:0)
[05:48:13.700] Build status: SCHEDULED
[05:48:13.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:15:0) after 3m33s
[05:51:46.876] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:15:0)
[05:51:46.933] Build status: SCHEDULED
[05:51:46.933] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:16:0) after 1m48s
[05:53:34.952] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:16:0)
[05:53:34.981] Build status: SCHEDULED
[05:53:34.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:17:0) after 8m44s
[06:02:19.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:17:0)
[06:02:19.243] Build status: SCHEDULED
[06:02:19.243] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:18:0) after 3m57s
[06:06:16.262] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:18:0)
[06:06:16.315] Build status: SCHEDULED
[06:06:16.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:19:0) after 9m54s
[06:16:10.338] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:19:0)
[06:16:10.360] Build status: SCHEDULED
[06:16:10.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:20:0) after 3m5s
[06:19:15.614] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:20:0)
[06:19:15.636] Build status: SCHEDULED
[06:19:15.636] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:21:0) after 7m23s
[06:26:38.670] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:21:0)
[06:26:38.724] Build status: SCHEDULED
[06:26:38.724] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:22:0) after 1m36s
[06:28:14.831] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:22:0)
[06:28:14.854] Build status: SCHEDULED
[06:28:14.854] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:23:0) after 6m29s
[06:34:43.882] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:23:0)
[06:34:43.905] Build status: SCHEDULED
[06:34:43.905] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:24:0) after 3m4s
[06:37:48.483] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:24:0)
[06:37:48.502] Build status: SCHEDULED
[06:37:48.502] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:25:0) after 4m31s
[06:42:19.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:25:0)
[06:42:19.543] Build status: SCHEDULED
[06:42:19.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:26:0) after 7m30s
[06:49:49.671] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:26:0)
[06:49:49.692] Build status: SCHEDULED
[06:49:49.692] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:27:0) after 4m17s
[06:54:06.722] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:27:0)
[06:54:06.742] Build status: SCHEDULED
[06:54:06.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:28:0) after 7m53s
[07:01:59.773] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:28:0)
[07:01:59.818] Build status: SCHEDULED
[07:01:59.818] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:29:0) after 9m15s
[07:11:15.189] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:29:0)
[07:11:15.209] Build status: SCHEDULED
[07:11:15.209] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:30:0) after 8m29s
[07:19:44.283] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:30:0)
[07:19:44.303] Build status: SCHEDULED
[07:19:44.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:31:0) after 3m18s
[07:23:02.331] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:31:0)
[07:23:02.375] Build status: SCHEDULED
[07:23:02.375] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:32:0) after 4m24s
[07:27:26.581] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:32:0)
[07:27:26.622] Build status: SCHEDULED
[07:27:26.622] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:33:0) after 2m47s
[07:30:13.644] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:33:0)
[07:30:13.671] Build status: SCHEDULED
[07:30:13.671] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:34:0) after 8m52s
[07:39:05.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:34:0)
[07:39:05.716] Build status: SCHEDULED
[07:39:05.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:35:0) after 1m48s
[07:40:53.758] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:35:0)
[07:40:53.801] Build status: SCHEDULED
[07:40:53.801] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:36:0) after 2m39s
[07:43:32.921] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:36:0)
[07:43:32.942] Build status: SCHEDULED
[07:43:32.942] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:37:0) after 4m38s
[07:48:11.219] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:37:0)
[07:48:11.238] Build status: SCHEDULED
[07:48:11.238] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:38:0) after 9m59s
[07:58:10.266] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:38:0)
[07:58:10.314] Build status: SCHEDULED
[07:58:10.314] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:39:0) after 6m16s
[08:04:26.336] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:39:0)
[08:04:26.359] Build status: SCHEDULED
[08:04:26.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:40:0) after 2m45s
[08:07:11.388] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:40:0)
[08:07:11.438] Build status: SCHEDULED
[08:07:11.438] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:41:0) after 7m29s
[08:14:40.511] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:41:0)
[08:14:40.539] Build status: SCHEDULED
[08:14:40.539] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:42:0) after 8m4s
[08:22:44.571] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:42:0)
[08:22:44.601] Build status: SCHEDULED
[08:22:44.601] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:43:0) after 7m2s
[08:29:46.720] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:43:0)
[08:29:46.746] Build status: SCHEDULED
[08:29:46.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:44:0) after 6m27s
[08:36:13.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:44:0)
[08:36:13.835] Build status: SCHEDULED
[08:36:13.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:45:0) after 9m56s
[08:46:09.932] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:45:0)
[08:46:09.953] Build status: SCHEDULED
[08:46:09.953] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:46:0) after 5m21s
[08:51:31.045] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:46:0)
[08:51:31.126] Build status: SCHEDULED
[08:51:31.126] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:47:0) after 5m47s
[08:57:18.143] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:47:0)
[08:57:18.166] Build status: SCHEDULED
[08:57:18.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:48:0) after 8m28s
[09:05:46.324] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:48:0)
[09:05:46.360] Build status: SCHEDULED
[09:05:46.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:49:0) after 7m8s
[09:12:54.379] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:49:0)
[09:12:54.410] Build status: SCHEDULED
[09:12:54.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:50:0) after 3m33s
[09:16:27.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:50:0)
[09:16:27.485] Build status: SCHEDULED
[09:16:27.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:51:0) after 6m21s
[09:22:48.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:51:0)
[09:22:48.531] Build status: SCHEDULED
[09:22:48.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:52:0) after 4m57s
[09:27:45.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:52:0)
[09:27:45.663] Build status: SCHEDULED
[09:27:45.663] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:53:0) after 7m2s
[09:34:47.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:53:0)
[09:34:47.731] Build status: SCHEDULED
[09:34:47.731] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:54:0) after 7m29s
[09:42:16.816] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:54:0)
[09:42:16.839] Build status: SCHEDULED
[09:42:16.839] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:55:0) after 3m3s
[09:45:20.024] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:55:0)
[09:45:20.049] Build status: SCHEDULED
[09:45:20.049] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:56:0) after 4m25s
[09:49:45.085] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:56:0)
[09:49:45.111] Build status: SCHEDULED
[09:49:45.111] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:57:0) after 6m39s
[09:56:24.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:57:0)
[09:56:24.266] Build status: SCHEDULED
[09:56:24.266] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:58:0) after 4m47s
[10:01:11.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:58:0)
[10:01:11.330] Build status: SCHEDULED
[10:01:11.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:59:0) after 1m20s
[10:02:31.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:59:0)
[10:02:31.405] Build status: SCHEDULED
[10:02:31.405] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:60:0) after 6m7s
[10:08:38.431] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:60:0)
[10:08:38.522] Build status: SCHEDULED
[10:08:38.522] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:61:0) after 7m57s
[10:16:35.727] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:61:0)
[10:16:35.748] Build status: SCHEDULED
[10:16:35.748] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:62:0) after 8m44s
[10:25:19.935] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:62:0)
[10:25:19.957] Build status: SCHEDULED
[10:25:19.957] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:63:0) after 4m32s
[10:29:51.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:63:0)
[10:29:52.001] Build status: SCHEDULED
[10:29:52.001] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:64:0) after 8m57s
[10:38:49.058] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:64:0)
[10:38:49.080] Build status: SCHEDULED
[10:38:49.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955549907652402240:65:0) after 9m50s
[10:39:05.346] Received PubSub notification, asking Buildbucket for the build status
[10:39:05.371] Build:
{
"id": "8790119843572643441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60286,
"createdBy": "project:chromium",
"createTime": "2023-02-04T04:38:09.259965874Z",
"endTime": "2023-02-04T10:39:04.812834Z",
"updateTime": "2023-02-04T10:39:04.812834Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2907b12f5a6e47548016cebc7240f53159a0df94",
"ref": "refs/heads/main"
}
}
}
[10:39:05.371] Invocation finished in 6h0m59.386261992s with status FAILED