[15:01:06.644] New invocation is queued and will start shortly
[15:01:07.725] Starting the invocation (attempt 1)
[15:01:07.754] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7d3660ea976d35d8bca9a18a62361f230e30f1cc"
[15:01:07.754] Popped gitiles commit info from properties and tags
[15:01:07.754] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:01:07.754] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:01:07.754] Buildbucket request:
{
"requestId": "8957775635357356016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d3660ea976d35d8bca9a18a62361f230e30f1cc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8957775635357356016"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:01:08.331] Scheduled build:
{
"id": "8792345573443025393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60188,
"createdBy": "project:chromium",
"createTime": "2023-01-10T15:01:07.847599075Z",
"updateTime": "2023-01-10T15:01:07.847599075Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d3660ea976d35d8bca9a18a62361f230e30f1cc",
"ref": "refs/heads/main"
}
}
}
[15:01:08.331] Task URL: https://cr-buildbucket.appspot.com/build/8792345573443025393
[15:01:08.331] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:2:0) after 2m38s
[15:03:46.405] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:2:0)
[15:03:46.433] Build status: SCHEDULED
[15:03:46.433] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:3:0) after 6m16s
[15:10:02.670] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:3:0)
[15:10:02.732] Build status: SCHEDULED
[15:10:02.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:4:0) after 5m37s
[15:15:39.767] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:4:0)
[15:15:39.828] Build status: SCHEDULED
[15:15:39.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:5:0) after 2m18s
[15:17:57.886] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:5:0)
[15:17:57.924] Build status: SCHEDULED
[15:17:57.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:6:0) after 9m5s
[15:27:03.337] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:6:0)
[15:27:03.370] Build status: SCHEDULED
[15:27:03.370] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:7:0) after 2m37s
[15:29:40.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:7:0)
[15:29:40.413] Build status: SCHEDULED
[15:29:40.413] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:8:0) after 2m37s
[15:32:17.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:8:0)
[15:32:17.797] Build status: SCHEDULED
[15:32:17.797] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:9:0) after 5m14s
[15:37:31.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:9:0)
[15:37:32.017] Build status: SCHEDULED
[15:37:32.017] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:10:0) after 4m18s
[15:41:50.216] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:10:0)
[15:41:50.242] Build status: SCHEDULED
[15:41:50.242] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:11:0) after 8m55s
[15:50:45.915] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:11:0)
[15:50:45.945] Build status: SCHEDULED
[15:50:45.945] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:12:0) after 7m52s
[15:58:38.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:12:0)
[15:58:38.059] Build status: SCHEDULED
[15:58:38.059] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:13:0) after 2m46s
[16:01:24.335] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:13:0)
[16:01:24.355] Build status: SCHEDULED
[16:01:24.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:14:0) after 4m2s
[16:05:26.561] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:14:0)
[16:05:26.643] Build status: SCHEDULED
[16:05:26.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:15:0) after 7m9s
[16:12:35.701] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:15:0)
[16:12:35.721] Build status: SCHEDULED
[16:12:35.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:16:0) after 4m52s
[16:17:27.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:16:0)
[16:17:27.915] Build status: SCHEDULED
[16:17:27.916] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:17:0) after 5m35s
[16:23:03.093] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:17:0)
[16:23:03.156] Build status: SCHEDULED
[16:23:03.156] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:18:0) after 9m7s
[16:32:10.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:18:0)
[16:32:10.265] Build status: SCHEDULED
[16:32:10.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:19:0) after 9m11s
[16:41:21.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:19:0)
[16:41:21.292] Build status: SCHEDULED
[16:41:21.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:20:0) after 6m29s
[16:47:50.524] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:20:0)
[16:47:50.561] Build status: SCHEDULED
[16:47:50.561] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:21:0) after 3m28s
[16:51:18.593] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:21:0)
[16:51:18.643] Build status: SCHEDULED
[16:51:18.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:22:0) after 9m57s
[17:01:15.679] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:22:0)
[17:01:15.710] Build status: SCHEDULED
[17:01:15.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:23:0) after 2m11s
[17:03:27.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:23:0)
[17:03:27.116] Build status: SCHEDULED
[17:03:27.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:24:0) after 4m52s
[17:08:19.185] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:24:0)
[17:08:19.206] Build status: SCHEDULED
[17:08:19.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:25:0) after 8m45s
[17:17:04.236] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:25:0)
[17:17:04.308] Build status: SCHEDULED
[17:17:04.308] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:26:0) after 7m31s
[17:24:35.975] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:26:0)
[17:24:35.999] Build status: SCHEDULED
[17:24:35.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:27:0) after 8m31s
[17:33:07.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:27:0)
[17:33:07.208] Build status: SCHEDULED
[17:33:07.208] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:28:0) after 8m52s
[17:41:59.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:28:0)
[17:41:59.233] Build status: SCHEDULED
[17:41:59.233] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:29:0) after 7m52s
[17:49:51.862] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:29:0)
[17:49:51.884] Build status: SCHEDULED
[17:49:51.884] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:30:0) after 8m47s
[17:58:39.078] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:30:0)
[17:58:39.110] Build status: SCHEDULED
[17:58:39.110] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:31:0) after 6m10s
[18:04:49.134] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:31:0)
[18:04:49.159] Build status: SCHEDULED
[18:04:49.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:32:0) after 1m51s
[18:06:40.453] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:32:0)
[18:06:40.486] Build status: SCHEDULED
[18:06:40.486] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:33:0) after 7m20s
[18:14:00.493] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:33:0)
[18:14:00.518] Build status: SCHEDULED
[18:14:00.519] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:34:0) after 1m25s
[18:15:25.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:34:0)
[18:15:25.638] Build status: SCHEDULED
[18:15:25.638] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:35:0) after 6m18s
[18:21:43.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:35:0)
[18:21:43.760] Build status: SCHEDULED
[18:21:43.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:36:0) after 9m50s
[18:31:33.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:36:0)
[18:31:33.831] Build status: SCHEDULED
[18:31:33.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:37:0) after 2m11s
[18:33:44.873] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:37:0)
[18:33:44.987] Build status: SCHEDULED
[18:33:44.988] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:38:0) after 9m48s
[18:43:33.448] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:38:0)
[18:43:33.528] Build status: SCHEDULED
[18:43:33.528] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:39:0) after 3m52s
[18:47:25.796] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:39:0)
[18:47:25.828] Build status: SCHEDULED
[18:47:25.828] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:40:0) after 3m53s
[18:51:18.872] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:40:0)
[18:51:18.968] Build status: SCHEDULED
[18:51:18.968] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:41:0) after 1m27s
[18:52:46.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:41:0)
[18:52:46.046] Build status: SCHEDULED
[18:52:46.046] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:42:0) after 6m17s
[18:59:03.111] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:42:0)
[18:59:03.133] Build status: SCHEDULED
[18:59:03.133] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:43:0) after 8m44s
[19:07:47.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:43:0)
[19:07:47.235] Build status: SCHEDULED
[19:07:47.235] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:44:0) after 4m20s
[19:12:07.442] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:44:0)
[19:12:07.507] Build status: SCHEDULED
[19:12:07.507] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:45:0) after 2m4s
[19:14:11.846] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:45:0)
[19:14:11.880] Build status: SCHEDULED
[19:14:11.881] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:46:0) after 4m57s
[19:19:08.906] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:46:0)
[19:19:08.937] Build status: SCHEDULED
[19:19:08.937] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:47:0) after 6m53s
[19:26:01.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:47:0)
[19:26:02.094] Build status: SCHEDULED
[19:26:02.094] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:48:0) after 8m33s
[19:34:35.175] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:48:0)
[19:34:35.196] Build status: SCHEDULED
[19:34:35.196] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:49:0) after 7m33s
[19:42:08.218] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:49:0)
[19:42:08.239] Build status: SCHEDULED
[19:42:08.239] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:50:0) after 1m11s
[19:43:19.291] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:50:0)
[19:43:19.327] Build status: SCHEDULED
[19:43:19.327] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:51:0) after 9m4s
[19:52:23.789] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:51:0)
[19:52:23.811] Build status: SCHEDULED
[19:52:23.811] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:52:0) after 3m2s
[19:55:25.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:52:0)
[19:55:26.008] Build status: SCHEDULED
[19:55:26.008] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:53:0) after 5m21s
[20:00:47.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:53:0)
[20:00:47.164] Build status: SCHEDULED
[20:00:47.164] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:54:0) after 3m7s
[20:03:54.392] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:54:0)
[20:03:54.418] Build status: SCHEDULED
[20:03:54.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:55:0) after 4m6s
[20:08:00.455] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:55:0)
[20:08:00.477] Build status: SCHEDULED
[20:08:00.477] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:56:0) after 4m32s
[20:12:32.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:56:0)
[20:12:32.531] Build status: SCHEDULED
[20:12:32.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:57:0) after 7m36s
[20:20:08.640] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:57:0)
[20:20:08.683] Build status: SCHEDULED
[20:20:08.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:58:0) after 9m40s
[20:29:48.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:58:0)
[20:29:48.856] Build status: SCHEDULED
[20:29:48.856] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:59:0) after 2m58s
[20:32:46.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:59:0)
[20:32:46.927] Build status: SCHEDULED
[20:32:46.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:60:0) after 7m26s
[20:40:12.953] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:60:0)
[20:40:12.979] Build status: SCHEDULED
[20:40:12.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:61:0) after 4m14s
[20:44:26.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:61:0)
[20:44:26.995] Build status: SCHEDULED
[20:44:26.995] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:62:0) after 1m21s
[20:45:48.028] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:62:0)
[20:45:48.056] Build status: SCHEDULED
[20:45:48.056] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:63:0) after 5m54s
[20:51:42.080] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:63:0)
[20:51:42.115] Build status: SCHEDULED
[20:51:42.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:64:0) after 4m50s
[20:56:32.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:64:0)
[20:56:32.426] Build status: SCHEDULED
[20:56:32.426] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:65:0) after 1m48s
[20:58:21.099] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:65:0)
[20:58:21.124] Build status: SCHEDULED
[20:58:21.124] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8957775635357356016:66:0) after 6m23s
[21:02:09.041] Received PubSub notification, asking Buildbucket for the build status
[21:02:09.072] Build:
{
"id": "8792345573443025393",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60188,
"createdBy": "project:chromium",
"createTime": "2023-01-10T15:01:07.847599075Z",
"endTime": "2023-01-10T21:02:08.449862Z",
"updateTime": "2023-01-10T21:02:08.449862Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d3660ea976d35d8bca9a18a62361f230e30f1cc",
"ref": "refs/heads/main"
}
}
}
[21:02:09.072] Invocation finished in 6h1m2.434358051s with status FAILED