[04:35:04.699] New invocation is queued and will start shortly
[04:35:05.742] Starting the invocation (attempt 1)
[04:35:05.773] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/76e2b2c360691d0aae2162bc24e83b1e536e26d0"
[04:35:05.773] Popped gitiles commit info from properties and tags
[04:35:05.773] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:35:05.773] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:35:05.773] Buildbucket request:
{
"requestId": "8955640694732458576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "76e2b2c360691d0aae2162bc24e83b1e536e26d0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955640694732458576"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:35:06.420] Scheduled build:
{
"id": "8790210632775139073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60282,
"createdBy": "project:chromium",
"createTime": "2023-02-03T04:35:05.929970958Z",
"updateTime": "2023-02-03T04:35:05.929970958Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "76e2b2c360691d0aae2162bc24e83b1e536e26d0",
"ref": "refs/heads/main"
}
}
}
[04:35:06.420] Task URL: https://cr-buildbucket.appspot.com/build/8790210632775139073
[04:35:06.420] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:2:0) after 4m8s
[04:39:14.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:2:0)
[04:39:14.981] Build status: SCHEDULED
[04:39:14.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:3:0) after 4m47s
[04:44:02.283] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:3:0)
[04:44:02.309] Build status: SCHEDULED
[04:44:02.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:4:0) after 9m51s
[04:53:53.724] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:4:0)
[04:53:53.765] Build status: SCHEDULED
[04:53:53.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:5:0) after 2m37s
[04:56:30.807] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:5:0)
[04:56:30.838] Build status: SCHEDULED
[04:56:30.838] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:6:0) after 6m49s
[05:03:20.049] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:6:0)
[05:03:20.084] Build status: SCHEDULED
[05:03:20.084] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:7:0) after 6m33s
[05:09:53.506] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:7:0)
[05:09:53.534] Build status: SCHEDULED
[05:09:53.534] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:8:0) after 9m9s
[05:19:02.547] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:8:0)
[05:19:02.569] Build status: SCHEDULED
[05:19:02.570] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:9:0) after 6m5s
[05:25:07.598] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:9:0)
[05:25:07.620] Build status: SCHEDULED
[05:25:07.620] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:10:0) after 5m27s
[05:30:34.847] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:10:0)
[05:30:34.867] Build status: SCHEDULED
[05:30:34.867] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:11:0) after 1m57s
[05:32:31.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:11:0)
[05:32:31.913] Build status: SCHEDULED
[05:32:31.913] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:12:0) after 4m18s
[05:36:49.940] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:12:0)
[05:36:50.003] Build status: SCHEDULED
[05:36:50.003] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:13:0) after 6m18s
[05:43:08.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:13:0)
[05:43:08.355] Build status: SCHEDULED
[05:43:08.355] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:14:0) after 6m23s
[05:49:31.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:14:0)
[05:49:31.409] Build status: SCHEDULED
[05:49:31.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:15:0) after 5m0s
[05:54:31.461] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:15:0)
[05:54:31.489] Build status: SCHEDULED
[05:54:31.489] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:16:0) after 9m0s
[06:03:31.665] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:16:0)
[06:03:31.689] Build status: SCHEDULED
[06:03:31.689] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:17:0) after 7m49s
[06:11:20.721] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:17:0)
[06:11:20.745] Build status: SCHEDULED
[06:11:20.745] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:18:0) after 3m6s
[06:14:26.896] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:18:0)
[06:14:26.921] Build status: SCHEDULED
[06:14:26.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:19:0) after 9m32s
[06:23:58.990] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:19:0)
[06:23:59.009] Build status: SCHEDULED
[06:23:59.009] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:20:0) after 8m39s
[06:32:38.226] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:20:0)
[06:32:38.290] Build status: SCHEDULED
[06:32:38.290] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:21:0) after 4m26s
[06:37:04.497] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:21:0)
[06:37:04.520] Build status: SCHEDULED
[06:37:04.520] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:22:0) after 9m36s
[06:46:40.631] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:22:0)
[06:46:40.656] Build status: SCHEDULED
[06:46:40.656] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:23:0) after 9m18s
[06:55:58.805] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:23:0)
[06:55:58.827] Build status: SCHEDULED
[06:55:58.827] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:24:0) after 8m8s
[07:04:06.937] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:24:0)
[07:04:06.962] Build status: SCHEDULED
[07:04:06.962] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:25:0) after 7m31s
[07:11:38.270] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:25:0)
[07:11:38.291] Build status: SCHEDULED
[07:11:38.291] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:26:0) after 3m31s
[07:15:09.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:26:0)
[07:15:09.890] Build status: SCHEDULED
[07:15:09.890] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:27:0) after 9m14s
[07:24:23.941] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:27:0)
[07:24:23.964] Build status: SCHEDULED
[07:24:23.964] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:28:0) after 3m42s
[07:28:05.956] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:28:0)
[07:28:05.977] Build status: SCHEDULED
[07:28:05.977] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:29:0) after 5m54s
[07:34:00.000] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:29:0)
[07:34:00.023] Build status: SCHEDULED
[07:34:00.023] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:30:0) after 1m42s
[07:35:42.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:30:0)
[07:35:42.241] Build status: SCHEDULED
[07:35:42.241] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:31:0) after 8m5s
[07:43:47.352] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:31:0)
[07:43:47.378] Build status: SCHEDULED
[07:43:47.379] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:32:0) after 3m25s
[07:47:12.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:32:0)
[07:47:12.441] Build status: SCHEDULED
[07:47:12.441] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:33:0) after 8m4s
[07:55:16.832] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:33:0)
[07:55:16.859] Build status: SCHEDULED
[07:55:16.859] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:34:0) after 6m54s
[08:02:10.882] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:34:0)
[08:02:10.945] Build status: SCHEDULED
[08:02:10.945] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:35:0) after 6m7s
[08:08:17.981] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:35:0)
[08:08:18.008] Build status: SCHEDULED
[08:08:18.008] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:36:0) after 7m54s
[08:16:12.032] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:36:0)
[08:16:12.077] Build status: SCHEDULED
[08:16:12.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:37:0) after 8m11s
[08:24:23.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:37:0)
[08:24:23.303] Build status: SCHEDULED
[08:24:23.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:38:0) after 9m7s
[08:33:30.653] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:38:0)
[08:33:30.676] Build status: SCHEDULED
[08:33:30.676] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:39:0) after 2m22s
[08:35:52.716] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:39:0)
[08:35:52.739] Build status: SCHEDULED
[08:35:52.739] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:40:0) after 6m38s
[08:42:31.041] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:40:0)
[08:42:31.087] Build status: SCHEDULED
[08:42:31.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:41:0) after 5m7s
[08:47:38.117] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:41:0)
[08:47:38.140] Build status: SCHEDULED
[08:47:38.140] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:42:0) after 2m47s
[08:50:25.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:42:0)
[08:50:25.311] Build status: SCHEDULED
[08:50:25.311] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:43:0) after 7m27s
[08:57:52.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:43:0)
[08:57:52.583] Build status: SCHEDULED
[08:57:52.583] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:44:0) after 2m56s
[09:00:48.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:44:0)
[09:00:48.838] Build status: SCHEDULED
[09:00:48.838] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:45:0) after 2m29s
[09:03:18.295] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:45:0)
[09:03:18.315] Build status: SCHEDULED
[09:03:18.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:46:0) after 7m54s
[09:11:12.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:46:0)
[09:11:12.413] Build status: SCHEDULED
[09:11:12.413] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:47:0) after 9m19s
[09:20:31.436] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:47:0)
[09:20:31.614] Build status: SCHEDULED
[09:20:31.614] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:48:0) after 9m54s
[09:30:25.800] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:48:0)
[09:30:25.827] Build status: SCHEDULED
[09:30:25.827] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:49:0) after 6m38s
[09:37:04.075] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:49:0)
[09:37:04.101] Build status: SCHEDULED
[09:37:04.101] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:50:0) after 1m32s
[09:38:36.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:50:0)
[09:38:36.301] Build status: SCHEDULED
[09:38:36.301] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:51:0) after 4m53s
[09:43:29.373] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:51:0)
[09:43:29.405] Build status: SCHEDULED
[09:43:29.406] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:52:0) after 5m58s
[09:49:27.806] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:52:0)
[09:49:27.856] Build status: SCHEDULED
[09:49:27.856] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:53:0) after 6m1s
[09:55:29.014] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:53:0)
[09:55:29.035] Build status: SCHEDULED
[09:55:29.035] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:54:0) after 8m47s
[10:04:16.364] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:54:0)
[10:04:16.425] Build status: SCHEDULED
[10:04:16.425] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:55:0) after 7m1s
[10:11:17.459] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:55:0)
[10:11:17.487] Build status: SCHEDULED
[10:11:17.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:56:0) after 3m3s
[10:14:20.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:56:0)
[10:14:20.538] Build status: SCHEDULED
[10:14:20.538] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:57:0) after 1m35s
[10:15:55.567] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:57:0)
[10:15:55.598] Build status: SCHEDULED
[10:15:55.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:58:0) after 4m40s
[10:20:35.725] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:58:0)
[10:20:35.751] Build status: SCHEDULED
[10:20:35.751] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:59:0) after 5m41s
[10:26:16.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:59:0)
[10:26:16.803] Build status: SCHEDULED
[10:26:16.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:60:0) after 6m57s
[10:33:14.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:60:0)
[10:33:14.309] Build status: SCHEDULED
[10:33:14.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8955640694732458576:61:0) after 2m19s
[10:35:08.321] Received PubSub notification, asking Buildbucket for the build status
[10:35:08.346] Build:
{
"id": "8790210632775139073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60282,
"createdBy": "project:chromium",
"createTime": "2023-02-03T04:35:05.929970958Z",
"endTime": "2023-02-03T10:35:07.848620Z",
"updateTime": "2023-02-03T10:35:07.848620Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "76e2b2c360691d0aae2162bc24e83b1e536e26d0",
"ref": "refs/heads/main"
}
}
}
[10:35:08.346] Invocation finished in 6h0m3.666779487s with status FAILED