[19:03:10.906] New invocation is queued and will start shortly
[19:03:12.085] Starting the invocation (attempt 1)
[19:03:12.119] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b9387f2b93def7603768f7ebbe380917f1531495"
[19:03:12.119] Popped gitiles commit info from properties and tags
[19:03:12.119] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:03:12.119] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:03:12.119] Buildbucket request:
{
"requestId": "8951781005783044416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b9387f2b93def7603768f7ebbe380917f1531495",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8951781005783044416"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:03:12.570] Scheduled build:
{
"id": "8786350943781668689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60466,
"createdBy": "project:chromium",
"createTime": "2023-03-17T19:03:12.191528214Z",
"updateTime": "2023-03-17T19:03:12.191528214Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b9387f2b93def7603768f7ebbe380917f1531495",
"ref": "refs/heads/main"
}
}
}
[19:03:12.570] Task URL: https://cr-buildbucket.appspot.com/build/8786350943781668689
[19:03:12.570] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:2:0) after 2m54s
[19:06:06.820] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:2:0)
[19:06:06.853] Build status: SCHEDULED
[19:06:06.853] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:3:0) after 2m32s
[19:08:38.975] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:3:0)
[19:08:39.004] Build status: SCHEDULED
[19:08:39.004] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:4:0) after 1m47s
[19:10:26.035] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:4:0)
[19:10:26.075] Build status: SCHEDULED
[19:10:26.075] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:5:0) after 8m40s
[19:19:06.169] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:5:0)
[19:19:06.193] Build status: SCHEDULED
[19:19:06.193] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:6:0) after 1m37s
[19:20:43.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:6:0)
[19:20:43.286] Build status: SCHEDULED
[19:20:43.286] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:7:0) after 6m37s
[19:27:20.484] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:7:0)
[19:27:20.510] Build status: SCHEDULED
[19:27:20.510] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:8:0) after 7m1s
[19:34:21.742] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:8:0)
[19:34:21.769] Build status: SCHEDULED
[19:34:21.769] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:9:0) after 3m9s
[19:37:30.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:9:0)
[19:37:31.089] Build status: SCHEDULED
[19:37:31.089] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:10:0) after 3m41s
[19:41:12.380] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:10:0)
[19:41:12.410] Build status: SCHEDULED
[19:41:12.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:11:0) after 4m13s
[19:45:25.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:11:0)
[19:45:25.661] Build status: SCHEDULED
[19:45:25.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:12:0) after 3m59s
[19:49:24.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:12:0)
[19:49:24.713] Build status: SCHEDULED
[19:49:24.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:13:0) after 8m1s
[19:57:25.843] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:13:0)
[19:57:25.864] Build status: SCHEDULED
[19:57:25.864] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:14:0) after 2m57s
[20:00:22.983] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:14:0)
[20:00:23.008] Build status: SCHEDULED
[20:00:23.008] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:15:0) after 9m47s
[20:10:10.064] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:15:0)
[20:10:10.093] Build status: SCHEDULED
[20:10:10.093] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:16:0) after 5m54s
[20:16:04.117] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:16:0)
[20:16:04.146] Build status: SCHEDULED
[20:16:04.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:17:0) after 6m57s
[20:23:01.323] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:17:0)
[20:23:01.352] Build status: SCHEDULED
[20:23:01.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:18:0) after 2m14s
[20:25:15.508] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:18:0)
[20:25:15.544] Build status: SCHEDULED
[20:25:15.544] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:19:0) after 9m40s
[20:34:55.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:19:0)
[20:34:55.652] Build status: SCHEDULED
[20:34:55.652] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:20:0) after 9m47s
[20:44:42.696] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:20:0)
[20:44:42.719] Build status: SCHEDULED
[20:44:42.719] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:21:0) after 7m6s
[20:51:48.898] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:21:0)
[20:51:48.930] Build status: SCHEDULED
[20:51:48.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:22:0) after 7m54s
[20:59:43.299] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:22:0)
[20:59:43.342] Build status: SCHEDULED
[20:59:43.342] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:23:0) after 7m44s
[21:07:27.646] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:23:0)
[21:07:27.666] Build status: SCHEDULED
[21:07:27.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:24:0) after 7m0s
[21:14:27.777] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:24:0)
[21:14:27.841] Build status: SCHEDULED
[21:14:27.841] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:25:0) after 5m1s
[21:19:28.863] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:25:0)
[21:19:28.907] Build status: SCHEDULED
[21:19:28.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:26:0) after 1m29s
[21:20:57.930] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:26:0)
[21:20:57.950] Build status: SCHEDULED
[21:20:57.950] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:27:0) after 7m21s
[21:28:19.214] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:27:0)
[21:28:19.236] Build status: SCHEDULED
[21:28:19.236] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:28:0) after 2m29s
[21:30:48.363] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:28:0)
[21:30:48.386] Build status: SCHEDULED
[21:30:48.386] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:29:0) after 3m3s
[21:33:51.408] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:29:0)
[21:33:51.443] Build status: SCHEDULED
[21:33:51.443] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:30:0) after 9m54s
[21:43:45.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:30:0)
[21:43:45.548] Build status: SCHEDULED
[21:43:45.548] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:31:0) after 7m34s
[21:51:19.569] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:31:0)
[21:51:19.593] Build status: SCHEDULED
[21:51:19.593] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:32:0) after 8m59s
[22:00:18.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:32:0)
[22:00:18.732] Build status: SCHEDULED
[22:00:18.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:33:0) after 1m31s
[22:01:50.029] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:33:0)
[22:01:50.060] Build status: SCHEDULED
[22:01:50.060] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:34:0) after 9m23s
[22:11:13.385] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:34:0)
[22:11:13.409] Build status: SCHEDULED
[22:11:13.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:35:0) after 6m48s
[22:18:01.606] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:35:0)
[22:18:01.626] Build status: SCHEDULED
[22:18:01.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:36:0) after 4m41s
[22:22:42.649] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:36:0)
[22:22:42.671] Build status: SCHEDULED
[22:22:42.671] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:37:0) after 2m1s
[22:24:43.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:37:0)
[22:24:43.956] Build status: SCHEDULED
[22:24:43.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:38:0) after 3m37s
[22:28:21.005] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:38:0)
[22:28:21.063] Build status: SCHEDULED
[22:28:21.063] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:39:0) after 8m39s
[22:37:00.210] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:39:0)
[22:37:00.231] Build status: SCHEDULED
[22:37:00.231] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:40:0) after 1m2s
[22:38:02.288] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:40:0)
[22:38:02.309] Build status: SCHEDULED
[22:38:02.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:41:0) after 1m51s
[22:39:53.432] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:41:0)
[22:39:53.476] Build status: SCHEDULED
[22:39:53.476] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:42:0) after 2m56s
[22:42:49.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:42:0)
[22:42:49.520] Build status: SCHEDULED
[22:42:49.520] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:43:0) after 3m56s
[22:46:45.585] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:43:0)
[22:46:45.611] Build status: SCHEDULED
[22:46:45.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:44:0) after 3m10s
[22:49:55.646] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:44:0)
[22:49:55.665] Build status: SCHEDULED
[22:49:55.665] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:45:0) after 6m29s
[22:56:24.827] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:45:0)
[22:56:24.871] Build status: SCHEDULED
[22:56:24.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:46:0) after 3m27s
[22:59:51.852] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:46:0)
[22:59:51.872] Build status: SCHEDULED
[22:59:51.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:47:0) after 3m32s
[23:03:24.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:47:0)
[23:03:24.283] Build status: SCHEDULED
[23:03:24.283] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:48:0) after 5m50s
[23:09:14.302] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:48:0)
[23:09:14.324] Build status: SCHEDULED
[23:09:14.324] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:49:0) after 2m11s
[23:11:25.463] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:49:0)
[23:11:25.497] Build status: SCHEDULED
[23:11:25.497] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:50:0) after 7m36s
[23:19:01.845] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:50:0)
[23:19:01.863] Build status: SCHEDULED
[23:19:01.863] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:51:0) after 3m5s
[23:22:07.122] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:51:0)
[23:22:07.145] Build status: SCHEDULED
[23:22:07.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:52:0) after 4m20s
[23:26:27.634] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:52:0)
[23:26:27.659] Build status: SCHEDULED
[23:26:27.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:53:0) after 6m2s
[23:32:29.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:53:0)
[23:32:29.819] Build status: SCHEDULED
[23:32:29.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:54:0) after 7m33s
[23:40:03.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:54:0)
[23:40:03.115] Build status: SCHEDULED
[23:40:03.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:55:0) after 9m17s
[23:49:20.096] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:55:0)
[23:49:20.117] Build status: SCHEDULED
[23:49:20.117] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:56:0) after 9m34s
[23:58:54.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:56:0)
[23:58:54.302] Build status: SCHEDULED
[23:58:54.302] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:57:0) after 4m9s
[00:03:03.331] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:57:0)
[00:03:03.358] Build status: SCHEDULED
[00:03:03.358] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:58:0) after 7m23s
[00:10:26.718] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:58:0)
[00:10:27.053] Build status: SCHEDULED
[00:10:27.053] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:59:0) after 6m59s
[00:17:26.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:59:0)
[00:17:26.105] Build status: SCHEDULED
[00:17:26.105] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:60:0) after 4m31s
[00:21:57.429] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:60:0)
[00:21:57.600] Build status: SCHEDULED
[00:21:57.600] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:61:0) after 3m22s
[00:25:19.746] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:61:0)
[00:25:19.809] Build status: SCHEDULED
[00:25:19.809] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:62:0) after 7m49s
[00:33:09.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:62:0)
[00:33:09.352] Build status: SCHEDULED
[00:33:09.352] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:63:0) after 8m34s
[00:41:43.587] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:63:0)
[00:41:43.609] Build status: SCHEDULED
[00:41:43.609] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:64:0) after 5m27s
[00:47:10.634] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:64:0)
[00:47:10.662] Build status: SCHEDULED
[00:47:10.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:65:0) after 6m16s
[00:53:27.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:65:0)
[00:53:27.024] Build status: SCHEDULED
[00:53:27.024] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:66:0) after 9m20s
[01:02:47.286] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:66:0)
[01:02:47.307] Build status: SCHEDULED
[01:02:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8951781005783044416:67:0) after 6m11s
[01:04:04.399] Received PubSub notification, asking Buildbucket for the build status
[01:04:04.427] Build:
{
"id": "8786350943781668689",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60466,
"createdBy": "project:chromium",
"createTime": "2023-03-17T19:03:12.191528214Z",
"endTime": "2023-03-18T01:04:03.813454Z",
"updateTime": "2023-03-18T01:04:03.813454Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b9387f2b93def7603768f7ebbe380917f1531495",
"ref": "refs/heads/main"
}
}
}
[01:04:04.427] Invocation finished in 6h0m53.527808594s with status FAILED