[17:18:07.531] New invocation is queued and will start shortly
[17:18:08.643] Starting the invocation (attempt 1)
[17:18:08.673] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0dae74b02fefe6440dd32647e644cd4f759c92b8"
[17:18:08.673] Popped gitiles commit info from properties and tags
[17:18:08.673] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:18:08.673] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:18:08.673] Buildbucket request:
{
"requestId": "8952602988056170768",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0dae74b02fefe6440dd32647e644cd4f759c92b8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952602988056170768"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:18:09.169] Scheduled build:
{
"id": "8787172926134216961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60410,
"createdBy": "project:chromium",
"createTime": "2023-03-08T17:18:08.733450877Z",
"updateTime": "2023-03-08T17:18:08.733450877Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0dae74b02fefe6440dd32647e644cd4f759c92b8",
"ref": "refs/heads/main"
}
}
}
[17:18:09.169] Task URL: https://cr-buildbucket.appspot.com/build/8787172926134216961
[17:18:09.169] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:2:0) after 2m4s
[17:20:13.239] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:2:0)
[17:20:13.262] Build status: SCHEDULED
[17:20:13.262] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:3:0) after 6m16s
[17:26:29.610] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:3:0)
[17:26:29.639] Build status: SCHEDULED
[17:26:29.639] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:4:0) after 7m52s
[17:34:22.081] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:4:0)
[17:34:22.106] Build status: SCHEDULED
[17:34:22.106] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:5:0) after 9m10s
[17:43:32.248] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:5:0)
[17:43:32.272] Build status: SCHEDULED
[17:43:32.272] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:6:0) after 2m59s
[17:46:31.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:6:0)
[17:46:31.350] Build status: SCHEDULED
[17:46:31.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:7:0) after 2m34s
[17:49:05.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:7:0)
[17:49:05.386] Build status: SCHEDULED
[17:49:05.386] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:8:0) after 4m29s
[17:53:34.484] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:8:0)
[17:53:34.523] Build status: SCHEDULED
[17:53:34.523] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:9:0) after 8m33s
[18:02:07.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:9:0)
[18:02:07.787] Build status: SCHEDULED
[18:02:07.787] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:10:0) after 4m18s
[18:06:25.949] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:10:0)
[18:06:26.023] Build status: SCHEDULED
[18:06:26.023] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:11:0) after 4m31s
[18:10:57.127] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:11:0)
[18:10:57.150] Build status: SCHEDULED
[18:10:57.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:12:0) after 8m28s
[18:19:25.175] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:12:0)
[18:19:25.200] Build status: SCHEDULED
[18:19:25.200] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:13:0) after 9m34s
[18:28:59.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:13:0)
[18:28:59.604] Build status: SCHEDULED
[18:28:59.604] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:14:0) after 5m11s
[18:34:10.673] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:14:0)
[18:34:10.699] Build status: SCHEDULED
[18:34:10.700] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:15:0) after 5m43s
[18:39:53.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:15:0)
[18:39:53.843] Build status: SCHEDULED
[18:39:53.843] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:16:0) after 7m32s
[18:47:25.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:16:0)
[18:47:25.908] Build status: SCHEDULED
[18:47:25.908] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:17:0) after 9m27s
[18:56:52.943] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:17:0)
[18:56:52.963] Build status: SCHEDULED
[18:56:52.963] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:18:0) after 9m21s
[19:06:13.988] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:18:0)
[19:06:14.164] Build status: SCHEDULED
[19:06:14.164] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:19:0) after 8m54s
[19:15:08.279] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:19:0)
[19:15:08.313] Build status: SCHEDULED
[19:15:08.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:20:0) after 8m20s
[19:23:28.698] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:20:0)
[19:23:28.722] Build status: SCHEDULED
[19:23:28.722] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:21:0) after 9m49s
[19:33:17.860] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:21:0)
[19:33:17.882] Build status: SCHEDULED
[19:33:17.882] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:22:0) after 1m22s
[19:34:39.909] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:22:0)
[19:34:39.932] Build status: SCHEDULED
[19:34:39.932] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:23:0) after 1m34s
[19:36:14.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:23:0)
[19:36:14.095] Build status: SCHEDULED
[19:36:14.096] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:24:0) after 6m25s
[19:42:40.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:24:0)
[19:42:40.223] Build status: SCHEDULED
[19:42:40.223] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:25:0) after 4m16s
[19:46:56.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:25:0)
[19:46:56.547] Build status: SCHEDULED
[19:46:56.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:26:0) after 6m57s
[19:53:53.694] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:26:0)
[19:53:53.716] Build status: SCHEDULED
[19:53:53.716] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:27:0) after 2m8s
[19:56:01.788] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:27:0)
[19:56:01.829] Build status: SCHEDULED
[19:56:01.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:28:0) after 1m47s
[19:57:48.890] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:28:0)
[19:57:48.924] Build status: SCHEDULED
[19:57:48.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:29:0) after 7m34s
[20:05:23.069] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:29:0)
[20:05:23.096] Build status: SCHEDULED
[20:05:23.096] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:30:0) after 3m0s
[20:08:23.164] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:30:0)
[20:08:23.188] Build status: SCHEDULED
[20:08:23.188] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:31:0) after 4m55s
[20:13:18.248] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:31:0)
[20:13:18.287] Build status: SCHEDULED
[20:13:18.287] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:32:0) after 4m55s
[20:18:13.403] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:32:0)
[20:18:13.438] Build status: SCHEDULED
[20:18:13.438] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:33:0) after 4m6s
[20:22:19.456] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:33:0)
[20:22:19.476] Build status: SCHEDULED
[20:22:19.477] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:34:0) after 7m37s
[20:29:56.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:34:0)
[20:29:56.717] Build status: SCHEDULED
[20:29:56.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:35:0) after 4m4s
[20:34:00.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:35:0)
[20:34:00.779] Build status: SCHEDULED
[20:34:00.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:36:0) after 1m55s
[20:35:55.883] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:36:0)
[20:35:55.903] Build status: SCHEDULED
[20:35:55.903] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:37:0) after 6m3s
[20:41:58.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:37:0)
[20:41:58.983] Build status: SCHEDULED
[20:41:58.983] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:38:0) after 8m24s
[20:50:23.010] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:38:0)
[20:50:23.040] Build status: SCHEDULED
[20:50:23.040] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:39:0) after 7m21s
[20:57:44.111] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:39:0)
[20:57:44.132] Build status: SCHEDULED
[20:57:44.132] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:40:0) after 1m34s
[20:59:18.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:40:0)
[20:59:18.571] Build status: SCHEDULED
[20:59:18.571] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:41:0) after 8m35s
[21:07:53.600] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:41:0)
[21:07:53.632] Build status: SCHEDULED
[21:07:53.632] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:42:0) after 8m13s
[21:16:06.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:42:0)
[21:16:06.711] Build status: SCHEDULED
[21:16:06.711] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:43:0) after 6m42s
[21:22:48.744] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:43:0)
[21:22:48.766] Build status: SCHEDULED
[21:22:48.766] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:44:0) after 2m32s
[21:25:20.790] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:44:0)
[21:25:20.815] Build status: SCHEDULED
[21:25:20.815] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:45:0) after 8m15s
[21:33:36.065] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:45:0)
[21:33:36.087] Build status: SCHEDULED
[21:33:36.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:46:0) after 4m52s
[21:38:28.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:46:0)
[21:38:28.201] Build status: SCHEDULED
[21:38:28.201] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:47:0) after 1m47s
[21:40:15.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:47:0)
[21:40:15.502] Build status: SCHEDULED
[21:40:15.502] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:48:0) after 5m23s
[21:45:38.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:48:0)
[21:45:38.543] Build status: SCHEDULED
[21:45:38.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:49:0) after 5m19s
[21:50:57.633] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:49:0)
[21:50:57.654] Build status: SCHEDULED
[21:50:57.654] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:50:0) after 5m45s
[21:56:42.788] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:50:0)
[21:56:42.816] Build status: SCHEDULED
[21:56:42.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:51:0) after 6m53s
[22:03:35.845] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:51:0)
[22:03:35.873] Build status: SCHEDULED
[22:03:35.873] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:52:0) after 1m58s
[22:05:33.938] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:52:0)
[22:05:33.964] Build status: SCHEDULED
[22:05:33.964] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:53:0) after 7m49s
[22:13:23.050] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:53:0)
[22:13:23.068] Build status: SCHEDULED
[22:13:23.068] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:54:0) after 4m32s
[22:17:55.195] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:54:0)
[22:17:55.224] Build status: SCHEDULED
[22:17:55.224] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:55:0) after 8m7s
[22:26:02.342] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:55:0)
[22:26:02.368] Build status: SCHEDULED
[22:26:02.368] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:56:0) after 7m15s
[22:33:17.805] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:56:0)
[22:33:17.832] Build status: SCHEDULED
[22:33:17.832] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:57:0) after 2m40s
[22:35:58.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:57:0)
[22:35:58.024] Build status: SCHEDULED
[22:35:58.024] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:58:0) after 3m14s
[22:39:12.453] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:58:0)
[22:39:12.475] Build status: SCHEDULED
[22:39:12.475] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:59:0) after 2m29s
[22:41:41.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:59:0)
[22:41:41.611] Build status: SCHEDULED
[22:41:41.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:60:0) after 8m57s
[22:50:38.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:60:0)
[22:50:38.663] Build status: SCHEDULED
[22:50:38.663] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:61:0) after 6m3s
[22:56:41.844] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:61:0)
[22:56:41.865] Build status: SCHEDULED
[22:56:41.865] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:62:0) after 5m30s
[23:02:11.887] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:62:0)
[23:02:12.004] Build status: SCHEDULED
[23:02:12.004] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:63:0) after 2m59s
[23:05:11.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:63:0)
[23:05:11.150] Build status: SCHEDULED
[23:05:11.150] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:64:0) after 1m17s
[23:06:28.181] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:64:0)
[23:06:28.203] Build status: SCHEDULED
[23:06:28.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:65:0) after 4m12s
[23:10:40.230] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:65:0)
[23:10:40.249] Build status: SCHEDULED
[23:10:40.249] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:66:0) after 7m10s
[23:17:50.276] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:66:0)
[23:17:50.298] Build status: SCHEDULED
[23:17:50.298] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952602988056170768:67:0) after 9m14s
[23:19:09.122] Received PubSub notification, asking Buildbucket for the build status
[23:19:09.142] Build:
{
"id": "8787172926134216961",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60410,
"createdBy": "project:chromium",
"createTime": "2023-03-08T17:18:08.733450877Z",
"endTime": "2023-03-08T23:19:07.794258Z",
"updateTime": "2023-03-08T23:19:07.794258Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0dae74b02fefe6440dd32647e644cd4f759c92b8",
"ref": "refs/heads/main"
}
}
}
[23:19:09.142] Invocation finished in 6h1m1.62607417s with status FAILED