[06:56:04.848] New invocation is queued and will start shortly
[06:56:06.054] Starting the invocation (attempt 1)
[06:56:06.083] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0a667114ed6500d0c453488506d349d44d3d5011"
[06:56:06.083] Popped gitiles commit info from properties and tags
[06:56:06.083] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:56:06.083] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:56:06.083] Buildbucket request:
{
"requestId": "8945031978549962112",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0a667114ed6500d0c453488506d349d44d3d5011",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945031978549962112"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:56:06.612] Scheduled build:
{
"id": "8779601916528609313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60763,
"createdBy": "project:chromium",
"createTime": "2023-05-31T06:56:06.143361330Z",
"updateTime": "2023-05-31T06:56:06.143361330Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0a667114ed6500d0c453488506d349d44d3d5011",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:56:06.612] Task URL: https://cr-buildbucket.appspot.com/build/8779601916528609313
[06:56:06.612] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:2:0) after 3m44s
[06:59:50.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:2:0)
[06:59:50.749] Build status: SCHEDULED
[06:59:50.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:3:0) after 4m46s
[07:04:36.913] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:3:0)
[07:04:36.929] Build status: SCHEDULED
[07:04:36.929] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:4:0) after 1m14s
[07:05:51.206] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:4:0)
[07:05:51.250] Build status: SCHEDULED
[07:05:51.250] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:5:0) after 7m40s
[07:13:31.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:5:0)
[07:13:31.510] Build status: SCHEDULED
[07:13:31.510] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:6:0) after 2m51s
[07:16:22.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:6:0)
[07:16:22.561] Build status: SCHEDULED
[07:16:22.561] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:7:0) after 7m47s
[07:24:09.849] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:7:0)
[07:24:09.879] Build status: SCHEDULED
[07:24:09.879] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:8:0) after 7m31s
[07:31:40.956] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:8:0)
[07:31:40.975] Build status: SCHEDULED
[07:31:40.975] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:9:0) after 8m50s
[07:40:31.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:9:0)
[07:40:31.080] Build status: SCHEDULED
[07:40:31.080] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:10:0) after 3m18s
[07:43:49.104] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:10:0)
[07:43:49.123] Build status: SCHEDULED
[07:43:49.123] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:11:0) after 9m10s
[07:52:59.346] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:11:0)
[07:52:59.365] Build status: SCHEDULED
[07:52:59.365] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:12:0) after 9m24s
[08:02:23.761] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:12:0)
[08:02:23.785] Build status: SCHEDULED
[08:02:23.785] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:13:0) after 5m10s
[08:07:33.983] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:13:0)
[08:07:34.011] Build status: SCHEDULED
[08:07:34.012] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:14:0) after 6m10s
[08:13:44.245] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:14:0)
[08:13:44.368] Build status: SCHEDULED
[08:13:44.368] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:15:0) after 8m22s
[08:22:06.380] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:15:0)
[08:22:06.399] Build status: SCHEDULED
[08:22:06.399] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:16:0) after 2m14s
[08:24:20.421] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:16:0)
[08:24:20.440] Build status: SCHEDULED
[08:24:20.440] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:17:0) after 6m14s
[08:30:34.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:17:0)
[08:30:34.607] Build status: SCHEDULED
[08:30:34.607] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:18:0) after 7m40s
[08:38:14.692] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:18:0)
[08:38:14.713] Build status: SCHEDULED
[08:38:14.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:19:0) after 2m39s
[08:40:54.245] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:19:0)
[08:40:54.316] Build status: SCHEDULED
[08:40:54.316] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:20:0) after 9m42s
[08:50:36.664] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:20:0)
[08:50:36.686] Build status: SCHEDULED
[08:50:36.686] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:21:0) after 3m15s
[08:53:52.056] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:21:0)
[08:53:52.073] Build status: SCHEDULED
[08:53:52.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:22:0) after 9m6s
[09:02:58.199] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:22:0)
[09:02:58.222] Build status: SCHEDULED
[09:02:58.222] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:23:0) after 7m11s
[09:10:09.406] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:23:0)
[09:10:09.428] Build status: SCHEDULED
[09:10:09.428] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:24:0) after 6m40s
[09:16:49.465] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:24:0)
[09:16:49.521] Build status: SCHEDULED
[09:16:49.521] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:25:0) after 3m0s
[09:19:49.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:25:0)
[09:19:49.888] Build status: SCHEDULED
[09:19:49.888] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:26:0) after 1m21s
[09:21:11.032] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:26:0)
[09:21:11.051] Build status: SCHEDULED
[09:21:11.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:27:0) after 9m37s
[09:30:48.258] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:27:0)
[09:30:48.273] Build status: SCHEDULED
[09:30:48.273] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:28:0) after 1m58s
[09:32:46.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:28:0)
[09:32:46.765] Build status: SCHEDULED
[09:32:46.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:29:0) after 4m41s
[09:37:27.789] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:29:0)
[09:37:27.808] Build status: SCHEDULED
[09:37:27.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:30:0) after 3m9s
[09:40:37.043] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:30:0)
[09:40:37.070] Build status: SCHEDULED
[09:40:37.070] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:31:0) after 8m53s
[09:49:30.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:31:0)
[09:49:30.141] Build status: SCHEDULED
[09:49:30.141] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:32:0) after 9m10s
[09:58:40.345] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:32:0)
[09:58:40.389] Build status: SCHEDULED
[09:58:40.389] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:33:0) after 3m28s
[10:02:08.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:33:0)
[10:02:08.667] Build status: SCHEDULED
[10:02:08.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:34:0) after 7m58s
[10:10:06.728] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:34:0)
[10:10:06.749] Build status: SCHEDULED
[10:10:06.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:35:0) after 6m17s
[10:16:23.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:35:0)
[10:16:23.800] Build status: SCHEDULED
[10:16:23.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:36:0) after 4m15s
[10:20:38.844] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:36:0)
[10:20:38.867] Build status: SCHEDULED
[10:20:38.867] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:37:0) after 6m53s
[10:27:31.895] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:37:0)
[10:27:31.932] Build status: SCHEDULED
[10:27:31.932] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:38:0) after 1m20s
[10:28:51.948] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:38:0)
[10:28:51.963] Build status: SCHEDULED
[10:28:51.963] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:39:0) after 3m53s
[10:32:45.375] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:39:0)
[10:32:45.396] Build status: SCHEDULED
[10:32:45.396] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:40:0) after 3m28s
[10:36:13.403] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:40:0)
[10:36:13.425] Build status: SCHEDULED
[10:36:13.425] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:41:0) after 3m4s
[10:39:17.749] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:41:0)
[10:39:17.817] Build status: SCHEDULED
[10:39:17.817] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:42:0) after 3m38s
[10:42:55.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:42:0)
[10:42:56.008] Build status: SCHEDULED
[10:42:56.008] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:43:0) after 5m19s
[10:48:15.131] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:43:0)
[10:48:15.149] Build status: SCHEDULED
[10:48:15.149] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:44:0) after 8m42s
[10:56:57.232] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:44:0)
[10:56:57.252] Build status: SCHEDULED
[10:56:57.253] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:45:0) after 7m25s
[11:04:22.369] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:45:0)
[11:04:22.428] Build status: SCHEDULED
[11:04:22.428] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:46:0) after 7m14s
[11:11:36.704] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:46:0)
[11:11:36.722] Build status: SCHEDULED
[11:11:36.722] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:47:0) after 2m34s
[11:14:10.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:47:0)
[11:14:10.730] Build status: SCHEDULED
[11:14:10.730] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:48:0) after 6m36s
[11:20:46.758] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:48:0)
[11:20:46.781] Build status: SCHEDULED
[11:20:46.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:49:0) after 6m21s
[11:27:07.833] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:49:0)
[11:27:07.857] Build status: SCHEDULED
[11:27:07.858] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:50:0) after 3m42s
[11:30:49.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:50:0)
[11:30:49.926] Build status: SCHEDULED
[11:30:49.926] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:51:0) after 8m10s
[11:39:00.234] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:51:0)
[11:39:00.252] Build status: SCHEDULED
[11:39:00.252] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:52:0) after 4m45s
[11:43:45.318] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:52:0)
[11:43:45.333] Build status: SCHEDULED
[11:43:45.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:53:0) after 6m37s
[11:50:22.425] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:53:0)
[11:50:22.446] Build status: SCHEDULED
[11:50:22.446] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:54:0) after 8m2s
[11:58:24.585] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:54:0)
[11:58:24.610] Build status: SCHEDULED
[11:58:24.610] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:55:0) after 7m44s
[12:06:08.783] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:55:0)
[12:06:08.804] Build status: SCHEDULED
[12:06:08.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:56:0) after 3m47s
[12:09:55.827] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:56:0)
[12:09:55.847] Build status: SCHEDULED
[12:09:55.847] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:57:0) after 4m40s
[12:14:35.878] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:57:0)
[12:14:35.895] Build status: SCHEDULED
[12:14:35.895] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:58:0) after 2m56s
[12:17:32.034] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:58:0)
[12:17:32.055] Build status: SCHEDULED
[12:17:32.055] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:59:0) after 4m47s
[12:22:19.087] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:59:0)
[12:22:19.110] Build status: SCHEDULED
[12:22:19.110] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:60:0) after 9m37s
[12:31:56.239] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:60:0)
[12:31:56.271] Build status: SCHEDULED
[12:31:56.272] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:61:0) after 6m2s
[12:37:58.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:61:0)
[12:37:58.647] Build status: SCHEDULED
[12:37:58.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:62:0) after 8m24s
[12:46:22.674] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:62:0)
[12:46:22.821] Build status: SCHEDULED
[12:46:22.821] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:63:0) after 6m25s
[12:52:47.845] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:63:0)
[12:52:47.928] Build status: SCHEDULED
[12:52:47.928] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8945031978549962112:64:0) after 6m26s
[12:57:04.026] Received PubSub notification, asking Buildbucket for the build status
[12:57:04.044] Build:
{
"id": "8779601916528609313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60763,
"createdBy": "project:chromium",
"createTime": "2023-05-31T06:56:06.143361330Z",
"endTime": "2023-05-31T12:57:03.368820Z",
"updateTime": "2023-05-31T12:57:03.368820Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0a667114ed6500d0c453488506d349d44d3d5011",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:57:04.044] Invocation finished in 6h0m59.211445773s with status FAILED