[05:20:06.936] New invocation is queued and will start shortly
[05:20:08.229] Starting the invocation (attempt 1)
[05:20:08.271] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dd8741783262f7bd304cfb298a3463ff55308f13"
[05:20:08.271] Popped gitiles commit info from properties and tags
[05:20:08.271] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:20:08.271] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:20:08.271] Buildbucket request:
{
"requestId": "8952557564370282720",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd8741783262f7bd304cfb298a3463ff55308f13",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8952557564370282720"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:20:08.748] Scheduled build:
{
"id": "8787127502197661617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60412,
"createdBy": "project:chromium",
"createTime": "2023-03-09T05:20:08.375892437Z",
"updateTime": "2023-03-09T05:20:08.375892437Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd8741783262f7bd304cfb298a3463ff55308f13",
"ref": "refs/heads/main"
}
}
}
[05:20:08.748] Task URL: https://cr-buildbucket.appspot.com/build/8787127502197661617
[05:20:08.748] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:2:0) after 9m53s
[05:30:01.778] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:2:0)
[05:30:01.817] Build status: SCHEDULED
[05:30:01.817] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:3:0) after 2m45s
[05:32:46.848] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:3:0)
[05:32:46.870] Build status: SCHEDULED
[05:32:46.870] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:4:0) after 2m28s
[05:35:15.022] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:4:0)
[05:35:15.055] Build status: SCHEDULED
[05:35:15.055] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:5:0) after 6m50s
[05:42:05.079] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:5:0)
[05:42:05.122] Build status: SCHEDULED
[05:42:05.122] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:6:0) after 2m24s
[05:44:29.205] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:6:0)
[05:44:29.225] Build status: SCHEDULED
[05:44:29.225] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:7:0) after 5m1s
[05:49:30.436] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:7:0)
[05:49:30.455] Build status: SCHEDULED
[05:49:30.455] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:8:0) after 9m7s
[05:58:37.495] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:8:0)
[05:58:37.519] Build status: SCHEDULED
[05:58:37.519] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:9:0) after 5m26s
[06:04:03.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:9:0)
[06:04:03.612] Build status: SCHEDULED
[06:04:03.612] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:10:0) after 2m19s
[06:06:22.647] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:10:0)
[06:06:22.667] Build status: SCHEDULED
[06:06:22.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:11:0) after 6m46s
[06:13:08.690] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:11:0)
[06:13:08.707] Build status: SCHEDULED
[06:13:08.707] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:12:0) after 8m32s
[06:21:40.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:12:0)
[06:21:40.756] Build status: SCHEDULED
[06:21:40.756] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:13:0) after 6m40s
[06:28:20.881] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:13:0)
[06:28:20.904] Build status: SCHEDULED
[06:28:20.904] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:14:0) after 7m30s
[06:35:50.927] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:14:0)
[06:35:50.950] Build status: SCHEDULED
[06:35:50.950] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:15:0) after 3m35s
[06:39:26.022] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:15:0)
[06:39:26.051] Build status: SCHEDULED
[06:39:26.051] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:16:0) after 8m24s
[06:47:50.100] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:16:0)
[06:47:50.120] Build status: SCHEDULED
[06:47:50.120] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:17:0) after 9m9s
[06:56:59.142] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:17:0)
[06:56:59.163] Build status: SCHEDULED
[06:56:59.163] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:18:0) after 3m54s
[07:00:53.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:18:0)
[07:00:53.564] Build status: SCHEDULED
[07:00:53.564] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:19:0) after 5m29s
[07:06:22.579] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:19:0)
[07:06:22.608] Build status: SCHEDULED
[07:06:22.608] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:20:0) after 6m17s
[07:12:39.623] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:20:0)
[07:12:39.706] Build status: SCHEDULED
[07:12:39.706] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:21:0) after 6m53s
[07:19:32.864] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:21:0)
[07:19:32.885] Build status: SCHEDULED
[07:19:32.885] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:22:0) after 7m14s
[07:26:46.906] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:22:0)
[07:26:46.934] Build status: SCHEDULED
[07:26:46.934] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:23:0) after 8m54s
[07:35:41.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:23:0)
[07:35:41.218] Build status: SCHEDULED
[07:35:41.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:24:0) after 6m59s
[07:42:40.348] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:24:0)
[07:42:40.369] Build status: SCHEDULED
[07:42:40.369] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:25:0) after 4m23s
[07:47:03.599] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:25:0)
[07:47:03.646] Build status: SCHEDULED
[07:47:03.646] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:26:0) after 3m33s
[07:50:36.799] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:26:0)
[07:50:36.840] Build status: SCHEDULED
[07:50:36.840] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:27:0) after 8m42s
[07:59:19.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:27:0)
[07:59:19.132] Build status: SCHEDULED
[07:59:19.132] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:28:0) after 5m2s
[08:04:21.275] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:28:0)
[08:04:21.300] Build status: SCHEDULED
[08:04:21.300] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:29:0) after 1m8s
[08:05:29.326] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:29:0)
[08:05:29.350] Build status: SCHEDULED
[08:05:29.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:30:0) after 8m50s
[08:14:19.482] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:30:0)
[08:14:19.761] Build status: SCHEDULED
[08:14:19.761] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:31:0) after 4m36s
[08:18:55.792] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:31:0)
[08:18:55.811] Build status: SCHEDULED
[08:18:55.811] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:32:0) after 8m15s
[08:27:10.831] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:32:0)
[08:27:10.855] Build status: SCHEDULED
[08:27:10.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:33:0) after 2m7s
[08:29:18.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:33:0)
[08:29:18.101] Build status: SCHEDULED
[08:29:18.101] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:34:0) after 8m11s
[08:37:29.137] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:34:0)
[08:37:29.159] Build status: SCHEDULED
[08:37:29.159] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:35:0) after 5m12s
[08:42:41.300] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:35:0)
[08:42:41.318] Build status: SCHEDULED
[08:42:41.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:36:0) after 3m31s
[08:46:12.340] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:36:0)
[08:46:12.360] Build status: SCHEDULED
[08:46:12.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:37:0) after 5m38s
[08:51:50.386] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:37:0)
[08:51:50.409] Build status: SCHEDULED
[08:51:50.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:38:0) after 8m18s
[09:00:08.515] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:38:0)
[09:00:08.538] Build status: SCHEDULED
[09:00:08.538] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:39:0) after 1m49s
[09:01:57.778] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:39:0)
[09:01:57.819] Build status: SCHEDULED
[09:01:57.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:40:0) after 3m20s
[09:05:17.844] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:40:0)
[09:05:17.864] Build status: SCHEDULED
[09:05:17.864] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:41:0) after 8m9s
[09:13:26.887] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:41:0)
[09:13:26.909] Build status: SCHEDULED
[09:13:26.909] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:42:0) after 6m45s
[09:20:11.932] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:42:0)
[09:20:11.967] Build status: SCHEDULED
[09:20:11.967] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:43:0) after 9m17s
[09:29:29.130] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:43:0)
[09:29:29.147] Build status: SCHEDULED
[09:29:29.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:44:0) after 1m9s
[09:30:38.196] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:44:0)
[09:30:38.215] Build status: SCHEDULED
[09:30:38.215] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:45:0) after 1m3s
[09:31:41.301] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:45:0)
[09:31:41.324] Build status: SCHEDULED
[09:31:41.324] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:46:0) after 1m5s
[09:32:46.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:46:0)
[09:32:46.664] Build status: SCHEDULED
[09:32:46.664] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:47:0) after 6m58s
[09:39:44.872] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:47:0)
[09:39:44.902] Build status: SCHEDULED
[09:39:44.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:48:0) after 9m40s
[09:49:25.127] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:48:0)
[09:49:25.257] Build status: SCHEDULED
[09:49:25.257] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:49:0) after 1m9s
[09:50:34.667] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:49:0)
[09:50:34.697] Build status: SCHEDULED
[09:50:34.697] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:50:0) after 6m19s
[09:56:53.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:50:0)
[09:56:53.911] Build status: SCHEDULED
[09:56:53.911] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:51:0) after 9m19s
[10:06:12.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:51:0)
[10:06:13.006] Build status: SCHEDULED
[10:06:13.006] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:52:0) after 7m59s
[10:14:12.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:52:0)
[10:14:12.182] Build status: SCHEDULED
[10:14:12.182] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:53:0) after 9m56s
[10:24:08.259] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:53:0)
[10:24:08.286] Build status: SCHEDULED
[10:24:08.286] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:54:0) after 4m10s
[10:28:18.379] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:54:0)
[10:28:18.414] Build status: SCHEDULED
[10:28:18.414] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:55:0) after 8m3s
[10:36:21.521] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:55:0)
[10:36:21.547] Build status: SCHEDULED
[10:36:21.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:56:0) after 8m21s
[10:44:42.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:56:0)
[10:44:42.857] Build status: SCHEDULED
[10:44:42.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:57:0) after 6m52s
[10:51:35.024] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:57:0)
[10:51:35.079] Build status: SCHEDULED
[10:51:35.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:58:0) after 7m8s
[10:58:43.094] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:58:0)
[10:58:43.117] Build status: SCHEDULED
[10:58:43.117] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:59:0) after 6m26s
[11:05:09.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:59:0)
[11:05:09.356] Build status: SCHEDULED
[11:05:09.356] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:60:0) after 2m30s
[11:07:39.555] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:60:0)
[11:07:39.583] Build status: SCHEDULED
[11:07:39.583] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:61:0) after 3m0s
[11:10:39.633] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:61:0)
[11:10:39.662] Build status: SCHEDULED
[11:10:39.662] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:62:0) after 1m4s
[11:11:43.908] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:62:0)
[11:11:43.930] Build status: SCHEDULED
[11:11:43.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:63:0) after 2m41s
[11:14:25.009] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:63:0)
[11:14:25.028] Build status: SCHEDULED
[11:14:25.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:64:0) after 2m33s
[11:16:58.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:64:0)
[11:16:58.212] Build status: SCHEDULED
[11:16:58.212] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8952557564370282720:65:0) after 7m45s
[11:21:04.788] Received PubSub notification, asking Buildbucket for the build status
[11:21:04.811] Build:
{
"id": "8787127502197661617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60412,
"createdBy": "project:chromium",
"createTime": "2023-03-09T05:20:08.375892437Z",
"endTime": "2023-03-09T11:21:03.863705Z",
"updateTime": "2023-03-09T11:21:03.863705Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dd8741783262f7bd304cfb298a3463ff55308f13",
"ref": "refs/heads/main"
}
}
}
[11:21:04.811] Invocation finished in 6h0m57.891953079s with status FAILED