[06:59:10.994] New invocation is queued and will start shortly
[06:59:12.165] Starting the invocation (attempt 1)
[06:59:12.195] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/069f9924f9673fb69a232fc3156d3ff6a9b78817"
[06:59:12.195] Popped gitiles commit info from properties and tags
[06:59:12.195] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:59:12.195] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:59:12.196] Buildbucket request:
{
"requestId": "8944941186390940208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "069f9924f9673fb69a232fc3156d3ff6a9b78817",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8944941186390940208"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:59:12.594] Scheduled build:
{
"id": "8779511124409987969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60767,
"createdBy": "project:chromium",
"createTime": "2023-06-01T06:59:12.255783643Z",
"updateTime": "2023-06-01T06:59:12.255783643Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "069f9924f9673fb69a232fc3156d3ff6a9b78817",
"ref": "refs/heads/main"
}
}
}
[06:59:12.594] Task URL: https://cr-buildbucket.appspot.com/build/8779511124409987969
[06:59:12.594] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:2:0) after 8m30s
[07:07:42.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:2:0)
[07:07:42.914] Build status: SCHEDULED
[07:07:42.914] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:3:0) after 4m23s
[07:12:06.038] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:3:0)
[07:12:06.071] Build status: SCHEDULED
[07:12:06.071] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:4:0) after 4m19s
[07:16:25.122] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:4:0)
[07:16:25.147] Build status: SCHEDULED
[07:16:25.147] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:5:0) after 3m57s
[07:20:22.164] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:5:0)
[07:20:22.185] Build status: SCHEDULED
[07:20:22.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:6:0) after 2m27s
[07:22:49.202] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:6:0)
[07:22:49.219] Build status: SCHEDULED
[07:22:49.219] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:7:0) after 5m43s
[07:28:32.419] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:7:0)
[07:28:32.457] Build status: SCHEDULED
[07:28:32.457] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:8:0) after 8m35s
[07:37:07.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:8:0)
[07:37:07.587] Build status: SCHEDULED
[07:37:07.587] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:9:0) after 5m57s
[07:43:04.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:9:0)
[07:43:04.911] Build status: SCHEDULED
[07:43:04.911] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:10:0) after 5m26s
[07:48:30.967] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:10:0)
[07:48:30.983] Build status: SCHEDULED
[07:48:30.983] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:11:0) after 2m3s
[07:50:34.237] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:11:0)
[07:50:34.262] Build status: SCHEDULED
[07:50:34.262] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:12:0) after 3m41s
[07:54:15.362] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:12:0)
[07:54:15.380] Build status: SCHEDULED
[07:54:15.380] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:13:0) after 1m16s
[07:55:31.413] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:13:0)
[07:55:31.431] Build status: SCHEDULED
[07:55:31.431] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:14:0) after 5m16s
[08:00:47.462] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:14:0)
[08:00:47.482] Build status: SCHEDULED
[08:00:47.482] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:15:0) after 8m20s
[08:09:07.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:15:0)
[08:09:07.520] Build status: SCHEDULED
[08:09:07.520] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:16:0) after 7m40s
[08:16:47.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:16:0)
[08:16:47.601] Build status: SCHEDULED
[08:16:47.601] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:17:0) after 5m27s
[08:22:14.697] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:17:0)
[08:22:14.725] Build status: SCHEDULED
[08:22:14.725] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:18:0) after 2m46s
[08:25:01.054] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:18:0)
[08:25:01.071] Build status: SCHEDULED
[08:25:01.071] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:19:0) after 7m35s
[08:32:36.096] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:19:0)
[08:32:36.186] Build status: SCHEDULED
[08:32:36.186] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:20:0) after 5m18s
[08:37:54.219] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:20:0)
[08:37:54.247] Build status: SCHEDULED
[08:37:54.247] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:21:0) after 2m49s
[08:40:43.282] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:21:0)
[08:40:43.389] Build status: SCHEDULED
[08:40:43.389] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:22:0) after 3m59s
[08:44:42.409] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:22:0)
[08:44:42.426] Build status: SCHEDULED
[08:44:42.426] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:23:0) after 9m1s
[08:53:43.462] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:23:0)
[08:53:43.485] Build status: SCHEDULED
[08:53:43.485] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:24:0) after 2m2s
[08:55:45.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:24:0)
[08:55:45.541] Build status: SCHEDULED
[08:55:45.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:25:0) after 2m33s
[08:58:18.570] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:25:0)
[08:58:18.590] Build status: SCHEDULED
[08:58:18.590] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:26:0) after 1m54s
[09:00:12.687] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:26:0)
[09:00:12.733] Build status: SCHEDULED
[09:00:12.733] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:27:0) after 7m36s
[09:07:48.804] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:27:0)
[09:07:48.881] Build status: SCHEDULED
[09:07:48.881] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:28:0) after 3m57s
[09:11:45.943] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:28:0)
[09:11:45.970] Build status: SCHEDULED
[09:11:45.970] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:29:0) after 9m17s
[09:21:03.029] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:29:0)
[09:21:03.054] Build status: SCHEDULED
[09:21:03.054] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:30:0) after 7m55s
[09:28:58.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:30:0)
[09:28:58.122] Build status: SCHEDULED
[09:28:58.122] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:31:0) after 5m14s
[09:34:12.294] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:31:0)
[09:34:12.336] Build status: SCHEDULED
[09:34:12.336] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:32:0) after 5m2s
[09:39:14.420] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:32:0)
[09:39:14.437] Build status: SCHEDULED
[09:39:14.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:33:0) after 9m5s
[09:48:19.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:33:0)
[09:48:19.582] Build status: SCHEDULED
[09:48:19.582] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:34:0) after 3m35s
[09:51:54.605] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:34:0)
[09:51:54.624] Build status: SCHEDULED
[09:51:54.624] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:35:0) after 7m13s
[09:59:07.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:35:0)
[09:59:07.689] Build status: SCHEDULED
[09:59:07.689] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:36:0) after 2m40s
[10:01:47.879] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:36:0)
[10:01:47.903] Build status: SCHEDULED
[10:01:47.903] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:37:0) after 3m27s
[10:05:14.923] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:37:0)
[10:05:14.944] Build status: SCHEDULED
[10:05:14.944] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:38:0) after 7m44s
[10:12:58.960] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:38:0)
[10:12:58.977] Build status: SCHEDULED
[10:12:58.978] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:39:0) after 1m21s
[10:14:20.009] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:39:0)
[10:14:20.063] Build status: SCHEDULED
[10:14:20.063] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:40:0) after 6m18s
[10:20:38.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:40:0)
[10:20:38.481] Build status: SCHEDULED
[10:20:38.481] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:41:0) after 5m42s
[10:26:20.578] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:41:0)
[10:26:20.599] Build status: SCHEDULED
[10:26:20.599] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:42:0) after 9m26s
[10:35:46.618] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:42:0)
[10:35:46.666] Build status: SCHEDULED
[10:35:46.666] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:43:0) after 9m39s
[10:45:25.688] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:43:0)
[10:45:25.710] Build status: SCHEDULED
[10:45:25.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:44:0) after 3m52s
[10:49:17.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:44:0)
[10:49:17.815] Build status: SCHEDULED
[10:49:17.815] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:45:0) after 9m39s
[10:58:56.836] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:45:0)
[10:58:56.859] Build status: SCHEDULED
[10:58:56.860] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:46:0) after 4m39s
[11:03:35.876] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:46:0)
[11:03:35.912] Build status: SCHEDULED
[11:03:35.912] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:47:0) after 4m49s
[11:08:25.060] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:47:0)
[11:08:25.125] Build status: SCHEDULED
[11:08:25.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:48:0) after 3m26s
[11:11:51.239] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:48:0)
[11:11:51.269] Build status: SCHEDULED
[11:11:51.269] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:49:0) after 3m20s
[11:15:11.478] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:49:0)
[11:15:11.500] Build status: SCHEDULED
[11:15:11.500] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:50:0) after 7m2s
[11:22:13.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:50:0)
[11:22:13.562] Build status: SCHEDULED
[11:22:13.562] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:51:0) after 9m50s
[11:32:04.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:51:0)
[11:32:04.541] Build status: SCHEDULED
[11:32:04.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:52:0) after 1m12s
[11:33:16.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:52:0)
[11:33:16.656] Build status: SCHEDULED
[11:33:16.656] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:53:0) after 5m49s
[11:39:05.872] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:53:0)
[11:39:05.891] Build status: SCHEDULED
[11:39:05.891] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:54:0) after 9m17s
[11:48:23.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:54:0)
[11:48:23.419] Build status: SCHEDULED
[11:48:23.419] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:55:0) after 6m36s
[11:54:59.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:55:0)
[11:54:59.648] Build status: SCHEDULED
[11:54:59.648] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:56:0) after 2m38s
[11:57:37.780] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:56:0)
[11:57:37.811] Build status: SCHEDULED
[11:57:37.811] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:57:0) after 8m24s
[12:06:01.888] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:57:0)
[12:06:01.908] Build status: SCHEDULED
[12:06:01.908] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:58:0) after 6m8s
[12:12:10.051] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:58:0)
[12:12:10.086] Build status: SCHEDULED
[12:12:10.086] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:59:0) after 2m26s
[12:14:36.300] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:59:0)
[12:14:36.315] Build status: SCHEDULED
[12:14:36.315] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:60:0) after 8m49s
[12:23:25.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:60:0)
[12:23:25.356] Build status: SCHEDULED
[12:23:25.356] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:61:0) after 9m2s
[12:32:27.385] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:61:0)
[12:32:27.552] Build status: SCHEDULED
[12:32:27.552] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:62:0) after 8m48s
[12:41:15.653] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:62:0)
[12:41:15.678] Build status: SCHEDULED
[12:41:15.678] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:63:0) after 3m34s
[12:44:49.893] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:63:0)
[12:44:49.958] Build status: SCHEDULED
[12:44:49.958] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:64:0) after 8m24s
[12:53:14.150] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:64:0)
[12:53:14.174] Build status: SCHEDULED
[12:53:14.174] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8944941186390940208:65:0) after 7m54s
[13:00:09.597] Received PubSub notification, asking Buildbucket for the build status
[13:00:09.629] Build:
{
"id": "8779511124409987969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60767,
"createdBy": "project:chromium",
"createTime": "2023-06-01T06:59:12.255783643Z",
"endTime": "2023-06-01T13:00:09.084942Z",
"updateTime": "2023-06-01T13:00:09.084942Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "069f9924f9673fb69a232fc3156d3ff6a9b78817",
"ref": "refs/heads/main"
}
}
}
[13:00:09.629] Invocation finished in 6h0m58.646320098s with status FAILED