[09:45:12.164] New invocation is queued and will start shortly
[09:45:13.282] Starting the invocation (attempt 1)
[09:45:13.313] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/835113ed73adf841bf21c82575adfcdfc4aadf39"
[09:45:13.313] Popped gitiles commit info from properties and tags
[09:45:13.313] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:45:13.313] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:45:13.313] Buildbucket request:
{
"requestId": "8949460589662808096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "835113ed73adf841bf21c82575adfcdfc4aadf39",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949460589662808096"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:45:13.771] Scheduled build:
{
"id": "8784030527694846081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60568,
"createdBy": "project:chromium",
"createTime": "2023-04-12T09:45:13.416971657Z",
"updateTime": "2023-04-12T09:45:13.416971657Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "835113ed73adf841bf21c82575adfcdfc4aadf39",
"ref": "refs/heads/main"
}
}
}
[09:45:13.771] Task URL: https://cr-buildbucket.appspot.com/build/8784030527694846081
[09:45:13.771] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:2:0) after 1m31s
[09:46:44.792] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:2:0)
[09:46:44.834] Build status: SCHEDULED
[09:46:44.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:3:0) after 8m4s
[09:54:48.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:3:0)
[09:54:48.936] Build status: SCHEDULED
[09:54:48.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:4:0) after 9m31s
[10:04:20.077] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:4:0)
[10:04:20.119] Build status: SCHEDULED
[10:04:20.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:5:0) after 7m32s
[10:11:52.490] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:5:0)
[10:11:52.511] Build status: SCHEDULED
[10:11:52.511] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:6:0) after 3m26s
[10:15:18.532] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:6:0)
[10:15:18.551] Build status: SCHEDULED
[10:15:18.551] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:7:0) after 7m48s
[10:23:06.704] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:7:0)
[10:23:06.728] Build status: SCHEDULED
[10:23:06.728] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:8:0) after 6m43s
[10:29:49.712] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:8:0)
[10:29:49.734] Build status: SCHEDULED
[10:29:49.734] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:9:0) after 3m0s
[10:32:49.756] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:9:0)
[10:32:49.775] Build status: SCHEDULED
[10:32:49.775] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:10:0) after 4m56s
[10:37:45.795] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:10:0)
[10:37:45.816] Build status: SCHEDULED
[10:37:45.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:11:0) after 6m56s
[10:44:41.939] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:11:0)
[10:44:41.965] Build status: SCHEDULED
[10:44:41.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:12:0) after 5m15s
[10:49:57.192] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:12:0)
[10:49:57.211] Build status: SCHEDULED
[10:49:57.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:13:0) after 3m45s
[10:53:42.264] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:13:0)
[10:53:42.285] Build status: SCHEDULED
[10:53:42.285] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:14:0) after 2m13s
[10:55:55.404] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:14:0)
[10:55:55.555] Build status: SCHEDULED
[10:55:55.556] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:15:0) after 7m13s
[11:03:08.536] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:15:0)
[11:03:08.781] Build status: SCHEDULED
[11:03:08.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:16:0) after 1m5s
[11:04:13.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:16:0)
[11:04:13.831] Build status: SCHEDULED
[11:04:13.831] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:17:0) after 9m10s
[11:13:23.917] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:17:0)
[11:13:23.940] Build status: SCHEDULED
[11:13:23.940] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:18:0) after 5m36s
[11:19:00.114] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:18:0)
[11:19:00.203] Build status: SCHEDULED
[11:19:00.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:19:0) after 1m28s
[11:20:28.222] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:19:0)
[11:20:28.245] Build status: SCHEDULED
[11:20:28.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:20:0) after 9m1s
[11:29:29.267] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:20:0)
[11:29:29.312] Build status: SCHEDULED
[11:29:29.312] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:21:0) after 6m53s
[11:36:22.432] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:21:0)
[11:36:22.454] Build status: SCHEDULED
[11:36:22.454] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:22:0) after 7m49s
[11:44:11.693] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:22:0)
[11:44:11.713] Build status: SCHEDULED
[11:44:11.713] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:23:0) after 1m54s
[11:46:05.991] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:23:0)
[11:46:06.021] Build status: SCHEDULED
[11:46:06.021] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:24:0) after 8m38s
[11:54:44.051] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:24:0)
[11:54:44.079] Build status: SCHEDULED
[11:54:44.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:25:0) after 1m52s
[11:56:36.110] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:25:0)
[11:56:36.145] Build status: SCHEDULED
[11:56:36.145] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:26:0) after 7m59s
[12:04:35.166] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:26:0)
[12:04:35.185] Build status: SCHEDULED
[12:04:35.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:27:0) after 2m43s
[12:07:18.209] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:27:0)
[12:07:18.233] Build status: SCHEDULED
[12:07:18.233] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:28:0) after 3m27s
[12:10:45.318] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:28:0)
[12:10:45.347] Build status: SCHEDULED
[12:10:45.347] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:29:0) after 6m27s
[12:17:12.473] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:29:0)
[12:17:12.493] Build status: SCHEDULED
[12:17:12.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:30:0) after 1m37s
[12:18:49.641] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:30:0)
[12:18:49.729] Build status: SCHEDULED
[12:18:49.729] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:31:0) after 6m16s
[12:25:05.853] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:31:0)
[12:25:05.882] Build status: SCHEDULED
[12:25:05.882] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:32:0) after 2m23s
[12:27:28.900] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:32:0)
[12:27:28.929] Build status: SCHEDULED
[12:27:28.929] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:33:0) after 4m29s
[12:31:58.073] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:33:0)
[12:31:58.100] Build status: SCHEDULED
[12:31:58.101] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:34:0) after 9m6s
[12:41:04.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:34:0)
[12:41:04.291] Build status: SCHEDULED
[12:41:04.291] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:35:0) after 9m38s
[12:50:42.476] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:35:0)
[12:50:42.526] Build status: SCHEDULED
[12:50:42.526] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:36:0) after 8m35s
[12:59:17.719] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:36:0)
[12:59:17.742] Build status: SCHEDULED
[12:59:17.742] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:37:0) after 2m53s
[13:02:10.775] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:37:0)
[13:02:10.795] Build status: SCHEDULED
[13:02:10.795] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:38:0) after 7m38s
[13:09:49.023] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:38:0)
[13:09:49.044] Build status: SCHEDULED
[13:09:49.044] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:39:0) after 9m14s
[13:19:03.119] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:39:0)
[13:19:03.161] Build status: SCHEDULED
[13:19:03.161] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:40:0) after 4m56s
[13:23:59.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:40:0)
[13:23:59.198] Build status: SCHEDULED
[13:23:59.198] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:41:0) after 1m28s
[13:25:27.455] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:41:0)
[13:25:27.474] Build status: SCHEDULED
[13:25:27.474] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:42:0) after 6m2s
[13:31:29.790] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:42:0)
[13:31:29.816] Build status: SCHEDULED
[13:31:29.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:43:0) after 7m32s
[13:39:01.885] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:43:0)
[13:39:01.926] Build status: SCHEDULED
[13:39:01.926] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:44:0) after 7m50s
[13:46:52.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:44:0)
[13:46:52.234] Build status: SCHEDULED
[13:46:52.234] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:45:0) after 5m43s
[13:52:35.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:45:0)
[13:52:35.350] Build status: SCHEDULED
[13:52:35.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:46:0) after 8m2s
[14:00:37.490] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:46:0)
[14:00:37.512] Build status: SCHEDULED
[14:00:37.512] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:47:0) after 4m37s
[14:05:14.936] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:47:0)
[14:05:15.001] Build status: SCHEDULED
[14:05:15.001] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:48:0) after 5m32s
[14:10:47.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:48:0)
[14:10:47.158] Build status: SCHEDULED
[14:10:47.158] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:49:0) after 5m8s
[14:15:55.181] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:49:0)
[14:15:55.214] Build status: SCHEDULED
[14:15:55.214] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:50:0) after 5m22s
[14:21:17.239] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:50:0)
[14:21:17.270] Build status: SCHEDULED
[14:21:17.270] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:51:0) after 2m59s
[14:24:16.496] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:51:0)
[14:24:16.515] Build status: SCHEDULED
[14:24:16.515] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:52:0) after 4m44s
[14:29:00.710] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:52:0)
[14:29:00.768] Build status: SCHEDULED
[14:29:00.768] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:53:0) after 3m51s
[14:32:51.789] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:53:0)
[14:32:51.809] Build status: SCHEDULED
[14:32:51.809] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:54:0) after 9m4s
[14:41:56.129] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:54:0)
[14:41:56.190] Build status: SCHEDULED
[14:41:56.190] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:55:0) after 9m17s
[14:51:13.228] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:55:0)
[14:51:13.248] Build status: SCHEDULED
[14:51:13.248] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:56:0) after 3m42s
[14:54:55.301] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:56:0)
[14:54:55.322] Build status: SCHEDULED
[14:54:55.322] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:57:0) after 7m37s
[15:02:32.466] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:57:0)
[15:02:32.488] Build status: SCHEDULED
[15:02:32.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:58:0) after 4m44s
[15:07:16.566] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:58:0)
[15:07:16.591] Build status: SCHEDULED
[15:07:16.591] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:59:0) after 4m12s
[15:11:29.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:59:0)
[15:11:29.211] Build status: SCHEDULED
[15:11:29.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:60:0) after 4m57s
[15:16:26.189] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:60:0)
[15:16:26.218] Build status: SCHEDULED
[15:16:26.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:61:0) after 3m53s
[15:20:19.295] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:61:0)
[15:20:19.313] Build status: SCHEDULED
[15:20:19.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:62:0) after 7m55s
[15:28:14.583] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:62:0)
[15:28:14.613] Build status: SCHEDULED
[15:28:14.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:63:0) after 6m43s
[15:34:57.705] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:63:0)
[15:34:57.737] Build status: SCHEDULED
[15:34:57.737] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:64:0) after 6m25s
[15:41:22.902] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:64:0)
[15:41:22.926] Build status: SCHEDULED
[15:41:22.926] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949460589662808096:65:0) after 8m32s
[15:46:02.700] Received PubSub notification, asking Buildbucket for the build status
[15:46:02.720] Build:
{
"id": "8784030527694846081",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60568,
"createdBy": "project:chromium",
"createTime": "2023-04-12T09:45:13.416971657Z",
"endTime": "2023-04-12T15:46:01.995949Z",
"updateTime": "2023-04-12T15:46:01.995949Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "835113ed73adf841bf21c82575adfcdfc4aadf39",
"ref": "refs/heads/main"
}
}
}
[15:46:02.720] Invocation finished in 6h0m50.563689177s with status FAILED