[10:55:15.332] New invocation is queued and will start shortly
[10:55:16.438] Starting the invocation (attempt 1)
[10:55:16.466] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c439f3a97a571c53b26180d12cb7b019def52d13"
[10:55:16.466] Popped gitiles commit info from properties and tags
[10:55:16.466] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:55:16.466] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:55:16.466] Buildbucket request:
{
"requestId": "8947825436932130784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c439f3a97a571c53b26180d12cb7b019def52d13",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947825436932130784"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:55:16.857] Scheduled build:
{
"id": "8782395375018735249",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60640,
"createdBy": "project:chromium",
"createTime": "2023-04-30T10:55:16.527803925Z",
"updateTime": "2023-04-30T10:55:16.527803925Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c439f3a97a571c53b26180d12cb7b019def52d13",
"ref": "refs/heads/main"
}
}
}
[10:55:16.857] Task URL: https://cr-buildbucket.appspot.com/build/8782395375018735249
[10:55:16.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:2:0) after 4m51s
[11:00:07.882] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:2:0)
[11:00:07.959] Build status: SCHEDULED
[11:00:07.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:3:0) after 8m29s
[11:08:36.942] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:3:0)
[11:08:36.964] Build status: SCHEDULED
[11:08:36.964] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:4:0) after 1m19s
[11:09:55.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:4:0)
[11:09:56.007] Build status: SCHEDULED
[11:09:56.007] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:5:0) after 6m53s
[11:16:49.047] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:5:0)
[11:16:49.068] Build status: SCHEDULED
[11:16:49.068] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:6:0) after 4m13s
[11:21:02.089] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:6:0)
[11:21:02.117] Build status: SCHEDULED
[11:21:02.117] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:7:0) after 7m13s
[11:28:15.299] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:7:0)
[11:28:15.320] Build status: SCHEDULED
[11:28:15.320] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:8:0) after 6m49s
[11:35:04.450] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:8:0)
[11:35:04.502] Build status: SCHEDULED
[11:35:04.502] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:9:0) after 7m1s
[11:42:05.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:9:0)
[11:42:05.541] Build status: SCHEDULED
[11:42:05.541] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:10:0) after 7m36s
[11:49:41.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:10:0)
[11:49:41.604] Build status: SCHEDULED
[11:49:41.604] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:11:0) after 7m54s
[11:57:35.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:11:0)
[11:57:35.654] Build status: SCHEDULED
[11:57:35.655] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:12:0) after 1m19s
[11:58:54.716] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:12:0)
[11:58:54.735] Build status: SCHEDULED
[11:58:54.735] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:13:0) after 8m41s
[12:07:35.932] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:13:0)
[12:07:35.999] Build status: SCHEDULED
[12:07:35.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:14:0) after 1m36s
[12:09:12.017] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:14:0)
[12:09:12.038] Build status: SCHEDULED
[12:09:12.038] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:15:0) after 6m26s
[12:15:38.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:15:0)
[12:15:38.077] Build status: SCHEDULED
[12:15:38.077] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:16:0) after 5m36s
[12:21:14.172] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:16:0)
[12:21:14.191] Build status: SCHEDULED
[12:21:14.191] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:17:0) after 1m36s
[12:22:50.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:17:0)
[12:22:50.931] Build status: SCHEDULED
[12:22:50.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:18:0) after 9m7s
[12:31:58.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:18:0)
[12:31:58.102] Build status: SCHEDULED
[12:31:58.102] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:19:0) after 5m56s
[12:37:54.121] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:19:0)
[12:37:54.139] Build status: SCHEDULED
[12:37:54.140] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:20:0) after 6m44s
[12:44:38.160] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:20:0)
[12:44:38.179] Build status: SCHEDULED
[12:44:38.179] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:21:0) after 2m31s
[12:47:09.271] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:21:0)
[12:47:09.293] Build status: SCHEDULED
[12:47:09.293] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:22:0) after 7m23s
[12:54:32.389] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:22:0)
[12:54:32.407] Build status: SCHEDULED
[12:54:32.407] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:23:0) after 3m26s
[12:57:58.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:23:0)
[12:57:58.540] Build status: SCHEDULED
[12:57:58.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:24:0) after 3m55s
[13:01:53.568] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:24:0)
[13:01:53.588] Build status: SCHEDULED
[13:01:53.588] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:25:0) after 3m5s
[13:04:58.614] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:25:0)
[13:04:58.660] Build status: SCHEDULED
[13:04:58.660] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:26:0) after 5m42s
[13:10:40.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:26:0)
[13:10:40.702] Build status: SCHEDULED
[13:10:40.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:27:0) after 5m2s
[13:15:42.719] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:27:0)
[13:15:42.737] Build status: SCHEDULED
[13:15:42.737] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:28:0) after 6m21s
[13:22:03.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:28:0)
[13:22:03.848] Build status: SCHEDULED
[13:22:03.849] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:29:0) after 2m10s
[13:24:14.199] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:29:0)
[13:24:14.218] Build status: SCHEDULED
[13:24:14.218] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:30:0) after 8m54s
[13:33:08.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:30:0)
[13:33:08.320] Build status: SCHEDULED
[13:33:08.320] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:31:0) after 5m0s
[13:38:08.620] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:31:0)
[13:38:08.647] Build status: SCHEDULED
[13:38:08.647] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:32:0) after 5m1s
[13:43:09.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:32:0)
[13:43:09.886] Build status: SCHEDULED
[13:43:09.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:33:0) after 2m39s
[13:45:48.906] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:33:0)
[13:45:48.931] Build status: SCHEDULED
[13:45:48.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:34:0) after 9m33s
[13:55:22.283] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:34:0)
[13:55:22.313] Build status: SCHEDULED
[13:55:22.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:35:0) after 6m15s
[14:01:37.506] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:35:0)
[14:01:37.531] Build status: SCHEDULED
[14:01:37.531] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:36:0) after 1m4s
[14:02:41.823] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:36:0)
[14:02:41.872] Build status: SCHEDULED
[14:02:41.872] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:37:0) after 2m20s
[14:05:02.187] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:37:0)
[14:05:02.205] Build status: SCHEDULED
[14:05:02.205] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:38:0) after 6m56s
[14:11:58.233] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:38:0)
[14:11:58.252] Build status: SCHEDULED
[14:11:58.252] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:39:0) after 9m53s
[14:21:51.284] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:39:0)
[14:21:51.312] Build status: SCHEDULED
[14:21:51.312] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:40:0) after 7m35s
[14:29:26.328] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:40:0)
[14:29:26.347] Build status: SCHEDULED
[14:29:26.347] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:41:0) after 7m53s
[14:37:19.390] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:41:0)
[14:37:19.408] Build status: SCHEDULED
[14:37:19.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:42:0) after 8m23s
[14:45:42.433] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:42:0)
[14:45:42.455] Build status: SCHEDULED
[14:45:42.455] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:43:0) after 8m46s
[14:54:28.518] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:43:0)
[14:54:28.551] Build status: SCHEDULED
[14:54:28.551] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:44:0) after 7m53s
[15:02:21.747] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:44:0)
[15:02:21.802] Build status: SCHEDULED
[15:02:21.802] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:45:0) after 1m9s
[15:03:31.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:45:0)
[15:03:31.166] Build status: SCHEDULED
[15:03:31.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:46:0) after 9m59s
[15:13:30.355] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:46:0)
[15:13:30.377] Build status: SCHEDULED
[15:13:30.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:47:0) after 9m21s
[15:22:51.400] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:47:0)
[15:22:51.436] Build status: SCHEDULED
[15:22:51.436] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:48:0) after 7m44s
[15:30:35.456] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:48:0)
[15:30:35.482] Build status: SCHEDULED
[15:30:35.482] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:49:0) after 2m36s
[15:33:11.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:49:0)
[15:33:11.528] Build status: SCHEDULED
[15:33:11.528] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:50:0) after 8m45s
[15:41:56.521] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:50:0)
[15:41:56.542] Build status: SCHEDULED
[15:41:56.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:51:0) after 8m39s
[15:50:35.572] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:51:0)
[15:50:35.598] Build status: SCHEDULED
[15:50:35.598] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:52:0) after 3m0s
[15:53:36.319] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:52:0)
[15:53:36.337] Build status: SCHEDULED
[15:53:36.337] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:53:0) after 3m19s
[15:56:55.355] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:53:0)
[15:56:55.584] Build status: SCHEDULED
[15:56:55.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:54:0) after 7m38s
[16:04:33.603] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:54:0)
[16:04:33.641] Build status: SCHEDULED
[16:04:33.641] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:55:0) after 5m35s
[16:10:08.721] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:55:0)
[16:10:08.796] Build status: SCHEDULED
[16:10:08.796] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:56:0) after 5m36s
[16:15:44.827] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:56:0)
[16:15:44.856] Build status: SCHEDULED
[16:15:44.856] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:57:0) after 4m24s
[16:20:09.206] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:57:0)
[16:20:09.227] Build status: SCHEDULED
[16:20:09.227] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:58:0) after 8m8s
[16:28:17.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:58:0)
[16:28:17.263] Build status: SCHEDULED
[16:28:17.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:59:0) after 2m46s
[16:31:03.341] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:59:0)
[16:31:03.359] Build status: SCHEDULED
[16:31:03.359] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:60:0) after 7m3s
[16:38:06.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:60:0)
[16:38:06.446] Build status: SCHEDULED
[16:38:06.447] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:61:0) after 7m32s
[16:45:38.615] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:61:0)
[16:45:38.634] Build status: SCHEDULED
[16:45:38.634] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:62:0) after 1m7s
[16:46:45.657] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:62:0)
[16:46:45.734] Build status: SCHEDULED
[16:46:45.735] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:63:0) after 8m34s
[16:55:19.779] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:63:0)
[16:55:19.800] Build status: SCHEDULED
[16:55:19.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947825436932130784:64:0) after 7m13s
[16:56:03.603] Received PubSub notification, asking Buildbucket for the build status
[16:56:03.627] Build:
{
"id": "8782395375018735249",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60640,
"createdBy": "project:chromium",
"createTime": "2023-04-30T10:55:16.527803925Z",
"endTime": "2023-04-30T16:56:02.983151Z",
"updateTime": "2023-04-30T16:56:02.983151Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c439f3a97a571c53b26180d12cb7b019def52d13",
"ref": "refs/heads/main"
}
}
}
[16:56:03.627] Invocation finished in 6h0m48.308234137s with status FAILED