[10:58:10.314] New invocation is queued and will start shortly
[10:58:11.437] Starting the invocation (attempt 1)
[10:58:11.464] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/256328e3f4c3acc03145b507769c03625216697c"
[10:58:11.464] Popped gitiles commit info from properties and tags
[10:58:11.464] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:58:11.466] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:58:11.466] Buildbucket request:
{
"requestId": "8947734656484155168",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "256328e3f4c3acc03145b507769c03625216697c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8947734656484155168"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:58:11.860] Scheduled build:
{
"id": "8782304594549169105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60644,
"createdBy": "project:chromium",
"createTime": "2023-05-01T10:58:11.529535105Z",
"updateTime": "2023-05-01T10:58:11.529535105Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "256328e3f4c3acc03145b507769c03625216697c",
"ref": "refs/heads/main"
}
}
}
[10:58:11.860] Task URL: https://cr-buildbucket.appspot.com/build/8782304594549169105
[10:58:11.860] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:2:0) after 4m1s
[11:02:12.880] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:2:0)
[11:02:12.903] Build status: SCHEDULED
[11:02:12.903] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:3:0) after 7m33s
[11:09:45.921] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:3:0)
[11:09:45.952] Build status: SCHEDULED
[11:09:45.952] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:4:0) after 5m21s
[11:15:07.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:4:0)
[11:15:07.067] Build status: SCHEDULED
[11:15:07.067] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:5:0) after 3m23s
[11:18:30.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:5:0)
[11:18:30.124] Build status: SCHEDULED
[11:18:30.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:6:0) after 5m40s
[11:24:10.123] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:6:0)
[11:24:10.156] Build status: SCHEDULED
[11:24:10.156] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:7:0) after 7m33s
[11:31:43.174] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:7:0)
[11:31:43.360] Build status: SCHEDULED
[11:31:43.360] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:8:0) after 8m42s
[11:40:25.522] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:8:0)
[11:40:25.540] Build status: SCHEDULED
[11:40:25.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:9:0) after 5m44s
[11:46:09.569] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:9:0)
[11:46:09.603] Build status: SCHEDULED
[11:46:09.603] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:10:0) after 8m1s
[11:54:10.627] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:10:0)
[11:54:10.645] Build status: SCHEDULED
[11:54:10.645] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:11:0) after 2m59s
[11:57:09.730] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:11:0)
[11:57:09.747] Build status: SCHEDULED
[11:57:09.747] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:12:0) after 9m8s
[12:06:17.859] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:12:0)
[12:06:17.877] Build status: SCHEDULED
[12:06:17.878] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:13:0) after 3m35s
[12:09:52.894] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:13:0)
[12:09:52.923] Build status: SCHEDULED
[12:09:52.923] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:14:0) after 7m36s
[12:17:29.000] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:14:0)
[12:17:29.084] Build status: SCHEDULED
[12:17:29.084] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:15:0) after 1m1s
[12:18:30.280] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:15:0)
[12:18:30.392] Build status: SCHEDULED
[12:18:30.392] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:16:0) after 3m41s
[12:22:11.419] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:16:0)
[12:22:11.437] Build status: SCHEDULED
[12:22:11.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:17:0) after 3m6s
[12:25:17.570] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:17:0)
[12:25:18.064] Build status: SCHEDULED
[12:25:18.064] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:18:0) after 3m0s
[12:28:18.108] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:18:0)
[12:28:18.125] Build status: SCHEDULED
[12:28:18.125] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:19:0) after 1m27s
[12:29:45.142] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:19:0)
[12:29:45.161] Build status: SCHEDULED
[12:29:45.161] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:20:0) after 9m41s
[12:39:26.181] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:20:0)
[12:39:26.201] Build status: SCHEDULED
[12:39:26.201] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:21:0) after 8m21s
[12:47:47.287] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:21:0)
[12:47:47.307] Build status: SCHEDULED
[12:47:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:22:0) after 2m41s
[12:50:28.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:22:0)
[12:50:28.455] Build status: SCHEDULED
[12:50:28.455] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:23:0) after 1m55s
[12:52:23.465] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:23:0)
[12:52:23.482] Build status: SCHEDULED
[12:52:23.482] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:24:0) after 8m54s
[13:01:17.511] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:24:0)
[13:01:17.532] Build status: SCHEDULED
[13:01:17.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:25:0) after 1m50s
[13:03:07.552] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:25:0)
[13:03:07.577] Build status: SCHEDULED
[13:03:07.577] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:26:0) after 3m10s
[13:06:17.600] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:26:0)
[13:06:17.619] Build status: SCHEDULED
[13:06:17.619] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:27:0) after 7m13s
[13:13:30.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:27:0)
[13:13:30.715] Build status: SCHEDULED
[13:13:30.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:28:0) after 3m43s
[13:17:13.735] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:28:0)
[13:17:13.757] Build status: SCHEDULED
[13:17:13.757] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:29:0) after 4m33s
[13:21:46.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:29:0)
[13:21:46.946] Build status: SCHEDULED
[13:21:46.946] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:30:0) after 5m46s
[13:27:32.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:30:0)
[13:27:32.990] Build status: SCHEDULED
[13:27:32.990] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:31:0) after 8m33s
[13:36:06.018] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:31:0)
[13:36:06.047] Build status: SCHEDULED
[13:36:06.047] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:32:0) after 9m11s
[13:45:17.074] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:32:0)
[13:45:17.113] Build status: SCHEDULED
[13:45:17.113] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:33:0) after 7m59s
[13:53:16.257] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:33:0)
[13:53:16.303] Build status: SCHEDULED
[13:53:16.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:34:0) after 9m12s
[14:02:28.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:34:0)
[14:02:28.458] Build status: SCHEDULED
[14:02:28.458] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:35:0) after 5m3s
[14:07:31.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:35:0)
[14:07:31.510] Build status: SCHEDULED
[14:07:31.510] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:36:0) after 8m2s
[14:15:33.632] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:36:0)
[14:15:33.669] Build status: SCHEDULED
[14:15:33.669] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:37:0) after 9m51s
[14:25:24.712] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:37:0)
[14:25:24.731] Build status: SCHEDULED
[14:25:24.731] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:38:0) after 9m16s
[14:34:40.979] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:38:0)
[14:34:40.995] Build status: SCHEDULED
[14:34:40.995] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:39:0) after 3m51s
[14:38:32.116] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:39:0)
[14:38:32.133] Build status: SCHEDULED
[14:38:32.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:40:0) after 7m57s
[14:46:29.320] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:40:0)
[14:46:29.340] Build status: SCHEDULED
[14:46:29.340] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:41:0) after 8m34s
[14:55:03.363] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:41:0)
[14:55:03.382] Build status: SCHEDULED
[14:55:03.382] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:42:0) after 6m20s
[15:01:23.415] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:42:0)
[15:01:23.433] Build status: SCHEDULED
[15:01:23.433] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:43:0) after 3m23s
[15:04:46.453] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:43:0)
[15:04:46.475] Build status: SCHEDULED
[15:04:46.475] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:44:0) after 5m58s
[15:10:44.595] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:44:0)
[15:10:44.616] Build status: SCHEDULED
[15:10:44.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:45:0) after 2m42s
[15:13:26.782] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:45:0)
[15:13:26.805] Build status: SCHEDULED
[15:13:26.805] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:46:0) after 7m44s
[15:21:10.793] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:46:0)
[15:21:10.865] Build status: SCHEDULED
[15:21:10.865] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:47:0) after 7m2s
[15:28:13.103] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:47:0)
[15:28:13.127] Build status: SCHEDULED
[15:28:13.127] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:48:0) after 4m13s
[15:32:26.201] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:48:0)
[15:32:26.226] Build status: SCHEDULED
[15:32:26.226] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:49:0) after 5m57s
[15:38:23.283] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:49:0)
[15:38:23.303] Build status: SCHEDULED
[15:38:23.303] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:50:0) after 2m27s
[15:40:50.590] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:50:0)
[15:40:50.612] Build status: SCHEDULED
[15:40:50.612] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:51:0) after 9m32s
[15:50:22.957] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:51:0)
[15:50:22.981] Build status: SCHEDULED
[15:50:22.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:52:0) after 5m38s
[15:56:01.075] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:52:0)
[15:56:01.096] Build status: SCHEDULED
[15:56:01.096] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:53:0) after 5m3s
[16:01:04.252] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:53:0)
[16:01:04.271] Build status: SCHEDULED
[16:01:04.271] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:54:0) after 1m15s
[16:02:19.317] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:54:0)
[16:02:19.378] Build status: SCHEDULED
[16:02:19.378] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:55:0) after 4m37s
[16:06:56.499] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:55:0)
[16:06:56.523] Build status: SCHEDULED
[16:06:56.523] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:56:0) after 8m44s
[16:15:40.535] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:56:0)
[16:15:40.553] Build status: SCHEDULED
[16:15:40.553] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:57:0) after 6m8s
[16:21:48.571] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:57:0)
[16:21:48.616] Build status: SCHEDULED
[16:21:48.616] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:58:0) after 2m2s
[16:23:50.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:58:0)
[16:23:50.759] Build status: SCHEDULED
[16:23:50.759] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:59:0) after 3m33s
[16:27:24.006] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:59:0)
[16:27:24.028] Build status: SCHEDULED
[16:27:24.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:60:0) after 8m1s
[16:35:25.053] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:60:0)
[16:35:25.076] Build status: SCHEDULED
[16:35:25.076] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:61:0) after 4m29s
[16:39:54.095] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:61:0)
[16:39:54.113] Build status: SCHEDULED
[16:39:54.113] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:62:0) after 3m29s
[16:43:23.152] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:62:0)
[16:43:23.174] Build status: SCHEDULED
[16:43:23.174] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:63:0) after 8m53s
[16:52:16.272] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:63:0)
[16:52:16.318] Build status: SCHEDULED
[16:52:16.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:64:0) after 4m35s
[16:56:51.536] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:64:0)
[16:56:51.562] Build status: SCHEDULED
[16:56:51.563] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8947734656484155168:65:0) after 7m58s
[16:59:08.556] Received PubSub notification, asking Buildbucket for the build status
[16:59:08.580] Build:
{
"id": "8782304594549169105",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60644,
"createdBy": "project:chromium",
"createTime": "2023-05-01T10:58:11.529535105Z",
"endTime": "2023-05-01T16:59:05.588234Z",
"updateTime": "2023-05-01T16:59:05.588234Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "256328e3f4c3acc03145b507769c03625216697c",
"ref": "refs/heads/main"
}
}
}
[16:59:08.580] Invocation finished in 6h0m58.280607438s with status FAILED