[03:12:08.103] New invocation is queued and will start shortly
[03:12:09.221] Starting the invocation (attempt 1)
[03:12:09.254] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/97d68d8871a1d020d0efb07b5c7b7dc3d27a0cf4"
[03:12:09.254] Popped gitiles commit info from properties and tags
[03:12:09.254] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:12:09.254] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:12:09.255] Buildbucket request:
{
"requestId": "8950210095081869312",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97d68d8871a1d020d0efb07b5c7b7dc3d27a0cf4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8950210095081869312"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:12:09.655] Scheduled build:
{
"id": "8784780033143133121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60535,
"createdBy": "project:chromium",
"createTime": "2023-04-04T03:12:09.320029870Z",
"updateTime": "2023-04-04T03:12:09.320029870Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97d68d8871a1d020d0efb07b5c7b7dc3d27a0cf4",
"ref": "refs/heads/main"
}
}
}
[03:12:09.655] Task URL: https://cr-buildbucket.appspot.com/build/8784780033143133121
[03:12:09.655] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:2:0) after 7m49s
[03:19:58.724] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:2:0)
[03:19:58.760] Build status: SCHEDULED
[03:19:58.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:3:0) after 6m51s
[03:26:49.883] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:3:0)
[03:26:49.908] Build status: SCHEDULED
[03:26:49.908] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:4:0) after 6m51s
[03:33:40.967] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:4:0)
[03:33:40.987] Build status: SCHEDULED
[03:33:40.987] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:5:0) after 6m32s
[03:40:12.997] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:5:0)
[03:40:13.040] Build status: SCHEDULED
[03:40:13.041] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:6:0) after 3m18s
[03:43:31.583] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:6:0)
[03:43:31.655] Build status: SCHEDULED
[03:43:31.655] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:7:0) after 3m7s
[03:46:38.763] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:7:0)
[03:46:38.843] Build status: SCHEDULED
[03:46:38.844] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:8:0) after 9m38s
[03:56:16.955] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:8:0)
[03:56:16.975] Build status: SCHEDULED
[03:56:16.975] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:9:0) after 5m10s
[04:01:27.038] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:9:0)
[04:01:27.081] Build status: SCHEDULED
[04:01:27.081] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:10:0) after 4m45s
[04:06:12.314] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:10:0)
[04:06:12.357] Build status: SCHEDULED
[04:06:12.357] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:11:0) after 3m4s
[04:09:16.787] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:11:0)
[04:09:16.804] Build status: SCHEDULED
[04:09:16.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:12:0) after 7m49s
[04:17:05.853] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:12:0)
[04:17:05.873] Build status: SCHEDULED
[04:17:05.873] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:13:0) after 6m23s
[04:23:28.870] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:13:0)
[04:23:28.915] Build status: SCHEDULED
[04:23:28.915] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:14:0) after 6m49s
[04:30:18.092] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:14:0)
[04:30:18.116] Build status: SCHEDULED
[04:30:18.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:15:0) after 2m24s
[04:32:42.252] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:15:0)
[04:32:42.276] Build status: SCHEDULED
[04:32:42.276] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:16:0) after 9m34s
[04:42:16.299] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:16:0)
[04:42:16.344] Build status: SCHEDULED
[04:42:16.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:17:0) after 5m33s
[04:47:49.485] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:17:0)
[04:47:49.509] Build status: SCHEDULED
[04:47:49.509] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:18:0) after 9m44s
[04:57:33.531] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:18:0)
[04:57:33.550] Build status: SCHEDULED
[04:57:33.550] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:19:0) after 2m38s
[05:00:11.584] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:19:0)
[05:00:11.604] Build status: SCHEDULED
[05:00:11.604] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:20:0) after 6m59s
[05:07:10.797] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:20:0)
[05:07:10.824] Build status: SCHEDULED
[05:07:10.824] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:21:0) after 3m48s
[05:10:58.903] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:21:0)
[05:10:58.931] Build status: SCHEDULED
[05:10:58.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:22:0) after 6m2s
[05:17:01.081] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:22:0)
[05:17:01.117] Build status: SCHEDULED
[05:17:01.117] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:23:0) after 5m26s
[05:22:27.141] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:23:0)
[05:22:27.161] Build status: SCHEDULED
[05:22:27.161] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:24:0) after 4m17s
[05:26:44.190] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:24:0)
[05:26:44.214] Build status: SCHEDULED
[05:26:44.214] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:25:0) after 6m5s
[05:32:49.503] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:25:0)
[05:32:49.543] Build status: SCHEDULED
[05:32:49.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:26:0) after 5m47s
[05:38:36.729] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:26:0)
[05:38:36.755] Build status: SCHEDULED
[05:38:36.755] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:27:0) after 1m43s
[05:40:20.046] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:27:0)
[05:40:20.066] Build status: SCHEDULED
[05:40:20.066] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:28:0) after 8m19s
[05:48:39.260] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:28:0)
[05:48:39.277] Build status: SCHEDULED
[05:48:39.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:29:0) after 1m18s
[05:49:57.381] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:29:0)
[05:49:57.409] Build status: SCHEDULED
[05:49:57.409] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:30:0) after 7m6s
[05:57:03.431] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:30:0)
[05:57:03.451] Build status: SCHEDULED
[05:57:03.451] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:31:0) after 7m50s
[06:04:53.491] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:31:0)
[06:04:53.514] Build status: SCHEDULED
[06:04:53.514] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:32:0) after 2m23s
[06:07:16.554] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:32:0)
[06:07:16.573] Build status: SCHEDULED
[06:07:16.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:33:0) after 2m7s
[06:09:23.724] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:33:0)
[06:09:23.746] Build status: SCHEDULED
[06:09:23.746] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:34:0) after 9m29s
[06:18:52.788] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:34:0)
[06:18:52.810] Build status: SCHEDULED
[06:18:52.810] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:35:0) after 8m57s
[06:27:49.937] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:35:0)
[06:27:49.975] Build status: SCHEDULED
[06:27:49.975] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:36:0) after 3m43s
[06:31:33.012] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:36:0)
[06:31:33.042] Build status: SCHEDULED
[06:31:33.042] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:37:0) after 4m26s
[06:35:59.069] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:37:0)
[06:35:59.094] Build status: SCHEDULED
[06:35:59.094] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:38:0) after 9m28s
[06:45:27.096] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:38:0)
[06:45:27.139] Build status: SCHEDULED
[06:45:27.139] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:39:0) after 5m43s
[06:51:10.212] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:39:0)
[06:51:10.236] Build status: SCHEDULED
[06:51:10.236] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:40:0) after 2m39s
[06:53:49.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:40:0)
[06:53:49.617] Build status: SCHEDULED
[06:53:49.618] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:41:0) after 1m24s
[06:55:13.678] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:41:0)
[06:55:13.696] Build status: SCHEDULED
[06:55:13.696] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:42:0) after 4m13s
[06:59:26.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:42:0)
[06:59:26.972] Build status: SCHEDULED
[06:59:26.972] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:43:0) after 9m30s
[07:08:57.251] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:43:0)
[07:08:57.271] Build status: SCHEDULED
[07:08:57.271] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:44:0) after 4m55s
[07:13:52.379] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:44:0)
[07:13:52.405] Build status: SCHEDULED
[07:13:52.405] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:45:0) after 9m31s
[07:23:23.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:45:0)
[07:23:23.550] Build status: SCHEDULED
[07:23:23.550] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:46:0) after 7m29s
[07:30:52.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:46:0)
[07:30:52.577] Build status: SCHEDULED
[07:30:52.577] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:47:0) after 7m29s
[07:38:21.599] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:47:0)
[07:38:21.672] Build status: SCHEDULED
[07:38:21.672] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:48:0) after 3m13s
[07:41:35.030] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:48:0)
[07:41:35.048] Build status: SCHEDULED
[07:41:35.048] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:49:0) after 6m6s
[07:47:41.222] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:49:0)
[07:47:41.242] Build status: SCHEDULED
[07:47:41.242] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:50:0) after 4m57s
[07:52:38.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:50:0)
[07:52:38.632] Build status: SCHEDULED
[07:52:38.632] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:51:0) after 9m25s
[08:02:03.654] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:51:0)
[08:02:03.830] Build status: SCHEDULED
[08:02:03.830] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:52:0) after 5m23s
[08:07:26.980] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:52:0)
[08:07:27.026] Build status: SCHEDULED
[08:07:27.026] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:53:0) after 6m42s
[08:14:09.057] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:53:0)
[08:14:09.087] Build status: SCHEDULED
[08:14:09.087] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:54:0) after 5m12s
[08:19:21.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:54:0)
[08:19:21.378] Build status: SCHEDULED
[08:19:21.378] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:55:0) after 5m59s
[08:25:20.492] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:55:0)
[08:25:20.514] Build status: SCHEDULED
[08:25:20.514] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:56:0) after 2m1s
[08:27:21.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:56:0)
[08:27:21.581] Build status: SCHEDULED
[08:27:21.581] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:57:0) after 3m5s
[08:30:26.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:57:0)
[08:30:26.705] Build status: SCHEDULED
[08:30:26.705] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:58:0) after 3m3s
[08:33:29.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:58:0)
[08:33:29.757] Build status: SCHEDULED
[08:33:29.757] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:59:0) after 9m23s
[08:42:52.983] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:59:0)
[08:42:53.005] Build status: SCHEDULED
[08:42:53.005] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:60:0) after 8m34s
[08:51:27.180] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:60:0)
[08:51:27.198] Build status: SCHEDULED
[08:51:27.198] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:61:0) after 5m44s
[08:57:11.286] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:61:0)
[08:57:11.309] Build status: SCHEDULED
[08:57:11.309] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:62:0) after 5m53s
[09:03:04.498] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:62:0)
[09:03:04.525] Build status: SCHEDULED
[09:03:04.525] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:63:0) after 8m53s
[09:11:57.659] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:63:0)
[09:11:57.681] Build status: SCHEDULED
[09:11:57.681] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:64:0) after 1m1s
[09:12:58.706] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:64:0)
[09:12:58.726] Build status: SCHEDULED
[09:12:58.726] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8950210095081869312:65:0) after 4m16s
[09:13:06.058] Received PubSub notification, asking Buildbucket for the build status
[09:13:06.079] Build:
{
"id": "8784780033143133121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60535,
"createdBy": "project:chromium",
"createTime": "2023-04-04T03:12:09.320029870Z",
"endTime": "2023-04-04T09:13:02.453463Z",
"updateTime": "2023-04-04T09:13:02.453463Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "97d68d8871a1d020d0efb07b5c7b7dc3d27a0cf4",
"ref": "refs/heads/main"
}
}
}
[09:13:06.079] Invocation finished in 6h0m57.991469166s with status FAILED