[02:06:06.333] New invocation is queued and will start shortly
[02:06:07.633] Starting the invocation (attempt 1)
[02:06:07.695] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f0a215d84cdfe791a186a0b26cd8ee606f3ae178"
[02:06:07.695] Popped gitiles commit info from properties and tags
[02:06:07.695] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:06:07.695] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:06:07.695] Buildbucket request:
{
"requestId": "8972319909102398944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0a215d84cdfe791a186a0b26cd8ee606f3ae178",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8972319909102398944"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:06:08.418] Scheduled build:
{
"id": "8806889846918628145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56991,
"createdBy": "project:chromium",
"createTime": "2022-08-03T02:06:07.782570835Z",
"updateTime": "2022-08-03T02:06:07.782570835Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0a215d84cdfe791a186a0b26cd8ee606f3ae178",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:06:08.418] Task URL: https://cr-buildbucket.appspot.com/build/8806889846918628145
[02:06:08.418] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:2:0) after 4m41s
[02:10:49.438] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:2:0)
[02:10:49.478] Build status: SCHEDULED
[02:10:49.478] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:3:0) after 3m54s
[02:14:43.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:3:0)
[02:14:43.522] Build status: SCHEDULED
[02:14:43.522] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:4:0) after 8m1s
[02:22:44.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:4:0)
[02:22:44.572] Build status: SCHEDULED
[02:22:44.572] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:5:0) after 2m31s
[02:25:15.662] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:5:0)
[02:25:15.684] Build status: SCHEDULED
[02:25:15.684] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:6:0) after 8m56s
[02:34:11.704] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:6:0)
[02:34:11.732] Build status: SCHEDULED
[02:34:11.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:7:0) after 5m27s
[02:39:38.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:7:0)
[02:39:38.896] Build status: SCHEDULED
[02:39:38.896] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:8:0) after 1m26s
[02:41:04.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:8:0)
[02:41:04.948] Build status: SCHEDULED
[02:41:04.948] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:9:0) after 6m44s
[02:47:48.992] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:9:0)
[02:47:49.035] Build status: SCHEDULED
[02:47:49.035] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:10:0) after 2m54s
[02:50:43.064] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:10:0)
[02:50:43.110] Build status: SCHEDULED
[02:50:43.110] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:11:0) after 4m16s
[02:54:59.397] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:11:0)
[02:54:59.440] Build status: SCHEDULED
[02:54:59.440] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:12:0) after 1m59s
[02:56:58.468] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:12:0)
[02:56:58.537] Build status: SCHEDULED
[02:56:58.537] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:13:0) after 8m59s
[03:05:57.764] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:13:0)
[03:05:57.803] Build status: SCHEDULED
[03:05:57.803] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:14:0) after 3m18s
[03:09:15.829] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:14:0)
[03:09:15.855] Build status: SCHEDULED
[03:09:15.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:15:0) after 2m0s
[03:11:16.033] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:15:0)
[03:11:16.058] Build status: SCHEDULED
[03:11:16.058] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:16:0) after 8m56s
[03:20:12.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:16:0)
[03:20:12.118] Build status: SCHEDULED
[03:20:12.118] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:17:0) after 3m4s
[03:23:16.288] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:17:0)
[03:23:16.333] Build status: SCHEDULED
[03:23:16.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:18:0) after 9m37s
[03:32:53.358] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:18:0)
[03:32:53.382] Build status: SCHEDULED
[03:32:53.382] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:19:0) after 6m7s
[03:39:00.444] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:19:0)
[03:39:00.467] Build status: SCHEDULED
[03:39:00.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:20:0) after 8m17s
[03:47:17.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:20:0)
[03:47:17.512] Build status: SCHEDULED
[03:47:17.512] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:21:0) after 6m51s
[03:54:08.666] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:21:0)
[03:54:08.718] Build status: SCHEDULED
[03:54:08.718] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:22:0) after 4m34s
[03:58:42.739] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:22:0)
[03:58:42.760] Build status: SCHEDULED
[03:58:42.760] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:23:0) after 9m12s
[04:07:54.821] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:23:0)
[04:07:54.857] Build status: SCHEDULED
[04:07:54.857] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:24:0) after 7m30s
[04:15:24.880] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:24:0)
[04:15:24.902] Build status: SCHEDULED
[04:15:24.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:25:0) after 4m22s
[04:19:46.967] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:25:0)
[04:19:46.987] Build status: SCHEDULED
[04:19:46.987] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:26:0) after 3m9s
[04:22:56.084] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:26:0)
[04:22:56.115] Build status: SCHEDULED
[04:22:56.115] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:27:0) after 6m34s
[04:29:30.416] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:27:0)
[04:29:30.442] Build status: SCHEDULED
[04:29:30.442] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:28:0) after 7m55s
[04:37:25.478] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:28:0)
[04:37:25.498] Build status: SCHEDULED
[04:37:25.498] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:29:0) after 7m51s
[04:45:16.567] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:29:0)
[04:45:16.590] Build status: SCHEDULED
[04:45:16.590] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:30:0) after 4m58s
[04:50:14.817] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:30:0)
[04:50:14.840] Build status: SCHEDULED
[04:50:14.840] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:31:0) after 2m21s
[04:52:35.866] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:31:0)
[04:52:35.885] Build status: SCHEDULED
[04:52:35.885] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:32:0) after 9m36s
[05:02:11.861] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:32:0)
[05:02:11.880] Build status: SCHEDULED
[05:02:11.880] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:33:0) after 9m56s
[05:12:08.006] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:33:0)
[05:12:08.028] Build status: SCHEDULED
[05:12:08.028] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:34:0) after 5m10s
[05:17:18.249] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:34:0)
[05:17:18.268] Build status: SCHEDULED
[05:17:18.268] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:35:0) after 6m56s
[05:24:14.293] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:35:0)
[05:24:14.312] Build status: SCHEDULED
[05:24:14.313] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:36:0) after 7m26s
[05:31:40.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:36:0)
[05:31:40.374] Build status: SCHEDULED
[05:31:40.374] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:37:0) after 5m42s
[05:37:22.443] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:37:0)
[05:37:22.467] Build status: SCHEDULED
[05:37:22.467] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:38:0) after 1m17s
[05:38:39.487] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:38:0)
[05:38:39.508] Build status: SCHEDULED
[05:38:39.508] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:39:0) after 1m4s
[05:39:43.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:39:0)
[05:39:43.658] Build status: SCHEDULED
[05:39:43.658] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:40:0) after 8m28s
[05:48:11.690] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:40:0)
[05:48:11.712] Build status: SCHEDULED
[05:48:11.712] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:41:0) after 1m46s
[05:49:57.927] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:41:0)
[05:49:57.947] Build status: SCHEDULED
[05:49:57.947] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:42:0) after 2m31s
[05:52:28.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:42:0)
[05:52:28.997] Build status: SCHEDULED
[05:52:28.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:43:0) after 7m17s
[05:59:46.558] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:43:0)
[05:59:46.579] Build status: SCHEDULED
[05:59:46.579] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:44:0) after 4m48s
[06:04:34.644] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:44:0)
[06:04:34.678] Build status: SCHEDULED
[06:04:34.678] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:45:0) after 6m58s
[06:11:32.804] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:45:0)
[06:11:32.833] Build status: SCHEDULED
[06:11:32.833] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:46:0) after 7m3s
[06:18:35.869] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:46:0)
[06:18:35.954] Build status: SCHEDULED
[06:18:35.954] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:47:0) after 5m5s
[06:23:41.068] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:47:0)
[06:23:41.089] Build status: SCHEDULED
[06:23:41.089] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:48:0) after 8m52s
[06:32:33.129] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:48:0)
[06:32:33.155] Build status: SCHEDULED
[06:32:33.155] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:49:0) after 7m6s
[06:39:39.164] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:49:0)
[06:39:39.226] Build status: SCHEDULED
[06:39:39.226] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:50:0) after 1m23s
[06:41:02.350] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:50:0)
[06:41:02.524] Build status: SCHEDULED
[06:41:02.524] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:51:0) after 5m20s
[06:46:22.552] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:51:0)
[06:46:22.573] Build status: SCHEDULED
[06:46:22.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:52:0) after 9m34s
[06:55:56.626] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:52:0)
[06:55:56.685] Build status: SCHEDULED
[06:55:56.685] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:53:0) after 6m31s
[07:02:27.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:53:0)
[07:02:27.867] Build status: SCHEDULED
[07:02:27.867] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:54:0) after 8m36s
[07:11:04.004] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:54:0)
[07:11:04.027] Build status: SCHEDULED
[07:11:04.027] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:55:0) after 8m33s
[07:19:37.058] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:55:0)
[07:19:37.092] Build status: SCHEDULED
[07:19:37.092] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:56:0) after 9m32s
[07:29:09.115] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:56:0)
[07:29:09.135] Build status: SCHEDULED
[07:29:09.135] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:57:0) after 5m42s
[07:34:51.161] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:57:0)
[07:34:51.183] Build status: SCHEDULED
[07:34:51.183] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:58:0) after 2m28s
[07:37:19.246] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:58:0)
[07:37:19.288] Build status: SCHEDULED
[07:37:19.288] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:59:0) after 1m51s
[07:39:10.402] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:59:0)
[07:39:10.423] Build status: SCHEDULED
[07:39:10.423] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:60:0) after 6m26s
[07:45:36.444] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:60:0)
[07:45:36.511] Build status: SCHEDULED
[07:45:36.511] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:61:0) after 6m29s
[07:52:05.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:61:0)
[07:52:05.545] Build status: SCHEDULED
[07:52:05.545] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:62:0) after 9m20s
[08:01:25.565] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:62:0)
[08:01:25.588] Build status: SCHEDULED
[08:01:25.588] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:63:0) after 1m55s
[08:03:20.673] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:63:0)
[08:03:20.692] Build status: SCHEDULED
[08:03:20.692] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:64:0) after 2m7s
[08:05:28.002] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:64:0)
[08:05:28.026] Build status: SCHEDULED
[08:05:28.026] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8972319909102398944:65:0) after 2m44s
[08:07:04.827] Received PubSub notification, asking Buildbucket for the build status
[08:07:04.848] Build:
{
"id": "8806889846918628145",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56991,
"createdBy": "project:chromium",
"createTime": "2022-08-03T02:06:07.782570835Z",
"endTime": "2022-08-03T08:07:04.221410Z",
"updateTime": "2022-08-03T08:07:04.573118Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0a215d84cdfe791a186a0b26cd8ee606f3ae178",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:07:04.848] Invocation finished in 6h0m58.532361314s with status FAILED