[04:24:05.176] New invocation is queued and will start shortly
[04:24:06.275] Starting the invocation (attempt 1)
[04:24:06.344] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cf73647f17c877e6fc08db950d0451cd1ae7b306"
[04:24:06.344] Popped gitiles commit info from properties and tags
[04:24:06.344] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:24:06.344] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:24:06.344] Buildbucket request:
{
"requestId": "8948574822899953808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf73647f17c877e6fc08db950d0451cd1ae7b306",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8948574822899953808"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:24:06.753] Scheduled build:
{
"id": "8783144760922628641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60607,
"createdBy": "project:chromium",
"createTime": "2023-04-22T04:24:06.437551826Z",
"updateTime": "2023-04-22T04:24:06.437551826Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf73647f17c877e6fc08db950d0451cd1ae7b306",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:24:06.753] Task URL: https://cr-buildbucket.appspot.com/build/8783144760922628641
[04:24:06.753] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:2:0) after 8m15s
[04:32:21.781] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:2:0)
[04:32:21.800] Build status: SCHEDULED
[04:32:21.800] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:3:0) after 6m28s
[04:38:49.827] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:3:0)
[04:38:49.855] Build status: SCHEDULED
[04:38:49.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:4:0) after 5m31s
[04:44:21.059] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:4:0)
[04:44:21.079] Build status: SCHEDULED
[04:44:21.079] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:5:0) after 9m28s
[04:53:49.312] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:5:0)
[04:53:49.331] Build status: SCHEDULED
[04:53:49.331] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:6:0) after 9m47s
[05:03:36.444] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:6:0)
[05:03:36.576] Build status: SCHEDULED
[05:03:36.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:7:0) after 6m3s
[05:09:39.677] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:7:0)
[05:09:39.710] Build status: SCHEDULED
[05:09:39.710] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:8:0) after 8m27s
[05:18:06.935] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:8:0)
[05:18:06.959] Build status: SCHEDULED
[05:18:06.959] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:9:0) after 1m38s
[05:19:45.031] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:9:0)
[05:19:45.049] Build status: SCHEDULED
[05:19:45.049] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:10:0) after 7m3s
[05:26:48.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:10:0)
[05:26:48.194] Build status: SCHEDULED
[05:26:48.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:11:0) after 8m24s
[05:35:12.238] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:11:0)
[05:35:12.330] Build status: SCHEDULED
[05:35:12.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:12:0) after 5m49s
[05:41:01.352] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:12:0)
[05:41:01.377] Build status: SCHEDULED
[05:41:01.377] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:13:0) after 5m17s
[05:46:18.395] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:13:0)
[05:46:18.434] Build status: SCHEDULED
[05:46:18.434] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:14:0) after 5m34s
[05:51:52.523] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:14:0)
[05:51:52.546] Build status: SCHEDULED
[05:51:52.546] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:15:0) after 7m15s
[05:59:07.567] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:15:0)
[05:59:07.589] Build status: SCHEDULED
[05:59:07.589] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:16:0) after 9m31s
[06:08:38.616] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:16:0)
[06:08:38.643] Build status: SCHEDULED
[06:08:38.643] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:17:0) after 6m29s
[06:15:07.663] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:17:0)
[06:15:07.683] Build status: SCHEDULED
[06:15:07.683] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:18:0) after 7m2s
[06:22:09.809] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:18:0)
[06:22:09.831] Build status: SCHEDULED
[06:22:09.832] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:19:0) after 8m27s
[06:30:36.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:19:0)
[06:30:36.956] Build status: SCHEDULED
[06:30:36.956] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:20:0) after 1m8s
[06:31:44.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:20:0)
[06:31:44.998] Build status: SCHEDULED
[06:31:44.998] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:21:0) after 3m31s
[06:35:16.026] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:21:0)
[06:35:16.085] Build status: SCHEDULED
[06:35:16.085] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:22:0) after 7m29s
[06:42:45.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:22:0)
[06:42:45.370] Build status: SCHEDULED
[06:42:45.370] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:23:0) after 3m55s
[06:46:40.391] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:23:0)
[06:46:40.410] Build status: SCHEDULED
[06:46:40.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:24:0) after 6m33s
[06:53:13.485] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:24:0)
[06:53:13.505] Build status: SCHEDULED
[06:53:13.505] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:25:0) after 5m39s
[06:58:52.550] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:25:0)
[06:58:52.573] Build status: SCHEDULED
[06:58:52.573] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:26:0) after 8m18s
[07:07:10.699] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:26:0)
[07:07:10.721] Build status: SCHEDULED
[07:07:10.721] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:27:0) after 8m12s
[07:15:22.844] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:27:0)
[07:15:22.866] Build status: SCHEDULED
[07:15:22.866] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:28:0) after 2m54s
[07:18:16.868] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:28:0)
[07:18:16.896] Build status: SCHEDULED
[07:18:16.896] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:29:0) after 2m7s
[07:20:23.919] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:29:0)
[07:20:23.962] Build status: SCHEDULED
[07:20:23.962] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:30:0) after 3m29s
[07:23:53.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:30:0)
[07:23:53.278] Build status: SCHEDULED
[07:23:53.278] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:31:0) after 9m30s
[07:33:23.457] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:31:0)
[07:33:23.511] Build status: SCHEDULED
[07:33:23.511] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:32:0) after 8m25s
[07:41:48.580] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:32:0)
[07:41:48.604] Build status: SCHEDULED
[07:41:48.604] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:33:0) after 8m5s
[07:49:53.577] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:33:0)
[07:49:53.601] Build status: SCHEDULED
[07:49:53.601] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:34:0) after 8m58s
[07:58:51.763] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:34:0)
[07:58:51.785] Build status: SCHEDULED
[07:58:51.785] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:35:0) after 3m11s
[08:02:02.932] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:35:0)
[08:02:02.966] Build status: SCHEDULED
[08:02:02.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:36:0) after 2m53s
[08:04:56.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:36:0)
[08:04:56.137] Build status: SCHEDULED
[08:04:56.137] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:37:0) after 7m52s
[08:12:48.424] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:37:0)
[08:12:48.447] Build status: SCHEDULED
[08:12:48.447] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:38:0) after 5m35s
[08:18:23.596] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:38:0)
[08:18:23.620] Build status: SCHEDULED
[08:18:23.620] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:39:0) after 3m7s
[08:21:30.743] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:39:0)
[08:21:30.764] Build status: SCHEDULED
[08:21:30.764] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:40:0) after 9m29s
[08:30:59.883] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:40:0)
[08:30:59.904] Build status: SCHEDULED
[08:30:59.904] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:41:0) after 4m15s
[08:35:14.929] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:41:0)
[08:35:14.953] Build status: SCHEDULED
[08:35:14.953] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:42:0) after 8m30s
[08:43:45.097] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:42:0)
[08:43:45.119] Build status: SCHEDULED
[08:43:45.119] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:43:0) after 5m30s
[08:49:15.261] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:43:0)
[08:49:15.289] Build status: SCHEDULED
[08:49:15.289] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:44:0) after 3m23s
[08:52:38.315] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:44:0)
[08:52:38.354] Build status: SCHEDULED
[08:52:38.354] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:45:0) after 8m17s
[09:00:55.378] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:45:0)
[09:00:55.404] Build status: SCHEDULED
[09:00:55.404] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:46:0) after 6m32s
[09:07:27.456] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:46:0)
[09:07:27.483] Build status: SCHEDULED
[09:07:27.483] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:47:0) after 1m58s
[09:09:25.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:47:0)
[09:09:25.615] Build status: SCHEDULED
[09:09:25.615] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:48:0) after 6m59s
[09:16:24.771] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:48:0)
[09:16:24.793] Build status: SCHEDULED
[09:16:24.793] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:49:0) after 4m40s
[09:21:05.038] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:49:0)
[09:21:05.059] Build status: SCHEDULED
[09:21:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:50:0) after 2m46s
[09:23:51.246] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:50:0)
[09:23:51.277] Build status: SCHEDULED
[09:23:51.277] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:51:0) after 5m19s
[09:29:10.448] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:51:0)
[09:29:10.469] Build status: SCHEDULED
[09:29:10.469] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:52:0) after 9m26s
[09:38:36.498] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:52:0)
[09:38:36.676] Build status: SCHEDULED
[09:38:36.676] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:53:0) after 3m31s
[09:42:07.845] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:53:0)
[09:42:07.876] Build status: SCHEDULED
[09:42:07.876] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:54:0) after 1m24s
[09:43:31.911] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:54:0)
[09:43:31.931] Build status: SCHEDULED
[09:43:31.931] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:55:0) after 6m40s
[09:50:11.963] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:55:0)
[09:50:11.989] Build status: SCHEDULED
[09:50:11.989] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:56:0) after 1m1s
[09:51:13.007] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:56:0)
[09:51:13.030] Build status: SCHEDULED
[09:51:13.030] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:57:0) after 2m18s
[09:53:31.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:57:0)
[09:53:31.064] Build status: SCHEDULED
[09:53:31.064] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:58:0) after 7m12s
[10:00:43.159] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:58:0)
[10:00:43.181] Build status: SCHEDULED
[10:00:43.181] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:59:0) after 3m26s
[10:04:09.309] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:59:0)
[10:04:09.389] Build status: SCHEDULED
[10:04:09.389] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:60:0) after 1m32s
[10:05:41.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:60:0)
[10:05:41.439] Build status: SCHEDULED
[10:05:41.439] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:61:0) after 7m0s
[10:12:41.462] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:61:0)
[10:12:41.484] Build status: SCHEDULED
[10:12:41.484] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:62:0) after 2m45s
[10:15:26.512] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:62:0)
[10:15:26.586] Build status: SCHEDULED
[10:15:26.586] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:63:0) after 6m50s
[10:22:16.710] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:63:0)
[10:22:16.731] Build status: SCHEDULED
[10:22:16.731] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:64:0) after 1m23s
[10:23:39.753] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:64:0)
[10:23:39.813] Build status: SCHEDULED
[10:23:39.813] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8948574822899953808:65:0) after 8m7s
[10:25:13.722] Received PubSub notification, asking Buildbucket for the build status
[10:25:13.742] Build:
{
"id": "8783144760922628641",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60607,
"createdBy": "project:chromium",
"createTime": "2023-04-22T04:24:06.437551826Z",
"endTime": "2023-04-22T10:25:12.871599Z",
"updateTime": "2023-04-22T10:25:12.871599Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cf73647f17c877e6fc08db950d0451cd1ae7b306",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:25:13.742] Invocation finished in 6h1m8.573479948s with status FAILED