[03:48:13.381] New invocation is queued and will start shortly
[03:48:14.461] Starting the invocation (attempt 1)
[03:48:14.508] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/67585e8efa616f9f632e8751ea4f3aea037cd203"
[03:48:14.508] Popped gitiles commit info from properties and tags
[03:48:14.508] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:48:14.508] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:48:14.508] Buildbucket request:
{
"requestId": "8949392451918863520",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "67585e8efa616f9f632e8751ea4f3aea037cd203",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949392451918863520"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:48:14.936] Scheduled build:
{
"id": "8783962390017353729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60571,
"createdBy": "project:chromium",
"createTime": "2023-04-13T03:48:14.569580970Z",
"updateTime": "2023-04-13T03:48:14.569580970Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "67585e8efa616f9f632e8751ea4f3aea037cd203",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:48:14.936] Task URL: https://cr-buildbucket.appspot.com/build/8783962390017353729
[03:48:14.936] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:2:0) after 3m5s
[03:51:21.086] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:2:0)
[03:51:21.113] Build status: SCHEDULED
[03:51:21.113] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:3:0) after 5m5s
[03:56:26.246] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:3:0)
[03:56:26.286] Build status: SCHEDULED
[03:56:26.286] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:4:0) after 6m32s
[04:02:58.386] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:4:0)
[04:02:58.410] Build status: SCHEDULED
[04:02:58.410] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:5:0) after 7m22s
[04:10:20.684] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:5:0)
[04:10:20.765] Build status: SCHEDULED
[04:10:20.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:6:0) after 8m43s
[04:19:04.165] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:6:0)
[04:19:04.185] Build status: SCHEDULED
[04:19:04.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:7:0) after 5m13s
[04:24:17.208] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:7:0)
[04:24:17.226] Build status: SCHEDULED
[04:24:17.226] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:8:0) after 9m26s
[04:33:43.450] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:8:0)
[04:33:43.484] Build status: SCHEDULED
[04:33:43.484] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:9:0) after 5m9s
[04:38:52.603] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:9:0)
[04:38:52.626] Build status: SCHEDULED
[04:38:52.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:10:0) after 6m29s
[04:45:21.657] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:10:0)
[04:45:21.679] Build status: SCHEDULED
[04:45:21.679] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:11:0) after 9m29s
[04:54:50.700] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:11:0)
[04:54:50.733] Build status: SCHEDULED
[04:54:50.733] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:12:0) after 1m45s
[04:56:35.880] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:12:0)
[04:56:35.924] Build status: SCHEDULED
[04:56:35.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:13:0) after 3m26s
[05:00:01.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:13:0)
[05:00:02.020] Build status: SCHEDULED
[05:00:02.020] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:14:0) after 5m11s
[05:05:13.446] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:14:0)
[05:05:13.464] Build status: SCHEDULED
[05:05:13.464] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:15:0) after 3m43s
[05:08:56.488] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:15:0)
[05:08:56.509] Build status: SCHEDULED
[05:08:56.509] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:16:0) after 5m47s
[05:14:43.638] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:16:0)
[05:14:43.656] Build status: SCHEDULED
[05:14:43.656] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:17:0) after 3m36s
[05:18:19.684] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:17:0)
[05:18:19.703] Build status: SCHEDULED
[05:18:19.703] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:18:0) after 2m23s
[05:20:42.838] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:18:0)
[05:20:42.865] Build status: SCHEDULED
[05:20:42.865] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:19:0) after 5m37s
[05:26:19.987] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:19:0)
[05:26:20.011] Build status: SCHEDULED
[05:26:20.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:20:0) after 5m7s
[05:31:27.160] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:20:0)
[05:31:27.203] Build status: SCHEDULED
[05:31:27.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:21:0) after 2m33s
[05:34:00.227] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:21:0)
[05:34:00.265] Build status: SCHEDULED
[05:34:00.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:22:0) after 7m28s
[05:41:28.324] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:22:0)
[05:41:28.341] Build status: SCHEDULED
[05:41:28.341] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:23:0) after 4m38s
[05:46:06.633] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:23:0)
[05:46:06.650] Build status: SCHEDULED
[05:46:06.650] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:24:0) after 7m35s
[05:53:41.745] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:24:0)
[05:53:41.765] Build status: SCHEDULED
[05:53:41.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:25:0) after 2m10s
[05:55:52.014] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:25:0)
[05:55:52.033] Build status: SCHEDULED
[05:55:52.033] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:26:0) after 7m21s
[06:03:13.157] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:26:0)
[06:03:13.174] Build status: SCHEDULED
[06:03:13.174] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:27:0) after 3m8s
[06:06:21.200] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:27:0)
[06:06:21.221] Build status: SCHEDULED
[06:06:21.221] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:28:0) after 9m40s
[06:16:01.254] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:28:0)
[06:16:01.314] Build status: SCHEDULED
[06:16:01.314] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:29:0) after 6m24s
[06:22:25.517] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:29:0)
[06:22:25.537] Build status: SCHEDULED
[06:22:25.537] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:30:0) after 3m8s
[06:25:33.606] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:30:0)
[06:25:33.627] Build status: SCHEDULED
[06:25:33.627] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:31:0) after 9m1s
[06:34:34.649] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:31:0)
[06:34:34.681] Build status: SCHEDULED
[06:34:34.681] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:32:0) after 6m58s
[06:41:32.704] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:32:0)
[06:41:32.727] Build status: SCHEDULED
[06:41:32.728] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:33:0) after 5m49s
[06:47:21.809] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:33:0)
[06:47:21.829] Build status: SCHEDULED
[06:47:21.829] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:34:0) after 7m7s
[06:54:28.920] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:34:0)
[06:54:28.943] Build status: SCHEDULED
[06:54:28.943] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:35:0) after 8m37s
[07:03:05.973] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:35:0)
[07:03:05.993] Build status: SCHEDULED
[07:03:05.993] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:36:0) after 9m44s
[07:12:49.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:36:0)
[07:12:50.016] Build status: SCHEDULED
[07:12:50.016] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:37:0) after 4m37s
[07:17:27.105] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:37:0)
[07:17:27.135] Build status: SCHEDULED
[07:17:27.136] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:38:0) after 3m12s
[07:20:39.258] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:38:0)
[07:20:39.284] Build status: SCHEDULED
[07:20:39.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:39:0) after 2m9s
[07:22:48.303] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:39:0)
[07:22:48.324] Build status: SCHEDULED
[07:22:48.324] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:40:0) after 1m48s
[07:24:36.380] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:40:0)
[07:24:36.402] Build status: SCHEDULED
[07:24:36.402] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:41:0) after 6m31s
[07:31:07.627] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:41:0)
[07:31:07.693] Build status: SCHEDULED
[07:31:07.693] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:42:0) after 2m34s
[07:33:42.170] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:42:0)
[07:33:42.282] Build status: SCHEDULED
[07:33:42.282] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:43:0) after 6m3s
[07:39:45.330] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:43:0)
[07:39:45.350] Build status: SCHEDULED
[07:39:45.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:44:0) after 3m25s
[07:43:10.472] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:44:0)
[07:43:10.493] Build status: SCHEDULED
[07:43:10.493] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:45:0) after 8m42s
[07:51:53.011] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:45:0)
[07:51:53.032] Build status: SCHEDULED
[07:51:53.032] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:46:0) after 7m39s
[07:59:32.144] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:46:0)
[07:59:32.164] Build status: SCHEDULED
[07:59:32.164] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:47:0) after 1m49s
[08:01:21.532] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:47:0)
[08:01:21.564] Build status: SCHEDULED
[08:01:21.564] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:48:0) after 7m56s
[08:09:17.664] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:48:0)
[08:09:17.690] Build status: SCHEDULED
[08:09:17.690] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:49:0) after 7m25s
[08:16:43.172] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:49:0)
[08:16:43.206] Build status: SCHEDULED
[08:16:43.206] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:50:0) after 8m49s
[08:25:32.289] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:50:0)
[08:25:32.317] Build status: SCHEDULED
[08:25:32.317] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:51:0) after 1m56s
[08:27:28.516] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:51:0)
[08:27:28.537] Build status: SCHEDULED
[08:27:28.537] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:52:0) after 7m43s
[08:35:11.686] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:52:0)
[08:35:11.712] Build status: SCHEDULED
[08:35:11.712] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:53:0) after 2m17s
[08:37:28.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:53:0)
[08:37:28.981] Build status: SCHEDULED
[08:37:28.981] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:54:0) after 6m47s
[08:44:15.956] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:54:0)
[08:44:15.977] Build status: SCHEDULED
[08:44:15.977] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:55:0) after 5m29s
[08:49:45.013] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:55:0)
[08:49:45.032] Build status: SCHEDULED
[08:49:45.032] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:56:0) after 9m22s
[08:59:07.292] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:56:0)
[08:59:07.314] Build status: SCHEDULED
[08:59:07.314] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:57:0) after 5m9s
[09:04:16.326] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:57:0)
[09:04:16.346] Build status: SCHEDULED
[09:04:16.346] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:58:0) after 6m49s
[09:11:05.553] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:58:0)
[09:11:05.575] Build status: SCHEDULED
[09:11:05.575] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:59:0) after 4m9s
[09:15:14.668] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:59:0)
[09:15:14.690] Build status: SCHEDULED
[09:15:14.690] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:60:0) after 8m8s
[09:23:22.912] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:60:0)
[09:23:22.935] Build status: SCHEDULED
[09:23:22.935] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:61:0) after 2m37s
[09:26:00.194] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:61:0)
[09:26:00.260] Build status: SCHEDULED
[09:26:00.260] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:62:0) after 1m3s
[09:27:03.386] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:62:0)
[09:27:03.408] Build status: SCHEDULED
[09:27:03.408] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:63:0) after 7m53s
[09:34:56.451] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:63:0)
[09:34:56.472] Build status: SCHEDULED
[09:34:56.472] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:64:0) after 2m55s
[09:37:51.509] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:64:0)
[09:37:51.540] Build status: SCHEDULED
[09:37:51.540] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:65:0) after 8m0s
[09:45:51.580] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:65:0)
[09:45:51.625] Build status: SCHEDULED
[09:45:51.625] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8949392451918863520:66:0) after 6m46s
[09:49:03.352] Received PubSub notification, asking Buildbucket for the build status
[09:49:03.371] Build:
{
"id": "8783962390017353729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60571,
"createdBy": "project:chromium",
"createTime": "2023-04-13T03:48:14.569580970Z",
"endTime": "2023-04-13T09:49:02.588382Z",
"updateTime": "2023-04-13T09:49:02.588382Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "67585e8efa616f9f632e8751ea4f3aea037cd203",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:49:03.371] Invocation finished in 6h0m49.998589079s with status FAILED