[13:28:04.432] New invocation is queued and will start shortly
[13:28:05.962] Starting the invocation (attempt 1)
[13:28:05.995] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d7b2925c5e8a168c416e1d92c4aa49142fd2d73c"
[13:28:05.995] Popped gitiles commit info from properties and tags
[13:28:05.995] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:28:05.995] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:28:05.995] Buildbucket request:
{
"requestId": "8973092376062826672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7b2925c5e8a168c416e1d92c4aa49142fd2d73c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973092376062826672"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:28:06.574] Scheduled build:
{
"id": "8807662313686639041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56957,
"createdBy": "project:chromium",
"createTime": "2022-07-25T13:28:06.065312302Z",
"updateTime": "2022-07-25T13:28:06.065312302Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7b2925c5e8a168c416e1d92c4aa49142fd2d73c",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:28:06.574] Task URL: https://cr-buildbucket.appspot.com/build/8807662313686639041
[13:28:06.574] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:2:0) after 4m44s
[13:32:50.760] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:2:0)
[13:32:50.778] Build status: SCHEDULED
[13:32:50.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:3:0) after 5m55s
[13:38:45.849] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:3:0)
[13:38:45.868] Build status: SCHEDULED
[13:38:45.868] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:4:0) after 4m51s
[13:43:36.991] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:4:0)
[13:43:37.010] Build status: SCHEDULED
[13:43:37.010] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:5:0) after 7m6s
[13:50:43.044] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:5:0)
[13:50:43.074] Build status: SCHEDULED
[13:50:43.074] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:6:0) after 6m41s
[13:57:24.094] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:6:0)
[13:57:24.116] Build status: SCHEDULED
[13:57:24.116] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:7:0) after 4m40s
[14:02:04.138] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:7:0)
[14:02:04.166] Build status: SCHEDULED
[14:02:04.166] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:8:0) after 7m13s
[14:09:17.365] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:8:0)
[14:09:17.394] Build status: SCHEDULED
[14:09:17.394] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:9:0) after 4m32s
[14:13:49.661] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:9:0)
[14:13:49.684] Build status: SCHEDULED
[14:13:49.684] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:10:0) after 5m33s
[14:19:22.707] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:10:0)
[14:19:22.733] Build status: SCHEDULED
[14:19:22.733] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:11:0) after 8m54s
[14:28:16.857] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:11:0)
[14:28:16.887] Build status: SCHEDULED
[14:28:16.887] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:12:0) after 4m6s
[14:32:23.015] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:12:0)
[14:32:23.035] Build status: SCHEDULED
[14:32:23.035] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:13:0) after 4m12s
[14:36:35.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:13:0)
[14:36:35.178] Build status: SCHEDULED
[14:36:35.178] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:14:0) after 9m51s
[14:46:26.351] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:14:0)
[14:46:26.369] Build status: SCHEDULED
[14:46:26.369] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:15:0) after 5m5s
[14:51:31.493] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:15:0)
[14:51:31.511] Build status: SCHEDULED
[14:51:31.511] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:16:0) after 6m58s
[14:58:29.534] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:16:0)
[14:58:29.565] Build status: SCHEDULED
[14:58:29.565] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:17:0) after 2m33s
[15:01:02.754] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:17:0)
[15:01:02.781] Build status: SCHEDULED
[15:01:02.781] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:18:0) after 9m32s
[15:10:34.950] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:18:0)
[15:10:35.132] Build status: SCHEDULED
[15:10:35.132] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:19:0) after 6m44s
[15:17:19.263] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:19:0)
[15:17:19.284] Build status: SCHEDULED
[15:17:19.284] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:20:0) after 1m47s
[15:19:06.307] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:20:0)
[15:19:06.329] Build status: SCHEDULED
[15:19:06.329] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:21:0) after 2m22s
[15:21:28.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:21:0)
[15:21:28.393] Build status: SCHEDULED
[15:21:28.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:22:0) after 2m49s
[15:24:17.416] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:22:0)
[15:24:17.446] Build status: SCHEDULED
[15:24:17.446] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:23:0) after 3m28s
[15:27:45.466] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:23:0)
[15:27:45.488] Build status: SCHEDULED
[15:27:45.488] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:24:0) after 7m11s
[15:34:56.574] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:24:0)
[15:34:56.613] Build status: SCHEDULED
[15:34:56.613] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:25:0) after 4m5s
[15:39:01.638] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:25:0)
[15:39:01.657] Build status: SCHEDULED
[15:39:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:26:0) after 4m39s
[15:43:40.690] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:26:0)
[15:43:40.749] Build status: SCHEDULED
[15:43:40.749] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:27:0) after 8m34s
[15:52:14.775] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:27:0)
[15:52:14.804] Build status: SCHEDULED
[15:52:14.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:28:0) after 9m43s
[16:01:58.062] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:28:0)
[16:01:58.082] Build status: SCHEDULED
[16:01:58.083] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:29:0) after 4m25s
[16:06:23.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:29:0)
[16:06:23.237] Build status: SCHEDULED
[16:06:23.237] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:30:0) after 1m59s
[16:08:22.269] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:30:0)
[16:08:22.304] Build status: SCHEDULED
[16:08:22.304] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:31:0) after 2m26s
[16:10:48.578] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:31:0)
[16:10:48.624] Build status: SCHEDULED
[16:10:48.624] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:32:0) after 7m42s
[16:18:30.705] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:32:0)
[16:18:30.754] Build status: SCHEDULED
[16:18:30.754] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:33:0) after 2m34s
[16:21:04.783] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:33:0)
[16:21:04.804] Build status: SCHEDULED
[16:21:04.804] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:34:0) after 8m17s
[16:29:22.123] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:34:0)
[16:29:22.144] Build status: SCHEDULED
[16:29:22.144] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:35:0) after 9m36s
[16:38:58.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:35:0)
[16:38:58.237] Build status: SCHEDULED
[16:38:58.237] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:36:0) after 6m25s
[16:45:24.152] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:36:0)
[16:45:24.176] Build status: SCHEDULED
[16:45:24.176] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:37:0) after 3m55s
[16:49:19.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:37:0)
[16:49:19.668] Build status: SCHEDULED
[16:49:19.668] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:38:0) after 1m8s
[16:50:27.782] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:38:0)
[16:50:27.815] Build status: SCHEDULED
[16:50:27.815] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:39:0) after 9m35s
[17:00:02.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:39:0)
[17:00:02.870] Build status: SCHEDULED
[17:00:02.871] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:40:0) after 8m32s
[17:08:34.891] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:40:0)
[17:08:34.952] Build status: SCHEDULED
[17:08:34.952] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:41:0) after 6m48s
[17:15:23.017] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:41:0)
[17:15:23.073] Build status: SCHEDULED
[17:15:23.073] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:42:0) after 2m32s
[17:17:55.126] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:42:0)
[17:17:55.151] Build status: SCHEDULED
[17:17:55.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:43:0) after 3m25s
[17:21:20.174] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:43:0)
[17:21:20.194] Build status: SCHEDULED
[17:21:20.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:44:0) after 7m21s
[17:28:41.217] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:44:0)
[17:28:41.245] Build status: SCHEDULED
[17:28:41.245] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:45:0) after 6m21s
[17:35:02.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:45:0)
[17:35:02.431] Build status: SCHEDULED
[17:35:02.431] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:46:0) after 5m8s
[17:40:10.454] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:46:0)
[17:40:10.475] Build status: SCHEDULED
[17:40:10.475] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:47:0) after 7m46s
[17:47:56.541] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:47:0)
[17:47:56.572] Build status: SCHEDULED
[17:47:56.572] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:48:0) after 7m34s
[17:55:30.636] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:48:0)
[17:55:30.673] Build status: SCHEDULED
[17:55:30.673] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:49:0) after 3m14s
[17:58:44.695] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:49:0)
[17:58:44.715] Build status: SCHEDULED
[17:58:44.715] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:50:0) after 3m14s
[18:01:58.803] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:50:0)
[18:01:58.820] Build status: SCHEDULED
[18:01:58.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:51:0) after 1m56s
[18:03:54.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:51:0)
[18:03:54.863] Build status: SCHEDULED
[18:03:54.863] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:52:0) after 3m44s
[18:07:38.887] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:52:0)
[18:07:38.924] Build status: SCHEDULED
[18:07:38.924] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:53:0) after 6m15s
[18:13:53.948] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:53:0)
[18:13:53.967] Build status: SCHEDULED
[18:13:53.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:54:0) after 6m4s
[18:19:58.682] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:54:0)
[18:19:58.702] Build status: SCHEDULED
[18:19:58.702] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:55:0) after 4m14s
[18:24:12.796] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:55:0)
[18:24:12.820] Build status: SCHEDULED
[18:24:12.820] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:56:0) after 8m13s
[18:32:25.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:56:0)
[18:32:25.890] Build status: SCHEDULED
[18:32:25.890] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:57:0) after 8m6s
[18:40:32.453] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:57:0)
[18:40:32.484] Build status: SCHEDULED
[18:40:32.484] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:58:0) after 4m28s
[18:45:00.508] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:58:0)
[18:45:00.547] Build status: SCHEDULED
[18:45:00.547] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:59:0) after 2m32s
[18:47:32.568] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:59:0)
[18:47:32.614] Build status: SCHEDULED
[18:47:32.614] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:60:0) after 1m16s
[18:48:48.683] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:60:0)
[18:48:48.711] Build status: SCHEDULED
[18:48:48.711] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:61:0) after 7m43s
[18:56:31.737] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:61:0)
[18:56:31.756] Build status: SCHEDULED
[18:56:31.756] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:62:0) after 8m43s
[19:05:14.874] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:62:0)
[19:05:14.895] Build status: SCHEDULED
[19:05:14.895] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:63:0) after 3m55s
[19:09:09.918] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:63:0)
[19:09:09.945] Build status: SCHEDULED
[19:09:09.945] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:64:0) after 7m43s
[19:16:53.733] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:64:0)
[19:16:53.772] Build status: SCHEDULED
[19:16:53.772] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:65:0) after 9m0s
[19:25:54.164] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:65:0)
[19:25:54.185] Build status: SCHEDULED
[19:25:54.185] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:66:0) after 2m48s
[19:28:42.545] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:66:0)
[19:28:42.564] Build status: SCHEDULED
[19:28:42.564] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8973092376062826672:67:0) after 4m24s
[19:29:10.065] Received PubSub notification, asking Buildbucket for the build status
[19:29:10.126] Build:
{
"id": "8807662313686639041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 56957,
"createdBy": "project:chromium",
"createTime": "2022-07-25T13:28:06.065312302Z",
"endTime": "2022-07-25T19:29:08.902502Z",
"updateTime": "2022-07-25T19:29:09.529410Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d7b2925c5e8a168c416e1d92c4aa49142fd2d73c",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:29:10.126] Invocation finished in 6h1m5.710470172s with status FAILED