[20:38:10.614] New invocation is queued and will start shortly
[20:38:11.911] Starting the invocation (attempt 1)
[20:38:12.173] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0fc9e108803d6e6ca6fc6ecb7533b0cef17d53d8"
[20:38:12.173] Popped gitiles commit info from properties and tags
[20:38:12.173] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:38:12.174] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:38:12.174] Buildbucket request:
{
"requestId": "8958298010796380256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0fc9e108803d6e6ca6fc6ecb7533b0cef17d53d8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8958298010796380256"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:38:12.847] Scheduled build:
{
"id": "8792867948375848529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60165,
"createdBy": "project:chromium",
"createTime": "2023-01-04T20:38:12.290363307Z",
"updateTime": "2023-01-04T20:38:12.290363307Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0fc9e108803d6e6ca6fc6ecb7533b0cef17d53d8",
"ref": "refs/heads/main"
}
}
}
[20:38:12.847] Task URL: https://cr-buildbucket.appspot.com/build/8792867948375848529
[20:38:12.847] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:2:0) after 5m15s
[20:43:27.918] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:2:0)
[20:43:27.946] Build status: SCHEDULED
[20:43:27.946] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:3:0) after 6m28s
[20:49:56.242] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:3:0)
[20:49:56.271] Build status: SCHEDULED
[20:49:56.271] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:4:0) after 9m37s
[20:59:33.301] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:4:0)
[20:59:33.325] Build status: SCHEDULED
[20:59:33.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:5:0) after 1m49s
[21:01:22.374] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:5:0)
[21:01:22.400] Build status: SCHEDULED
[21:01:22.400] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:6:0) after 9m25s
[21:10:47.446] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:6:0)
[21:10:47.470] Build status: SCHEDULED
[21:10:47.470] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:7:0) after 2m7s
[21:12:54.501] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:7:0)
[21:12:54.521] Build status: SCHEDULED
[21:12:54.521] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:8:0) after 7m42s
[21:20:36.543] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:8:0)
[21:20:36.586] Build status: SCHEDULED
[21:20:36.586] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:9:0) after 2m53s
[21:23:29.611] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:9:0)
[21:23:29.634] Build status: SCHEDULED
[21:23:29.634] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:10:0) after 3m54s
[21:27:24.046] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:10:0)
[21:27:24.075] Build status: SCHEDULED
[21:27:24.075] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:11:0) after 1m4s
[21:28:28.100] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:11:0)
[21:28:28.128] Build status: SCHEDULED
[21:28:28.128] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:12:0) after 5m39s
[21:34:07.857] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:12:0)
[21:34:07.969] Build status: SCHEDULED
[21:34:07.969] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:13:0) after 5m30s
[21:39:38.001] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:13:0)
[21:39:38.037] Build status: SCHEDULED
[21:39:38.037] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:14:0) after 7m22s
[21:47:00.069] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:14:0)
[21:47:00.099] Build status: SCHEDULED
[21:47:00.099] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:15:0) after 6m29s
[21:53:29.562] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:15:0)
[21:53:29.588] Build status: SCHEDULED
[21:53:29.588] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:16:0) after 6m26s
[21:59:55.731] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:16:0)
[21:59:55.799] Build status: SCHEDULED
[21:59:55.799] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:17:0) after 5m43s
[22:05:38.931] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:17:0)
[22:05:38.952] Build status: SCHEDULED
[22:05:38.952] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:18:0) after 4m17s
[22:09:55.975] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:18:0)
[22:09:55.997] Build status: SCHEDULED
[22:09:55.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:19:0) after 2m36s
[22:12:32.439] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:19:0)
[22:12:32.469] Build status: SCHEDULED
[22:12:32.469] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:20:0) after 9m26s
[22:21:58.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:20:0)
[22:21:58.542] Build status: SCHEDULED
[22:21:58.542] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:21:0) after 8m21s
[22:30:19.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:21:0)
[22:30:19.608] Build status: SCHEDULED
[22:30:19.608] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:22:0) after 5m11s
[22:35:30.691] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:22:0)
[22:35:30.712] Build status: SCHEDULED
[22:35:30.712] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:23:0) after 2m23s
[22:37:53.883] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:23:0)
[22:37:53.907] Build status: SCHEDULED
[22:37:53.907] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:24:0) after 5m35s
[22:43:28.938] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:24:0)
[22:43:28.964] Build status: SCHEDULED
[22:43:28.964] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:25:0) after 7m55s
[22:51:23.990] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:25:0)
[22:51:24.011] Build status: SCHEDULED
[22:51:24.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:26:0) after 9m33s
[23:00:57.177] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:26:0)
[23:00:57.200] Build status: SCHEDULED
[23:00:57.200] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:27:0) after 7m42s
[23:08:39.557] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:27:0)
[23:08:39.578] Build status: SCHEDULED
[23:08:39.578] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:28:0) after 3m58s
[23:12:37.612] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:28:0)
[23:12:37.636] Build status: SCHEDULED
[23:12:37.636] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:29:0) after 8m37s
[23:21:14.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:29:0)
[23:21:14.717] Build status: SCHEDULED
[23:21:14.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:30:0) after 3m28s
[23:24:42.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:30:0)
[23:24:43.031] Build status: SCHEDULED
[23:24:43.031] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:31:0) after 2m37s
[23:27:20.061] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:31:0)
[23:27:20.118] Build status: SCHEDULED
[23:27:20.118] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:32:0) after 9m5s
[23:36:25.130] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:32:0)
[23:36:25.149] Build status: SCHEDULED
[23:36:25.149] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:33:0) after 1m31s
[23:37:56.411] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:33:0)
[23:37:56.458] Build status: SCHEDULED
[23:37:56.458] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:34:0) after 4m39s
[23:42:35.493] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:34:0)
[23:42:35.516] Build status: SCHEDULED
[23:42:35.516] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:35:0) after 4m13s
[23:46:48.689] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:35:0)
[23:46:48.717] Build status: SCHEDULED
[23:46:48.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:36:0) after 6m41s
[23:53:29.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:36:0)
[23:53:29.765] Build status: SCHEDULED
[23:53:29.765] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:37:0) after 6m29s
[23:59:58.812] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:37:0)
[23:59:58.834] Build status: SCHEDULED
[23:59:58.834] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:38:0) after 9m6s
[00:09:04.996] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:38:0)
[00:09:05.020] Build status: SCHEDULED
[00:09:05.020] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:39:0) after 6m55s
[00:16:00.149] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:39:0)
[00:16:00.173] Build status: SCHEDULED
[00:16:00.173] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:40:0) after 2m48s
[00:18:48.410] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:40:0)
[00:18:48.433] Build status: SCHEDULED
[00:18:48.433] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:41:0) after 6m6s
[00:24:54.538] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:41:0)
[00:24:54.566] Build status: SCHEDULED
[00:24:54.566] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:42:0) after 1m8s
[00:26:02.795] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:42:0)
[00:26:02.816] Build status: SCHEDULED
[00:26:02.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:43:0) after 3m20s
[00:29:22.841] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:43:0)
[00:29:22.862] Build status: SCHEDULED
[00:29:22.862] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:44:0) after 5m55s
[00:35:17.906] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:44:0)
[00:35:17.930] Build status: SCHEDULED
[00:35:17.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:45:0) after 5m23s
[00:40:40.955] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:45:0)
[00:40:40.979] Build status: SCHEDULED
[00:40:40.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:46:0) after 6m29s
[00:47:10.037] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:46:0)
[00:47:10.059] Build status: SCHEDULED
[00:47:10.060] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:47:0) after 9m54s
[00:57:04.163] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:47:0)
[00:57:04.189] Build status: SCHEDULED
[00:57:04.189] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:48:0) after 6m30s
[01:03:34.215] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:48:0)
[01:03:34.238] Build status: SCHEDULED
[01:03:34.238] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:49:0) after 6m53s
[01:10:27.520] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:49:0)
[01:10:27.543] Build status: SCHEDULED
[01:10:27.543] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:50:0) after 4m12s
[01:14:40.113] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:50:0)
[01:14:40.133] Build status: SCHEDULED
[01:14:40.133] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:51:0) after 4m42s
[01:19:22.202] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:51:0)
[01:19:22.223] Build status: SCHEDULED
[01:19:22.223] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:52:0) after 5m22s
[01:24:44.462] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:52:0)
[01:24:44.513] Build status: SCHEDULED
[01:24:44.513] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:53:0) after 9m23s
[01:34:07.732] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:53:0)
[01:34:07.758] Build status: SCHEDULED
[01:34:07.758] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:54:0) after 2m28s
[01:36:36.508] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:54:0)
[01:36:36.532] Build status: SCHEDULED
[01:36:36.532] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:55:0) after 8m13s
[01:44:49.759] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:55:0)
[01:44:49.782] Build status: SCHEDULED
[01:44:49.782] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:56:0) after 4m59s
[01:49:48.856] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:56:0)
[01:49:48.877] Build status: SCHEDULED
[01:49:48.878] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:57:0) after 3m41s
[01:53:29.904] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:57:0)
[01:53:29.927] Build status: SCHEDULED
[01:53:29.927] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:58:0) after 7m22s
[02:00:52.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:58:0)
[02:00:52.333] Build status: SCHEDULED
[02:00:52.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:59:0) after 2m27s
[02:03:19.361] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:59:0)
[02:03:19.385] Build status: SCHEDULED
[02:03:19.385] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:60:0) after 7m46s
[02:11:05.483] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:60:0)
[02:11:05.505] Build status: SCHEDULED
[02:11:05.505] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:61:0) after 7m26s
[02:18:31.529] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:61:0)
[02:18:31.550] Build status: SCHEDULED
[02:18:31.550] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:62:0) after 9m58s
[02:28:29.676] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:62:0)
[02:28:29.701] Build status: SCHEDULED
[02:28:29.701] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:63:0) after 6m33s
[02:35:02.971] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:63:0)
[02:35:02.997] Build status: SCHEDULED
[02:35:02.997] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:64:0) after 2m38s
[02:37:41.643] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:64:0)
[02:37:41.667] Build status: SCHEDULED
[02:37:41.667] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8958298010796380256:65:0) after 8m3s
[02:39:06.202] Received PubSub notification, asking Buildbucket for the build status
[02:39:06.222] Build:
{
"id": "8792867948375848529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60165,
"createdBy": "project:chromium",
"createTime": "2023-01-04T20:38:12.290363307Z",
"endTime": "2023-01-05T02:39:05.774466Z",
"updateTime": "2023-01-05T02:39:05.774466Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0fc9e108803d6e6ca6fc6ecb7533b0cef17d53d8",
"ref": "refs/heads/main"
}
}
}
[02:39:06.222] Invocation finished in 6h0m55.623904997s with status FAILED