[09:40:05.581] New invocation is queued and will start shortly
[09:40:07.302] Starting the invocation (attempt 1)
[09:40:07.334] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8d8a99913d260246cc34d899ef1ba4a50d3bad1d"
[09:40:07.334] Popped gitiles commit info from properties and tags
[09:40:07.334] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:40:07.334] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:40:07.334] Buildbucket request:
{
"requestId": "8956889862388903088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8d8a99913d260246cc34d899ef1ba4a50d3bad1d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956889862388903088"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:40:07.966] Scheduled build:
{
"id": "8791459799819319025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60227,
"createdBy": "project:chromium",
"createTime": "2023-01-20T09:40:07.402642310Z",
"updateTime": "2023-01-20T09:40:07.402642310Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8d8a99913d260246cc34d899ef1ba4a50d3bad1d",
"ref": "refs/heads/main"
}
}
}
[09:40:07.966] Task URL: https://cr-buildbucket.appspot.com/build/8791459799819319025
[09:40:07.966] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:2:0) after 2m59s
[09:43:07.218] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:2:0)
[09:43:07.261] Build status: SCHEDULED
[09:43:07.261] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:3:0) after 8m14s
[09:51:21.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:3:0)
[09:51:21.325] Build status: SCHEDULED
[09:51:21.325] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:4:0) after 3m42s
[09:55:03.383] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:4:0)
[09:55:03.406] Build status: SCHEDULED
[09:55:03.406] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:5:0) after 5m7s
[10:00:10.535] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:5:0)
[10:00:10.569] Build status: SCHEDULED
[10:00:10.569] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:6:0) after 5m57s
[10:06:07.590] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:6:0)
[10:06:07.611] Build status: SCHEDULED
[10:06:07.611] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:7:0) after 5m55s
[10:12:02.633] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:7:0)
[10:12:02.659] Build status: SCHEDULED
[10:12:02.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:8:0) after 6m19s
[10:18:21.877] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:8:0)
[10:18:21.902] Build status: SCHEDULED
[10:18:21.902] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:9:0) after 7m35s
[10:25:56.990] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:9:0)
[10:25:57.022] Build status: SCHEDULED
[10:25:57.022] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:10:0) after 9m43s
[10:35:40.042] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:10:0)
[10:35:40.070] Build status: SCHEDULED
[10:35:40.070] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:11:0) after 2m12s
[10:37:52.295] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:11:0)
[10:37:52.321] Build status: SCHEDULED
[10:37:52.321] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:12:0) after 6m15s
[10:44:07.296] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:12:0)
[10:44:07.318] Build status: SCHEDULED
[10:44:07.318] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:13:0) after 5m6s
[10:49:13.642] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:13:0)
[10:49:13.661] Build status: SCHEDULED
[10:49:13.661] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:14:0) after 1m41s
[10:50:54.712] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:14:0)
[10:50:54.734] Build status: SCHEDULED
[10:50:54.734] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:15:0) after 8m17s
[10:59:12.075] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:15:0)
[10:59:12.104] Build status: SCHEDULED
[10:59:12.104] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:16:0) after 4m39s
[11:03:51.123] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:16:0)
[11:03:51.151] Build status: SCHEDULED
[11:03:51.151] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:17:0) after 1m13s
[11:05:04.250] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:17:0)
[11:05:04.270] Build status: SCHEDULED
[11:05:04.270] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:18:0) after 7m18s
[11:12:22.464] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:18:0)
[11:12:22.491] Build status: SCHEDULED
[11:12:22.491] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:19:0) after 2m2s
[11:14:24.837] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:19:0)
[11:14:24.861] Build status: SCHEDULED
[11:14:24.861] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:20:0) after 3m33s
[11:17:57.955] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:20:0)
[11:17:57.979] Build status: SCHEDULED
[11:17:57.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:21:0) after 4m9s
[11:22:07.052] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:21:0)
[11:22:07.132] Build status: SCHEDULED
[11:22:07.132] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:22:0) after 1m9s
[11:23:16.247] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:22:0)
[11:23:16.292] Build status: SCHEDULED
[11:23:16.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:23:0) after 9m34s
[11:32:50.688] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:23:0)
[11:32:50.731] Build status: SCHEDULED
[11:32:50.731] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:24:0) after 5m1s
[11:37:51.752] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:24:0)
[11:37:51.779] Build status: SCHEDULED
[11:37:51.779] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:25:0) after 4m8s
[11:41:59.802] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:25:0)
[11:41:59.882] Build status: SCHEDULED
[11:41:59.882] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:26:0) after 2m18s
[11:44:17.905] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:26:0)
[11:44:17.923] Build status: SCHEDULED
[11:44:17.923] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:27:0) after 6m59s
[11:51:17.083] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:27:0)
[11:51:17.104] Build status: SCHEDULED
[11:51:17.104] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:28:0) after 5m10s
[11:56:27.166] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:28:0)
[11:56:27.194] Build status: SCHEDULED
[11:56:27.194] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:29:0) after 6m18s
[12:02:45.311] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:29:0)
[12:02:45.330] Build status: SCHEDULED
[12:02:45.330] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:30:0) after 7m24s
[12:10:09.353] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:30:0)
[12:10:09.413] Build status: SCHEDULED
[12:10:09.413] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:31:0) after 7m1s
[12:17:10.414] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:31:0)
[12:17:10.525] Build status: SCHEDULED
[12:17:10.525] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:32:0) after 9m35s
[12:26:45.696] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:32:0)
[12:26:45.719] Build status: SCHEDULED
[12:26:45.719] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:33:0) after 6m53s
[12:33:38.792] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:33:0)
[12:33:38.816] Build status: SCHEDULED
[12:33:38.816] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:34:0) after 8m15s
[12:41:54.064] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:34:0)
[12:41:54.085] Build status: SCHEDULED
[12:41:54.085] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:35:0) after 6m24s
[12:48:18.268] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:35:0)
[12:48:18.292] Build status: SCHEDULED
[12:48:18.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:36:0) after 8m4s
[12:56:22.329] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:36:0)
[12:56:22.367] Build status: SCHEDULED
[12:56:22.367] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:37:0) after 7m29s
[13:03:51.491] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:37:0)
[13:03:51.511] Build status: SCHEDULED
[13:03:51.511] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:38:0) after 3m48s
[13:07:39.637] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:38:0)
[13:07:39.659] Build status: SCHEDULED
[13:07:39.659] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:39:0) after 7m7s
[13:14:46.704] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:39:0)
[13:14:46.726] Build status: SCHEDULED
[13:14:46.726] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:40:0) after 6m8s
[13:20:54.738] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:40:0)
[13:20:54.784] Build status: SCHEDULED
[13:20:54.784] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:41:0) after 3m52s
[13:24:46.813] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:41:0)
[13:24:46.922] Build status: SCHEDULED
[13:24:46.922] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:42:0) after 5m1s
[13:29:47.951] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:42:0)
[13:29:47.971] Build status: SCHEDULED
[13:29:47.971] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:43:0) after 6m39s
[13:36:26.991] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:43:0)
[13:36:27.011] Build status: SCHEDULED
[13:36:27.011] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:44:0) after 9m14s
[13:45:41.310] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:44:0)
[13:45:41.339] Build status: SCHEDULED
[13:45:41.339] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:45:0) after 5m55s
[13:51:36.634] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:45:0)
[13:51:36.657] Build status: SCHEDULED
[13:51:36.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:46:0) after 8m35s
[14:00:11.774] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:46:0)
[14:00:11.808] Build status: SCHEDULED
[14:00:11.808] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:47:0) after 7m45s
[14:07:56.896] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:47:0)
[14:07:56.921] Build status: SCHEDULED
[14:07:56.921] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:48:0) after 8m8s
[14:16:05.040] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:48:0)
[14:16:05.065] Build status: SCHEDULED
[14:16:05.065] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:49:0) after 3m20s
[14:19:25.192] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:49:0)
[14:19:25.211] Build status: SCHEDULED
[14:19:25.211] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:50:0) after 6m13s
[14:25:38.241] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:50:0)
[14:25:38.263] Build status: SCHEDULED
[14:25:38.263] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:51:0) after 6m58s
[14:32:36.483] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:51:0)
[14:32:36.518] Build status: SCHEDULED
[14:32:36.518] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:52:0) after 4m3s
[14:36:39.776] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:52:0)
[14:36:39.814] Build status: SCHEDULED
[14:36:39.814] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:53:0) after 9m40s
[14:46:20.302] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:53:0)
[14:46:20.322] Build status: SCHEDULED
[14:46:20.322] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:54:0) after 3m34s
[14:49:54.548] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:54:0)
[14:49:54.584] Build status: SCHEDULED
[14:49:54.584] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:55:0) after 1m35s
[14:51:29.621] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:55:0)
[14:51:29.644] Build status: SCHEDULED
[14:51:29.644] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:56:0) after 6m6s
[14:57:35.674] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:56:0)
[14:57:35.709] Build status: SCHEDULED
[14:57:35.709] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:57:0) after 6m30s
[15:04:05.971] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:57:0)
[15:04:06.006] Build status: SCHEDULED
[15:04:06.006] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:58:0) after 6m26s
[15:10:32.321] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:58:0)
[15:10:32.344] Build status: SCHEDULED
[15:10:32.344] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:59:0) after 3m55s
[15:14:27.362] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:59:0)
[15:14:27.437] Build status: SCHEDULED
[15:14:27.437] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:60:0) after 5m8s
[15:19:35.956] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:60:0)
[15:19:35.978] Build status: SCHEDULED
[15:19:35.978] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:61:0) after 4m32s
[15:24:08.429] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:61:0)
[15:24:08.454] Build status: SCHEDULED
[15:24:08.454] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:62:0) after 4m24s
[15:28:32.689] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:62:0)
[15:28:32.709] Build status: SCHEDULED
[15:28:32.709] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:63:0) after 7m3s
[15:35:35.828] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:63:0)
[15:35:35.868] Build status: SCHEDULED
[15:35:35.868] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:64:0) after 2m59s
[15:38:35.109] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:64:0)
[15:38:35.137] Build status: SCHEDULED
[15:38:35.137] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956889862388903088:65:0) after 9m51s
[15:41:07.356] Received PubSub notification, asking Buildbucket for the build status
[15:41:07.375] Build:
{
"id": "8791459799819319025",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60227,
"createdBy": "project:chromium",
"createTime": "2023-01-20T09:40:07.402642310Z",
"endTime": "2023-01-20T15:41:06.522447Z",
"updateTime": "2023-01-20T15:41:06.522447Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8d8a99913d260246cc34d899ef1ba4a50d3bad1d",
"ref": "refs/heads/main"
}
}
}
[15:41:07.375] Invocation finished in 6h1m1.807218862s with status FAILED