[11:24:29.779] New invocation is queued and will start shortly
[11:24:30.852] Starting the invocation (attempt 1)
[11:24:30.882] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3f1cf9b57e9a9f7f82ce62fc180437a35d1d4d5f"
[11:24:30.882] Popped gitiles commit info from properties and tags
[11:24:30.882] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:24:30.884] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:24:30.885] Buildbucket request:
{
"requestId": "8946736433667132640",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f1cf9b57e9a9f7f82ce62fc180437a35d1d4d5f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946736433667132640"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:24:31.476] Scheduled build:
{
"id": "8781306371771966385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9355,
"createdBy": "project:chromium",
"createTime": "2023-05-12T11:24:30.954926890Z",
"updateTime": "2023-05-12T11:24:30.954926890Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f1cf9b57e9a9f7f82ce62fc180437a35d1d4d5f",
"ref": "refs/heads/main"
}
}
}
[11:24:31.476] Task URL: https://cr-buildbucket.appspot.com/build/8781306371771966385
[11:24:31.476] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:2:0) after 3m50s
[11:28:21.469] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:2:0)
[11:28:21.488] Build status: SCHEDULED
[11:28:21.488] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:3:0) after 6m51s
[11:31:29.176] Received PubSub notification, asking Buildbucket for the build status
[11:31:29.199] Build status: STARTED
[11:35:12.532] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:3:0)
[11:35:12.595] Build status: STARTED
[11:35:12.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:5:0) after 6m24s
[11:41:36.637] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:5:0)
[11:41:36.662] Build status: STARTED
[11:41:36.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:6:0) after 1m0s
[11:42:36.686] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:6:0)
[11:42:36.706] Build status: STARTED
[11:42:36.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:7:0) after 8m21s
[11:50:58.003] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:7:0)
[11:50:58.029] Build status: STARTED
[11:50:58.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:8:0) after 8m20s
[11:59:18.009] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:8:0)
[11:59:18.048] Build status: STARTED
[11:59:18.048] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:9:0) after 4m55s
[12:04:13.448] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:9:0)
[12:04:13.470] Build status: STARTED
[12:04:13.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:10:0) after 6m50s
[12:11:03.491] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:10:0)
[12:11:03.517] Build status: STARTED
[12:11:03.517] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:11:0) after 2m28s
[12:13:31.539] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:11:0)
[12:13:31.567] Build status: STARTED
[12:13:31.567] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:12:0) after 2m20s
[12:15:51.656] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:12:0)
[12:15:51.675] Build status: STARTED
[12:15:51.675] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:13:0) after 6m48s
[12:22:39.901] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:13:0)
[12:22:39.956] Build status: STARTED
[12:22:39.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:14:0) after 7m52s
[12:30:32.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:14:0)
[12:30:32.521] Build status: STARTED
[12:30:32.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:15:0) after 4m49s
[12:35:21.574] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:15:0)
[12:35:21.595] Build status: STARTED
[12:35:21.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:16:0) after 2m29s
[12:37:50.703] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:16:0)
[12:37:50.729] Build status: STARTED
[12:37:50.730] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:17:0) after 2m55s
[12:40:45.747] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:17:0)
[12:40:45.769] Build status: STARTED
[12:40:45.769] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:18:0) after 9m8s
[12:49:53.805] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:18:0)
[12:49:53.826] Build status: STARTED
[12:49:53.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:19:0) after 6m34s
[12:56:28.324] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:19:0)
[12:56:28.341] Build status: STARTED
[12:56:28.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:20:0) after 9m49s
[13:06:17.364] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:20:0)
[13:06:17.382] Build status: STARTED
[13:06:17.382] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:21:0) after 6m43s
[13:13:00.387] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:21:0)
[13:13:00.418] Build status: STARTED
[13:13:00.418] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:22:0) after 1m31s
[13:14:31.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:22:0)
[13:14:31.705] Build status: STARTED
[13:14:31.705] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:23:0) after 8m55s
[13:23:26.748] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:23:0)
[13:23:26.765] Build status: STARTED
[13:23:26.765] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:24:0) after 1m15s
[13:24:41.785] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:24:0)
[13:24:41.803] Build status: STARTED
[13:24:41.804] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:25:0) after 4m20s
[13:29:01.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:25:0)
[13:29:01.960] Build status: STARTED
[13:29:01.960] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:26:0) after 3m4s
[13:32:06.036] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:26:0)
[13:32:06.058] Build status: STARTED
[13:32:06.058] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:27:0) after 1m10s
[13:33:16.277] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:27:0)
[13:33:16.299] Build status: STARTED
[13:33:16.299] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:28:0) after 6m35s
[13:39:51.331] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:28:0)
[13:39:51.352] Build status: STARTED
[13:39:51.352] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:29:0) after 7m23s
[13:47:14.369] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:29:0)
[13:47:14.444] Build status: STARTED
[13:47:14.444] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:30:0) after 6m14s
[13:53:28.460] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:30:0)
[13:53:28.487] Build status: STARTED
[13:53:28.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:31:0) after 8m2s
[14:01:30.633] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:31:0)
[14:01:30.743] Build status: STARTED
[14:01:30.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:32:0) after 3m5s
[14:04:35.853] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:32:0)
[14:04:35.872] Build status: STARTED
[14:04:35.873] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:33:0) after 6m32s
[14:11:08.148] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:33:0)
[14:11:08.181] Build status: STARTED
[14:11:08.181] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:34:0) after 6m53s
[14:18:01.260] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:34:0)
[14:18:01.294] Build status: STARTED
[14:18:01.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:35:0) after 1m15s
[14:19:16.698] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:35:0)
[14:19:16.719] Build status: STARTED
[14:19:16.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:36:0) after 5m39s
[14:24:55.920] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:36:0)
[14:24:56.132] Build status: STARTED
[14:24:56.132] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:37:0) after 4m59s
[14:29:55.625] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:37:0)
[14:29:55.654] Build status: STARTED
[14:29:55.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:38:0) after 6m33s
[14:36:28.735] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:38:0)
[14:36:28.794] Build status: STARTED
[14:36:28.794] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:39:0) after 7m10s
[14:43:38.819] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:39:0)
[14:43:38.970] Build status: STARTED
[14:43:38.970] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:40:0) after 8m12s
[14:51:51.388] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:40:0)
[14:51:51.452] Build status: STARTED
[14:51:51.452] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:41:0) after 6m40s
[14:58:31.500] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:41:0)
[14:58:31.521] Build status: STARTED
[14:58:31.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:42:0) after 1m34s
[15:00:05.580] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:42:0)
[15:00:05.599] Build status: STARTED
[15:00:05.599] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:43:0) after 1m25s
[15:01:30.584] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:43:0)
[15:01:30.603] Build status: STARTED
[15:01:30.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:44:0) after 5m52s
[15:07:22.761] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:44:0)
[15:07:22.779] Build status: STARTED
[15:07:22.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:45:0) after 5m24s
[15:12:46.841] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:45:0)
[15:12:46.862] Build status: STARTED
[15:12:46.862] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:46:0) after 8m30s
[15:21:16.992] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:46:0)
[15:21:17.015] Build status: STARTED
[15:21:17.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:47:0) after 6m3s
[15:27:20.047] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:47:0)
[15:27:20.087] Build status: STARTED
[15:27:20.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:48:0) after 8m22s
[15:35:42.292] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:48:0)
[15:35:42.314] Build status: STARTED
[15:35:42.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:49:0) after 7m25s
[15:43:07.326] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:49:0)
[15:43:07.368] Build status: STARTED
[15:43:07.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:50:0) after 7m57s
[15:51:04.573] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:50:0)
[15:51:04.598] Build status: STARTED
[15:51:04.598] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:51:0) after 7m27s
[15:58:31.799] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:51:0)
[15:58:31.817] Build status: STARTED
[15:58:31.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:52:0) after 6m48s
[16:05:19.835] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:52:0)
[16:05:19.856] Build status: STARTED
[16:05:19.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:53:0) after 5m44s
[16:11:03.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:53:0)
[16:11:03.953] Build status: STARTED
[16:11:03.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:54:0) after 9m18s
[16:20:21.986] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:54:0)
[16:20:22.014] Build status: STARTED
[16:20:22.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:55:0) after 5m43s
[16:26:05.004] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:55:0)
[16:26:05.046] Build status: STARTED
[16:26:05.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:56:0) after 6m55s
[16:33:00.200] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:56:0)
[16:33:00.242] Build status: STARTED
[16:33:00.242] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:57:0) after 7m55s
[16:40:55.437] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:57:0)
[16:40:55.457] Build status: STARTED
[16:40:55.457] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:58:0) after 7m25s
[16:48:20.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:58:0)
[16:48:20.497] Build status: STARTED
[16:48:20.497] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:59:0) after 1m22s
[16:49:42.536] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:59:0)
[16:49:42.555] Build status: STARTED
[16:49:42.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:60:0) after 6m4s
[16:55:46.827] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:60:0)
[16:55:46.849] Build status: STARTED
[16:55:46.849] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:61:0) after 3m16s
[16:59:02.841] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:61:0)
[16:59:02.885] Build status: STARTED
[16:59:02.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:62:0) after 5m20s
[17:04:22.922] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:62:0)
[17:04:22.980] Build status: STARTED
[17:04:22.980] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:63:0) after 9m30s
[17:13:53.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:63:0)
[17:13:53.492] Build status: STARTED
[17:13:53.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:64:0) after 2m14s
[17:16:07.563] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:64:0)
[17:16:07.602] Build status: STARTED
[17:16:07.602] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:65:0) after 5m52s
[17:21:59.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:65:0)
[17:21:59.701] Build status: STARTED
[17:21:59.702] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8946736433667132640:66:0) after 9m18s
[17:30:44.376] Received PubSub notification, asking Buildbucket for the build status
[17:30:44.395] Build:
{
"id": "8781306371771966385",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 9355,
"createdBy": "project:chromium",
"createTime": "2023-05-12T11:24:30.954926890Z",
"startTime": "2023-05-12T11:31:28.685317Z",
"endTime": "2023-05-12T17:30:43.821000843Z",
"updateTime": "2023-05-12T17:30:43.821000843Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3f1cf9b57e9a9f7f82ce62fc180437a35d1d4d5f",
"ref": "refs/heads/main"
}
}
}
[17:30:44.395] Invocation finished in 6h6m14.631990413s with status FAILED