[20:20:46.141] New invocation is queued and will start shortly
[20:20:47.237] Starting the invocation (attempt 1)
[20:20:47.272] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8e2b8f25c455a40c7e2840dcf814686be6c72bfd"
[20:20:47.272] Popped gitiles commit info from properties and tags
[20:20:47.272] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:20:47.272] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:20:47.272] Buildbucket request:
{
"requestId": "8985115808060301040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e2b8f25c455a40c7e2840dcf814686be6c72bfd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8985115808060301040"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:20:47.767] Scheduled build:
{
"id": "8819685746141125489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 7318,
"createdBy": "project:chromium",
"createTime": "2022-03-14T20:20:47.338333842Z",
"updateTime": "2022-03-14T20:20:47.338333842Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e2b8f25c455a40c7e2840dcf814686be6c72bfd",
"ref": "refs/heads/main"
}
}
}
[20:20:47.767] Task URL: https://cr-buildbucket.appspot.com/build/8819685746141125489
[20:20:47.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:2:0) after 7m5s
[20:27:52.796] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:2:0)
[20:27:52.848] Build status: SCHEDULED
[20:27:52.849] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:3:0) after 5m34s
[20:33:26.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:3:0)
[20:33:26.900] Build status: STARTED
[20:33:26.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:4:0) after 3m0s
[20:33:54.144] Received PubSub notification, asking Buildbucket for the build status
[20:33:54.164] Build status: STARTED
[20:36:27.040] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:4:0)
[20:36:27.062] Build status: STARTED
[20:36:27.062] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:6:0) after 9m2s
[20:45:29.217] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:6:0)
[20:45:29.248] Build status: STARTED
[20:45:29.248] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:7:0) after 5m41s
[20:51:10.346] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:7:0)
[20:51:10.367] Build status: STARTED
[20:51:10.367] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:8:0) after 4m48s
[20:55:58.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:8:0)
[20:55:58.430] Build status: STARTED
[20:55:58.430] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:9:0) after 6m35s
[21:02:33.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:9:0)
[21:02:33.490] Build status: STARTED
[21:02:33.490] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:10:0) after 3m10s
[21:05:43.523] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:10:0)
[21:05:43.552] Build status: STARTED
[21:05:43.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:11:0) after 4m47s
[21:10:30.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:11:0)
[21:10:30.577] Build status: STARTED
[21:10:30.577] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:12:0) after 1m9s
[21:11:39.743] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:12:0)
[21:11:39.767] Build status: STARTED
[21:11:39.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:13:0) after 8m8s
[21:19:47.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:13:0)
[21:19:47.958] Build status: STARTED
[21:19:47.958] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:14:0) after 6m0s
[21:25:48.316] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:14:0)
[21:25:48.341] Build status: STARTED
[21:25:48.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:15:0) after 5m7s
[21:30:55.371] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:15:0)
[21:30:55.391] Build status: STARTED
[21:30:55.391] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:16:0) after 8m0s
[21:38:55.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:16:0)
[21:38:55.548] Build status: STARTED
[21:38:55.548] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:17:0) after 6m40s
[21:45:35.652] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:17:0)
[21:45:35.674] Build status: STARTED
[21:45:35.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:18:0) after 8m34s
[21:54:09.887] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:18:0)
[21:54:09.912] Build status: STARTED
[21:54:09.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:19:0) after 2m36s
[21:56:46.097] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:19:0)
[21:56:46.141] Build status: STARTED
[21:56:46.141] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:20:0) after 3m19s
[22:00:05.171] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:20:0)
[22:00:05.195] Build status: STARTED
[22:00:05.195] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:21:0) after 9m53s
[22:09:58.226] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:21:0)
[22:09:58.315] Build status: STARTED
[22:09:58.315] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:22:0) after 9m14s
[22:19:12.344] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:22:0)
[22:19:12.361] Build status: STARTED
[22:19:12.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:23:0) after 1m44s
[22:20:56.389] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:23:0)
[22:20:56.431] Build status: STARTED
[22:20:56.431] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:24:0) after 5m17s
[22:26:13.667] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:24:0)
[22:26:13.708] Build status: STARTED
[22:26:13.708] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:25:0) after 3m33s
[22:29:46.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:25:0)
[22:29:46.782] Build status: STARTED
[22:29:46.782] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:26:0) after 3m40s
[22:33:26.822] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:26:0)
[22:33:26.872] Build status: STARTED
[22:33:26.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:27:0) after 9m54s
[22:43:21.044] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:27:0)
[22:43:21.115] Build status: STARTED
[22:43:21.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:28:0) after 2m43s
[22:46:04.413] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:28:0)
[22:46:04.440] Build status: STARTED
[22:46:04.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:29:0) after 4m3s
[22:50:07.546] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:29:0)
[22:50:07.613] Build status: STARTED
[22:50:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:30:0) after 8m7s
[22:58:14.637] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:30:0)
[22:58:14.662] Build status: STARTED
[22:58:14.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:31:0) after 9m57s
[23:08:11.974] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:31:0)
[23:08:12.579] Build status: STARTED
[23:08:12.579] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:32:0) after 4m2s
[23:12:14.647] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:32:0)
[23:12:14.669] Build status: STARTED
[23:12:14.669] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:33:0) after 1m18s
[23:13:32.860] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:33:0)
[23:13:32.883] Build status: STARTED
[23:13:32.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:34:0) after 7m53s
[23:21:26.189] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:34:0)
[23:21:26.209] Build status: STARTED
[23:21:26.209] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:35:0) after 7m19s
[23:28:45.243] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:35:0)
[23:28:45.271] Build status: STARTED
[23:28:45.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:36:0) after 9m14s
[23:37:59.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:36:0)
[23:37:59.316] Build status: STARTED
[23:37:59.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:37:0) after 5m36s
[23:43:35.497] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:37:0)
[23:43:35.518] Build status: STARTED
[23:43:35.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:38:0) after 9m59s
[23:53:34.629] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:38:0)
[23:53:34.674] Build status: STARTED
[23:53:34.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:39:0) after 1m36s
[23:55:11.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:39:0)
[23:55:11.142] Build status: STARTED
[23:55:11.142] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:40:0) after 4m46s
[23:59:57.300] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:40:0)
[23:59:57.364] Build status: STARTED
[23:59:57.364] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:41:0) after 8m4s
[00:08:01.483] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:41:0)
[00:08:01.539] Build status: STARTED
[00:08:01.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:42:0) after 2m52s
[00:10:53.808] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:42:0)
[00:10:53.830] Build status: STARTED
[00:10:53.830] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:43:0) after 5m54s
[00:16:48.111] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:43:0)
[00:16:48.140] Build status: STARTED
[00:16:48.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:44:0) after 3m56s
[00:20:44.378] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:44:0)
[00:20:44.411] Build status: STARTED
[00:20:44.411] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:45:0) after 9m36s
[00:30:20.685] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:45:0)
[00:30:20.707] Build status: STARTED
[00:30:20.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:46:0) after 3m19s
[00:33:39.853] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:46:0)
[00:33:39.894] Build status: STARTED
[00:33:39.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:47:0) after 2m45s
[00:36:24.919] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:47:0)
[00:36:24.956] Build status: STARTED
[00:36:24.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:48:0) after 3m44s
[00:40:08.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:48:0)
[00:40:09.051] Build status: STARTED
[00:40:09.051] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:49:0) after 4m26s
[00:44:35.330] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:49:0)
[00:44:35.350] Build status: STARTED
[00:44:35.350] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:50:0) after 1m12s
[00:45:47.390] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:50:0)
[00:45:47.547] Build status: STARTED
[00:45:47.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:51:0) after 2m37s
[00:48:24.581] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:51:0)
[00:48:24.606] Build status: STARTED
[00:48:24.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:52:0) after 8m4s
[00:56:28.769] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:52:0)
[00:56:28.825] Build status: STARTED
[00:56:28.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:53:0) after 5m0s
[01:01:28.852] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:53:0)
[01:01:28.890] Build status: STARTED
[01:01:28.890] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:54:0) after 4m55s
[01:06:23.887] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:54:0)
[01:06:23.959] Build status: STARTED
[01:06:23.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:55:0) after 9m8s
[01:15:31.988] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:55:0)
[01:15:32.008] Build status: STARTED
[01:15:32.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:56:0) after 9m56s
[01:25:28.032] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:56:0)
[01:25:28.064] Build status: STARTED
[01:25:28.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:57:0) after 6m49s
[01:32:17.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:57:0)
[01:32:17.130] Build status: STARTED
[01:32:17.130] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:58:0) after 7m24s
[01:39:41.198] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:58:0)
[01:39:41.217] Build status: STARTED
[01:39:41.217] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:59:0) after 7m38s
[01:47:19.241] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:59:0)
[01:47:19.273] Build status: STARTED
[01:47:19.273] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:60:0) after 2m18s
[01:49:37.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:60:0)
[01:49:37.514] Build status: STARTED
[01:49:37.514] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:61:0) after 9m41s
[01:59:18.859] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:61:0)
[01:59:18.889] Build status: STARTED
[01:59:18.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:62:0) after 2m0s
[02:01:19.170] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:62:0)
[02:01:19.251] Build status: STARTED
[02:01:19.251] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:63:0) after 9m7s
[02:10:26.339] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:63:0)
[02:10:26.368] Build status: STARTED
[02:10:26.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:64:0) after 1m52s
[02:12:18.447] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:64:0)
[02:12:18.547] Build status: STARTED
[02:12:18.547] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:65:0) after 7m46s
[02:20:04.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:65:0)
[02:20:04.696] Build status: STARTED
[02:20:04.696] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:66:0) after 8m12s
[02:28:16.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:66:0)
[02:28:16.856] Build status: STARTED
[02:28:16.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8985115808060301040:67:0) after 8m21s
[02:34:24.234] Received PubSub notification, asking Buildbucket for the build status
[02:34:24.263] Build:
{
"id": "8819685746141125489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 7318,
"createdBy": "project:chromium",
"createTime": "2022-03-14T20:20:47.338333842Z",
"startTime": "2022-03-14T20:32:58.387349Z",
"endTime": "2022-03-15T02:34:23.897771389Z",
"updateTime": "2022-03-15T02:34:23.897771389Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8e2b8f25c455a40c7e2840dcf814686be6c72bfd",
"ref": "refs/heads/main"
}
}
}
[02:34:24.263] Invocation finished in 6h13m38.138018045s with status FAILED