[19:53:48.873] New invocation is queued and will start shortly
[19:53:54.394] Starting the invocation (attempt 1)
[19:53:54.425] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0c658ddc56edf1e14fc3cc19aa286cb36e8f31a6"
[19:53:54.425] Popped gitiles commit info from properties and tags
[19:53:54.425] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:53:54.425] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:53:54.425] Buildbucket request:
{
"requestId": "8962105874425093152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c658ddc56edf1e14fc3cc19aa286cb36e8f31a6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8962105874425093152"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:53:55.056] Scheduled build:
{
"id": "8796675807810425121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8792,
"createdBy": "project:chromium",
"createTime": "2022-11-23T19:53:54.546531776Z",
"updateTime": "2022-11-23T19:53:54.546531776Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c658ddc56edf1e14fc3cc19aa286cb36e8f31a6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:53:55.056] Task URL: https://cr-buildbucket.appspot.com/build/8796675807810425121
[19:53:55.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:2:0) after 1m43s
[19:55:38.158] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:2:0)
[19:55:38.189] Build status: SCHEDULED
[19:55:38.189] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:3:0) after 1m30s
[19:57:08.225] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:3:0)
[19:57:08.260] Build status: SCHEDULED
[19:57:08.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:4:0) after 6m23s
[20:03:31.297] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:4:0)
[20:03:31.329] Build status: SCHEDULED
[20:03:31.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:5:0) after 2m21s
[20:05:52.529] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:5:0)
[20:05:52.552] Build status: SCHEDULED
[20:05:52.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:6:0) after 4m48s
[20:10:40.571] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:6:0)
[20:10:40.616] Build status: SCHEDULED
[20:10:40.616] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:7:0) after 5m29s
[20:16:09.639] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:7:0)
[20:16:09.668] Build status: SCHEDULED
[20:16:09.668] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:8:0) after 7m55s
[20:24:04.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:8:0)
[20:24:04.741] Build status: SCHEDULED
[20:24:04.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:9:0) after 9m48s
[20:33:52.986] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:9:0)
[20:33:53.017] Build status: SCHEDULED
[20:33:53.017] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:10:0) after 6m8s
[20:40:01.439] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:10:0)
[20:40:01.464] Build status: SCHEDULED
[20:40:01.464] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:11:0) after 8m32s
[20:48:33.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:11:0)
[20:48:33.499] Build status: SCHEDULED
[20:48:33.499] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:12:0) after 9m31s
[20:58:04.519] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:12:0)
[20:58:04.559] Build status: SCHEDULED
[20:58:04.559] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:13:0) after 1m0s
[20:59:04.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:13:0)
[20:59:04.612] Build status: SCHEDULED
[20:59:04.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:14:0) after 2m35s
[21:01:40.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:14:0)
[21:01:40.251] Build status: SCHEDULED
[21:01:40.251] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:15:0) after 8m37s
[21:10:17.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:15:0)
[21:10:17.302] Build status: SCHEDULED
[21:10:17.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:16:0) after 5m43s
[21:16:00.544] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:16:0)
[21:16:00.576] Build status: SCHEDULED
[21:16:00.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:17:0) after 6m21s
[21:22:21.786] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:17:0)
[21:22:21.892] Build status: SCHEDULED
[21:22:21.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:18:0) after 9m5s
[21:30:08.086] Received PubSub notification, asking Buildbucket for the build status
[21:30:08.154] Build status: STARTED
[21:31:27.140] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:18:0)
[21:31:27.186] Build status: STARTED
[21:31:27.186] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:20:0) after 6m4s
[21:37:31.428] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:20:0)
[21:37:31.454] Build status: STARTED
[21:37:31.454] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:21:0) after 2m44s
[21:40:15.871] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:21:0)
[21:40:15.898] Build status: STARTED
[21:40:15.898] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:22:0) after 5m17s
[21:45:33.024] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:22:0)
[21:45:33.047] Build status: STARTED
[21:45:33.047] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:23:0) after 4m31s
[21:50:04.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:23:0)
[21:50:04.115] Build status: STARTED
[21:50:04.115] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:24:0) after 1m18s
[21:51:22.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:24:0)
[21:51:22.246] Build status: STARTED
[21:51:22.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:25:0) after 4m7s
[21:55:29.257] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:25:0)
[21:55:29.295] Build status: STARTED
[21:55:29.296] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:26:0) after 2m25s
[21:57:54.478] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:26:0)
[21:57:54.531] Build status: STARTED
[21:57:54.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:27:0) after 5m26s
[22:03:20.622] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:27:0)
[22:03:20.662] Build status: STARTED
[22:03:20.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:28:0) after 1m52s
[22:05:12.984] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:28:0)
[22:05:13.008] Build status: STARTED
[22:05:13.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:29:0) after 9m51s
[22:15:04.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:29:0)
[22:15:04.149] Build status: STARTED
[22:15:04.149] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:30:0) after 3m58s
[22:19:02.246] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:30:0)
[22:19:02.268] Build status: STARTED
[22:19:02.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:31:0) after 9m27s
[22:28:29.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:31:0)
[22:28:29.431] Build status: STARTED
[22:28:29.431] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:32:0) after 7m56s
[22:36:25.501] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:32:0)
[22:36:25.530] Build status: STARTED
[22:36:25.530] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:33:0) after 6m18s
[22:42:43.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:33:0)
[22:42:43.785] Build status: STARTED
[22:42:43.785] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:34:0) after 7m33s
[22:50:17.015] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:34:0)
[22:50:17.071] Build status: STARTED
[22:50:17.071] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:35:0) after 4m21s
[22:54:38.200] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:35:0)
[22:54:38.221] Build status: STARTED
[22:54:38.221] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:36:0) after 6m38s
[23:01:16.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:36:0)
[23:01:16.295] Build status: STARTED
[23:01:16.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:37:0) after 1m24s
[23:02:40.529] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:37:0)
[23:02:40.554] Build status: STARTED
[23:02:40.554] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:38:0) after 7m35s
[23:10:15.753] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:38:0)
[23:10:15.776] Build status: STARTED
[23:10:15.776] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:39:0) after 8m50s
[23:19:06.021] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:39:0)
[23:19:06.047] Build status: STARTED
[23:19:06.047] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:40:0) after 6m31s
[23:25:37.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:40:0)
[23:25:37.110] Build status: STARTED
[23:25:37.110] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:41:0) after 2m38s
[23:28:15.545] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:41:0)
[23:28:15.567] Build status: STARTED
[23:28:15.567] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:42:0) after 5m16s
[23:33:31.607] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:42:0)
[23:33:31.631] Build status: STARTED
[23:33:31.631] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:43:0) after 2m9s
[23:35:40.666] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:43:0)
[23:35:40.827] Build status: STARTED
[23:35:40.827] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:44:0) after 5m27s
[23:41:08.145] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:44:0)
[23:41:08.172] Build status: STARTED
[23:41:08.172] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:45:0) after 2m15s
[23:43:23.410] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:45:0)
[23:43:23.445] Build status: STARTED
[23:43:23.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:46:0) after 5m0s
[23:48:23.436] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:46:0)
[23:48:23.535] Build status: STARTED
[23:48:23.535] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:47:0) after 9m4s
[23:57:27.645] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:47:0)
[23:57:27.670] Build status: STARTED
[23:57:27.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:48:0) after 1m4s
[23:58:31.694] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:48:0)
[23:58:31.724] Build status: STARTED
[23:58:31.724] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:49:0) after 1m49s
[00:00:20.831] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:49:0)
[00:00:20.863] Build status: STARTED
[00:00:20.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:50:0) after 9m48s
[00:10:08.929] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:50:0)
[00:10:08.951] Build status: STARTED
[00:10:08.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:51:0) after 6m59s
[00:17:07.977] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:51:0)
[00:17:07.999] Build status: STARTED
[00:17:07.999] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:52:0) after 9m3s
[00:26:11.904] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:52:0)
[00:26:11.927] Build status: STARTED
[00:26:11.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:53:0) after 7m59s
[00:34:11.155] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:53:0)
[00:34:12.125] Build status: STARTED
[00:34:12.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:54:0) after 2m2s
[00:36:14.180] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:54:0)
[00:36:14.205] Build status: STARTED
[00:36:14.205] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:55:0) after 6m5s
[00:42:19.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:55:0)
[00:42:19.616] Build status: STARTED
[00:42:19.616] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:56:0) after 1m9s
[00:43:28.645] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:56:0)
[00:43:28.672] Build status: STARTED
[00:43:28.672] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:57:0) after 4m5s
[00:47:33.704] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:57:0)
[00:47:33.734] Build status: STARTED
[00:47:33.735] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:58:0) after 7m30s
[00:55:03.764] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:58:0)
[00:55:03.784] Build status: STARTED
[00:55:03.784] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:59:0) after 3m54s
[00:58:58.058] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:59:0)
[00:58:58.080] Build status: STARTED
[00:58:58.080] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:60:0) after 7m30s
[01:06:28.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:60:0)
[01:06:28.197] Build status: STARTED
[01:06:28.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:61:0) after 6m22s
[01:12:50.228] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:61:0)
[01:12:50.327] Build status: STARTED
[01:12:50.327] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:62:0) after 3m41s
[01:16:31.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:62:0)
[01:16:31.395] Build status: STARTED
[01:16:31.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:63:0) after 1m20s
[01:17:51.454] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:63:0)
[01:17:51.530] Build status: STARTED
[01:17:51.530] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:64:0) after 6m21s
[01:24:12.553] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:64:0)
[01:24:12.584] Build status: STARTED
[01:24:12.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:65:0) after 9m23s
[01:33:35.626] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:65:0)
[01:33:35.653] Build status: STARTED
[01:33:35.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:8962105874425093152:66:0) after 9m38s
[01:42:02.867] Received PubSub notification, asking Buildbucket for the build status
[01:42:02.888] Build:
{
"id": "8796675807810425121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 8792,
"createdBy": "project:chromium",
"createTime": "2022-11-23T19:53:54.546531776Z",
"startTime": "2022-11-23T21:30:07.202722Z",
"endTime": "2022-11-24T01:42:02.421046655Z",
"updateTime": "2022-11-24T01:42:02.421046655Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0c658ddc56edf1e14fc3cc19aa286cb36e8f31a6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:42:02.888] Invocation finished in 5h48m14.032453002s with status FAILED