[21:23:27.530] New invocation is queued and will start shortly
[21:23:28.877] Starting the invocation (attempt 1)
[21:23:28.912] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/37fa773ee306fd8be351a06828f34dea3f74ba15"
[21:23:28.912] Popped gitiles commit info from properties and tags
[21:23:28.912] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:23:28.912] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:23:28.912] Buildbucket request:
{
"requestId": "9017092593099008576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "37fa773ee306fd8be351a06828f34dea3f74ba15",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017092593099008576"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:23:29.568] Scheduled build:
{
"id": "8851662530857564448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3606,
"createdBy": "project:chromium",
"createTime": "2021-03-26T21:23:29.033595Z",
"updateTime": "2021-03-26T21:23:29.494566Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "37fa773ee306fd8be351a06828f34dea3f74ba15",
"ref": "refs/heads/master"
}
},
"canary": true
}
[21:23:29.568] Task URL: https://cr-buildbucket.appspot.com/build/8851662530857564448
[21:23:29.568] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:2:0) after 9m47s
[21:23:35.066] Received PubSub notification, asking Buildbucket for the build status
[21:23:35.093] Build status: STARTED
[21:33:16.606] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:2:0)
[21:33:16.637] Build status: STARTED
[21:33:16.637] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:4:0) after 1m34s
[21:34:50.688] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:4:0)
[21:34:50.714] Build status: STARTED
[21:34:50.714] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:5:0) after 4m6s
[21:38:56.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:5:0)
[21:38:56.772] Build status: STARTED
[21:38:56.772] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:6:0) after 2m24s
[21:41:20.794] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:6:0)
[21:41:20.822] Build status: STARTED
[21:41:20.822] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:7:0) after 2m58s
[21:44:19.185] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:7:0)
[21:44:19.221] Build status: STARTED
[21:44:19.221] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:8:0) after 4m59s
[21:49:18.246] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:8:0)
[21:49:18.282] Build status: STARTED
[21:49:18.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:9:0) after 3m48s
[21:53:06.407] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:9:0)
[21:53:06.443] Build status: STARTED
[21:53:06.443] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:10:0) after 7m8s
[22:00:14.480] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:10:0)
[22:00:14.522] Build status: STARTED
[22:00:14.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:11:0) after 1m25s
[22:01:39.546] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:11:0)
[22:01:39.576] Build status: STARTED
[22:01:39.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:12:0) after 9m22s
[22:11:01.659] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:12:0)
[22:11:01.697] Build status: STARTED
[22:11:01.697] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:13:0) after 8m39s
[22:19:40.762] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:13:0)
[22:19:40.832] Build status: STARTED
[22:19:40.832] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:14:0) after 8m55s
[22:28:35.850] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:14:0)
[22:28:35.894] Build status: STARTED
[22:28:35.894] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:15:0) after 1m48s
[22:30:23.877] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:15:0)
[22:30:23.904] Build status: STARTED
[22:30:23.904] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:16:0) after 3m28s
[22:33:51.927] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:16:0)
[22:33:51.955] Build status: STARTED
[22:33:51.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:17:0) after 2m51s
[22:36:42.972] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:17:0)
[22:36:43.091] Build status: STARTED
[22:36:43.091] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:18:0) after 4m32s
[22:41:15.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:18:0)
[22:41:15.136] Build status: STARTED
[22:41:15.136] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:19:0) after 8m12s
[22:49:28.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:19:0)
[22:49:28.156] Build status: STARTED
[22:49:28.156] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:20:0) after 1m40s
[22:51:08.181] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:20:0)
[22:51:08.230] Build status: STARTED
[22:51:08.230] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:21:0) after 7m39s
[22:58:47.683] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:21:0)
[22:58:47.708] Build status: STARTED
[22:58:47.708] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:22:0) after 8m20s
[23:07:07.823] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:22:0)
[23:07:07.855] Build status: STARTED
[23:07:07.855] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:23:0) after 2m57s
[23:10:05.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:23:0)
[23:10:05.190] Build status: STARTED
[23:10:05.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:24:0) after 8m34s
[23:18:39.264] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:24:0)
[23:18:39.290] Build status: STARTED
[23:18:39.290] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:25:0) after 7m7s
[23:25:46.307] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:25:0)
[23:25:46.339] Build status: STARTED
[23:25:46.339] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:26:0) after 9m13s
[23:34:59.397] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:26:0)
[23:34:59.423] Build status: STARTED
[23:34:59.423] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:27:0) after 5m54s
[23:40:53.615] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:27:0)
[23:40:53.649] Build status: STARTED
[23:40:53.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:28:0) after 3m35s
[23:44:28.703] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:28:0)
[23:44:28.744] Build status: STARTED
[23:44:28.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:29:0) after 3m16s
[23:47:44.801] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:29:0)
[23:47:44.828] Build status: STARTED
[23:47:44.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:30:0) after 3m29s
[23:51:14.171] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:30:0)
[23:51:14.199] Build status: STARTED
[23:51:14.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:31:0) after 5m53s
[23:57:07.219] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:31:0)
[23:57:07.270] Build status: STARTED
[23:57:07.270] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:32:0) after 9m23s
[00:06:30.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:32:0)
[00:06:30.906] Build status: STARTED
[00:06:30.906] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:33:0) after 9m56s
[00:16:27.403] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:33:0)
[00:16:27.437] Build status: STARTED
[00:16:27.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:34:0) after 7m1s
[00:23:28.477] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:34:0)
[00:23:28.511] Build status: STARTED
[00:23:28.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:35:0) after 1m55s
[00:25:23.588] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:35:0)
[00:25:23.619] Build status: STARTED
[00:25:23.619] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:36:0) after 2m22s
[00:27:45.638] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:36:0)
[00:27:45.804] Build status: STARTED
[00:27:45.804] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:37:0) after 2m47s
[00:30:33.252] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:37:0)
[00:30:33.336] Build status: STARTED
[00:30:33.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:38:0) after 3m54s
[00:34:27.376] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:38:0)
[00:34:27.426] Build status: STARTED
[00:34:27.426] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:39:0) after 7m28s
[00:41:55.450] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:39:0)
[00:41:55.477] Build status: STARTED
[00:41:55.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:40:0) after 9m15s
[00:51:10.898] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:40:0)
[00:51:10.953] Build status: STARTED
[00:51:10.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:41:0) after 8m44s
[00:59:54.975] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:41:0)
[00:59:55.024] Build status: STARTED
[00:59:55.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:42:0) after 3m50s
[01:03:45.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:42:0)
[01:03:45.220] Build status: STARTED
[01:03:45.220] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:43:0) after 7m32s
[01:11:17.691] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:43:0)
[01:11:17.720] Build status: STARTED
[01:11:17.720] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:44:0) after 5m9s
[01:16:26.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:44:0)
[01:16:26.940] Build status: STARTED
[01:16:26.940] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:45:0) after 2m2s
[01:18:29.075] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:45:0)
[01:18:29.104] Build status: STARTED
[01:18:29.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:46:0) after 2m24s
[01:20:53.229] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:46:0)
[01:20:53.257] Build status: STARTED
[01:20:53.258] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:47:0) after 1m22s
[01:22:15.735] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:47:0)
[01:22:15.766] Build status: STARTED
[01:22:15.766] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:48:0) after 1m58s
[01:24:13.945] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:48:0)
[01:24:13.978] Build status: STARTED
[01:24:13.978] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:49:0) after 5m22s
[01:29:36.037] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:49:0)
[01:29:36.064] Build status: STARTED
[01:29:36.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:50:0) after 8m3s
[01:37:39.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:50:0)
[01:37:39.122] Build status: STARTED
[01:37:39.122] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:51:0) after 4m17s
[01:41:56.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:51:0)
[01:41:56.169] Build status: STARTED
[01:41:56.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:52:0) after 4m54s
[01:46:50.194] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:52:0)
[01:46:50.222] Build status: STARTED
[01:46:50.222] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:53:0) after 6m12s
[01:53:02.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:53:0)
[01:53:02.615] Build status: STARTED
[01:53:02.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:54:0) after 5m0s
[01:58:02.672] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:54:0)
[01:58:02.717] Build status: STARTED
[01:58:02.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:55:0) after 4m33s
[02:02:35.976] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:55:0)
[02:02:36.004] Build status: STARTED
[02:02:36.004] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:56:0) after 8m38s
[02:11:14.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:56:0)
[02:11:14.598] Build status: STARTED
[02:11:14.598] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:57:0) after 4m32s
[02:15:46.655] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:57:0)
[02:15:46.685] Build status: STARTED
[02:15:46.685] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:58:0) after 8m27s
[02:24:13.906] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:58:0)
[02:24:13.940] Build status: STARTED
[02:24:13.940] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:59:0) after 6m35s
[02:30:49.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:59:0)
[02:30:49.173] Build status: STARTED
[02:30:49.173] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:60:0) after 8m59s
[02:39:48.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:60:0)
[02:39:48.223] Build status: STARTED
[02:39:48.223] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:61:0) after 4m25s
[02:44:13.244] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:61:0)
[02:44:13.271] Build status: STARTED
[02:44:13.271] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:62:0) after 3m15s
[02:47:28.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:62:0)
[02:47:28.606] Build status: STARTED
[02:47:28.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:63:0) after 6m45s
[02:54:13.595] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:63:0)
[02:54:13.626] Build status: STARTED
[02:54:13.626] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:64:0) after 8m13s
[03:02:26.748] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:64:0)
[03:02:26.789] Build status: STARTED
[03:02:26.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:65:0) after 6m58s
[03:09:24.808] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:65:0)
[03:09:24.874] Build status: STARTED
[03:09:24.874] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:66:0) after 6m49s
[03:16:13.897] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:66:0)
[03:16:13.927] Build status: STARTED
[03:16:13.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:67:0) after 9m27s
[03:25:40.951] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:67:0)
[03:25:40.995] Build status: STARTED
[03:25:40.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:68:0) after 6m27s
[03:32:08.215] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:68:0)
[03:32:08.326] Build status: STARTED
[03:32:08.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:69:0) after 1m31s
[03:33:39.372] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:69:0)
[03:33:39.429] Build status: STARTED
[03:33:39.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:70:0) after 5m44s
[03:39:23.520] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:70:0)
[03:39:23.549] Build status: STARTED
[03:39:23.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:71:0) after 4m2s
[03:43:25.568] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:71:0)
[03:43:25.595] Build status: STARTED
[03:43:25.595] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:72:0) after 4m53s
[03:48:18.621] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:72:0)
[03:48:18.663] Build status: STARTED
[03:48:18.663] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:73:0) after 6m53s
[03:55:11.731] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:73:0)
[03:55:11.760] Build status: STARTED
[03:55:11.760] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:74:0) after 7m47s
[04:02:58.922] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:74:0)
[04:02:58.953] Build status: STARTED
[04:02:58.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:75:0) after 2m55s
[04:05:54.352] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:75:0)
[04:05:54.396] Build status: STARTED
[04:05:54.396] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:76:0) after 5m37s
[04:11:31.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:76:0)
[04:11:31.959] Build status: STARTED
[04:11:31.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:77:0) after 5m11s
[04:16:42.976] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:77:0)
[04:16:43.010] Build status: STARTED
[04:16:43.010] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:78:0) after 5m55s
[04:22:38.339] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:78:0)
[04:22:38.383] Build status: STARTED
[04:22:38.383] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:79:0) after 7m28s
[04:30:06.832] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:79:0)
[04:30:06.866] Build status: STARTED
[04:30:06.866] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:80:0) after 8m43s
[04:38:50.255] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:80:0)
[04:38:50.355] Build status: STARTED
[04:38:50.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:81:0) after 1m16s
[04:40:06.621] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:81:0)
[04:40:06.649] Build status: STARTED
[04:40:06.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:82:0) after 6m48s
[04:46:54.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:82:0)
[04:46:54.817] Build status: STARTED
[04:46:54.817] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:83:0) after 6m9s
[04:53:04.027] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:83:0)
[04:53:04.063] Build status: STARTED
[04:53:04.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:84:0) after 3m43s
[04:56:47.081] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:84:0)
[04:56:47.119] Build status: STARTED
[04:56:47.119] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:85:0) after 6m51s
[05:03:38.146] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:85:0)
[05:03:38.217] Build status: STARTED
[05:03:38.217] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:86:0) after 3m50s
[05:07:28.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:86:0)
[05:07:28.336] Build status: STARTED
[05:07:28.336] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:87:0) after 7m43s
[05:15:11.465] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:87:0)
[05:15:11.497] Build status: STARTED
[05:15:11.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:88:0) after 7m59s
[05:23:10.520] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:88:0)
[05:23:10.552] Build status: STARTED
[05:23:10.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:89:0) after 7m41s
[05:30:51.710] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:89:0)
[05:30:51.796] Build status: STARTED
[05:30:51.796] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:90:0) after 6m39s
[05:37:30.965] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:90:0)
[05:37:30.995] Build status: STARTED
[05:37:30.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:91:0) after 1m21s
[05:38:51.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:91:0)
[05:38:52.015] Build status: STARTED
[05:38:52.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:92:0) after 5m49s
[05:44:41.036] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:92:0)
[05:44:41.063] Build status: STARTED
[05:44:41.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:93:0) after 7m37s
[05:52:18.184] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:93:0)
[05:52:18.214] Build status: STARTED
[05:52:18.214] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:94:0) after 3m56s
[05:56:14.276] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:94:0)
[05:56:14.305] Build status: STARTED
[05:56:14.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:95:0) after 2m15s
[05:58:29.481] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:95:0)
[05:58:29.513] Build status: STARTED
[05:58:29.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:96:0) after 8m13s
[06:06:42.510] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:96:0)
[06:06:42.541] Build status: STARTED
[06:06:42.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:97:0) after 8m32s
[06:15:14.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:97:0)
[06:15:14.613] Build status: STARTED
[06:15:14.613] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:98:0) after 3m24s
[06:18:38.871] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:98:0)
[06:18:38.913] Build status: STARTED
[06:18:38.913] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:99:0) after 7m19s
[06:25:57.946] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:99:0)
[06:25:57.971] Build status: STARTED
[06:25:57.971] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:100:0) after 3m51s
[06:29:49.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:100:0)
[06:29:49.038] Build status: STARTED
[06:29:49.038] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:101:0) after 7m10s
[06:36:59.064] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:101:0)
[06:36:59.091] Build status: STARTED
[06:36:59.091] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:102:0) after 6m24s
[06:43:23.204] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:102:0)
[06:43:23.304] Build status: STARTED
[06:43:23.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:103:0) after 7m53s
[06:51:17.172] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:103:0)
[06:51:17.195] Build status: STARTED
[06:51:17.195] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:104:0) after 4m0s
[06:55:18.691] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:104:0)
[06:55:18.722] Build status: STARTED
[06:55:18.722] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:105:0) after 6m42s
[07:02:01.344] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:105:0)
[07:02:01.376] Build status: STARTED
[07:02:01.376] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:106:0) after 2m50s
[07:04:51.733] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:106:0)
[07:04:51.775] Build status: STARTED
[07:04:51.775] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:107:0) after 3m30s
[07:08:22.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:107:0)
[07:08:22.253] Build status: STARTED
[07:08:22.253] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:108:0) after 9m8s
[07:17:30.276] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:108:0)
[07:17:30.300] Build status: STARTED
[07:17:30.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:109:0) after 6m15s
[07:23:45.326] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:109:0)
[07:23:45.356] Build status: STARTED
[07:23:45.356] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:110:0) after 8m12s
[07:31:57.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:110:0)
[07:31:57.431] Build status: STARTED
[07:31:57.431] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:111:0) after 5m37s
[07:37:34.933] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:111:0)
[07:37:34.961] Build status: STARTED
[07:37:34.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:112:0) after 6m45s
[07:44:20.497] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:112:0)
[07:44:20.524] Build status: STARTED
[07:44:20.524] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:113:0) after 9m19s
[07:53:39.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:113:0)
[07:53:39.612] Build status: STARTED
[07:53:39.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:114:0) after 4m55s
[07:58:34.639] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:114:0)
[07:58:34.670] Build status: STARTED
[07:58:34.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:115:0) after 9m20s
[08:07:54.694] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:115:0)
[08:07:54.719] Build status: STARTED
[08:07:54.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:116:0) after 8m30s
[08:16:25.376] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:116:0)
[08:16:25.428] Build status: STARTED
[08:16:25.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:117:0) after 3m31s
[08:19:57.398] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:117:0)
[08:19:57.425] Build status: STARTED
[08:19:57.425] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:118:0) after 1m16s
[08:21:13.492] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:118:0)
[08:21:13.519] Build status: STARTED
[08:21:13.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017092593099008576:119:0) after 5m42s
[08:26:44.831] Received PubSub notification, asking Buildbucket for the build status
[08:26:44.858] Build:
{
"id": "8851662530857564448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3606,
"createdBy": "project:chromium",
"createTime": "2021-03-26T21:23:29.033595Z",
"startTime": "2021-03-26T21:23:34.533731Z",
"endTime": "2021-03-27T08:26:44.465238973Z",
"updateTime": "2021-03-27T08:26:44.465575591Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "37fa773ee306fd8be351a06828f34dea3f74ba15",
"ref": "refs/heads/master"
}
},
"canary": true
}
[08:26:44.858] Invocation finished in 11h3m17.346365852s with status FAILED