[15:24:40.189] New invocation is queued and will start shortly
[15:24:41.323] Starting the invocation (attempt 1)
[15:24:41.349] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4c7f45e7198c155127f6a5c1edd51900d5e09931"
[15:24:41.349] Popped gitiles commit info from properties and tags
[15:24:41.349] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:24:41.350] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:24:41.350] Buildbucket request:
{
"requestId": "9001804278827533248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4c7f45e7198c155127f6a5c1edd51900d5e09931",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9001804278827533248"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:24:41.856] Scheduled build:
{
"id": "8836374216892740097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 6750,
"createdBy": "project:chromium",
"createTime": "2021-09-11T15:24:41.403983084Z",
"updateTime": "2021-09-11T15:24:41.681032928Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4c7f45e7198c155127f6a5c1edd51900d5e09931",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:24:41.856] Task URL: https://cr-buildbucket.appspot.com/build/8836374216892740097
[15:24:41.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:2:0) after 2m34s
[15:27:16.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:2:0)
[15:27:16.322] Build status: SCHEDULED
[15:27:16.322] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:3:0) after 5m53s
[15:28:01.043] Received PubSub notification, asking Buildbucket for the build status
[15:28:01.073] Build status: STARTED
[15:33:09.339] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:3:0)
[15:33:09.435] Build status: STARTED
[15:33:09.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:5:0) after 5m52s
[15:39:01.453] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:5:0)
[15:39:01.487] Build status: STARTED
[15:39:01.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:6:0) after 6m28s
[15:45:30.012] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:6:0)
[15:45:30.037] Build status: STARTED
[15:45:30.037] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:7:0) after 1m10s
[15:46:40.398] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:7:0)
[15:46:44.517] Build status: STARTED
[15:46:44.517] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:8:0) after 2m14s
[15:48:58.969] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:8:0)
[15:48:58.999] Build status: STARTED
[15:48:58.999] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:9:0) after 8m40s
[15:57:39.073] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:9:0)
[15:57:39.112] Build status: STARTED
[15:57:39.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:10:0) after 7m52s
[16:05:31.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:10:0)
[16:05:31.156] Build status: STARTED
[16:05:31.156] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:11:0) after 2m36s
[16:08:07.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:11:0)
[16:08:07.987] Build status: STARTED
[16:08:07.987] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:12:0) after 7m2s
[16:15:10.115] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:12:0)
[16:15:10.151] Build status: STARTED
[16:15:10.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:13:0) after 5m8s
[16:20:18.326] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:13:0)
[16:20:18.360] Build status: STARTED
[16:20:18.360] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:14:0) after 8m39s
[16:28:57.889] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:14:0)
[16:28:57.933] Build status: STARTED
[16:28:57.933] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:15:0) after 4m0s
[16:32:58.185] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:15:0)
[16:32:58.260] Build status: STARTED
[16:32:58.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:16:0) after 4m18s
[16:37:16.280] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:16:0)
[16:37:16.309] Build status: STARTED
[16:37:16.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:17:0) after 4m22s
[16:41:38.331] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:17:0)
[16:41:38.449] Build status: STARTED
[16:41:38.449] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:18:0) after 3m1s
[16:44:39.469] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:18:0)
[16:44:39.513] Build status: STARTED
[16:44:39.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:19:0) after 2m35s
[16:47:14.536] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:19:0)
[16:47:14.571] Build status: STARTED
[16:47:14.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:20:0) after 1m10s
[16:48:24.588] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:20:0)
[16:48:24.744] Build status: STARTED
[16:48:24.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:21:0) after 9m31s
[16:57:55.764] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:21:0)
[16:57:55.792] Build status: STARTED
[16:57:55.792] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:22:0) after 5m3s
[17:02:59.810] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:22:0)
[17:02:59.850] Build status: STARTED
[17:02:59.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:23:0) after 4m33s
[17:07:32.879] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:23:0)
[17:07:32.920] Build status: STARTED
[17:07:32.920] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:24:0) after 7m9s
[17:14:41.975] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:24:0)
[17:14:42.007] Build status: STARTED
[17:14:42.007] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:25:0) after 3m6s
[17:17:48.024] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:25:0)
[17:17:48.052] Build status: STARTED
[17:17:48.052] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:26:0) after 9m1s
[17:26:49.076] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:26:0)
[17:26:49.101] Build status: STARTED
[17:26:49.101] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:27:0) after 1m9s
[17:27:58.122] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:27:0)
[17:27:58.151] Build status: STARTED
[17:27:58.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:28:0) after 2m22s
[17:30:20.165] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:28:0)
[17:30:20.198] Build status: STARTED
[17:30:20.198] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:29:0) after 4m27s
[17:34:47.285] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:29:0)
[17:34:47.312] Build status: STARTED
[17:34:47.312] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:30:0) after 4m53s
[17:39:40.352] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:30:0)
[17:39:40.384] Build status: STARTED
[17:39:40.384] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:31:0) after 2m8s
[17:41:48.404] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:31:0)
[17:41:48.444] Build status: STARTED
[17:41:48.444] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:32:0) after 4m27s
[17:46:15.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:32:0)
[17:46:15.552] Build status: STARTED
[17:46:15.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:33:0) after 9m44s
[17:55:59.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:33:0)
[17:55:59.620] Build status: STARTED
[17:55:59.620] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:34:0) after 7m17s
[18:03:16.636] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:34:0)
[18:03:16.697] Build status: STARTED
[18:03:16.697] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:35:0) after 2m16s
[18:05:32.716] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:35:0)
[18:05:32.752] Build status: STARTED
[18:05:32.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:36:0) after 9m34s
[18:15:06.804] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:36:0)
[18:15:06.836] Build status: STARTED
[18:15:06.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:37:0) after 5m58s
[18:21:04.896] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:37:0)
[18:21:04.927] Build status: STARTED
[18:21:04.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:38:0) after 8m51s
[18:29:55.950] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:38:0)
[18:29:55.981] Build status: STARTED
[18:29:55.981] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:39:0) after 6m11s
[18:36:07.001] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:39:0)
[18:36:07.231] Build status: STARTED
[18:36:07.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:40:0) after 6m27s
[18:42:34.474] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:40:0)
[18:42:34.523] Build status: STARTED
[18:42:34.523] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:41:0) after 6m46s
[18:49:21.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:41:0)
[18:49:21.858] Build status: STARTED
[18:49:21.858] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:42:0) after 2m50s
[18:52:12.242] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:42:0)
[18:52:12.277] Build status: STARTED
[18:52:12.277] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:43:0) after 3m33s
[18:55:45.304] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:43:0)
[18:55:45.332] Build status: STARTED
[18:55:45.332] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:44:0) after 7m55s
[19:03:41.197] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:44:0)
[19:03:41.235] Build status: STARTED
[19:03:41.235] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:45:0) after 6m38s
[19:10:19.259] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:45:0)
[19:10:19.293] Build status: STARTED
[19:10:19.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:46:0) after 8m44s
[19:19:03.456] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:46:0)
[19:19:03.584] Build status: STARTED
[19:19:03.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:47:0) after 1m59s
[19:21:02.752] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:47:0)
[19:21:02.785] Build status: STARTED
[19:21:02.785] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:48:0) after 5m32s
[19:26:34.807] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:48:0)
[19:26:34.834] Build status: STARTED
[19:26:34.834] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:49:0) after 7m13s
[19:33:47.916] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:49:0)
[19:33:47.952] Build status: STARTED
[19:33:47.952] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:50:0) after 2m28s
[19:36:15.986] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:50:0)
[19:36:16.018] Build status: STARTED
[19:36:16.018] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:51:0) after 1m36s
[19:37:52.041] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:51:0)
[19:37:52.071] Build status: STARTED
[19:37:52.071] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:52:0) after 8m7s
[19:46:00.263] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:52:0)
[19:46:00.292] Build status: STARTED
[19:46:00.292] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:53:0) after 7m40s
[19:53:40.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:53:0)
[19:53:40.345] Build status: STARTED
[19:53:40.345] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:54:0) after 8m5s
[20:01:45.366] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:54:0)
[20:01:45.419] Build status: STARTED
[20:01:45.419] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:55:0) after 6m33s
[20:08:18.443] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:55:0)
[20:08:18.470] Build status: STARTED
[20:08:18.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:56:0) after 7m21s
[20:15:39.496] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:56:0)
[20:15:39.574] Build status: STARTED
[20:15:39.574] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:57:0) after 4m56s
[20:20:35.696] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:57:0)
[20:20:35.728] Build status: STARTED
[20:20:35.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:58:0) after 1m37s
[20:22:12.766] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:58:0)
[20:22:12.798] Build status: STARTED
[20:22:12.798] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:59:0) after 1m11s
[20:23:23.827] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:59:0)
[20:23:23.951] Build status: STARTED
[20:23:23.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:60:0) after 2m42s
[20:26:06.093] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:60:0)
[20:26:06.140] Build status: STARTED
[20:26:06.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:61:0) after 9m2s
[20:35:08.284] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:61:0)
[20:35:08.323] Build status: STARTED
[20:35:08.323] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:62:0) after 2m14s
[20:37:22.468] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:62:0)
[20:37:22.502] Build status: STARTED
[20:37:22.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:63:0) after 8m32s
[20:45:54.559] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:63:0)
[20:45:54.681] Build status: STARTED
[20:45:54.681] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:64:0) after 3m15s
[20:49:09.820] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:64:0)
[20:49:09.851] Build status: STARTED
[20:49:09.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:65:0) after 3m50s
[20:52:59.970] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:65:0)
[20:53:00.052] Build status: STARTED
[20:53:00.052] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:66:0) after 4m27s
[20:57:27.073] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:66:0)
[20:57:27.125] Build status: STARTED
[20:57:27.125] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:67:0) after 5m45s
[21:03:12.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:67:0)
[21:03:12.260] Build status: STARTED
[21:03:12.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:68:0) after 3m28s
[21:06:40.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:68:0)
[21:06:40.510] Build status: STARTED
[21:06:40.510] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:69:0) after 9m35s
[21:16:16.243] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:69:0)
[21:16:16.281] Build status: STARTED
[21:16:16.281] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:70:0) after 8m24s
[21:24:40.339] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:70:0)
[21:24:40.368] Build status: STARTED
[21:24:40.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:71:0) after 1m16s
[21:25:56.706] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:71:0)
[21:25:56.781] Build status: STARTED
[21:25:56.781] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:72:0) after 5m56s
[21:31:53.350] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:72:0)
[21:31:53.385] Build status: STARTED
[21:31:53.385] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:73:0) after 5m48s
[21:37:41.406] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:73:0)
[21:37:41.441] Build status: STARTED
[21:37:41.441] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:74:0) after 7m37s
[21:45:18.468] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:74:0)
[21:45:18.501] Build status: STARTED
[21:45:18.501] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:75:0) after 7m6s
[21:52:24.655] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:75:0)
[21:52:24.688] Build status: STARTED
[21:52:24.688] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:76:0) after 8m42s
[22:01:06.711] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:76:0)
[22:01:06.740] Build status: STARTED
[22:01:06.740] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:77:0) after 9m12s
[22:10:19.829] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:77:0)
[22:10:19.869] Build status: STARTED
[22:10:19.869] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:78:0) after 6m52s
[22:17:11.902] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:78:0)
[22:17:11.936] Build status: STARTED
[22:17:11.936] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:79:0) after 6m37s
[22:23:48.962] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:79:0)
[22:23:48.991] Build status: STARTED
[22:23:48.991] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:80:0) after 4m55s
[22:28:44.015] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:80:0)
[22:28:44.049] Build status: STARTED
[22:28:44.049] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:81:0) after 3m48s
[22:32:32.188] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:81:0)
[22:32:32.222] Build status: STARTED
[22:32:32.222] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:82:0) after 3m41s
[22:36:13.446] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:82:0)
[22:36:13.487] Build status: STARTED
[22:36:13.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:83:0) after 3m2s
[22:39:15.507] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:83:0)
[22:39:15.604] Build status: STARTED
[22:39:15.604] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:84:0) after 6m18s
[22:45:33.722] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:84:0)
[22:45:33.816] Build status: STARTED
[22:45:33.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:85:0) after 1m41s
[22:47:15.302] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:85:0)
[22:47:15.338] Build status: STARTED
[22:47:15.338] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:86:0) after 6m18s
[22:53:33.364] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:86:0)
[22:53:33.446] Build status: STARTED
[22:53:33.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:87:0) after 5m48s
[22:59:21.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:87:0)
[22:59:21.498] Build status: STARTED
[22:59:21.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:88:0) after 4m18s
[23:03:39.526] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:88:0)
[23:03:39.558] Build status: STARTED
[23:03:39.559] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:89:0) after 4m42s
[23:08:21.662] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:89:0)
[23:08:21.717] Build status: STARTED
[23:08:21.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:90:0) after 8m18s
[23:16:39.724] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:90:0)
[23:16:39.763] Build status: STARTED
[23:16:39.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:91:0) after 1m40s
[23:18:20.098] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:91:0)
[23:18:20.206] Build status: STARTED
[23:18:20.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:92:0) after 2m53s
[23:21:13.228] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:92:0)
[23:21:13.255] Build status: STARTED
[23:21:13.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:93:0) after 6m2s
[23:27:15.278] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:93:0)
[23:27:15.310] Build status: STARTED
[23:27:15.310] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:94:0) after 8m54s
[23:36:09.941] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:94:0)
[23:36:10.026] Build status: STARTED
[23:36:10.026] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:95:0) after 6m12s
[23:42:22.121] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:95:0)
[23:42:22.149] Build status: STARTED
[23:42:22.149] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:96:0) after 7m31s
[23:49:53.400] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:96:0)
[23:49:53.429] Build status: STARTED
[23:49:53.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:97:0) after 2m20s
[23:52:13.471] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:97:0)
[23:52:13.510] Build status: STARTED
[23:52:13.510] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:98:0) after 8m43s
[00:00:56.820] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:98:0)
[00:00:57.013] Build status: STARTED
[00:00:57.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:99:0) after 7m18s
[00:08:15.358] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:99:0)
[00:08:15.394] Build status: STARTED
[00:08:15.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:100:0) after 5m49s
[00:14:04.883] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:100:0)
[00:14:04.913] Build status: STARTED
[00:14:04.913] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:101:0) after 5m6s
[00:19:11.921] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:101:0)
[00:19:11.953] Build status: STARTED
[00:19:11.953] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:102:0) after 6m40s
[00:25:51.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:102:0)
[00:25:52.021] Build status: STARTED
[00:25:52.021] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:103:0) after 2m31s
[00:28:23.043] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:103:0)
[00:28:23.083] Build status: STARTED
[00:28:23.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:104:0) after 4m31s
[00:32:54.379] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:104:0)
[00:32:54.419] Build status: STARTED
[00:32:54.419] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:105:0) after 3m24s
[00:36:18.436] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:105:0)
[00:36:18.468] Build status: STARTED
[00:36:18.468] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:106:0) after 4m3s
[00:40:21.487] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:106:0)
[00:40:21.518] Build status: STARTED
[00:40:21.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:107:0) after 4m22s
[00:44:43.527] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:107:0)
[00:44:43.560] Build status: STARTED
[00:44:43.560] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:108:0) after 4m2s
[00:48:45.628] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:108:0)
[00:48:45.658] Build status: STARTED
[00:48:45.658] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:109:0) after 9m7s
[00:57:52.785] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:109:0)
[00:57:52.977] Build status: STARTED
[00:57:52.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:110:0) after 1m47s
[00:59:40.075] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:110:0)
[00:59:40.105] Build status: STARTED
[00:59:40.105] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:111:0) after 7m24s
[01:07:04.131] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:111:0)
[01:07:04.166] Build status: STARTED
[01:07:04.166] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:112:0) after 3m2s
[01:10:06.252] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:112:0)
[01:10:06.309] Build status: STARTED
[01:10:06.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:113:0) after 1m51s
[01:11:57.430] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:113:0)
[01:11:57.460] Build status: STARTED
[01:11:57.460] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:114:0) after 4m33s
[01:16:30.550] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:114:0)
[01:16:30.588] Build status: STARTED
[01:16:30.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:115:0) after 5m13s
[01:21:43.712] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:115:0)
[01:21:43.753] Build status: STARTED
[01:21:43.753] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:116:0) after 4m36s
[01:26:20.310] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:116:0)
[01:26:20.341] Build status: STARTED
[01:26:20.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:117:0) after 9m0s
[01:35:20.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:117:0)
[01:35:20.416] Build status: STARTED
[01:35:20.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:118:0) after 7m13s
[01:42:33.438] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:118:0)
[01:42:33.569] Build status: STARTED
[01:42:33.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:119:0) after 9m24s
[01:51:57.615] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:119:0)
[01:51:57.645] Build status: STARTED
[01:51:57.645] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:120:0) after 9m26s
[02:01:23.742] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:120:0)
[02:01:23.779] Build status: STARTED
[02:01:23.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:121:0) after 5m11s
[02:06:34.824] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:121:0)
[02:06:34.857] Build status: STARTED
[02:06:34.857] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:122:0) after 6m5s
[02:12:39.878] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:122:0)
[02:12:39.909] Build status: STARTED
[02:12:39.909] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:123:0) after 9m9s
[02:21:49.051] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:123:0)
[02:21:49.157] Build status: STARTED
[02:21:49.157] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:124:0) after 2m51s
[02:24:40.264] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:124:0)
[02:24:40.298] Build status: STARTED
[02:24:40.298] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:125:0) after 1m22s
[02:26:02.404] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:125:0)
[02:26:02.474] Build status: STARTED
[02:26:02.474] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:126:0) after 6m41s
[02:32:43.569] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:126:0)
[02:32:43.603] Build status: STARTED
[02:32:43.603] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:127:0) after 6m59s
[02:39:42.626] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:127:0)
[02:39:42.655] Build status: STARTED
[02:39:42.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:128:0) after 2m24s
[02:42:06.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:128:0)
[02:42:06.704] Build status: STARTED
[02:42:06.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:129:0) after 2m22s
[02:44:28.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:129:0)
[02:44:28.783] Build status: STARTED
[02:44:28.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:130:0) after 4m33s
[02:49:01.781] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:130:0)
[02:49:01.813] Build status: STARTED
[02:49:01.813] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9001804278827533248:131:0) after 3m36s
[02:51:37.169] Received PubSub notification, asking Buildbucket for the build status
[02:51:37.195] Build:
{
"id": "8836374216892740097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 6750,
"createdBy": "project:chromium",
"createTime": "2021-09-11T15:24:41.403983084Z",
"startTime": "2021-09-11T15:28:00.043005Z",
"endTime": "2021-09-12T02:51:36.664288131Z",
"updateTime": "2021-09-12T02:51:36.664959442Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4c7f45e7198c155127f6a5c1edd51900d5e09931",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:51:37.195] Invocation finished in 11h26m57.021237612s with status FAILED