[18:37:01.188] New invocation is queued and will start shortly
[18:37:02.330] Starting the invocation (attempt 1)
[18:37:02.396] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/da8928ac887e2611fbdd71a02eeebb7e89222e3c"
[18:37:02.396] Popped gitiles commit info from properties and tags
[18:37:02.396] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:37:02.396] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:37:02.396] Buildbucket request:
{
"requestId": "9015019334310874128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "da8928ac887e2611fbdd71a02eeebb7e89222e3c",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015019334310874128"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:37:02.921] Scheduled build:
{
"id": "8849589272302997120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3654,
"createdBy": "project:chromium",
"createTime": "2021-04-18T18:37:02.468309Z",
"updateTime": "2021-04-18T18:37:02.854892Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "da8928ac887e2611fbdd71a02eeebb7e89222e3c",
"ref": "refs/heads/master"
}
}
}
[18:37:02.921] Task URL: https://cr-buildbucket.appspot.com/build/8849589272302997120
[18:37:02.921] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:2:0) after 6m9s
[18:37:24.361] Received PubSub notification, asking Buildbucket for the build status
[18:37:24.396] Build status: STARTED
[18:43:11.943] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:2:0)
[18:43:11.973] Build status: STARTED
[18:43:11.973] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:4:0) after 9m26s
[18:52:37.989] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:4:0)
[18:52:38.033] Build status: STARTED
[18:52:38.033] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:5:0) after 4m19s
[18:56:57.054] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:5:0)
[18:56:57.083] Build status: STARTED
[18:56:57.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:6:0) after 5m9s
[19:02:06.098] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:6:0)
[19:02:06.126] Build status: STARTED
[19:02:06.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:7:0) after 1m21s
[19:03:27.144] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:7:0)
[19:03:27.173] Build status: STARTED
[19:03:27.173] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:8:0) after 3m44s
[19:07:11.199] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:8:0)
[19:07:11.233] Build status: STARTED
[19:07:11.233] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:9:0) after 6m23s
[19:13:34.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:9:0)
[19:13:34.340] Build status: STARTED
[19:13:34.340] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:10:0) after 6m30s
[19:20:04.409] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:10:0)
[19:20:04.437] Build status: STARTED
[19:20:04.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:11:0) after 5m36s
[19:25:40.456] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:11:0)
[19:25:40.507] Build status: STARTED
[19:25:40.507] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:12:0) after 4m20s
[19:30:00.527] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:12:0)
[19:30:00.555] Build status: STARTED
[19:30:00.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:13:0) after 8m35s
[19:38:35.573] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:13:0)
[19:38:35.599] Build status: STARTED
[19:38:35.599] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:14:0) after 1m34s
[19:40:09.615] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:14:0)
[19:40:09.646] Build status: STARTED
[19:40:09.646] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:15:0) after 9m15s
[19:49:24.665] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:15:0)
[19:49:24.695] Build status: STARTED
[19:49:24.695] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:16:0) after 5m45s
[19:55:09.714] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:16:0)
[19:55:09.841] Build status: STARTED
[19:55:09.841] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:17:0) after 4m11s
[19:59:20.858] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:17:0)
[19:59:20.887] Build status: STARTED
[19:59:20.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:18:0) after 3m34s
[20:02:54.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:18:0)
[20:02:54.948] Build status: STARTED
[20:02:54.948] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:19:0) after 6m16s
[20:09:10.964] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:19:0)
[20:09:10.993] Build status: STARTED
[20:09:10.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:20:0) after 8m44s
[20:17:55.081] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:20:0)
[20:17:55.109] Build status: STARTED
[20:17:55.109] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:21:0) after 9m42s
[20:27:37.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:21:0)
[20:27:37.160] Build status: STARTED
[20:27:37.160] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:22:0) after 6m20s
[20:33:57.371] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:22:0)
[20:33:57.398] Build status: STARTED
[20:33:57.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:23:0) after 9m18s
[20:43:15.417] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:23:0)
[20:43:15.556] Build status: STARTED
[20:43:15.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:24:0) after 3m40s
[20:46:55.578] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:24:0)
[20:46:55.618] Build status: STARTED
[20:46:55.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:25:0) after 6m4s
[20:52:59.641] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:25:0)
[20:52:59.670] Build status: STARTED
[20:52:59.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:26:0) after 6m11s
[20:59:10.824] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:26:0)
[20:59:10.858] Build status: STARTED
[20:59:10.858] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:27:0) after 2m27s
[21:01:37.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:27:0)
[21:01:37.903] Build status: STARTED
[21:01:37.903] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:28:0) after 1m40s
[21:03:18.387] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:28:0)
[21:03:18.416] Build status: STARTED
[21:03:18.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:29:0) after 3m8s
[21:06:26.607] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:29:0)
[21:06:26.654] Build status: STARTED
[21:06:26.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:30:0) after 4m13s
[21:10:39.767] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:30:0)
[21:10:39.800] Build status: STARTED
[21:10:39.800] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:31:0) after 7m55s
[21:18:34.818] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:31:0)
[21:18:34.856] Build status: STARTED
[21:18:34.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:32:0) after 3m3s
[21:21:38.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:32:0)
[21:21:38.240] Build status: STARTED
[21:21:38.240] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:33:0) after 5m48s
[21:27:26.259] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:33:0)
[21:27:26.285] Build status: STARTED
[21:27:26.285] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:34:0) after 2m37s
[21:30:03.330] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:34:0)
[21:30:03.363] Build status: STARTED
[21:30:03.363] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:35:0) after 4m47s
[21:34:50.383] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:35:0)
[21:34:50.406] Build status: STARTED
[21:34:50.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:36:0) after 9m28s
[21:44:18.426] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:36:0)
[21:44:18.451] Build status: STARTED
[21:44:18.451] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:37:0) after 6m25s
[21:50:43.469] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:37:0)
[21:50:43.500] Build status: STARTED
[21:50:43.500] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:38:0) after 1m23s
[21:52:06.638] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:38:0)
[21:52:06.666] Build status: STARTED
[21:52:06.666] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:39:0) after 9m2s
[22:01:08.885] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:39:0)
[22:01:08.912] Build status: STARTED
[22:01:08.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:40:0) after 1m24s
[22:02:33.420] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:40:0)
[22:02:33.446] Build status: STARTED
[22:02:33.446] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:41:0) after 2m8s
[22:04:41.751] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:41:0)
[22:04:41.777] Build status: STARTED
[22:04:41.777] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:42:0) after 1m0s
[22:05:41.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:42:0)
[22:05:41.832] Build status: STARTED
[22:05:41.832] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:43:0) after 4m28s
[22:10:09.862] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:43:0)
[22:10:09.985] Build status: STARTED
[22:10:09.985] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:44:0) after 7m0s
[22:17:10.004] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:44:0)
[22:17:10.035] Build status: STARTED
[22:17:10.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:45:0) after 8m4s
[22:25:14.072] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:45:0)
[22:25:14.103] Build status: STARTED
[22:25:14.103] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:46:0) after 5m7s
[22:30:21.122] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:46:0)
[22:30:21.152] Build status: STARTED
[22:30:21.152] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:47:0) after 5m20s
[22:35:41.256] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:47:0)
[22:35:41.282] Build status: STARTED
[22:35:41.283] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:48:0) after 9m0s
[22:44:41.341] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:48:0)
[22:44:41.387] Build status: STARTED
[22:44:41.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:49:0) after 8m36s
[22:53:17.414] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:49:0)
[22:53:17.440] Build status: STARTED
[22:53:17.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:50:0) after 2m6s
[22:55:23.462] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:50:0)
[22:55:23.493] Build status: STARTED
[22:55:23.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:51:0) after 2m16s
[22:57:39.711] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:51:0)
[22:57:39.739] Build status: STARTED
[22:57:39.739] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:52:0) after 3m18s
[23:00:57.795] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:52:0)
[23:00:57.826] Build status: STARTED
[23:00:57.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:53:0) after 6m35s
[23:07:32.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:53:0)
[23:07:32.876] Build status: STARTED
[23:07:32.876] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:54:0) after 1m48s
[23:09:20.896] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:54:0)
[23:09:20.937] Build status: STARTED
[23:09:20.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:55:0) after 6m24s
[23:15:48.701] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:55:0)
[23:15:48.737] Build status: STARTED
[23:15:48.737] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:56:0) after 1m5s
[23:16:53.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:56:0)
[23:16:53.788] Build status: STARTED
[23:16:53.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:57:0) after 9m13s
[23:26:06.806] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:57:0)
[23:26:06.848] Build status: STARTED
[23:26:06.848] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:58:0) after 9m48s
[23:35:54.908] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:58:0)
[23:35:54.937] Build status: STARTED
[23:35:54.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:59:0) after 2m11s
[23:38:05.956] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:59:0)
[23:38:05.986] Build status: STARTED
[23:38:05.986] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:60:0) after 9m57s
[23:48:03.005] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:60:0)
[23:48:03.033] Build status: STARTED
[23:48:03.033] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:61:0) after 3m1s
[23:51:04.019] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:61:0)
[23:51:04.044] Build status: STARTED
[23:51:04.044] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:62:0) after 3m11s
[23:54:15.065] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:62:0)
[23:54:15.093] Build status: STARTED
[23:54:15.093] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:63:0) after 5m21s
[23:59:36.113] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:63:0)
[23:59:36.154] Build status: STARTED
[23:59:36.154] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:64:0) after 9m31s
[00:09:07.813] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:64:0)
[00:09:07.841] Build status: STARTED
[00:09:07.841] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:65:0) after 5m3s
[00:14:10.866] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:65:0)
[00:14:10.893] Build status: STARTED
[00:14:10.893] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:66:0) after 6m10s
[00:20:21.208] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:66:0)
[00:20:21.239] Build status: STARTED
[00:20:21.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:67:0) after 4m39s
[00:25:00.486] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:67:0)
[00:25:00.521] Build status: STARTED
[00:25:00.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:68:0) after 7m2s
[00:32:02.547] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:68:0)
[00:32:02.576] Build status: STARTED
[00:32:02.576] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:69:0) after 1m22s
[00:33:24.759] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:69:0)
[00:33:24.789] Build status: STARTED
[00:33:24.789] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:70:0) after 1m15s
[00:34:39.808] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:70:0)
[00:34:39.836] Build status: STARTED
[00:34:39.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:71:0) after 4m26s
[00:39:05.871] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:71:0)
[00:39:05.905] Build status: STARTED
[00:39:05.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:72:0) after 8m10s
[00:47:15.926] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:72:0)
[00:47:15.951] Build status: STARTED
[00:47:15.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:73:0) after 5m5s
[00:52:20.977] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:73:0)
[00:52:21.005] Build status: STARTED
[00:52:21.005] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:74:0) after 1m38s
[00:53:59.044] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:74:0)
[00:53:59.070] Build status: STARTED
[00:53:59.070] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:75:0) after 3m41s
[00:57:40.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:75:0)
[00:57:40.121] Build status: STARTED
[00:57:40.121] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:76:0) after 8m19s
[01:05:59.151] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:76:0)
[01:05:59.177] Build status: STARTED
[01:05:59.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:77:0) after 9m34s
[01:15:33.540] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:77:0)
[01:15:33.570] Build status: STARTED
[01:15:33.570] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:78:0) after 8m37s
[01:24:10.591] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:78:0)
[01:24:11.021] Build status: STARTED
[01:24:11.021] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:79:0) after 6m6s
[01:30:17.220] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:79:0)
[01:30:17.247] Build status: STARTED
[01:30:17.247] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:80:0) after 1m25s
[01:31:42.265] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:80:0)
[01:31:42.304] Build status: STARTED
[01:31:42.304] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:81:0) after 4m22s
[01:36:04.327] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:81:0)
[01:36:04.354] Build status: STARTED
[01:36:04.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:82:0) after 4m0s
[01:40:04.384] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:82:0)
[01:40:04.420] Build status: STARTED
[01:40:04.420] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:83:0) after 8m46s
[01:48:50.437] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:83:0)
[01:48:50.483] Build status: STARTED
[01:48:50.483] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:84:0) after 7m31s
[01:56:21.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:84:0)
[01:56:21.652] Build status: STARTED
[01:56:21.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:85:0) after 2m4s
[01:58:25.693] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:85:0)
[01:58:25.722] Build status: STARTED
[01:58:25.722] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:86:0) after 3m0s
[02:01:25.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:86:0)
[02:01:25.800] Build status: STARTED
[02:01:25.800] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:87:0) after 4m19s
[02:05:44.857] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:87:0)
[02:05:44.902] Build status: STARTED
[02:05:44.902] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:88:0) after 3m21s
[02:09:05.937] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:88:0)
[02:09:05.977] Build status: STARTED
[02:09:05.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:89:0) after 7m19s
[02:16:25.005] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:89:0)
[02:16:25.032] Build status: STARTED
[02:16:25.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:90:0) after 4m35s
[02:21:00.084] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:90:0)
[02:21:00.128] Build status: STARTED
[02:21:00.128] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:91:0) after 1m51s
[02:22:51.152] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:91:0)
[02:22:51.179] Build status: STARTED
[02:22:51.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:92:0) after 8m57s
[02:31:48.201] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:92:0)
[02:31:48.284] Build status: STARTED
[02:31:48.284] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:93:0) after 8m26s
[02:40:14.304] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:93:0)
[02:40:14.329] Build status: STARTED
[02:40:14.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:94:0) after 7m5s
[02:47:19.515] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:94:0)
[02:47:19.541] Build status: STARTED
[02:47:19.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:95:0) after 9m29s
[02:56:48.579] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:95:0)
[02:56:48.647] Build status: STARTED
[02:56:48.647] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:96:0) after 8m11s
[03:04:59.666] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:96:0)
[03:04:59.701] Build status: STARTED
[03:04:59.701] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:97:0) after 5m39s
[03:10:38.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:97:0)
[03:10:38.745] Build status: STARTED
[03:10:38.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:98:0) after 9m10s
[03:19:48.834] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:98:0)
[03:19:48.880] Build status: STARTED
[03:19:48.880] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:99:0) after 1m6s
[03:20:54.900] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:99:0)
[03:20:54.927] Build status: STARTED
[03:20:54.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:100:0) after 6m2s
[03:26:57.303] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:100:0)
[03:26:57.350] Build status: STARTED
[03:26:57.350] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:101:0) after 3m4s
[03:30:01.730] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:101:0)
[03:30:01.758] Build status: STARTED
[03:30:01.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:102:0) after 8m29s
[03:38:30.838] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:102:0)
[03:38:30.888] Build status: STARTED
[03:38:30.888] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:103:0) after 9m15s
[03:47:45.962] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:103:0)
[03:47:45.990] Build status: STARTED
[03:47:45.990] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:104:0) after 3m22s
[03:51:08.010] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:104:0)
[03:51:08.042] Build status: STARTED
[03:51:08.042] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:105:0) after 7m17s
[03:58:25.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:105:0)
[03:58:25.094] Build status: STARTED
[03:58:25.094] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:106:0) after 6m21s
[04:04:46.206] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:106:0)
[04:04:46.231] Build status: STARTED
[04:04:46.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:107:0) after 7m42s
[04:12:28.265] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:107:0)
[04:12:28.293] Build status: STARTED
[04:12:28.293] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:108:0) after 9m55s
[04:22:23.336] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:108:0)
[04:22:23.367] Build status: STARTED
[04:22:23.367] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:109:0) after 4m5s
[04:26:28.486] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:109:0)
[04:26:28.518] Build status: STARTED
[04:26:28.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:110:0) after 8m10s
[04:34:38.547] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:110:0)
[04:34:38.580] Build status: STARTED
[04:34:38.580] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:111:0) after 5m1s
[04:39:39.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:111:0)
[04:39:40.016] Build status: STARTED
[04:39:40.016] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:112:0) after 1m45s
[04:41:25.726] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:112:0)
[04:41:25.752] Build status: STARTED
[04:41:25.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:113:0) after 3m58s
[04:45:23.795] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:113:0)
[04:45:23.826] Build status: STARTED
[04:45:23.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:114:0) after 4m2s
[04:49:26.176] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:114:0)
[04:49:26.204] Build status: STARTED
[04:49:26.204] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:115:0) after 4m54s
[04:54:20.242] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:115:0)
[04:54:20.267] Build status: STARTED
[04:54:20.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:116:0) after 3m50s
[04:58:10.285] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:116:0)
[04:58:10.315] Build status: STARTED
[04:58:10.315] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:117:0) after 3m48s
[05:01:58.337] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:117:0)
[05:01:58.364] Build status: STARTED
[05:01:58.364] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:118:0) after 3m31s
[05:05:29.478] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:118:0)
[05:05:29.512] Build status: STARTED
[05:05:29.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:119:0) after 7m57s
[05:13:26.545] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:119:0)
[05:13:26.580] Build status: STARTED
[05:13:26.580] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:120:0) after 4m32s
[05:17:58.708] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:120:0)
[05:17:58.743] Build status: STARTED
[05:17:58.743] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:121:0) after 3m11s
[05:21:09.770] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:121:0)
[05:21:09.799] Build status: STARTED
[05:21:09.799] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:122:0) after 1m55s
[05:23:04.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:122:0)
[05:23:04.908] Build status: STARTED
[05:23:04.908] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:123:0) after 7m25s
[05:30:29.970] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:123:0)
[05:30:29.995] Build status: STARTED
[05:30:29.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:124:0) after 2m56s
[05:33:26.023] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:124:0)
[05:33:26.056] Build status: STARTED
[05:33:26.056] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015019334310874128:125:0) after 8m14s
[05:36:54.308] Received PubSub notification, asking Buildbucket for the build status
[05:36:54.371] Build:
{
"id": "8849589272302997120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3654,
"createdBy": "project:chromium",
"createTime": "2021-04-18T18:37:02.468309Z",
"startTime": "2021-04-18T18:37:14.583677Z",
"endTime": "2021-04-19T05:36:54.000515428Z",
"updateTime": "2021-04-19T05:36:54.000944021Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "da8928ac887e2611fbdd71a02eeebb7e89222e3c",
"ref": "refs/heads/master"
}
}
}
[05:36:54.371] Invocation finished in 10h59m53.202362993s with status FAILED