[23:00:58.534] New invocation is queued and will start shortly
[23:00:59.660] Starting the invocation (attempt 1)
[23:00:59.700] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/eff73ad53034dd5b0761b1b64d1169c420bcb64e"
[23:00:59.700] Popped gitiles commit info from properties and tags
[23:00:59.700] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:00:59.700] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:00:59.700] Buildbucket request:
{
"requestId": "9017177054842350288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eff73ad53034dd5b0761b1b64d1169c420bcb64e",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017177054842350288"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:01:01.199] Scheduled build:
{
"id": "8851746992755174736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3604,
"createdBy": "project:chromium",
"createTime": "2021-03-25T23:00:59.891573Z",
"updateTime": "2021-03-25T23:01:01.049436Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eff73ad53034dd5b0761b1b64d1169c420bcb64e",
"ref": "refs/heads/master"
}
},
"canary": true
}
[23:01:01.199] Task URL: https://cr-buildbucket.appspot.com/build/8851746992755174736
[23:01:01.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:2:0) after 1m0s
[23:02:01.631] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:2:0)
[23:02:01.686] Build status: SCHEDULED
[23:02:01.686] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:3:0) after 3m46s
[23:02:58.907] Received PubSub notification, asking Buildbucket for the build status
[23:02:58.946] Build status: STARTED
[23:05:47.721] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:3:0)
[23:05:47.751] Build status: STARTED
[23:05:47.751] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:5:0) after 9m6s
[23:14:54.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:5:0)
[23:14:54.227] Build status: STARTED
[23:14:54.227] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:6:0) after 1m59s
[23:16:53.272] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:6:0)
[23:16:53.316] Build status: STARTED
[23:16:53.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:7:0) after 5m28s
[23:22:21.756] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:7:0)
[23:22:21.794] Build status: STARTED
[23:22:21.794] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:8:0) after 3m50s
[23:26:11.823] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:8:0)
[23:26:11.854] Build status: STARTED
[23:26:11.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:9:0) after 6m55s
[23:33:06.981] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:9:0)
[23:33:07.038] Build status: STARTED
[23:33:07.038] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:10:0) after 5m1s
[23:38:08.077] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:10:0)
[23:38:08.106] Build status: STARTED
[23:38:08.106] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:11:0) after 2m11s
[23:40:19.135] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:11:0)
[23:40:19.164] Build status: STARTED
[23:40:19.164] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:12:0) after 8m1s
[23:48:20.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:12:0)
[23:48:20.326] Build status: STARTED
[23:48:20.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:13:0) after 6m49s
[23:55:09.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:13:0)
[23:55:09.512] Build status: STARTED
[23:55:09.512] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:14:0) after 1m3s
[23:56:12.671] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:14:0)
[23:56:12.705] Build status: STARTED
[23:56:12.705] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:15:0) after 7m19s
[00:03:31.823] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:15:0)
[00:03:31.851] Build status: STARTED
[00:03:31.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:16:0) after 1m42s
[00:05:13.875] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:16:0)
[00:05:13.906] Build status: STARTED
[00:05:13.906] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:17:0) after 9m56s
[00:15:10.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:17:0)
[00:15:10.118] Build status: STARTED
[00:15:10.118] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:18:0) after 7m13s
[00:22:23.176] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:18:0)
[00:22:23.221] Build status: STARTED
[00:22:23.222] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:19:0) after 8m29s
[00:30:52.417] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:19:0)
[00:30:52.458] Build status: STARTED
[00:30:52.458] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:20:0) after 6m31s
[00:37:23.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:20:0)
[00:37:23.614] Build status: STARTED
[00:37:23.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:21:0) after 8m13s
[00:45:36.659] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:21:0)
[00:45:36.697] Build status: STARTED
[00:45:36.697] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:22:0) after 7m47s
[00:53:23.807] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:22:0)
[00:53:23.844] Build status: STARTED
[00:53:23.844] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:23:0) after 8m23s
[01:01:46.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:23:0)
[01:01:46.958] Build status: STARTED
[01:01:46.958] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:24:0) after 5m2s
[01:06:48.989] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:24:0)
[01:06:49.025] Build status: STARTED
[01:06:49.025] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:25:0) after 9m31s
[01:16:20.296] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:25:0)
[01:16:20.367] Build status: STARTED
[01:16:20.367] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:26:0) after 8m50s
[01:25:10.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:26:0)
[01:25:10.489] Build status: STARTED
[01:25:10.489] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:27:0) after 5m57s
[01:31:07.533] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:27:0)
[01:31:07.572] Build status: STARTED
[01:31:07.572] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:28:0) after 3m30s
[01:34:38.049] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:28:0)
[01:34:38.087] Build status: STARTED
[01:34:38.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:29:0) after 6m39s
[01:41:17.127] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:29:0)
[01:41:17.156] Build status: STARTED
[01:41:17.156] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:30:0) after 3m29s
[01:44:46.184] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:30:0)
[01:44:46.218] Build status: STARTED
[01:44:46.218] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:31:0) after 1m4s
[01:45:50.303] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:31:0)
[01:45:50.337] Build status: STARTED
[01:45:50.337] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:32:0) after 9m54s
[01:55:44.485] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:32:0)
[01:55:44.515] Build status: STARTED
[01:55:44.515] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:33:0) after 8m16s
[02:04:00.658] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:33:0)
[02:04:00.687] Build status: STARTED
[02:04:00.687] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:34:0) after 9m47s
[02:13:47.738] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:34:0)
[02:13:47.765] Build status: STARTED
[02:13:47.765] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:35:0) after 4m42s
[02:18:29.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:35:0)
[02:18:29.998] Build status: STARTED
[02:18:29.998] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:36:0) after 2m56s
[02:21:26.331] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:36:0)
[02:21:26.367] Build status: STARTED
[02:21:26.367] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:37:0) after 9m16s
[02:30:42.399] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:37:0)
[02:30:42.434] Build status: STARTED
[02:30:42.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:38:0) after 2m19s
[02:33:01.508] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:38:0)
[02:33:01.540] Build status: STARTED
[02:33:01.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:39:0) after 7m46s
[02:40:47.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:39:0)
[02:40:47.701] Build status: STARTED
[02:40:47.701] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:40:0) after 2m2s
[02:42:49.913] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:40:0)
[02:42:49.942] Build status: STARTED
[02:42:49.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:41:0) after 1m53s
[02:44:42.996] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:41:0)
[02:44:43.029] Build status: STARTED
[02:44:43.029] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:42:0) after 2m39s
[02:47:22.147] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:42:0)
[02:47:22.177] Build status: STARTED
[02:47:22.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:43:0) after 8m23s
[02:55:45.213] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:43:0)
[02:55:45.245] Build status: STARTED
[02:55:45.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:44:0) after 2m29s
[02:58:14.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:44:0)
[02:58:14.314] Build status: STARTED
[02:58:14.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:45:0) after 3m11s
[03:01:25.392] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:45:0)
[03:01:25.488] Build status: STARTED
[03:01:25.488] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:46:0) after 5m9s
[03:06:34.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:46:0)
[03:06:34.747] Build status: STARTED
[03:06:34.747] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:47:0) after 2m55s
[03:09:29.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:47:0)
[03:09:29.835] Build status: STARTED
[03:09:29.835] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:48:0) after 1m27s
[03:10:56.947] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:48:0)
[03:10:57.000] Build status: STARTED
[03:10:57.000] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:49:0) after 4m5s
[03:15:02.103] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:49:0)
[03:15:02.143] Build status: STARTED
[03:15:02.143] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:50:0) after 3m6s
[03:18:08.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:50:0)
[03:18:08.169] Build status: STARTED
[03:18:08.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:51:0) after 4m10s
[03:22:18.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:51:0)
[03:22:18.226] Build status: STARTED
[03:22:18.226] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:52:0) after 9m11s
[03:31:29.309] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:52:0)
[03:31:29.339] Build status: STARTED
[03:31:29.339] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:53:0) after 5m34s
[03:37:03.394] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:53:0)
[03:37:03.423] Build status: STARTED
[03:37:03.423] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:54:0) after 7m45s
[03:44:48.484] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:54:0)
[03:44:48.516] Build status: STARTED
[03:44:48.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:55:0) after 1m47s
[03:46:35.754] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:55:0)
[03:46:35.790] Build status: STARTED
[03:46:35.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:56:0) after 3m29s
[03:50:04.891] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:56:0)
[03:50:04.923] Build status: STARTED
[03:50:04.923] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:57:0) after 9m57s
[04:00:02.062] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:57:0)
[04:00:02.193] Build status: STARTED
[04:00:02.193] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:58:0) after 1m8s
[04:01:10.625] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:58:0)
[04:01:10.671] Build status: STARTED
[04:01:10.671] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:59:0) after 3m38s
[04:04:48.726] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:59:0)
[04:04:48.774] Build status: STARTED
[04:04:48.774] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:60:0) after 2m28s
[04:07:16.835] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:60:0)
[04:07:16.866] Build status: STARTED
[04:07:16.866] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:61:0) after 2m30s
[04:09:46.864] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:61:0)
[04:09:46.891] Build status: STARTED
[04:09:46.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:62:0) after 6m33s
[04:16:19.966] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:62:0)
[04:16:19.996] Build status: STARTED
[04:16:19.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:63:0) after 9m24s
[04:25:44.034] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:63:0)
[04:25:44.060] Build status: STARTED
[04:25:44.060] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:64:0) after 8m15s
[04:33:59.421] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:64:0)
[04:33:59.452] Build status: STARTED
[04:33:59.452] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:65:0) after 2m21s
[04:36:20.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:65:0)
[04:36:20.614] Build status: STARTED
[04:36:20.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:66:0) after 5m24s
[04:41:44.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:66:0)
[04:41:44.674] Build status: STARTED
[04:41:44.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:67:0) after 8m44s
[04:50:28.716] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:67:0)
[04:50:28.754] Build status: STARTED
[04:50:28.754] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:68:0) after 6m46s
[04:57:16.087] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:68:0)
[04:57:16.121] Build status: STARTED
[04:57:16.121] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:69:0) after 8m0s
[05:05:16.182] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:69:0)
[05:05:16.215] Build status: STARTED
[05:05:16.215] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:70:0) after 4m32s
[05:09:48.281] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:70:0)
[05:09:48.315] Build status: STARTED
[05:09:48.315] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:71:0) after 4m50s
[05:14:38.564] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:71:0)
[05:14:38.612] Build status: STARTED
[05:14:38.612] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:72:0) after 4m38s
[05:19:16.731] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:72:0)
[05:19:16.815] Build status: STARTED
[05:19:16.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:73:0) after 4m7s
[05:23:24.025] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:73:0)
[05:23:24.087] Build status: STARTED
[05:23:24.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:74:0) after 4m56s
[05:28:20.340] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:74:0)
[05:28:20.370] Build status: STARTED
[05:28:20.370] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:75:0) after 2m30s
[05:30:50.441] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:75:0)
[05:30:50.471] Build status: STARTED
[05:30:50.471] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:76:0) after 8m51s
[05:39:41.621] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:76:0)
[05:39:41.670] Build status: STARTED
[05:39:41.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:77:0) after 8m1s
[05:47:42.833] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:77:0)
[05:47:42.864] Build status: STARTED
[05:47:42.864] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:78:0) after 3m6s
[05:50:48.892] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:78:0)
[05:50:48.923] Build status: STARTED
[05:50:48.923] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:79:0) after 4m24s
[05:55:12.996] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:79:0)
[05:55:13.024] Build status: STARTED
[05:55:13.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:80:0) after 7m58s
[06:03:11.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:80:0)
[06:03:11.110] Build status: STARTED
[06:03:11.110] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:81:0) after 7m46s
[06:10:57.547] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:81:0)
[06:10:58.102] Build status: STARTED
[06:10:58.102] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:82:0) after 2m40s
[06:13:38.487] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:82:0)
[06:13:38.516] Build status: STARTED
[06:13:38.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:83:0) after 8m11s
[06:21:49.712] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:83:0)
[06:21:49.745] Build status: STARTED
[06:21:49.745] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:84:0) after 2m8s
[06:23:58.168] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:84:0)
[06:23:58.201] Build status: STARTED
[06:23:58.201] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:85:0) after 9m2s
[06:33:00.431] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:85:0)
[06:33:00.460] Build status: STARTED
[06:33:00.460] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:86:0) after 9m23s
[06:42:23.502] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:86:0)
[06:42:23.528] Build status: STARTED
[06:42:23.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:87:0) after 4m5s
[06:46:28.561] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:87:0)
[06:46:28.591] Build status: STARTED
[06:46:28.591] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:88:0) after 6m56s
[06:53:24.711] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:88:0)
[06:53:24.854] Build status: STARTED
[06:53:24.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:89:0) after 6m34s
[06:59:58.884] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:89:0)
[06:59:58.911] Build status: STARTED
[06:59:58.911] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:90:0) after 2m47s
[07:02:45.940] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:90:0)
[07:02:45.977] Build status: STARTED
[07:02:45.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:91:0) after 6m53s
[07:09:39.018] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:91:0)
[07:09:39.188] Build status: STARTED
[07:09:39.188] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:92:0) after 7m57s
[07:17:36.807] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:92:0)
[07:17:36.832] Build status: STARTED
[07:17:36.832] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:93:0) after 3m34s
[07:21:10.864] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:93:0)
[07:21:10.898] Build status: STARTED
[07:21:10.898] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:94:0) after 5m55s
[07:27:05.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:94:0)
[07:27:06.013] Build status: STARTED
[07:27:06.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:95:0) after 8m46s
[07:35:52.113] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:95:0)
[07:35:52.146] Build status: STARTED
[07:35:52.146] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:96:0) after 8m10s
[07:44:02.175] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:96:0)
[07:44:02.224] Build status: STARTED
[07:44:02.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:97:0) after 3m3s
[07:47:05.253] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:97:0)
[07:47:05.288] Build status: STARTED
[07:47:05.288] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:98:0) after 4m59s
[07:52:04.335] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:98:0)
[07:52:04.371] Build status: STARTED
[07:52:04.371] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:99:0) after 5m21s
[07:57:25.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:99:0)
[07:57:25.432] Build status: STARTED
[07:57:25.432] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:100:0) after 4m35s
[08:02:00.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:100:0)
[08:02:00.701] Build status: STARTED
[08:02:00.701] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:101:0) after 9m6s
[08:11:06.782] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:101:0)
[08:11:06.815] Build status: STARTED
[08:11:06.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:102:0) after 1m34s
[08:12:40.842] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:102:0)
[08:12:40.899] Build status: STARTED
[08:12:40.899] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:103:0) after 1m39s
[08:14:20.004] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:103:0)
[08:14:20.255] Build status: STARTED
[08:14:20.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:104:0) after 9m43s
[08:24:03.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:104:0)
[08:24:03.321] Build status: STARTED
[08:24:03.321] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:105:0) after 8m49s
[08:32:52.402] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:105:0)
[08:32:52.432] Build status: STARTED
[08:32:52.432] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:106:0) after 1m10s
[08:34:02.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:106:0)
[08:34:02.540] Build status: STARTED
[08:34:02.540] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:107:0) after 5m8s
[08:39:11.304] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:107:0)
[08:39:11.355] Build status: STARTED
[08:39:11.355] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:108:0) after 8m50s
[08:48:01.478] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:108:0)
[08:48:01.528] Build status: STARTED
[08:48:01.528] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:109:0) after 9m47s
[08:57:48.563] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:109:0)
[08:57:48.670] Build status: STARTED
[08:57:48.671] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:110:0) after 4m32s
[09:02:20.795] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:110:0)
[09:02:20.841] Build status: STARTED
[09:02:20.841] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:111:0) after 7m39s
[09:10:00.231] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:111:0)
[09:10:00.262] Build status: STARTED
[09:10:00.262] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:112:0) after 3m38s
[09:13:38.682] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:112:0)
[09:13:38.711] Build status: STARTED
[09:13:38.711] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:113:0) after 3m32s
[09:17:10.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:113:0)
[09:17:10.951] Build status: STARTED
[09:17:10.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:114:0) after 1m19s
[09:18:30.313] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:114:0)
[09:18:30.363] Build status: STARTED
[09:18:30.363] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:115:0) after 7m45s
[09:26:15.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:115:0)
[09:26:15.503] Build status: STARTED
[09:26:15.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:116:0) after 4m15s
[09:30:31.180] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:116:0)
[09:30:31.208] Build status: STARTED
[09:30:31.208] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:117:0) after 1m21s
[09:31:52.441] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:117:0)
[09:31:52.493] Build status: STARTED
[09:31:52.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:118:0) after 3m36s
[09:35:28.546] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:118:0)
[09:35:28.597] Build status: STARTED
[09:35:28.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:119:0) after 3m29s
[09:38:58.078] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:119:0)
[09:38:58.104] Build status: STARTED
[09:38:58.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:120:0) after 8m24s
[09:47:22.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:120:0)
[09:47:22.234] Build status: STARTED
[09:47:22.234] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:121:0) after 8m9s
[09:55:31.424] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:121:0)
[09:55:31.466] Build status: STARTED
[09:55:31.466] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:122:0) after 1m8s
[09:56:39.746] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:122:0)
[09:56:39.777] Build status: STARTED
[09:56:39.777] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:123:0) after 7m37s
[10:04:16.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:123:0)
[10:04:16.847] Build status: STARTED
[10:04:16.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:124:0) after 9m20s
[10:13:37.487] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:124:0)
[10:13:37.519] Build status: STARTED
[10:13:37.519] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017177054842350288:125:0) after 4m4s
[10:14:29.690] Received PubSub notification, asking Buildbucket for the build status
[10:14:29.718] Build:
{
"id": "8851746992755174736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3604,
"createdBy": "project:chromium",
"createTime": "2021-03-25T23:00:59.891573Z",
"startTime": "2021-03-25T23:02:57.949007Z",
"endTime": "2021-03-26T10:14:28.990177680Z",
"updateTime": "2021-03-26T10:14:28.990712234Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eff73ad53034dd5b0761b1b64d1169c420bcb64e",
"ref": "refs/heads/master"
}
},
"canary": true
}
[10:14:29.718] Invocation finished in 11h13m31.200913s with status FAILED