[13:53:02.920] New invocation is queued and will start shortly
[13:53:04.067] Starting the invocation (attempt 1)
[13:53:04.102] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d4f7fe03ac0ee16bbc94fa90cb33140ceb253e8d"
[13:53:04.103] Popped gitiles commit info from properties and tags
[13:53:04.103] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:53:04.103] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:53:04.103] Buildbucket request:
{
"requestId": "9017302124387352672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4f7fe03ac0ee16bbc94fa90cb33140ceb253e8d",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9017302124387352672"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:53:05.066] Scheduled build:
{
"id": "8851872062153600272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3601,
"createdBy": "project:chromium",
"createTime": "2021-03-24T13:53:04.418210Z",
"updateTime": "2021-03-24T13:53:04.976477Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4f7fe03ac0ee16bbc94fa90cb33140ceb253e8d",
"ref": "refs/heads/master"
}
}
}
[13:53:05.066] Task URL: https://cr-buildbucket.appspot.com/build/8851872062153600272
[13:53:05.066] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:2:0) after 2m5s
[13:53:12.737] Received PubSub notification, asking Buildbucket for the build status
[13:53:12.767] Build status: STARTED
[13:55:10.302] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:2:0)
[13:55:10.328] Build status: STARTED
[13:55:10.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:4:0) after 6m53s
[14:02:03.375] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:4:0)
[14:02:03.421] Build status: STARTED
[14:02:03.421] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:5:0) after 2m52s
[14:04:55.416] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:5:0)
[14:04:55.449] Build status: STARTED
[14:04:55.449] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:6:0) after 8m22s
[14:13:17.588] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:6:0)
[14:13:17.616] Build status: STARTED
[14:13:17.616] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:7:0) after 6m32s
[14:19:49.639] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:7:0)
[14:19:49.699] Build status: STARTED
[14:19:49.699] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:8:0) after 5m18s
[14:25:07.865] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:8:0)
[14:25:07.894] Build status: STARTED
[14:25:07.895] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:9:0) after 9m5s
[14:34:13.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:9:0)
[14:34:13.043] Build status: STARTED
[14:34:13.043] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:10:0) after 7m43s
[14:41:56.136] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:10:0)
[14:41:56.169] Build status: STARTED
[14:41:56.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:11:0) after 8m1s
[14:49:57.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:11:0)
[14:49:57.223] Build status: STARTED
[14:49:57.223] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:12:0) after 5m40s
[14:55:37.264] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:12:0)
[14:55:37.294] Build status: STARTED
[14:55:37.294] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:13:0) after 7m0s
[15:02:37.418] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:13:0)
[15:02:37.451] Build status: STARTED
[15:02:37.451] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:14:0) after 5m47s
[15:08:24.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:14:0)
[15:08:24.554] Build status: STARTED
[15:08:24.554] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:15:0) after 3m38s
[15:12:02.620] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:15:0)
[15:12:02.662] Build status: STARTED
[15:12:02.662] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:16:0) after 9m56s
[15:21:58.714] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:16:0)
[15:21:58.741] Build status: STARTED
[15:21:58.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:17:0) after 6m24s
[15:28:22.765] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:17:0)
[15:28:22.831] Build status: STARTED
[15:28:22.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:18:0) after 7m41s
[15:36:03.957] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:18:0)
[15:36:03.995] Build status: STARTED
[15:36:03.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:19:0) after 9m52s
[15:45:56.031] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:19:0)
[15:45:56.059] Build status: STARTED
[15:45:56.059] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:20:0) after 2m35s
[15:48:31.117] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:20:0)
[15:48:31.148] Build status: STARTED
[15:48:31.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:21:0) after 7m56s
[15:56:27.195] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:21:0)
[15:56:27.297] Build status: STARTED
[15:56:27.297] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:22:0) after 5m3s
[16:01:30.324] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:22:0)
[16:01:30.349] Build status: STARTED
[16:01:30.349] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:23:0) after 1m25s
[16:02:55.372] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:23:0)
[16:02:55.403] Build status: STARTED
[16:02:55.403] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:24:0) after 7m46s
[16:10:41.489] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:24:0)
[16:10:41.518] Build status: STARTED
[16:10:41.518] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:25:0) after 9m8s
[16:19:49.577] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:25:0)
[16:19:49.608] Build status: STARTED
[16:19:49.608] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:26:0) after 7m27s
[16:27:16.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:26:0)
[16:27:16.818] Build status: STARTED
[16:27:16.818] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:27:0) after 7m20s
[16:34:36.841] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:27:0)
[16:34:36.872] Build status: STARTED
[16:34:36.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:28:0) after 4m25s
[16:39:01.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:28:0)
[16:39:02.077] Build status: STARTED
[16:39:02.077] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:29:0) after 8m54s
[16:47:56.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:29:0)
[16:47:56.325] Build status: STARTED
[16:47:56.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:30:0) after 9m10s
[16:57:06.401] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:30:0)
[16:57:06.428] Build status: STARTED
[16:57:06.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:31:0) after 6m14s
[17:03:20.450] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:31:0)
[17:03:20.477] Build status: STARTED
[17:03:20.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:32:0) after 7m59s
[17:11:19.873] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:32:0)
[17:11:19.909] Build status: STARTED
[17:11:19.909] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:33:0) after 1m59s
[17:13:18.952] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:33:0)
[17:13:18.996] Build status: STARTED
[17:13:18.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:34:0) after 6m18s
[17:19:37.104] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:34:0)
[17:19:37.134] Build status: STARTED
[17:19:37.134] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:35:0) after 2m22s
[17:21:59.155] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:35:0)
[17:21:59.205] Build status: STARTED
[17:21:59.205] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:36:0) after 4m41s
[17:26:40.214] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:36:0)
[17:26:40.243] Build status: STARTED
[17:26:40.243] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:37:0) after 6m21s
[17:33:01.270] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:37:0)
[17:33:01.302] Build status: STARTED
[17:33:01.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:38:0) after 4m13s
[17:37:14.396] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:38:0)
[17:37:14.427] Build status: STARTED
[17:37:14.427] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:39:0) after 4m3s
[17:41:17.646] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:39:0)
[17:41:17.675] Build status: STARTED
[17:41:17.675] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:40:0) after 7m24s
[17:48:41.707] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:40:0)
[17:48:41.733] Build status: STARTED
[17:48:41.733] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:41:0) after 4m9s
[17:52:50.862] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:41:0)
[17:52:50.911] Build status: STARTED
[17:52:50.911] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:42:0) after 7m2s
[17:59:53.259] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:42:0)
[17:59:53.286] Build status: STARTED
[17:59:53.286] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:43:0) after 2m40s
[18:02:33.344] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:43:0)
[18:02:33.375] Build status: STARTED
[18:02:33.375] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:44:0) after 7m5s
[18:09:38.502] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:44:0)
[18:09:38.532] Build status: STARTED
[18:09:38.532] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:45:0) after 7m11s
[18:16:49.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:45:0)
[18:16:50.318] Build status: STARTED
[18:16:50.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:46:0) after 9m50s
[18:26:40.409] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:46:0)
[18:26:40.438] Build status: STARTED
[18:26:40.438] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:47:0) after 3m43s
[18:30:23.539] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:47:0)
[18:30:23.580] Build status: STARTED
[18:30:23.580] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:48:0) after 5m29s
[18:35:52.787] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:48:0)
[18:35:52.828] Build status: STARTED
[18:35:52.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:49:0) after 6m15s
[18:42:07.849] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:49:0)
[18:42:07.909] Build status: STARTED
[18:42:07.909] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:50:0) after 8m35s
[18:50:43.046] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:50:0)
[18:50:43.099] Build status: STARTED
[18:50:43.099] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:51:0) after 3m22s
[18:54:05.293] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:51:0)
[18:54:05.325] Build status: STARTED
[18:54:05.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:52:0) after 9m33s
[19:03:38.396] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:52:0)
[19:03:38.437] Build status: STARTED
[19:03:38.437] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:53:0) after 6m23s
[19:10:01.575] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:53:0)
[19:10:01.622] Build status: STARTED
[19:10:01.622] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:54:0) after 5m35s
[19:15:36.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:54:0)
[19:15:36.853] Build status: STARTED
[19:15:36.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:55:0) after 6m35s
[19:22:12.338] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:55:0)
[19:22:12.368] Build status: STARTED
[19:22:12.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:56:0) after 8m23s
[19:30:35.393] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:56:0)
[19:30:35.459] Build status: STARTED
[19:30:35.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:57:0) after 1m39s
[19:32:14.495] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:57:0)
[19:32:14.533] Build status: STARTED
[19:32:14.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:58:0) after 6m37s
[19:38:51.808] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:58:0)
[19:38:51.836] Build status: STARTED
[19:38:51.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:59:0) after 7m37s
[19:46:28.848] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:59:0)
[19:46:28.883] Build status: STARTED
[19:46:28.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:60:0) after 7m37s
[19:54:05.917] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:60:0)
[19:54:05.975] Build status: STARTED
[19:54:05.975] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:61:0) after 7m22s
[20:01:28.030] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:61:0)
[20:01:28.061] Build status: STARTED
[20:01:28.062] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:62:0) after 4m50s
[20:06:18.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:62:0)
[20:06:18.116] Build status: STARTED
[20:06:18.116] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:63:0) after 5m59s
[20:12:17.338] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:63:0)
[20:12:17.374] Build status: STARTED
[20:12:17.374] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:64:0) after 8m33s
[20:20:50.475] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:64:0)
[20:20:50.526] Build status: STARTED
[20:20:50.526] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:65:0) after 2m50s
[20:23:40.583] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:65:0)
[20:23:40.614] Build status: STARTED
[20:23:40.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:66:0) after 3m42s
[20:27:22.654] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:66:0)
[20:27:22.713] Build status: STARTED
[20:27:22.713] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:67:0) after 8m26s
[20:35:48.802] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:67:0)
[20:35:48.968] Build status: STARTED
[20:35:48.968] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:68:0) after 6m54s
[20:42:43.107] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:68:0)
[20:42:43.159] Build status: STARTED
[20:42:43.159] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:69:0) after 5m48s
[20:48:31.182] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:69:0)
[20:48:31.207] Build status: STARTED
[20:48:31.207] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:70:0) after 8m6s
[20:56:37.404] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:70:0)
[20:56:37.436] Build status: STARTED
[20:56:37.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:71:0) after 5m32s
[21:02:09.489] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:71:0)
[21:02:09.525] Build status: STARTED
[21:02:09.525] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:72:0) after 8m24s
[21:10:33.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:72:0)
[21:10:33.555] Build status: STARTED
[21:10:33.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:73:0) after 2m45s
[21:13:18.634] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:73:0)
[21:13:18.666] Build status: STARTED
[21:13:18.666] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:74:0) after 9m13s
[21:22:32.124] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:74:0)
[21:22:32.158] Build status: STARTED
[21:22:32.158] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:75:0) after 5m39s
[21:28:11.311] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:75:0)
[21:28:11.414] Build status: STARTED
[21:28:11.414] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:76:0) after 1m3s
[21:29:14.440] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:76:0)
[21:29:14.484] Build status: STARTED
[21:29:14.484] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:77:0) after 9m53s
[21:39:07.609] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:77:0)
[21:39:07.641] Build status: STARTED
[21:39:07.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:78:0) after 1m10s
[21:40:17.728] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:78:0)
[21:40:17.767] Build status: STARTED
[21:40:17.767] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:79:0) after 7m53s
[21:48:10.811] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:79:0)
[21:48:10.840] Build status: STARTED
[21:48:10.840] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:80:0) after 2m17s
[21:50:27.877] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:80:0)
[21:50:27.916] Build status: STARTED
[21:50:27.916] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:81:0) after 7m17s
[21:57:44.924] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:81:0)
[21:57:44.955] Build status: STARTED
[21:57:44.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:82:0) after 8m39s
[22:06:24.232] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:82:0)
[22:06:24.282] Build status: STARTED
[22:06:24.282] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:83:0) after 9m3s
[22:15:27.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:83:0)
[22:15:27.532] Build status: STARTED
[22:15:27.532] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:84:0) after 9m8s
[22:24:35.709] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:84:0)
[22:24:35.741] Build status: STARTED
[22:24:35.741] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:85:0) after 4m12s
[22:28:47.855] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:85:0)
[22:28:47.885] Build status: STARTED
[22:28:47.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:86:0) after 7m27s
[22:36:14.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:86:0)
[22:36:14.903] Build status: STARTED
[22:36:14.903] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:87:0) after 8m55s
[22:45:09.947] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:87:0)
[22:45:09.979] Build status: STARTED
[22:45:09.979] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:88:0) after 2m52s
[22:48:02.083] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:88:0)
[22:48:02.171] Build status: STARTED
[22:48:02.171] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:89:0) after 4m34s
[22:52:36.453] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:89:0)
[22:52:36.480] Build status: STARTED
[22:52:36.480] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:90:0) after 1m13s
[22:53:49.457] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:90:0)
[22:53:49.484] Build status: STARTED
[22:53:49.484] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:91:0) after 3m8s
[22:56:57.624] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:91:0)
[22:56:57.686] Build status: STARTED
[22:56:57.686] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:92:0) after 2m48s
[22:59:45.878] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:92:0)
[22:59:45.912] Build status: STARTED
[22:59:45.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:93:0) after 1m51s
[23:01:36.937] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:93:0)
[23:01:37.014] Build status: STARTED
[23:01:37.014] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:94:0) after 6m20s
[23:07:57.158] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:94:0)
[23:07:57.188] Build status: STARTED
[23:07:57.188] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:95:0) after 8m57s
[23:16:54.210] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:95:0)
[23:16:54.254] Build status: STARTED
[23:16:54.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:96:0) after 4m44s
[23:21:38.279] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:96:0)
[23:21:38.309] Build status: STARTED
[23:21:38.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:97:0) after 1m26s
[23:23:04.343] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:97:0)
[23:23:04.402] Build status: STARTED
[23:23:04.402] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:98:0) after 6m17s
[23:29:21.449] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:98:0)
[23:29:21.477] Build status: STARTED
[23:29:21.477] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:99:0) after 8m37s
[23:37:59.036] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:99:0)
[23:37:59.071] Build status: STARTED
[23:37:59.071] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:100:0) after 2m7s
[23:40:06.099] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:100:0)
[23:40:06.128] Build status: STARTED
[23:40:06.128] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:101:0) after 5m14s
[23:45:20.257] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:101:0)
[23:45:20.302] Build status: STARTED
[23:45:20.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:102:0) after 8m18s
[23:53:38.681] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:102:0)
[23:53:38.714] Build status: STARTED
[23:53:38.714] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:103:0) after 2m7s
[23:55:46.198] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:103:0)
[23:55:46.225] Build status: STARTED
[23:55:46.225] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:104:0) after 3m40s
[23:59:26.398] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:104:0)
[23:59:26.449] Build status: STARTED
[23:59:26.450] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:105:0) after 2m36s
[00:02:02.604] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:105:0)
[00:02:02.653] Build status: STARTED
[00:02:02.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:106:0) after 7m14s
[00:09:16.847] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:106:0)
[00:09:16.885] Build status: STARTED
[00:09:16.885] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:107:0) after 5m43s
[00:14:59.921] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:107:0)
[00:14:59.961] Build status: STARTED
[00:14:59.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:108:0) after 6m35s
[00:21:35.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:108:0)
[00:21:35.102] Build status: STARTED
[00:21:35.102] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:109:0) after 3m6s
[00:24:41.128] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:109:0)
[00:24:41.163] Build status: STARTED
[00:24:41.163] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:110:0) after 3m31s
[00:28:12.303] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:110:0)
[00:28:12.359] Build status: STARTED
[00:28:12.359] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:111:0) after 4m54s
[00:33:06.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:111:0)
[00:33:06.648] Build status: STARTED
[00:33:06.648] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:112:0) after 6m46s
[00:39:52.727] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:112:0)
[00:39:52.788] Build status: STARTED
[00:39:52.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:113:0) after 9m38s
[00:49:31.174] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:113:0)
[00:49:31.206] Build status: STARTED
[00:49:31.206] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:114:0) after 4m49s
[00:54:20.366] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:114:0)
[00:54:20.395] Build status: STARTED
[00:54:20.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9017302124387352672:115:0) after 4m45s
[00:54:52.895] Received PubSub notification, asking Buildbucket for the build status
[00:54:52.928] Build:
{
"id": "8851872062153600272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3601,
"createdBy": "project:chromium",
"createTime": "2021-03-24T13:53:04.418210Z",
"startTime": "2021-03-24T13:53:10.429588Z",
"endTime": "2021-03-25T00:54:52.411651507Z",
"updateTime": "2021-03-25T00:54:52.412120735Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4f7fe03ac0ee16bbc94fa90cb33140ceb253e8d",
"ref": "refs/heads/master"
}
}
}
[00:54:52.929] Invocation finished in 11h1m50.024537614s with status FAILED