[02:49:04.891] New invocation is queued and will start shortly
[02:49:06.044] Starting the invocation (attempt 1)
[02:49:06.100] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f2b09a7be872731c3a98974860149780abc42cd6"
[02:49:06.100] Popped gitiles commit info from properties and tags
[02:49:06.100] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:49:06.101] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:49:06.101] Buildbucket request:
{
"requestId": "9015441361292466496",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2b09a7be872731c3a98974860149780abc42cd6",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015441361292466496"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:49:06.765] Scheduled build:
{
"id": "8850011299202692576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3644,
"createdBy": "project:chromium",
"createTime": "2021-04-14T02:49:06.253544Z",
"updateTime": "2021-04-14T02:49:06.697138Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2b09a7be872731c3a98974860149780abc42cd6",
"ref": "refs/heads/master"
}
}
}
[02:49:06.765] Task URL: https://cr-buildbucket.appspot.com/build/8850011299202692576
[02:49:06.765] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:2:0) after 7m58s
[02:49:38.389] Received PubSub notification, asking Buildbucket for the build status
[02:49:38.415] Build status: STARTED
[02:57:05.499] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:2:0)
[02:57:05.522] Build status: STARTED
[02:57:05.522] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:4:0) after 3m0s
[03:00:05.636] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:4:0)
[03:00:05.696] Build status: STARTED
[03:00:05.696] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:5:0) after 4m18s
[03:04:23.912] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:5:0)
[03:04:23.946] Build status: STARTED
[03:04:23.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:6:0) after 3m47s
[03:08:11.003] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:6:0)
[03:08:11.032] Build status: STARTED
[03:08:11.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:7:0) after 3m6s
[03:11:17.214] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:7:0)
[03:11:17.257] Build status: STARTED
[03:11:17.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:8:0) after 6m2s
[03:17:19.633] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:8:0)
[03:17:19.661] Build status: STARTED
[03:17:19.661] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:9:0) after 7m1s
[03:24:20.855] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:9:0)
[03:24:20.883] Build status: STARTED
[03:24:20.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:10:0) after 4m20s
[03:28:40.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:10:0)
[03:28:40.992] Build status: STARTED
[03:28:40.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:11:0) after 5m14s
[03:33:55.270] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:11:0)
[03:33:55.301] Build status: STARTED
[03:33:55.301] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:12:0) after 1m2s
[03:34:57.332] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:12:0)
[03:34:57.371] Build status: STARTED
[03:34:57.371] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:13:0) after 6m13s
[03:41:10.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:13:0)
[03:41:10.447] Build status: STARTED
[03:41:10.447] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:14:0) after 6m17s
[03:47:27.480] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:14:0)
[03:47:27.507] Build status: STARTED
[03:47:27.507] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:15:0) after 7m29s
[03:54:56.574] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:15:0)
[03:54:56.619] Build status: STARTED
[03:54:56.619] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:16:0) after 8m33s
[04:03:29.649] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:16:0)
[04:03:29.677] Build status: STARTED
[04:03:29.677] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:17:0) after 7m1s
[04:10:30.713] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:17:0)
[04:10:30.746] Build status: STARTED
[04:10:30.746] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:18:0) after 5m42s
[04:16:12.776] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:18:0)
[04:16:12.829] Build status: STARTED
[04:16:12.829] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:19:0) after 9m53s
[04:26:05.926] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:19:0)
[04:26:05.956] Build status: STARTED
[04:26:05.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:20:0) after 1m15s
[04:27:21.072] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:20:0)
[04:27:21.099] Build status: STARTED
[04:27:21.099] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:21:0) after 3m26s
[04:30:47.271] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:21:0)
[04:30:47.303] Build status: STARTED
[04:30:47.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:22:0) after 3m15s
[04:34:02.336] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:22:0)
[04:34:02.370] Build status: STARTED
[04:34:02.370] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:23:0) after 1m2s
[04:35:04.435] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:23:0)
[04:35:04.465] Build status: STARTED
[04:35:04.465] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:24:0) after 1m56s
[04:37:00.612] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:24:0)
[04:37:00.653] Build status: STARTED
[04:37:00.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:25:0) after 7m40s
[04:44:40.654] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:25:0)
[04:44:40.680] Build status: STARTED
[04:44:40.680] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:26:0) after 8m33s
[04:53:13.740] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:26:0)
[04:53:13.771] Build status: STARTED
[04:53:13.771] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:27:0) after 1m56s
[04:55:10.079] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:27:0)
[04:55:10.112] Build status: STARTED
[04:55:10.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:28:0) after 2m12s
[04:57:22.143] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:28:0)
[04:57:22.172] Build status: STARTED
[04:57:22.172] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:29:0) after 6m27s
[05:03:49.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:29:0)
[05:03:49.231] Build status: STARTED
[05:03:49.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:30:0) after 7m42s
[05:11:31.369] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:30:0)
[05:11:31.408] Build status: STARTED
[05:11:31.408] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:31:0) after 6m43s
[05:18:14.566] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:31:0)
[05:18:14.601] Build status: STARTED
[05:18:14.602] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:32:0) after 3m33s
[05:21:47.631] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:32:0)
[05:21:47.659] Build status: STARTED
[05:21:47.659] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:33:0) after 2m13s
[05:24:00.687] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:33:0)
[05:24:00.717] Build status: STARTED
[05:24:00.718] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:34:0) after 5m8s
[05:29:08.759] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:34:0)
[05:29:08.799] Build status: STARTED
[05:29:08.799] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:35:0) after 6m55s
[05:36:03.951] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:35:0)
[05:36:03.978] Build status: STARTED
[05:36:03.978] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:36:0) after 4m37s
[05:40:41.188] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:36:0)
[05:40:41.223] Build status: STARTED
[05:40:41.223] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:37:0) after 6m0s
[05:46:41.257] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:37:0)
[05:46:41.289] Build status: STARTED
[05:46:41.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:38:0) after 3m40s
[05:50:21.331] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:38:0)
[05:50:21.356] Build status: STARTED
[05:50:21.356] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:39:0) after 3m43s
[05:54:04.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:39:0)
[05:54:04.552] Build status: STARTED
[05:54:04.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:40:0) after 3m18s
[05:57:22.582] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:40:0)
[05:57:22.610] Build status: STARTED
[05:57:22.610] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:41:0) after 2m33s
[05:59:55.643] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:41:0)
[05:59:55.673] Build status: STARTED
[05:59:55.673] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:42:0) after 6m41s
[06:06:36.744] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:42:0)
[06:06:36.770] Build status: STARTED
[06:06:36.770] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:43:0) after 2m39s
[06:09:15.811] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:43:0)
[06:09:15.845] Build status: STARTED
[06:09:15.845] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:44:0) after 1m10s
[06:10:25.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:44:0)
[06:10:25.900] Build status: STARTED
[06:10:25.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:45:0) after 5m58s
[06:16:24.211] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:45:0)
[06:16:24.246] Build status: STARTED
[06:16:24.246] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:46:0) after 5m35s
[06:21:59.370] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:46:0)
[06:21:59.417] Build status: STARTED
[06:21:59.417] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:47:0) after 5m37s
[06:27:36.458] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:47:0)
[06:27:36.495] Build status: STARTED
[06:27:36.495] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:48:0) after 9m17s
[06:36:53.555] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:48:0)
[06:36:53.588] Build status: STARTED
[06:36:53.588] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:49:0) after 1m9s
[06:38:02.653] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:49:0)
[06:38:02.684] Build status: STARTED
[06:38:02.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:50:0) after 1m38s
[06:39:40.859] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:50:0)
[06:39:40.890] Build status: STARTED
[06:39:40.890] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:51:0) after 8m48s
[06:48:28.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:51:0)
[06:48:28.996] Build status: STARTED
[06:48:28.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:52:0) after 5m46s
[06:54:15.076] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:52:0)
[06:54:15.114] Build status: STARTED
[06:54:15.114] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:53:0) after 2m26s
[06:56:41.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:53:0)
[06:56:41.175] Build status: STARTED
[06:56:41.175] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:54:0) after 4m2s
[07:00:43.241] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:54:0)
[07:00:43.285] Build status: STARTED
[07:00:43.285] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:55:0) after 6m56s
[07:07:39.344] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:55:0)
[07:07:39.368] Build status: STARTED
[07:07:39.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:56:0) after 4m13s
[07:11:52.441] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:56:0)
[07:11:52.503] Build status: STARTED
[07:11:52.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:57:0) after 7m52s
[07:19:44.585] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:57:0)
[07:19:44.611] Build status: STARTED
[07:19:44.611] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:58:0) after 2m16s
[07:22:00.657] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:58:0)
[07:22:00.685] Build status: STARTED
[07:22:00.685] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:59:0) after 3m30s
[07:25:30.721] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:59:0)
[07:25:30.747] Build status: STARTED
[07:25:30.747] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:60:0) after 7m46s
[07:33:16.788] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:60:0)
[07:33:16.815] Build status: STARTED
[07:33:16.815] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:61:0) after 6m52s
[07:40:08.844] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:61:0)
[07:40:08.871] Build status: STARTED
[07:40:08.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:62:0) after 8m37s
[07:48:45.919] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:62:0)
[07:48:45.946] Build status: STARTED
[07:48:45.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:63:0) after 9m36s
[07:58:22.045] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:63:0)
[07:58:22.084] Build status: STARTED
[07:58:22.084] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:64:0) after 5m41s
[08:04:03.283] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:64:0)
[08:04:03.309] Build status: STARTED
[08:04:03.309] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:65:0) after 7m38s
[08:11:41.365] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:65:0)
[08:11:41.448] Build status: STARTED
[08:11:41.448] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:66:0) after 5m6s
[08:16:47.488] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:66:0)
[08:16:47.521] Build status: STARTED
[08:16:47.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:67:0) after 9m34s
[08:26:21.571] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:67:0)
[08:26:21.601] Build status: STARTED
[08:26:21.601] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:68:0) after 6m28s
[08:32:49.691] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:68:0)
[08:32:49.721] Build status: STARTED
[08:32:49.721] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:69:0) after 5m17s
[08:38:06.750] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:69:0)
[08:38:06.781] Build status: STARTED
[08:38:06.781] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:70:0) after 7m0s
[08:45:06.812] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:70:0)
[08:45:06.837] Build status: STARTED
[08:45:06.837] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:71:0) after 3m33s
[08:48:39.882] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:71:0)
[08:48:39.912] Build status: STARTED
[08:48:39.912] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:72:0) after 2m33s
[08:51:12.937] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:72:0)
[08:51:12.968] Build status: STARTED
[08:51:12.968] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:73:0) after 2m56s
[08:54:09.148] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:73:0)
[08:54:09.196] Build status: STARTED
[08:54:09.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:74:0) after 6m54s
[09:01:03.369] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:74:0)
[09:01:03.422] Build status: STARTED
[09:01:03.422] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:75:0) after 6m51s
[09:07:54.475] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:75:0)
[09:07:54.502] Build status: STARTED
[09:07:54.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:76:0) after 2m31s
[09:10:25.570] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:76:0)
[09:10:25.599] Build status: STARTED
[09:10:25.599] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:77:0) after 5m47s
[09:16:12.755] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:77:0)
[09:16:12.790] Build status: STARTED
[09:16:12.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:78:0) after 7m3s
[09:23:15.821] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:78:0)
[09:23:15.881] Build status: STARTED
[09:23:15.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:79:0) after 8m4s
[09:31:19.909] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:79:0)
[09:31:19.946] Build status: STARTED
[09:31:19.946] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:80:0) after 8m10s
[09:39:30.061] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:80:0)
[09:39:30.087] Build status: STARTED
[09:39:30.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:81:0) after 9m53s
[09:49:23.162] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:81:0)
[09:49:23.191] Build status: STARTED
[09:49:23.191] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:82:0) after 6m48s
[09:56:11.337] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:82:0)
[09:56:11.376] Build status: STARTED
[09:56:11.376] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:83:0) after 7m46s
[10:03:57.407] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:83:0)
[10:03:57.443] Build status: STARTED
[10:03:57.443] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:84:0) after 6m37s
[10:10:34.474] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:84:0)
[10:10:34.510] Build status: STARTED
[10:10:34.510] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:85:0) after 9m27s
[10:20:01.639] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:85:0)
[10:20:01.682] Build status: STARTED
[10:20:01.682] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:86:0) after 9m49s
[10:29:50.720] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:86:0)
[10:29:50.746] Build status: STARTED
[10:29:50.746] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:87:0) after 6m2s
[10:35:52.919] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:87:0)
[10:35:52.959] Build status: STARTED
[10:35:52.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:88:0) after 6m0s
[10:41:53.096] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:88:0)
[10:41:53.126] Build status: STARTED
[10:41:53.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:89:0) after 3m43s
[10:45:36.124] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:89:0)
[10:45:36.196] Build status: STARTED
[10:45:36.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:90:0) after 2m5s
[10:47:41.230] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:90:0)
[10:47:41.258] Build status: STARTED
[10:47:41.258] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:91:0) after 9m36s
[10:57:17.375] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:91:0)
[10:57:17.413] Build status: STARTED
[10:57:17.413] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:92:0) after 9m27s
[11:06:44.671] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:92:0)
[11:06:44.726] Build status: STARTED
[11:06:44.726] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:93:0) after 2m18s
[11:09:02.864] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:93:0)
[11:09:02.898] Build status: STARTED
[11:09:02.898] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:94:0) after 5m44s
[11:14:46.979] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:94:0)
[11:14:47.051] Build status: STARTED
[11:14:47.051] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:95:0) after 4m16s
[11:19:03.066] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:95:0)
[11:19:03.095] Build status: STARTED
[11:19:03.095] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:96:0) after 3m52s
[11:22:55.361] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:96:0)
[11:22:55.387] Build status: STARTED
[11:22:55.387] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:97:0) after 9m57s
[11:32:52.494] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:97:0)
[11:32:52.523] Build status: STARTED
[11:32:52.524] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:98:0) after 4m12s
[11:37:04.560] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:98:0)
[11:37:04.596] Build status: STARTED
[11:37:04.596] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:99:0) after 2m46s
[11:39:50.728] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:99:0)
[11:39:50.758] Build status: STARTED
[11:39:50.758] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:100:0) after 7m57s
[11:47:47.964] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:100:0)
[11:47:47.991] Build status: STARTED
[11:47:47.991] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:101:0) after 5m33s
[11:53:21.069] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:101:0)
[11:53:21.097] Build status: STARTED
[11:53:21.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:102:0) after 6m44s
[12:00:05.204] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:102:0)
[12:00:05.254] Build status: STARTED
[12:00:05.254] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:103:0) after 5m29s
[12:05:34.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:103:0)
[12:05:34.326] Build status: STARTED
[12:05:34.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:104:0) after 4m31s
[12:10:05.373] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:104:0)
[12:10:05.405] Build status: STARTED
[12:10:05.405] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:105:0) after 9m13s
[12:19:19.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:105:0)
[12:19:19.038] Build status: STARTED
[12:19:19.038] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:106:0) after 5m9s
[12:24:28.317] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:106:0)
[12:24:28.341] Build status: STARTED
[12:24:28.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:107:0) after 4m52s
[12:29:20.370] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:107:0)
[12:29:20.396] Build status: STARTED
[12:29:20.396] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:108:0) after 4m57s
[12:34:17.534] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:108:0)
[12:34:17.561] Build status: STARTED
[12:34:17.561] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:109:0) after 8m59s
[12:43:16.745] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:109:0)
[12:43:16.778] Build status: STARTED
[12:43:16.778] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:110:0) after 1m18s
[12:44:34.839] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:110:0)
[12:44:34.902] Build status: STARTED
[12:44:34.902] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:111:0) after 6m10s
[12:50:44.945] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:111:0)
[12:50:44.974] Build status: STARTED
[12:50:44.974] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:112:0) after 9m48s
[13:00:33.035] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:112:0)
[13:00:33.072] Build status: STARTED
[13:00:33.072] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:113:0) after 8m36s
[13:09:09.138] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:113:0)
[13:09:09.196] Build status: STARTED
[13:09:09.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:114:0) after 3m15s
[13:12:24.258] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:114:0)
[13:12:24.290] Build status: STARTED
[13:12:24.290] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:115:0) after 4m21s
[13:16:45.339] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:115:0)
[13:16:45.394] Build status: STARTED
[13:16:45.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:116:0) after 5m53s
[13:22:38.513] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:116:0)
[13:22:38.551] Build status: STARTED
[13:22:38.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:117:0) after 7m40s
[13:30:18.695] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:117:0)
[13:30:18.722] Build status: STARTED
[13:30:18.722] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:118:0) after 7m24s
[13:37:42.872] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:118:0)
[13:37:42.900] Build status: STARTED
[13:37:42.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:119:0) after 6m35s
[13:44:18.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:119:0)
[13:44:18.201] Build status: STARTED
[13:44:18.201] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:120:0) after 1m32s
[13:45:50.262] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:120:0)
[13:45:50.298] Build status: STARTED
[13:45:50.298] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:121:0) after 6m27s
[13:52:17.328] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:121:0)
[13:52:17.358] Build status: STARTED
[13:52:17.358] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015441361292466496:122:0) after 9m44s
[13:58:32.487] Received PubSub notification, asking Buildbucket for the build status
[13:58:32.528] Build:
{
"id": "8850011299202692576",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3644,
"createdBy": "project:chromium",
"createTime": "2021-04-14T02:49:06.253544Z",
"startTime": "2021-04-14T02:49:37.428859Z",
"endTime": "2021-04-14T13:58:32.160773326Z",
"updateTime": "2021-04-14T13:58:32.161119247Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f2b09a7be872731c3a98974860149780abc42cd6",
"ref": "refs/heads/master"
}
}
}
[13:58:32.528] Invocation finished in 11h9m27.652684956s with status FAILED