[18:12:57.035] New invocation is queued and will start shortly
[18:12:58.127] Starting the invocation (attempt 1)
[18:12:58.178] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/faf5b929762860780f7fe850026c9606a24e3293"
[18:12:58.178] Popped gitiles commit info from properties and tags
[18:12:58.178] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:12:58.178] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:12:58.178] Buildbucket request:
{
"requestId": "9016017415250549216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "faf5b929762860780f7fe850026c9606a24e3293",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9016017415250549216"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:12:58.747] Scheduled build:
{
"id": "8850587353263299792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3630,
"createdBy": "project:chromium",
"createTime": "2021-04-07T18:12:58.290593Z",
"updateTime": "2021-04-07T18:12:58.661646Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "faf5b929762860780f7fe850026c9606a24e3293",
"ref": "refs/heads/master"
}
}
}
[18:12:58.747] Task URL: https://cr-buildbucket.appspot.com/build/8850587353263299792
[18:12:58.747] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:2:0) after 9m4s
[18:16:08.053] Received PubSub notification, asking Buildbucket for the build status
[18:16:08.085] Build status: STARTED
[18:22:02.898] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:2:0)
[18:22:02.930] Build status: STARTED
[18:22:02.930] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:4:0) after 8m44s
[18:30:47.291] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:4:0)
[18:30:47.323] Build status: STARTED
[18:30:47.323] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:5:0) after 5m14s
[18:36:01.419] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:5:0)
[18:36:01.448] Build status: STARTED
[18:36:01.448] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:6:0) after 8m30s
[18:44:31.784] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:6:0)
[18:44:31.820] Build status: STARTED
[18:44:31.820] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:7:0) after 4m15s
[18:48:46.895] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:7:0)
[18:48:46.923] Build status: STARTED
[18:48:46.923] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:8:0) after 1m19s
[18:50:05.987] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:8:0)
[18:50:06.016] Build status: STARTED
[18:50:06.016] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:9:0) after 9m42s
[18:59:48.061] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:9:0)
[18:59:48.087] Build status: STARTED
[18:59:48.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:10:0) after 3m43s
[19:03:31.391] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:10:0)
[19:03:31.423] Build status: STARTED
[19:03:31.423] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:11:0) after 5m51s
[19:09:22.445] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:11:0)
[19:09:22.487] Build status: STARTED
[19:09:22.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:12:0) after 9m37s
[19:18:59.519] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:12:0)
[19:18:59.548] Build status: STARTED
[19:18:59.548] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:13:0) after 9m1s
[19:28:00.571] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:13:0)
[19:28:00.618] Build status: STARTED
[19:28:00.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:14:0) after 9m55s
[19:37:55.822] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:14:0)
[19:37:55.847] Build status: STARTED
[19:37:55.847] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:15:0) after 5m55s
[19:43:50.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:15:0)
[19:43:50.905] Build status: STARTED
[19:43:50.905] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:16:0) after 8m10s
[19:52:01.027] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:16:0)
[19:52:01.104] Build status: STARTED
[19:52:01.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:17:0) after 1m3s
[19:53:04.139] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:17:0)
[19:53:04.197] Build status: STARTED
[19:53:04.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:18:0) after 5m42s
[19:58:46.220] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:18:0)
[19:58:46.248] Build status: STARTED
[19:58:46.248] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:19:0) after 3m44s
[20:02:30.543] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:19:0)
[20:02:30.571] Build status: STARTED
[20:02:30.571] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:20:0) after 8m11s
[20:10:42.109] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:20:0)
[20:10:42.140] Build status: STARTED
[20:10:42.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:21:0) after 4m52s
[20:15:34.359] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:21:0)
[20:15:34.388] Build status: STARTED
[20:15:34.388] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:22:0) after 2m54s
[20:18:28.532] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:22:0)
[20:18:28.580] Build status: STARTED
[20:18:28.580] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:23:0) after 4m41s
[20:23:09.614] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:23:0)
[20:23:09.639] Build status: STARTED
[20:23:09.639] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:24:0) after 2m53s
[20:26:02.659] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:24:0)
[20:26:02.689] Build status: STARTED
[20:26:02.689] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:25:0) after 3m34s
[20:29:36.752] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:25:0)
[20:29:36.779] Build status: STARTED
[20:29:36.779] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:26:0) after 6m36s
[20:36:12.812] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:26:0)
[20:36:12.858] Build status: STARTED
[20:36:12.858] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:27:0) after 9m48s
[20:46:01.248] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:27:0)
[20:46:01.275] Build status: STARTED
[20:46:01.275] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:28:0) after 5m4s
[20:51:05.590] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:28:0)
[20:51:05.618] Build status: STARTED
[20:51:05.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:29:0) after 1m28s
[20:52:33.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:29:0)
[20:52:33.673] Build status: STARTED
[20:52:33.673] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:30:0) after 4m14s
[20:56:47.705] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:30:0)
[20:56:47.738] Build status: STARTED
[20:56:47.738] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:31:0) after 4m23s
[21:01:10.764] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:31:0)
[21:01:10.791] Build status: STARTED
[21:01:10.791] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:32:0) after 6m46s
[21:07:56.855] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:32:0)
[21:07:56.880] Build status: STARTED
[21:07:56.880] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:33:0) after 9m29s
[21:17:26.018] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:33:0)
[21:17:26.051] Build status: STARTED
[21:17:26.051] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:34:0) after 6m35s
[21:24:01.035] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:34:0)
[21:24:01.083] Build status: STARTED
[21:24:01.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:35:0) after 1m5s
[21:25:06.320] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:35:0)
[21:25:06.384] Build status: STARTED
[21:25:06.385] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:36:0) after 5m23s
[21:30:29.524] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:36:0)
[21:30:29.552] Build status: STARTED
[21:30:29.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:37:0) after 2m47s
[21:33:16.613] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:37:0)
[21:33:16.642] Build status: STARTED
[21:33:16.642] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:38:0) after 4m44s
[21:38:01.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:38:0)
[21:38:01.135] Build status: STARTED
[21:38:01.135] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:39:0) after 3m2s
[21:41:03.158] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:39:0)
[21:41:03.186] Build status: STARTED
[21:41:03.186] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:40:0) after 3m42s
[21:44:45.220] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:40:0)
[21:44:45.248] Build status: STARTED
[21:44:45.248] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:41:0) after 4m56s
[21:49:41.271] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:41:0)
[21:49:41.303] Build status: STARTED
[21:49:41.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:42:0) after 3m43s
[21:53:24.485] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:42:0)
[21:53:24.511] Build status: STARTED
[21:53:24.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:43:0) after 8m11s
[22:01:35.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:43:0)
[22:01:35.567] Build status: STARTED
[22:01:35.567] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:44:0) after 1m54s
[22:03:29.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:44:0)
[22:03:29.656] Build status: STARTED
[22:03:29.656] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:45:0) after 8m42s
[22:12:11.827] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:45:0)
[22:12:11.887] Build status: STARTED
[22:12:11.887] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:46:0) after 7m29s
[22:19:40.952] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:46:0)
[22:19:40.995] Build status: STARTED
[22:19:40.995] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:47:0) after 3m21s
[22:23:02.139] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:47:0)
[22:23:02.213] Build status: STARTED
[22:23:02.213] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:48:0) after 9m52s
[22:32:54.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:48:0)
[22:32:54.511] Build status: STARTED
[22:32:54.511] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:49:0) after 7m18s
[22:40:12.733] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:49:0)
[22:40:12.761] Build status: STARTED
[22:40:12.761] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:50:0) after 9m21s
[22:49:33.995] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:50:0)
[22:49:34.027] Build status: STARTED
[22:49:34.027] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:51:0) after 5m51s
[22:55:25.200] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:51:0)
[22:55:25.233] Build status: STARTED
[22:55:25.233] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:52:0) after 1m18s
[22:56:43.303] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:52:0)
[22:56:43.334] Build status: STARTED
[22:56:43.334] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:53:0) after 7m18s
[23:04:01.361] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:53:0)
[23:04:01.394] Build status: STARTED
[23:04:01.394] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:54:0) after 2m27s
[23:06:28.423] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:54:0)
[23:06:28.492] Build status: STARTED
[23:06:28.492] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:55:0) after 7m39s
[23:14:07.752] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:55:0)
[23:14:07.777] Build status: STARTED
[23:14:07.777] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:56:0) after 4m0s
[23:18:07.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:56:0)
[23:18:07.955] Build status: STARTED
[23:18:07.955] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:57:0) after 9m35s
[23:27:43.013] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:57:0)
[23:27:43.046] Build status: STARTED
[23:27:43.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:58:0) after 5m25s
[23:33:08.228] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:58:0)
[23:33:08.256] Build status: STARTED
[23:33:08.256] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:59:0) after 1m17s
[23:34:25.295] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:59:0)
[23:34:25.327] Build status: STARTED
[23:34:25.327] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:60:0) after 8m17s
[23:42:42.362] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:60:0)
[23:42:42.395] Build status: STARTED
[23:42:42.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:61:0) after 8m6s
[23:50:48.419] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:61:0)
[23:50:48.445] Build status: STARTED
[23:50:48.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:62:0) after 7m5s
[23:57:53.693] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:62:0)
[23:57:53.728] Build status: STARTED
[23:57:53.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:63:0) after 1m7s
[23:59:00.893] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:63:0)
[23:59:00.923] Build status: STARTED
[23:59:00.923] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:64:0) after 7m46s
[00:06:47.055] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:64:0)
[00:06:47.083] Build status: STARTED
[00:06:47.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:65:0) after 4m17s
[00:11:04.258] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:65:0)
[00:11:04.290] Build status: STARTED
[00:11:04.290] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:66:0) after 2m6s
[00:13:10.405] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:66:0)
[00:13:10.481] Build status: STARTED
[00:13:10.481] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:67:0) after 8m18s
[00:21:28.867] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:67:0)
[00:21:28.901] Build status: STARTED
[00:21:28.901] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:68:0) after 9m26s
[00:30:55.293] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:68:0)
[00:30:55.326] Build status: STARTED
[00:30:55.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:69:0) after 1m36s
[00:32:31.355] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:69:0)
[00:32:31.390] Build status: STARTED
[00:32:31.390] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:70:0) after 6m51s
[00:39:22.423] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:70:0)
[00:39:22.493] Build status: STARTED
[00:39:22.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:71:0) after 4m3s
[00:43:25.516] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:71:0)
[00:43:25.544] Build status: STARTED
[00:43:25.544] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:72:0) after 4m38s
[00:48:03.567] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:72:0)
[00:48:03.598] Build status: STARTED
[00:48:03.598] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:73:0) after 5m19s
[00:53:22.625] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:73:0)
[00:53:22.652] Build status: STARTED
[00:53:22.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:74:0) after 4m55s
[00:58:17.716] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:74:0)
[00:58:17.762] Build status: STARTED
[00:58:17.762] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:75:0) after 6m42s
[01:05:00.016] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:75:0)
[01:05:00.061] Build status: STARTED
[01:05:00.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:76:0) after 8m59s
[01:13:59.089] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:76:0)
[01:13:59.118] Build status: STARTED
[01:13:59.118] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:77:0) after 7m38s
[01:21:37.319] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:77:0)
[01:21:37.345] Build status: STARTED
[01:21:37.345] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:78:0) after 8m48s
[01:30:25.615] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:78:0)
[01:30:25.647] Build status: STARTED
[01:30:25.647] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:79:0) after 2m40s
[01:33:05.671] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:79:0)
[01:33:05.702] Build status: STARTED
[01:33:05.702] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:80:0) after 3m2s
[01:36:07.725] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:80:0)
[01:36:07.755] Build status: STARTED
[01:36:07.755] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:81:0) after 1m47s
[01:37:54.783] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:81:0)
[01:37:54.828] Build status: STARTED
[01:37:54.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:82:0) after 2m44s
[01:40:39.253] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:82:0)
[01:40:39.281] Build status: STARTED
[01:40:39.281] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:83:0) after 6m33s
[01:47:12.403] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:83:0)
[01:47:12.434] Build status: STARTED
[01:47:12.434] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:84:0) after 7m55s
[01:55:07.502] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:84:0)
[01:55:07.534] Build status: STARTED
[01:55:07.534] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:85:0) after 1m31s
[01:56:38.669] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:85:0)
[01:56:38.710] Build status: STARTED
[01:56:38.710] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:86:0) after 8m52s
[02:05:30.838] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:86:0)
[02:05:30.867] Build status: STARTED
[02:05:30.867] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:87:0) after 8m13s
[02:13:43.945] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:87:0)
[02:13:43.980] Build status: STARTED
[02:13:43.980] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:88:0) after 1m36s
[02:15:20.183] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:88:0)
[02:15:20.316] Build status: STARTED
[02:15:20.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:89:0) after 5m58s
[02:21:18.367] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:89:0)
[02:21:18.418] Build status: STARTED
[02:21:18.418] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:90:0) after 4m28s
[02:25:46.444] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:90:0)
[02:25:46.550] Build status: STARTED
[02:25:46.550] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:91:0) after 6m50s
[02:32:36.752] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:91:0)
[02:32:36.786] Build status: STARTED
[02:32:36.786] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:92:0) after 6m40s
[02:39:16.856] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:92:0)
[02:39:16.892] Build status: STARTED
[02:39:16.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:93:0) after 8m14s
[02:47:31.028] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:93:0)
[02:47:31.057] Build status: STARTED
[02:47:31.057] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:94:0) after 2m9s
[02:49:40.081] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:94:0)
[02:49:40.133] Build status: STARTED
[02:49:40.133] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:95:0) after 8m19s
[02:57:59.160] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:95:0)
[02:57:59.191] Build status: STARTED
[02:57:59.191] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:96:0) after 6m30s
[03:04:29.316] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:96:0)
[03:04:29.350] Build status: STARTED
[03:04:29.350] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:97:0) after 7m20s
[03:11:49.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:97:0)
[03:11:49.404] Build status: STARTED
[03:11:49.404] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:98:0) after 1m47s
[03:13:36.596] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:98:0)
[03:13:36.625] Build status: STARTED
[03:13:36.625] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:99:0) after 1m42s
[03:15:18.654] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:99:0)
[03:15:18.683] Build status: STARTED
[03:15:18.683] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:100:0) after 4m20s
[03:19:39.111] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:100:0)
[03:19:39.140] Build status: STARTED
[03:19:39.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:101:0) after 8m32s
[03:28:11.196] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:101:0)
[03:28:11.225] Build status: STARTED
[03:28:11.225] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:102:0) after 1m15s
[03:29:26.249] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:102:0)
[03:29:26.311] Build status: STARTED
[03:29:26.311] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:103:0) after 5m49s
[03:35:15.341] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:103:0)
[03:35:15.370] Build status: STARTED
[03:35:15.370] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:104:0) after 5m25s
[03:40:40.495] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:104:0)
[03:40:40.531] Build status: STARTED
[03:40:40.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:105:0) after 8m6s
[03:48:46.563] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:105:0)
[03:48:46.590] Build status: STARTED
[03:48:46.590] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:106:0) after 1m29s
[03:50:15.675] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:106:0)
[03:50:15.703] Build status: STARTED
[03:50:15.703] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:107:0) after 6m24s
[03:56:39.830] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:107:0)
[03:56:39.863] Build status: STARTED
[03:56:39.863] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:108:0) after 7m2s
[04:03:42.232] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:108:0)
[04:03:42.262] Build status: STARTED
[04:03:42.262] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:109:0) after 2m57s
[04:06:39.286] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:109:0)
[04:06:39.311] Build status: STARTED
[04:06:39.311] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:110:0) after 5m58s
[04:12:37.360] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:110:0)
[04:12:37.398] Build status: STARTED
[04:12:37.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:111:0) after 7m13s
[04:19:50.468] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:111:0)
[04:19:50.498] Build status: STARTED
[04:19:50.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:112:0) after 3m17s
[04:23:07.538] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:112:0)
[04:23:07.564] Build status: STARTED
[04:23:07.564] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:113:0) after 8m59s
[04:32:06.735] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:113:0)
[04:32:06.770] Build status: STARTED
[04:32:06.770] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:114:0) after 3m56s
[04:36:02.795] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:114:0)
[04:36:02.824] Build status: STARTED
[04:36:02.824] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:115:0) after 4m26s
[04:40:28.855] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:115:0)
[04:40:28.884] Build status: STARTED
[04:40:28.884] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:116:0) after 8m28s
[04:48:56.925] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:116:0)
[04:48:56.950] Build status: STARTED
[04:48:56.950] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:117:0) after 9m31s
[04:58:27.979] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:117:0)
[04:58:28.013] Build status: STARTED
[04:58:28.013] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:118:0) after 3m43s
[05:02:11.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:118:0)
[05:02:11.131] Build status: STARTED
[05:02:11.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:119:0) after 4m35s
[05:06:46.252] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:119:0)
[05:06:46.288] Build status: STARTED
[05:06:46.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:120:0) after 6m41s
[05:13:27.317] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:120:0)
[05:13:27.343] Build status: STARTED
[05:13:27.343] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:121:0) after 4m35s
[05:18:02.359] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:121:0)
[05:18:02.386] Build status: STARTED
[05:18:02.386] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9016017415250549216:122:0) after 4m16s
[05:18:50.109] Received PubSub notification, asking Buildbucket for the build status
[05:18:50.132] Build:
{
"id": "8850587353263299792",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3630,
"createdBy": "project:chromium",
"createTime": "2021-04-07T18:12:58.290593Z",
"startTime": "2021-04-07T18:16:06.991531Z",
"endTime": "2021-04-08T05:18:49.700512586Z",
"updateTime": "2021-04-08T05:18:49.700939829Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "faf5b929762860780f7fe850026c9606a24e3293",
"ref": "refs/heads/master"
}
}
}
[05:18:50.132] Invocation finished in 11h5m53.120001049s with status FAILED