[03:24:43.269] New invocation is queued and will start shortly
[03:24:44.413] Starting the invocation (attempt 1)
[03:24:44.447] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5119a8f0d3286f239457217f723fb9971fa917fd"
[03:24:44.447] Popped gitiles commit info from properties and tags
[03:24:44.447] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:24:44.447] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:24:44.447] Buildbucket request:
{
"requestId": "9014895537244035232",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5119a8f0d3286f239457217f723fb9971fa917fd",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9014895537244035232"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:24:45.012] Scheduled build:
{
"id": "8849465475260168352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3657,
"createdBy": "project:chromium",
"createTime": "2021-04-20T03:24:44.528412Z",
"updateTime": "2021-04-20T03:24:44.946181Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5119a8f0d3286f239457217f723fb9971fa917fd",
"ref": "refs/heads/master"
}
}
}
[03:24:45.012] Task URL: https://cr-buildbucket.appspot.com/build/8849465475260168352
[03:24:45.012] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:2:0) after 4m50s
[03:27:59.176] Received PubSub notification, asking Buildbucket for the build status
[03:27:59.202] Build status: STARTED
[03:29:35.100] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:2:0)
[03:29:35.131] Build status: STARTED
[03:29:35.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:4:0) after 3m11s
[03:32:46.153] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:4:0)
[03:32:46.195] Build status: STARTED
[03:32:46.195] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:5:0) after 6m37s
[03:39:23.515] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:5:0)
[03:39:23.611] Build status: STARTED
[03:39:23.611] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:6:0) after 1m36s
[03:40:59.672] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:6:0)
[03:40:59.706] Build status: STARTED
[03:40:59.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:7:0) after 8m41s
[03:49:40.738] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:7:0)
[03:49:40.769] Build status: STARTED
[03:49:40.769] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:8:0) after 7m13s
[03:56:53.804] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:8:0)
[03:56:53.835] Build status: STARTED
[03:56:53.835] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:9:0) after 8m22s
[04:05:15.863] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:9:0)
[04:05:15.896] Build status: STARTED
[04:05:15.896] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:10:0) after 2m24s
[04:07:39.953] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:10:0)
[04:07:39.985] Build status: STARTED
[04:07:39.985] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:11:0) after 3m15s
[04:10:55.012] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:11:0)
[04:10:55.041] Build status: STARTED
[04:10:55.041] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:12:0) after 7m18s
[04:18:13.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:12:0)
[04:18:13.098] Build status: STARTED
[04:18:13.098] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:13:0) after 3m43s
[04:21:56.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:13:0)
[04:21:56.295] Build status: STARTED
[04:21:56.295] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:14:0) after 5m55s
[04:27:51.343] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:14:0)
[04:27:51.370] Build status: STARTED
[04:27:51.370] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:15:0) after 7m16s
[04:35:07.396] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:15:0)
[04:35:07.428] Build status: STARTED
[04:35:07.428] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:16:0) after 4m32s
[04:39:39.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:16:0)
[04:39:39.615] Build status: STARTED
[04:39:39.615] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:17:0) after 2m45s
[04:42:24.644] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:17:0)
[04:42:24.670] Build status: STARTED
[04:42:24.670] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:18:0) after 6m0s
[04:48:24.707] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:18:0)
[04:48:24.740] Build status: STARTED
[04:48:24.740] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:19:0) after 8m25s
[04:56:49.818] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:19:0)
[04:56:49.845] Build status: STARTED
[04:56:49.845] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:20:0) after 3m14s
[05:00:04.095] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:20:0)
[05:00:04.126] Build status: STARTED
[05:00:04.126] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:21:0) after 6m19s
[05:06:23.203] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:21:0)
[05:06:23.236] Build status: STARTED
[05:06:23.236] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:22:0) after 1m13s
[05:07:36.460] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:22:0)
[05:07:36.491] Build status: STARTED
[05:07:36.491] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:23:0) after 6m33s
[05:14:09.603] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:23:0)
[05:14:09.633] Build status: STARTED
[05:14:09.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:24:0) after 2m6s
[05:16:15.657] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:24:0)
[05:16:15.684] Build status: STARTED
[05:16:15.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:25:0) after 5m41s
[05:21:56.718] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:25:0)
[05:21:56.749] Build status: STARTED
[05:21:56.749] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:26:0) after 4m46s
[05:26:42.779] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:26:0)
[05:26:42.808] Build status: STARTED
[05:26:42.808] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:27:0) after 1m26s
[05:28:08.966] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:27:0)
[05:28:08.993] Build status: STARTED
[05:28:08.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:28:0) after 7m6s
[05:35:15.108] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:28:0)
[05:35:15.174] Build status: STARTED
[05:35:15.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:29:0) after 9m11s
[05:44:26.403] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:29:0)
[05:44:26.513] Build status: STARTED
[05:44:26.513] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:30:0) after 1m44s
[05:46:10.653] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:30:0)
[05:46:10.693] Build status: STARTED
[05:46:10.693] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:31:0) after 8m52s
[05:55:02.765] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:31:0)
[05:55:02.808] Build status: STARTED
[05:55:02.808] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:32:0) after 3m48s
[05:58:50.948] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:32:0)
[05:58:50.981] Build status: STARTED
[05:58:50.981] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:33:0) after 2m45s
[06:01:36.207] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:33:0)
[06:01:36.253] Build status: STARTED
[06:01:36.253] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:34:0) after 6m41s
[06:08:17.422] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:34:0)
[06:08:17.452] Build status: STARTED
[06:08:17.453] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:35:0) after 9m19s
[06:17:36.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:35:0)
[06:17:36.551] Build status: STARTED
[06:17:36.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:36:0) after 8m46s
[06:26:22.587] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:36:0)
[06:26:22.652] Build status: STARTED
[06:26:22.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:37:0) after 1m14s
[06:27:36.783] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:37:0)
[06:27:36.831] Build status: STARTED
[06:27:36.831] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:38:0) after 6m39s
[06:34:15.863] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:38:0)
[06:34:15.896] Build status: STARTED
[06:34:15.896] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:39:0) after 7m27s
[06:41:42.928] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:39:0)
[06:41:42.959] Build status: STARTED
[06:41:42.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:40:0) after 5m13s
[06:46:55.980] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:40:0)
[06:46:56.011] Build status: STARTED
[06:46:56.011] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:41:0) after 4m59s
[06:51:55.053] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:41:0)
[06:51:55.082] Build status: STARTED
[06:51:55.082] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:42:0) after 3m33s
[06:55:28.276] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:42:0)
[06:55:28.314] Build status: STARTED
[06:55:28.314] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:43:0) after 3m30s
[06:58:58.445] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:43:0)
[06:58:58.520] Build status: STARTED
[06:58:58.520] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:44:0) after 1m6s
[07:00:04.581] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:44:0)
[07:00:04.611] Build status: STARTED
[07:00:04.611] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:45:0) after 7m4s
[07:07:08.642] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:45:0)
[07:07:08.674] Build status: STARTED
[07:07:08.674] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:46:0) after 1m5s
[07:08:13.768] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:46:0)
[07:08:13.797] Build status: STARTED
[07:08:13.797] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:47:0) after 9m15s
[07:17:28.914] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:47:0)
[07:17:28.942] Build status: STARTED
[07:17:28.942] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:48:0) after 5m0s
[07:22:29.267] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:48:0)
[07:22:29.308] Build status: STARTED
[07:22:29.308] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:49:0) after 7m17s
[07:29:46.353] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:49:0)
[07:29:46.382] Build status: STARTED
[07:29:46.382] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:50:0) after 5m28s
[07:35:14.446] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:50:0)
[07:35:14.478] Build status: STARTED
[07:35:14.478] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:51:0) after 4m4s
[07:39:18.606] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:51:0)
[07:39:18.636] Build status: STARTED
[07:39:18.636] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:52:0) after 9m59s
[07:49:17.793] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:52:0)
[07:49:17.824] Build status: STARTED
[07:49:17.824] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:53:0) after 1m3s
[07:50:20.869] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:53:0)
[07:50:20.913] Build status: STARTED
[07:50:20.913] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:54:0) after 5m20s
[07:55:40.997] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:54:0)
[07:55:41.092] Build status: STARTED
[07:55:41.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:55:0) after 3m56s
[07:59:37.133] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:55:0)
[07:59:37.189] Build status: STARTED
[07:59:37.189] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:56:0) after 7m27s
[08:07:04.310] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:56:0)
[08:07:04.354] Build status: STARTED
[08:07:04.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:57:0) after 9m6s
[08:16:10.505] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:57:0)
[08:16:10.546] Build status: STARTED
[08:16:10.546] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:58:0) after 7m42s
[08:23:52.606] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:58:0)
[08:23:52.641] Build status: STARTED
[08:23:52.641] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:59:0) after 3m23s
[08:27:15.758] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:59:0)
[08:27:15.793] Build status: STARTED
[08:27:15.793] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:60:0) after 7m27s
[08:34:42.838] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:60:0)
[08:34:42.863] Build status: STARTED
[08:34:42.863] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:61:0) after 1m7s
[08:35:50.095] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:61:0)
[08:35:50.169] Build status: STARTED
[08:35:50.169] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:62:0) after 7m42s
[08:43:32.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:62:0)
[08:43:32.289] Build status: STARTED
[08:43:32.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:63:0) after 2m5s
[08:45:37.324] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:63:0)
[08:45:37.359] Build status: STARTED
[08:45:37.359] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:64:0) after 8m1s
[08:53:38.597] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:64:0)
[08:53:38.623] Build status: STARTED
[08:53:38.623] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:65:0) after 1m8s
[08:54:46.674] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:65:0)
[08:54:46.710] Build status: STARTED
[08:54:46.710] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:66:0) after 1m21s
[08:56:07.823] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:66:0)
[08:56:07.853] Build status: STARTED
[08:56:07.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:67:0) after 8m27s
[09:04:34.992] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:67:0)
[09:04:35.032] Build status: STARTED
[09:04:35.032] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:68:0) after 8m2s
[09:12:37.104] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:68:0)
[09:12:37.140] Build status: STARTED
[09:12:37.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:69:0) after 2m44s
[09:15:21.278] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:69:0)
[09:15:21.325] Build status: STARTED
[09:15:21.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:70:0) after 8m14s
[09:23:35.377] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:70:0)
[09:23:35.406] Build status: STARTED
[09:23:35.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:71:0) after 3m1s
[09:26:36.430] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:71:0)
[09:26:36.476] Build status: STARTED
[09:26:36.476] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:72:0) after 2m38s
[09:29:14.908] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:72:0)
[09:29:14.935] Build status: STARTED
[09:29:14.935] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:73:0) after 5m15s
[09:34:30.071] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:73:0)
[09:34:30.104] Build status: STARTED
[09:34:30.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:74:0) after 1m40s
[09:36:10.129] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:74:0)
[09:36:10.156] Build status: STARTED
[09:36:10.156] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:75:0) after 3m7s
[09:39:17.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:75:0)
[09:39:17.303] Build status: STARTED
[09:39:17.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:76:0) after 9m0s
[09:48:17.344] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:76:0)
[09:48:17.407] Build status: STARTED
[09:48:17.407] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:77:0) after 3m23s
[09:51:40.432] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:77:0)
[09:51:40.462] Build status: STARTED
[09:51:40.462] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:78:0) after 7m30s
[09:59:10.504] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:78:0)
[09:59:10.533] Build status: STARTED
[09:59:10.533] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:79:0) after 5m14s
[10:04:24.604] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:79:0)
[10:04:24.633] Build status: STARTED
[10:04:24.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:80:0) after 7m46s
[10:12:10.844] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:80:0)
[10:12:10.881] Build status: STARTED
[10:12:10.881] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:81:0) after 5m5s
[10:17:16.088] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:81:0)
[10:17:16.119] Build status: STARTED
[10:17:16.119] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:82:0) after 4m5s
[10:21:21.325] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:82:0)
[10:21:21.393] Build status: STARTED
[10:21:21.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:83:0) after 3m10s
[10:24:31.449] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:83:0)
[10:24:31.489] Build status: STARTED
[10:24:31.489] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:84:0) after 4m46s
[10:29:17.647] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:84:0)
[10:29:17.676] Build status: STARTED
[10:29:17.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:85:0) after 1m19s
[10:30:36.709] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:85:0)
[10:30:36.746] Build status: STARTED
[10:30:36.746] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:86:0) after 2m14s
[10:32:50.793] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:86:0)
[10:32:50.826] Build status: STARTED
[10:32:50.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:87:0) after 2m44s
[10:35:34.875] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:87:0)
[10:35:34.977] Build status: STARTED
[10:35:34.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:88:0) after 8m37s
[10:44:12.486] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:88:0)
[10:44:12.607] Build status: STARTED
[10:44:12.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:89:0) after 3m42s
[10:47:54.870] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:89:0)
[10:47:54.911] Build status: STARTED
[10:47:54.911] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:90:0) after 9m43s
[10:57:37.958] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:90:0)
[10:57:37.994] Build status: STARTED
[10:57:37.994] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:91:0) after 3m6s
[11:00:44.052] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:91:0)
[11:00:44.112] Build status: STARTED
[11:00:44.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:92:0) after 7m32s
[11:08:16.243] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:92:0)
[11:08:16.324] Build status: STARTED
[11:08:16.324] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:93:0) after 7m21s
[11:15:37.541] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:93:0)
[11:15:37.572] Build status: STARTED
[11:15:37.572] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:94:0) after 2m56s
[11:18:33.604] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:94:0)
[11:18:33.633] Build status: STARTED
[11:18:33.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:95:0) after 8m33s
[11:27:06.797] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:95:0)
[11:27:06.836] Build status: STARTED
[11:27:06.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:96:0) after 5m1s
[11:32:07.954] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:96:0)
[11:32:08.024] Build status: STARTED
[11:32:08.024] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:97:0) after 9m40s
[11:41:48.062] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:97:0)
[11:41:48.092] Build status: STARTED
[11:41:48.092] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:98:0) after 5m37s
[11:47:25.131] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:98:0)
[11:47:25.177] Build status: STARTED
[11:47:25.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:99:0) after 6m2s
[11:53:27.333] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:99:0)
[11:53:27.361] Build status: STARTED
[11:53:27.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:100:0) after 7m27s
[12:00:54.427] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:100:0)
[12:00:54.474] Build status: STARTED
[12:00:54.474] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:101:0) after 6m19s
[12:07:13.577] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:101:0)
[12:07:13.607] Build status: STARTED
[12:07:13.607] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:102:0) after 8m29s
[12:15:42.695] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:102:0)
[12:15:42.728] Build status: STARTED
[12:15:42.728] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:103:0) after 2m32s
[12:18:14.820] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:103:0)
[12:18:14.854] Build status: STARTED
[12:18:14.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:104:0) after 7m0s
[12:25:14.972] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:104:0)
[12:25:15.011] Build status: STARTED
[12:25:15.011] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:105:0) after 2m50s
[12:28:05.049] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:105:0)
[12:28:05.078] Build status: STARTED
[12:28:05.078] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:106:0) after 4m25s
[12:32:30.156] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:106:0)
[12:32:30.194] Build status: STARTED
[12:32:30.194] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:107:0) after 7m48s
[12:40:18.347] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:107:0)
[12:40:18.378] Build status: STARTED
[12:40:18.378] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:108:0) after 1m56s
[12:42:14.409] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:108:0)
[12:42:14.470] Build status: STARTED
[12:42:14.470] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:109:0) after 5m36s
[12:47:50.668] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:109:0)
[12:47:50.714] Build status: STARTED
[12:47:50.714] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:110:0) after 1m42s
[12:49:32.760] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:110:0)
[12:49:32.801] Build status: STARTED
[12:49:32.801] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:111:0) after 5m12s
[12:54:44.845] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:111:0)
[12:54:44.875] Build status: STARTED
[12:54:44.875] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:112:0) after 5m2s
[12:59:47.054] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:112:0)
[12:59:47.085] Build status: STARTED
[12:59:47.085] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:113:0) after 6m27s
[13:06:14.116] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:113:0)
[13:06:14.153] Build status: STARTED
[13:06:14.153] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:114:0) after 4m29s
[13:10:43.247] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:114:0)
[13:10:43.280] Build status: STARTED
[13:10:43.280] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:115:0) after 2m4s
[13:12:47.509] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:115:0)
[13:12:47.565] Build status: STARTED
[13:12:47.565] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:116:0) after 2m32s
[13:15:19.701] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:116:0)
[13:15:19.734] Build status: STARTED
[13:15:19.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:117:0) after 1m33s
[13:16:52.778] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:117:0)
[13:16:52.809] Build status: STARTED
[13:16:52.809] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:118:0) after 2m47s
[13:19:39.886] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:118:0)
[13:19:39.913] Build status: STARTED
[13:19:39.913] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:119:0) after 8m56s
[13:28:35.950] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:119:0)
[13:28:35.977] Build status: STARTED
[13:28:35.977] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:120:0) after 8m40s
[13:37:16.301] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:120:0)
[13:37:16.327] Build status: STARTED
[13:37:16.327] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:121:0) after 7m27s
[13:44:43.532] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:121:0)
[13:44:43.561] Build status: STARTED
[13:44:43.561] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:122:0) after 8m18s
[13:53:01.676] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:122:0)
[13:53:01.714] Build status: STARTED
[13:53:01.714] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:123:0) after 2m18s
[13:55:19.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:123:0)
[13:55:19.998] Build status: STARTED
[13:55:19.998] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:124:0) after 1m20s
[13:56:40.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:124:0)
[13:56:40.319] Build status: STARTED
[13:56:40.319] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:125:0) after 4m53s
[14:01:33.338] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:125:0)
[14:01:33.368] Build status: STARTED
[14:01:33.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:126:0) after 3m18s
[14:04:51.520] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:126:0)
[14:04:51.551] Build status: STARTED
[14:04:51.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:127:0) after 9m51s
[14:14:42.878] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:127:0)
[14:14:42.947] Build status: STARTED
[14:14:42.947] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:128:0) after 3m11s
[14:17:54.006] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:128:0)
[14:17:54.037] Build status: STARTED
[14:17:54.037] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:129:0) after 9m19s
[14:27:13.050] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:129:0)
[14:27:13.090] Build status: STARTED
[14:27:13.090] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:130:0) after 4m38s
[14:31:51.218] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:130:0)
[14:31:51.243] Build status: STARTED
[14:31:51.243] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9014895537244035232:131:0) after 8m43s
[14:40:00.155] Received PubSub notification, asking Buildbucket for the build status
[14:40:00.187] Build:
{
"id": "8849465475260168352",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3657,
"createdBy": "project:chromium",
"createTime": "2021-04-20T03:24:44.528412Z",
"startTime": "2021-04-20T03:27:58.407326Z",
"endTime": "2021-04-20T14:39:59.683109743Z",
"updateTime": "2021-04-20T14:39:59.683454886Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5119a8f0d3286f239457217f723fb9971fa917fd",
"ref": "refs/heads/master"
}
}
}
[14:40:00.187] Invocation finished in 11h15m16.934056825s with status FAILED