[23:46:12.269] New invocation is queued and will start shortly
[23:46:13.456] Starting the invocation (attempt 1)
[23:46:13.492] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f84d11ba17c06b0406e8e1ccbd29b1641cf139b6"
[23:46:13.492] Popped gitiles commit info from properties and tags
[23:46:13.492] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:46:13.492] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:46:13.492] Buildbucket request:
{
"requestId": "9015271672991709696",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f84d11ba17c06b0406e8e1ccbd29b1641cf139b6",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015271672991709696"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:46:15.242] Scheduled build:
{
"id": "8849841610022700480",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3648,
"createdBy": "project:chromium",
"createTime": "2021-04-15T23:46:14.466727Z",
"updateTime": "2021-04-15T23:46:14.925689Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f84d11ba17c06b0406e8e1ccbd29b1641cf139b6",
"ref": "refs/heads/master"
}
}
}
[23:46:15.243] Task URL: https://cr-buildbucket.appspot.com/build/8849841610022700480
[23:46:15.243] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:2:0) after 1m52s
[23:46:52.097] Received PubSub notification, asking Buildbucket for the build status
[23:46:52.154] Build status: STARTED
[23:48:07.505] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:2:0)
[23:48:07.551] Build status: STARTED
[23:48:07.551] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:4:0) after 2m46s
[23:50:53.585] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:4:0)
[23:50:53.609] Build status: STARTED
[23:50:53.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:5:0) after 6m52s
[23:57:45.640] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:5:0)
[23:57:45.673] Build status: STARTED
[23:57:45.673] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:6:0) after 2m30s
[00:00:15.793] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:6:0)
[00:00:15.828] Build status: STARTED
[00:00:15.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:7:0) after 8m4s
[00:08:20.144] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:7:0)
[00:08:20.188] Build status: STARTED
[00:08:20.188] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:8:0) after 4m26s
[00:12:46.220] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:8:0)
[00:12:46.245] Build status: STARTED
[00:12:46.245] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:9:0) after 7m31s
[00:20:17.414] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:9:0)
[00:20:17.440] Build status: STARTED
[00:20:17.440] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:10:0) after 1m6s
[00:21:24.164] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:10:0)
[00:21:24.192] Build status: STARTED
[00:21:24.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:11:0) after 3m12s
[00:24:36.357] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:11:0)
[00:24:36.401] Build status: STARTED
[00:24:36.401] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:12:0) after 4m53s
[00:29:29.824] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:12:0)
[00:29:29.875] Build status: STARTED
[00:29:29.875] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:13:0) after 4m14s
[00:33:44.037] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:13:0)
[00:33:44.067] Build status: STARTED
[00:33:44.067] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:14:0) after 2m45s
[00:36:29.301] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:14:0)
[00:36:29.340] Build status: STARTED
[00:36:29.340] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:15:0) after 3m52s
[00:40:21.586] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:15:0)
[00:40:21.614] Build status: STARTED
[00:40:21.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:16:0) after 8m37s
[00:48:58.708] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:16:0)
[00:48:58.735] Build status: STARTED
[00:48:58.735] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:17:0) after 8m39s
[00:57:38.232] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:17:0)
[00:57:38.259] Build status: STARTED
[00:57:38.259] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:18:0) after 3m49s
[01:01:27.375] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:18:0)
[01:01:27.406] Build status: STARTED
[01:01:27.406] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:19:0) after 7m44s
[01:09:11.466] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:19:0)
[01:09:11.495] Build status: STARTED
[01:09:11.495] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:20:0) after 7m12s
[01:16:23.765] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:20:0)
[01:16:23.804] Build status: STARTED
[01:16:23.804] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:21:0) after 3m43s
[01:20:06.856] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:21:0)
[01:20:06.891] Build status: STARTED
[01:20:06.891] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:22:0) after 4m12s
[01:24:18.921] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:22:0)
[01:24:18.951] Build status: STARTED
[01:24:18.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:23:0) after 5m2s
[01:29:21.098] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:23:0)
[01:29:21.128] Build status: STARTED
[01:29:21.128] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:24:0) after 9m4s
[01:38:25.156] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:24:0)
[01:38:25.196] Build status: STARTED
[01:38:25.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:25:0) after 7m26s
[01:45:51.180] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:25:0)
[01:45:51.231] Build status: STARTED
[01:45:51.231] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:26:0) after 7m9s
[01:53:00.278] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:26:0)
[01:53:00.337] Build status: STARTED
[01:53:00.337] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:27:0) after 6m7s
[01:59:07.367] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:27:0)
[01:59:07.393] Build status: STARTED
[01:59:07.393] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:28:0) after 3m41s
[02:02:48.518] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:28:0)
[02:02:48.549] Build status: STARTED
[02:02:48.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:29:0) after 6m5s
[02:08:53.636] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:29:0)
[02:08:53.667] Build status: STARTED
[02:08:53.667] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:30:0) after 6m9s
[02:15:02.819] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:30:0)
[02:15:02.862] Build status: STARTED
[02:15:02.862] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:31:0) after 7m51s
[02:22:53.909] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:31:0)
[02:22:53.937] Build status: STARTED
[02:22:53.937] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:32:0) after 8m39s
[02:31:32.999] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:32:0)
[02:31:33.030] Build status: STARTED
[02:31:33.030] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:33:0) after 5m39s
[02:37:12.351] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:33:0)
[02:37:12.380] Build status: STARTED
[02:37:12.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:34:0) after 5m2s
[02:42:14.407] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:34:0)
[02:42:14.436] Build status: STARTED
[02:42:14.436] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:35:0) after 8m39s
[02:50:53.617] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:35:0)
[02:50:53.643] Build status: STARTED
[02:50:53.643] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:36:0) after 7m37s
[02:58:30.682] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:36:0)
[02:58:30.712] Build status: STARTED
[02:58:30.712] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:37:0) after 4m46s
[03:03:17.044] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:37:0)
[03:03:17.113] Build status: STARTED
[03:03:17.113] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:38:0) after 3m49s
[03:07:06.194] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:38:0)
[03:07:06.224] Build status: STARTED
[03:07:06.224] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:39:0) after 1m20s
[03:08:26.275] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:39:0)
[03:08:26.328] Build status: STARTED
[03:08:26.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:40:0) after 1m51s
[03:10:17.357] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:40:0)
[03:10:17.384] Build status: STARTED
[03:10:17.384] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:41:0) after 2m11s
[03:12:28.509] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:41:0)
[03:12:28.555] Build status: STARTED
[03:12:28.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:42:0) after 7m41s
[03:20:09.591] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:42:0)
[03:20:09.623] Build status: STARTED
[03:20:09.623] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:43:0) after 8m37s
[03:28:46.751] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:43:0)
[03:28:46.783] Build status: STARTED
[03:28:46.783] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:44:0) after 9m44s
[03:38:30.955] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:44:0)
[03:38:30.996] Build status: STARTED
[03:38:30.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:45:0) after 9m0s
[03:47:31.051] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:45:0)
[03:47:31.081] Build status: STARTED
[03:47:31.081] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:46:0) after 1m55s
[03:49:26.145] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:46:0)
[03:49:26.173] Build status: STARTED
[03:49:26.173] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:47:0) after 5m39s
[03:55:05.227] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:47:0)
[03:55:05.261] Build status: STARTED
[03:55:05.261] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:48:0) after 9m23s
[04:04:28.290] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:48:0)
[04:04:28.334] Build status: STARTED
[04:04:28.334] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:49:0) after 2m4s
[04:06:32.431] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:49:0)
[04:06:32.461] Build status: STARTED
[04:06:32.461] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:50:0) after 5m33s
[04:12:05.601] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:50:0)
[04:12:05.634] Build status: STARTED
[04:12:05.634] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:51:0) after 6m51s
[04:18:56.676] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:51:0)
[04:18:56.706] Build status: STARTED
[04:18:56.706] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:52:0) after 8m41s
[04:27:37.756] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:52:0)
[04:27:37.784] Build status: STARTED
[04:27:37.784] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:53:0) after 2m55s
[04:30:32.903] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:53:0)
[04:30:32.930] Build status: STARTED
[04:30:32.930] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:54:0) after 6m52s
[04:37:24.968] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:54:0)
[04:37:24.997] Build status: STARTED
[04:37:24.997] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:55:0) after 4m1s
[04:41:26.258] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:55:0)
[04:41:26.289] Build status: STARTED
[04:41:26.289] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:56:0) after 6m17s
[04:47:43.374] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:56:0)
[04:47:43.401] Build status: STARTED
[04:47:43.401] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:57:0) after 9m56s
[04:57:39.470] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:57:0)
[04:57:39.497] Build status: STARTED
[04:57:39.497] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:58:0) after 8m6s
[05:05:45.619] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:58:0)
[05:05:45.649] Build status: STARTED
[05:05:45.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:59:0) after 1m58s
[05:07:43.765] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:59:0)
[05:07:43.811] Build status: STARTED
[05:07:43.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:60:0) after 7m25s
[05:15:08.842] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:60:0)
[05:15:08.871] Build status: STARTED
[05:15:08.871] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:61:0) after 6m45s
[05:21:53.956] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:61:0)
[05:21:53.982] Build status: STARTED
[05:21:53.982] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:62:0) after 1m49s
[05:23:43.051] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:62:0)
[05:23:43.078] Build status: STARTED
[05:23:43.078] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:63:0) after 2m6s
[05:25:49.141] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:63:0)
[05:25:49.174] Build status: STARTED
[05:25:49.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:64:0) after 4m57s
[05:30:46.261] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:64:0)
[05:30:46.296] Build status: STARTED
[05:30:46.296] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:65:0) after 5m52s
[05:36:38.520] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:65:0)
[05:36:38.552] Build status: STARTED
[05:36:38.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:66:0) after 8m27s
[05:45:05.588] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:66:0)
[05:45:05.618] Build status: STARTED
[05:45:05.618] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:67:0) after 2m58s
[05:48:03.647] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:67:0)
[05:48:03.676] Build status: STARTED
[05:48:03.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:68:0) after 3m5s
[05:51:08.817] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:68:0)
[05:51:08.846] Build status: STARTED
[05:51:08.846] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:69:0) after 6m24s
[05:57:32.913] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:69:0)
[05:57:32.936] Build status: STARTED
[05:57:32.936] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:70:0) after 1m45s
[05:59:18.011] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:70:0)
[05:59:18.041] Build status: STARTED
[05:59:18.041] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:71:0) after 1m58s
[06:01:16.076] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:71:0)
[06:01:16.104] Build status: STARTED
[06:01:16.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:72:0) after 7m14s
[06:08:30.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:72:0)
[06:08:30.267] Build status: STARTED
[06:08:30.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:73:0) after 9m11s
[06:17:41.294] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:73:0)
[06:17:41.326] Build status: STARTED
[06:17:41.326] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:74:0) after 1m36s
[06:19:17.552] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:74:0)
[06:19:17.598] Build status: STARTED
[06:19:17.598] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:75:0) after 5m44s
[06:25:01.727] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:75:0)
[06:25:01.753] Build status: STARTED
[06:25:01.753] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:76:0) after 5m2s
[06:30:03.951] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:76:0)
[06:30:03.984] Build status: STARTED
[06:30:03.984] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:77:0) after 7m33s
[06:37:37.260] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:77:0)
[06:37:37.288] Build status: STARTED
[06:37:37.288] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:78:0) after 5m18s
[06:42:55.505] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:78:0)
[06:42:55.534] Build status: STARTED
[06:42:55.534] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:79:0) after 9m38s
[06:52:33.567] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:79:0)
[06:52:33.592] Build status: STARTED
[06:52:33.592] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:80:0) after 8m5s
[07:00:38.629] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:80:0)
[07:00:38.662] Build status: STARTED
[07:00:38.663] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:81:0) after 8m41s
[07:09:19.693] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:81:0)
[07:09:19.721] Build status: STARTED
[07:09:19.721] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:82:0) after 8m11s
[07:17:30.739] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:82:0)
[07:17:30.769] Build status: STARTED
[07:17:30.769] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:83:0) after 6m12s
[07:23:42.796] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:83:0)
[07:23:42.836] Build status: STARTED
[07:23:42.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:84:0) after 5m26s
[07:29:08.859] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:84:0)
[07:29:08.892] Build status: STARTED
[07:29:08.892] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:85:0) after 3m57s
[07:33:06.171] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:85:0)
[07:33:06.202] Build status: STARTED
[07:33:06.202] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:86:0) after 3m18s
[07:36:24.235] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:86:0)
[07:36:24.268] Build status: STARTED
[07:36:24.268] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:87:0) after 4m37s
[07:41:01.298] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:87:0)
[07:41:01.358] Build status: STARTED
[07:41:01.358] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:88:0) after 1m46s
[07:42:47.626] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:88:0)
[07:42:47.655] Build status: STARTED
[07:42:47.655] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:89:0) after 2m37s
[07:45:24.791] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:89:0)
[07:45:24.833] Build status: STARTED
[07:45:24.833] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:90:0) after 1m39s
[07:47:03.848] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:90:0)
[07:47:03.879] Build status: STARTED
[07:47:03.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:91:0) after 8m2s
[07:55:05.910] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:91:0)
[07:55:05.944] Build status: STARTED
[07:55:05.944] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:92:0) after 1m41s
[07:56:46.983] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:92:0)
[07:56:47.015] Build status: STARTED
[07:56:47.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:93:0) after 1m47s
[07:58:34.058] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:93:0)
[07:58:34.086] Build status: STARTED
[07:58:34.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:94:0) after 5m44s
[08:04:18.188] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:94:0)
[08:04:18.221] Build status: STARTED
[08:04:18.221] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:95:0) after 1m42s
[08:06:00.282] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:95:0)
[08:06:00.316] Build status: STARTED
[08:06:00.316] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:96:0) after 8m22s
[08:14:22.364] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:96:0)
[08:14:22.391] Build status: STARTED
[08:14:22.391] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:97:0) after 9m16s
[08:23:38.422] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:97:0)
[08:23:38.450] Build status: STARTED
[08:23:38.450] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:98:0) after 1m19s
[08:24:57.562] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:98:0)
[08:24:57.619] Build status: STARTED
[08:24:57.619] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:99:0) after 2m9s
[08:27:06.660] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:99:0)
[08:27:06.686] Build status: STARTED
[08:27:06.686] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:100:0) after 7m5s
[08:34:11.720] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:100:0)
[08:34:11.768] Build status: STARTED
[08:34:11.768] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:101:0) after 9m53s
[08:44:04.805] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:101:0)
[08:44:04.844] Build status: STARTED
[08:44:04.844] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:102:0) after 1m0s
[08:45:04.876] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:102:0)
[08:45:04.920] Build status: STARTED
[08:45:04.920] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:103:0) after 7m56s
[08:53:01.050] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:103:0)
[08:53:01.087] Build status: STARTED
[08:53:01.087] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:104:0) after 7m25s
[09:00:26.151] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:104:0)
[09:00:26.183] Build status: STARTED
[09:00:26.183] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:105:0) after 8m47s
[09:09:13.277] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:105:0)
[09:09:13.302] Build status: STARTED
[09:09:13.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:106:0) after 3m42s
[09:12:55.475] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:106:0)
[09:12:55.502] Build status: STARTED
[09:12:55.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:107:0) after 2m5s
[09:15:00.758] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:107:0)
[09:15:00.851] Build status: STARTED
[09:15:00.851] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:108:0) after 9m16s
[09:24:17.092] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:108:0)
[09:24:17.131] Build status: STARTED
[09:24:17.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:109:0) after 1m16s
[09:25:33.178] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:109:0)
[09:25:33.207] Build status: STARTED
[09:25:33.207] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:110:0) after 4m47s
[09:30:20.289] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:110:0)
[09:30:20.319] Build status: STARTED
[09:30:20.319] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:111:0) after 2m36s
[09:32:56.455] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:111:0)
[09:32:56.485] Build status: STARTED
[09:32:56.485] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:112:0) after 7m11s
[09:40:07.659] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:112:0)
[09:40:07.687] Build status: STARTED
[09:40:07.687] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:113:0) after 9m20s
[09:49:27.957] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:113:0)
[09:49:27.986] Build status: STARTED
[09:49:27.986] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:114:0) after 1m37s
[09:51:05.041] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:114:0)
[09:51:05.066] Build status: STARTED
[09:51:05.066] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:115:0) after 3m46s
[09:54:51.164] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:115:0)
[09:54:51.193] Build status: STARTED
[09:54:51.193] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:116:0) after 9m16s
[10:04:07.403] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:116:0)
[10:04:07.429] Build status: STARTED
[10:04:07.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:117:0) after 3m14s
[10:07:21.466] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:117:0)
[10:07:21.503] Build status: STARTED
[10:07:21.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:118:0) after 7m27s
[10:14:48.558] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:118:0)
[10:14:48.584] Build status: STARTED
[10:14:48.584] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:119:0) after 2m29s
[10:17:17.624] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:119:0)
[10:17:17.690] Build status: STARTED
[10:17:17.690] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:120:0) after 4m21s
[10:21:38.915] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:120:0)
[10:21:38.956] Build status: STARTED
[10:21:38.956] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:121:0) after 8m52s
[10:30:31.224] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:121:0)
[10:30:31.267] Build status: STARTED
[10:30:31.267] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:122:0) after 8m33s
[10:39:04.407] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:122:0)
[10:39:04.456] Build status: STARTED
[10:39:04.456] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:123:0) after 4m59s
[10:44:03.499] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:123:0)
[10:44:03.586] Build status: STARTED
[10:44:03.586] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:124:0) after 4m32s
[10:48:35.773] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:124:0)
[10:48:35.808] Build status: STARTED
[10:48:35.808] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:125:0) after 5m0s
[10:53:35.824] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:125:0)
[10:53:35.850] Build status: STARTED
[10:53:35.850] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:126:0) after 5m36s
[10:59:11.877] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:126:0)
[10:59:11.906] Build status: STARTED
[10:59:11.906] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:127:0) after 6m27s
[11:05:38.963] Handling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:127:0)
[11:05:39.002] Build status: STARTED
[11:05:39.002] Scheduling timer "check-buildbucket-build-status" (chromium/mac-code-coverage:9015271672991709696:128:0) after 4m13s
[11:06:40.541] Received PubSub notification, asking Buildbucket for the build status
[11:06:40.569] Build:
{
"id": "8849841610022700480",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-code-coverage"
},
"number": 3648,
"createdBy": "project:chromium",
"createTime": "2021-04-15T23:46:14.466727Z",
"startTime": "2021-04-15T23:46:42.472192Z",
"endTime": "2021-04-16T11:06:39.924496624Z",
"updateTime": "2021-04-16T11:06:39.925048128Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f84d11ba17c06b0406e8e1ccbd29b1641cf139b6",
"ref": "refs/heads/master"
}
}
}
[11:06:40.569] Invocation finished in 11h20m28.317854113s with status FAILED