LUCI Scheduler :: chromium :: ToTLinuxCoverage

Status: FAILED

Triggered by: -

Duration: 14 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxCoverage"
>

Incoming triggers

a300c243043a9e6a7eaf155e3a2cb12502a73c70 (8 months ago)
6505aa8caeaab835467662b1600e281c18431503 (8 months ago)
143acdd23651d6cf59baa743efc4ffc7d9894017 (8 months ago)
0195bbc41953b58c49f8fc263f73d8b053ad35d9 (8 months ago)
61062d13cc9c87b279c63eda85ed3f806feb29a6 (8 months ago)
8c95b642724071b3942b14e5449ad5452ca09110 (8 months ago)
b1e7273cd790cc6d1cd21a172463255cc95c1368 (8 months ago)
df94865db89cbb2b78f07faf72bff851e9800612 (8 months ago)
4910105fb36e87106ad709fa973a9b43bf3d88f6 (8 months ago)
8869f17c137a7f77fe177f0a747d3bd4156de77b (8 months ago)
794608240cb19dbb2ac28999ffc04b70d1ec87a5 (8 months ago)
8c88e39276e63b6249fb3d18efa89e17d9edd4d1 (8 months ago)
1af98bef7cb2a81b225f2e59e22d1962c05cf192 (8 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "1af98bef7cb2a81b225f2e59e22d1962c05cf192"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1af98bef7cb2a81b225f2e59e22d1962c05cf192
gitiles_ref:refs/heads/main

Debug log (UTC)

[02:38:02.309] New invocation is queued and will start shortly
[02:38:03.397] Starting the invocation (attempt 1)
[02:38:03.420] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1af98bef7cb2a81b225f2e59e22d1962c05cf192"
[02:38:03.420] Popped gitiles commit info from properties and tags
[02:38:03.420] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:38:03.420] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:38:03.420] Buildbucket request:
{
  "requestId": "8905547935809645456",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxCoverage"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "1af98bef7cb2a81b225f2e59e22d1962c05cf192",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8905547935809645456"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxCoverage"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[02:38:04.121] Scheduled build:
{
  "id": "8740117873868096465",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxCoverage"
  },
  "number": 82989,
  "createdBy": "project:chromium",
  "createTime": "2024-08-09T02:38:03.536321079Z",
  "updateTime": "2024-08-09T02:38:03.536321079Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "1af98bef7cb2a81b225f2e59e22d1962c05cf192",
      "ref": "refs/heads/main"
    }
  }
}
[02:38:04.121] Task URL: https://cr-buildbucket.appspot.com/build/8740117873868096465
[02:38:04.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:2:0) after 5m17s
[02:38:48.963] Received PubSub notification, asking Buildbucket for the build status
[02:38:48.981] Build status: STARTED
[02:39:38.142] Received PubSub notification, asking Buildbucket for the build status
[02:39:38.159] Build status: STARTED
[02:43:21.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:2:0)
[02:43:21.382] Build status: STARTED
[02:43:21.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:5:0) after 1m34s
[02:44:55.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:5:0)
[02:44:55.422] Build status: STARTED
[02:44:55.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:6:0) after 2m40s
[02:47:35.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:6:0)
[02:47:35.565] Build status: STARTED
[02:47:35.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:7:0) after 1m11s
[02:48:47.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:7:0)
[02:48:47.144] Build status: STARTED
[02:48:47.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:8:0) after 8m50s
[02:57:37.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:8:0)
[02:57:37.435] Build status: STARTED
[02:57:37.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:9:0) after 5m34s
[03:03:11.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:9:0)
[03:03:11.557] Build status: STARTED
[03:03:11.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:10:0) after 8m57s
[03:12:08.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:10:0)
[03:12:08.599] Build status: STARTED
[03:12:08.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:11:0) after 9m8s
[03:21:16.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:11:0)
[03:21:16.808] Build status: STARTED
[03:21:16.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:12:0) after 7m6s
[03:28:22.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:12:0)
[03:28:22.841] Build status: STARTED
[03:28:22.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:13:0) after 4m53s
[03:33:16.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:13:0)
[03:33:16.218] Build status: STARTED
[03:33:16.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:14:0) after 3m14s
[03:36:30.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:14:0)
[03:36:30.406] Build status: STARTED
[03:36:30.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:15:0) after 6m28s
[03:42:58.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:15:0)
[03:42:58.533] Build status: STARTED
[03:42:58.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:16:0) after 3m21s
[03:46:20.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:16:0)
[03:46:20.140] Build status: STARTED
[03:46:20.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:17:0) after 5m10s
[03:51:30.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:17:0)
[03:51:30.380] Build status: STARTED
[03:51:30.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:18:0) after 1m23s
[03:52:53.404] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:18:0)
[03:52:53.422] Build status: STARTED
[03:52:53.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:19:0) after 4m22s
[03:57:15.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:19:0)
[03:57:15.595] Build status: STARTED
[03:57:15.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:20:0) after 9m9s
[04:06:24.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:20:0)
[04:06:24.634] Build status: STARTED
[04:06:24.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:21:0) after 7m37s
[04:14:01.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:21:0)
[04:14:01.787] Build status: STARTED
[04:14:01.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:22:0) after 1m54s
[04:15:55.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:22:0)
[04:15:55.879] Build status: STARTED
[04:15:55.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:23:0) after 2m11s
[04:18:07.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:23:0)
[04:18:07.033] Build status: STARTED
[04:18:07.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:24:0) after 6m28s
[04:24:35.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:24:0)
[04:24:35.069] Build status: STARTED
[04:24:35.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:25:0) after 5m1s
[04:29:36.262] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:25:0)
[04:29:36.281] Build status: STARTED
[04:29:36.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:26:0) after 6m27s
[04:36:03.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:26:0)
[04:36:03.369] Build status: STARTED
[04:36:03.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:27:0) after 1m15s
[04:37:18.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:27:0)
[04:37:18.374] Build status: STARTED
[04:37:18.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:28:0) after 7m37s
[04:44:55.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:28:0)
[04:44:55.619] Build status: STARTED
[04:44:55.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:29:0) after 7m59s
[04:52:54.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:29:0)
[04:52:54.749] Build status: STARTED
[04:52:54.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:30:0) after 6m14s
[04:59:08.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:30:0)
[04:59:08.814] Build status: STARTED
[04:59:08.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:31:0) after 1m55s
[05:01:04.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:31:0)
[05:01:04.097] Build status: STARTED
[05:01:04.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:32:0) after 8m9s
[05:09:13.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:32:0)
[05:09:13.115] Build status: STARTED
[05:09:13.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:33:0) after 6m2s
[05:15:15.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:33:0)
[05:15:15.288] Build status: STARTED
[05:15:15.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:34:0) after 4m45s
[05:20:00.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:34:0)
[05:20:00.326] Build status: STARTED
[05:20:00.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:35:0) after 8m33s
[05:28:33.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:35:0)
[05:28:33.647] Build status: STARTED
[05:28:33.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:36:0) after 3m19s
[05:31:52.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:36:0)
[05:31:52.660] Build status: STARTED
[05:31:52.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:37:0) after 1m8s
[05:33:00.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:37:0)
[05:33:00.836] Build status: STARTED
[05:33:00.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:38:0) after 6m32s
[05:39:33.358] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:38:0)
[05:39:33.418] Build status: STARTED
[05:39:33.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:39:0) after 5m16s
[05:44:49.496] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:39:0)
[05:44:49.512] Build status: STARTED
[05:44:49.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:40:0) after 1m16s
[05:46:05.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:40:0)
[05:46:05.891] Build status: STARTED
[05:46:05.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:41:0) after 5m43s
[05:51:48.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:41:0)
[05:51:48.925] Build status: STARTED
[05:51:48.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:42:0) after 1m20s
[05:53:09.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:42:0)
[05:53:09.271] Build status: STARTED
[05:53:09.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:43:0) after 3m47s
[05:56:56.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:43:0)
[05:56:56.339] Build status: STARTED
[05:56:56.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:44:0) after 7m51s
[06:04:47.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:44:0)
[06:04:47.466] Build status: STARTED
[06:04:47.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:45:0) after 2m20s
[06:07:07.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:45:0)
[06:07:07.719] Build status: STARTED
[06:07:07.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:46:0) after 8m31s
[06:15:38.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:46:0)
[06:15:38.759] Build status: STARTED
[06:15:38.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:47:0) after 9m1s
[06:24:39.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:47:0)
[06:24:39.896] Build status: STARTED
[06:24:39.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:48:0) after 5m27s
[06:30:07.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:48:0)
[06:30:07.217] Build status: STARTED
[06:30:07.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:49:0) after 1m39s
[06:31:46.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:49:0)
[06:31:46.556] Build status: STARTED
[06:31:46.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:50:0) after 1m52s
[06:33:39.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:50:0)
[06:33:39.242] Build status: STARTED
[06:33:39.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:51:0) after 6m10s
[06:39:49.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:51:0)
[06:39:49.366] Build status: STARTED
[06:39:49.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:52:0) after 8m13s
[06:48:02.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:52:0)
[06:48:02.441] Build status: STARTED
[06:48:02.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:53:0) after 4m38s
[06:52:40.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:53:0)
[06:52:40.557] Build status: STARTED
[06:52:40.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:54:0) after 1m10s
[06:53:50.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:54:0)
[06:53:50.965] Build status: STARTED
[06:53:50.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:55:0) after 5m19s
[06:59:09.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:55:0)
[06:59:10.002] Build status: STARTED
[06:59:10.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:56:0) after 8m14s
[07:07:24.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:56:0)
[07:07:24.200] Build status: STARTED
[07:07:24.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:57:0) after 7m17s
[07:14:41.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:57:0)
[07:14:41.240] Build status: STARTED
[07:14:41.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:58:0) after 6m0s
[07:20:41.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:58:0)
[07:20:41.536] Build status: STARTED
[07:20:41.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:59:0) after 3m39s
[07:24:20.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:59:0)
[07:24:20.652] Build status: STARTED
[07:24:20.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:60:0) after 2m47s
[07:27:07.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:60:0)
[07:27:07.706] Build status: STARTED
[07:27:07.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:61:0) after 5m44s
[07:32:51.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:61:0)
[07:32:51.944] Build status: STARTED
[07:32:51.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:62:0) after 4m0s
[07:36:52.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:62:0)
[07:36:52.102] Build status: STARTED
[07:36:52.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:63:0) after 2m49s
[07:39:41.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:63:0)
[07:39:41.170] Build status: STARTED
[07:39:41.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:64:0) after 9m41s
[07:49:22.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:64:0)
[07:49:22.356] Build status: STARTED
[07:49:22.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:65:0) after 9m51s
[07:59:13.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:65:0)
[07:59:13.412] Build status: STARTED
[07:59:13.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:66:0) after 2m14s
[08:01:27.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:66:0)
[08:01:27.486] Build status: STARTED
[08:01:27.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:67:0) after 3m13s
[08:04:40.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:67:0)
[08:04:40.780] Build status: STARTED
[08:04:40.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:68:0) after 2m26s
[08:07:06.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:68:0)
[08:07:06.932] Build status: STARTED
[08:07:06.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:69:0) after 3m48s
[08:10:55.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:69:0)
[08:10:55.065] Build status: STARTED
[08:10:55.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:70:0) after 8m49s
[08:19:44.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:70:0)
[08:19:44.286] Build status: STARTED
[08:19:44.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:71:0) after 4m31s
[08:24:15.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:71:0)
[08:24:15.564] Build status: STARTED
[08:24:15.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:72:0) after 3m23s
[08:27:38.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:72:0)
[08:27:38.775] Build status: STARTED
[08:27:38.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:73:0) after 4m22s
[08:32:00.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:73:0)
[08:32:00.819] Build status: STARTED
[08:32:00.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:74:0) after 3m16s
[08:35:16.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:74:0)
[08:35:16.862] Build status: STARTED
[08:35:16.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:75:0) after 4m52s
[08:40:08.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:75:0)
[08:40:08.931] Build status: STARTED
[08:40:08.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:76:0) after 3m1s
[08:43:09.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:76:0)
[08:43:09.971] Build status: STARTED
[08:43:09.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:77:0) after 3m50s
[08:47:00.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:77:0)
[08:47:00.127] Build status: STARTED
[08:47:00.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:78:0) after 7m50s
[08:54:50.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:78:0)
[08:54:50.378] Build status: STARTED
[08:54:50.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:79:0) after 3m42s
[08:58:32.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:79:0)
[08:58:32.528] Build status: STARTED
[08:58:32.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:80:0) after 2m44s
[09:01:16.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:80:0)
[09:01:16.917] Build status: STARTED
[09:01:16.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:81:0) after 3m47s
[09:05:04.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:81:0)
[09:05:04.078] Build status: STARTED
[09:05:04.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:82:0) after 2m38s
[09:07:42.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:82:0)
[09:07:42.220] Build status: STARTED
[09:07:42.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:83:0) after 6m33s
[09:14:15.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:83:0)
[09:14:15.497] Build status: STARTED
[09:14:15.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:84:0) after 2m18s
[09:16:33.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:84:0)
[09:16:33.626] Build status: STARTED
[09:16:33.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:85:0) after 9m7s
[09:25:40.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:85:0)
[09:25:40.866] Build status: STARTED
[09:25:40.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:86:0) after 7m22s
[09:33:02.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:86:0)
[09:33:02.962] Build status: STARTED
[09:33:02.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:87:0) after 5m5s
[09:38:08.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:87:0)
[09:38:08.117] Build status: STARTED
[09:38:08.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:88:0) after 8m3s
[09:46:11.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:88:0)
[09:46:11.453] Build status: STARTED
[09:46:11.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:89:0) after 8m39s
[09:54:50.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:89:0)
[09:54:50.562] Build status: STARTED
[09:54:50.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:90:0) after 5m15s
[10:00:06.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:90:0)
[10:00:06.057] Build status: STARTED
[10:00:06.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:91:0) after 2m23s
[10:02:29.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:91:0)
[10:02:29.090] Build status: STARTED
[10:02:29.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:92:0) after 3m30s
[10:05:59.308] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:92:0)
[10:05:59.330] Build status: STARTED
[10:05:59.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:93:0) after 5m47s
[10:11:46.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:93:0)
[10:11:46.366] Build status: STARTED
[10:11:46.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:94:0) after 2m0s
[10:13:46.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:94:0)
[10:13:46.494] Build status: STARTED
[10:13:46.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:95:0) after 4m15s
[10:18:01.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:95:0)
[10:18:01.704] Build status: STARTED
[10:18:01.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:96:0) after 9m19s
[10:27:21.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:96:0)
[10:27:21.118] Build status: STARTED
[10:27:21.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:97:0) after 6m3s
[10:33:24.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:97:0)
[10:33:24.455] Build status: STARTED
[10:33:24.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:98:0) after 3m1s
[10:36:25.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:98:0)
[10:36:25.459] Build status: STARTED
[10:36:25.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:99:0) after 2m43s
[10:39:08.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:99:0)
[10:39:08.944] Build status: STARTED
[10:39:08.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:100:0) after 5m33s
[10:44:41.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:100:0)
[10:44:41.995] Build status: STARTED
[10:44:41.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:101:0) after 3m0s
[10:47:42.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:101:0)
[10:47:42.145] Build status: STARTED
[10:47:42.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:102:0) after 3m25s
[10:51:07.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:102:0)
[10:51:07.328] Build status: STARTED
[10:51:07.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:103:0) after 6m10s
[10:57:17.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:103:0)
[10:57:17.513] Build status: STARTED
[10:57:17.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:104:0) after 2m57s
[11:00:14.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:104:0)
[11:00:14.729] Build status: STARTED
[11:00:14.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:105:0) after 4m17s
[11:04:31.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:105:0)
[11:04:31.765] Build status: STARTED
[11:04:31.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:106:0) after 9m23s
[11:13:54.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:106:0)
[11:13:54.811] Build status: STARTED
[11:13:54.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:107:0) after 4m16s
[11:18:10.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:107:0)
[11:18:10.955] Build status: STARTED
[11:18:10.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:108:0) after 2m54s
[11:21:04.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:108:0)
[11:21:04.991] Build status: STARTED
[11:21:04.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:109:0) after 7m14s
[11:28:19.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:109:0)
[11:28:19.146] Build status: STARTED
[11:28:19.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:110:0) after 9m29s
[11:37:48.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:110:0)
[11:37:48.183] Build status: STARTED
[11:37:48.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:111:0) after 2m43s
[11:40:31.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:111:0)
[11:40:31.303] Build status: STARTED
[11:40:31.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:112:0) after 5m3s
[11:45:34.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:112:0)
[11:45:34.922] Build status: STARTED
[11:45:34.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:113:0) after 8m13s
[11:53:47.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:113:0)
[11:53:47.944] Build status: STARTED
[11:53:47.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:114:0) after 2m6s
[11:55:53.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:114:0)
[11:55:54.010] Build status: STARTED
[11:55:54.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:115:0) after 5m1s
[12:00:55.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:115:0)
[12:00:55.055] Build status: STARTED
[12:00:55.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:116:0) after 8m2s
[12:08:57.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:116:0)
[12:08:57.188] Build status: STARTED
[12:08:57.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:117:0) after 2m57s
[12:11:54.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:117:0)
[12:11:54.491] Build status: STARTED
[12:11:54.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:118:0) after 2m21s
[12:14:15.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:118:0)
[12:14:15.547] Build status: STARTED
[12:14:15.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:119:0) after 5m32s
[12:19:47.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:119:0)
[12:19:47.691] Build status: STARTED
[12:19:47.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:120:0) after 9m8s
[12:28:55.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:120:0)
[12:28:55.749] Build status: STARTED
[12:28:55.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:121:0) after 3m34s
[12:32:29.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:121:0)
[12:32:29.788] Build status: STARTED
[12:32:29.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:122:0) after 2m2s
[12:34:31.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:122:0)
[12:34:31.829] Build status: STARTED
[12:34:31.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:123:0) after 7m19s
[12:41:51.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:123:0)
[12:41:51.057] Build status: STARTED
[12:41:51.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:124:0) after 2m4s
[12:43:55.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:124:0)
[12:43:55.169] Build status: STARTED
[12:43:55.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:125:0) after 8m3s
[12:51:58.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:125:0)
[12:51:58.212] Build status: STARTED
[12:51:58.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:126:0) after 8m33s
[13:00:31.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:126:0)
[13:00:31.309] Build status: STARTED
[13:00:31.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:127:0) after 5m26s
[13:05:57.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:127:0)
[13:05:57.675] Build status: STARTED
[13:05:57.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:128:0) after 6m44s
[13:12:41.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:128:0)
[13:12:41.799] Build status: STARTED
[13:12:41.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:129:0) after 8m35s
[13:21:16.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:129:0)
[13:21:16.837] Build status: STARTED
[13:21:16.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:130:0) after 8m39s
[13:29:55.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:130:0)
[13:29:55.880] Build status: STARTED
[13:29:55.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:131:0) after 8m15s
[13:38:11.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:131:0)
[13:38:11.040] Build status: STARTED
[13:38:11.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:132:0) after 7m21s
[13:45:32.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:132:0)
[13:45:32.133] Build status: STARTED
[13:45:32.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:133:0) after 7m38s
[13:53:10.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:133:0)
[13:53:10.265] Build status: STARTED
[13:53:10.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:134:0) after 6m7s
[13:59:17.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:134:0)
[13:59:17.301] Build status: STARTED
[13:59:17.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:135:0) after 4m52s
[14:04:09.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:135:0)
[14:04:09.614] Build status: STARTED
[14:04:09.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:136:0) after 6m22s
[14:10:31.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:136:0)
[14:10:31.988] Build status: STARTED
[14:10:31.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:137:0) after 7m43s
[14:18:15.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:137:0)
[14:18:15.158] Build status: STARTED
[14:18:15.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:138:0) after 8m36s
[14:26:51.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:138:0)
[14:26:51.305] Build status: STARTED
[14:26:51.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:139:0) after 3m46s
[14:30:37.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:139:0)
[14:30:37.348] Build status: STARTED
[14:30:37.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:140:0) after 5m26s
[14:36:03.672] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:140:0)
[14:36:03.705] Build status: STARTED
[14:36:03.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:141:0) after 7m55s
[14:43:58.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:141:0)
[14:43:59.029] Build status: STARTED
[14:43:59.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:142:0) after 6m51s
[14:50:50.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:142:0)
[14:50:50.142] Build status: STARTED
[14:50:50.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:143:0) after 4m23s
[14:55:13.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:143:0)
[14:55:13.179] Build status: STARTED
[14:55:13.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:144:0) after 2m27s
[14:57:40.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:144:0)
[14:57:40.349] Build status: STARTED
[14:57:40.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:145:0) after 3m40s
[15:01:20.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:145:0)
[15:01:20.402] Build status: STARTED
[15:01:20.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:146:0) after 7m37s
[15:08:57.452] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:146:0)
[15:08:57.467] Build status: STARTED
[15:08:57.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:147:0) after 8m1s
[15:16:58.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:147:0)
[15:16:58.561] Build status: STARTED
[15:16:58.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:148:0) after 7m22s
[15:24:20.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:148:0)
[15:24:20.626] Build status: STARTED
[15:24:20.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:149:0) after 4m58s
[15:29:18.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:149:0)
[15:29:18.717] Build status: STARTED
[15:29:18.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:150:0) after 9m20s
[15:38:38.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:150:0)
[15:38:38.882] Build status: STARTED
[15:38:38.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:151:0) after 5m0s
[15:43:38.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:151:0)
[15:43:38.923] Build status: STARTED
[15:43:38.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:152:0) after 5m49s
[15:49:28.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:152:0)
[15:49:28.032] Build status: STARTED
[15:49:28.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:153:0) after 3m37s
[15:53:05.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:153:0)
[15:53:05.137] Build status: STARTED
[15:53:05.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:154:0) after 4m44s
[15:57:49.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:154:0)
[15:57:49.284] Build status: STARTED
[15:57:49.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:155:0) after 9m53s
[16:07:42.319] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:155:0)
[16:07:42.357] Build status: STARTED
[16:07:42.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:156:0) after 7m42s
[16:15:24.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:156:0)
[16:15:24.484] Build status: STARTED
[16:15:24.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:157:0) after 8m29s
[16:23:53.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:157:0)
[16:23:53.544] Build status: STARTED
[16:23:53.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:158:0) after 3m46s
[16:27:39.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:158:0)
[16:27:39.894] Build status: STARTED
[16:27:39.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:159:0) after 3m26s
[16:31:06.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:159:0)
[16:31:06.388] Build status: STARTED
[16:31:06.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:160:0) after 1m9s
[16:32:15.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:160:0)
[16:32:15.443] Build status: STARTED
[16:32:15.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:161:0) after 3m34s
[16:35:50.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:161:0)
[16:35:50.029] Build status: STARTED
[16:35:50.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxCoverage:8905547935809645456:162:0) after 5m5s
[16:39:28.444] Received PubSub notification, asking Buildbucket for the build status
[16:39:28.512] Build:
{
  "id": "8740117873868096465",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxCoverage"
  },
  "number": 82989,
  "createdBy": "project:chromium",
  "createTime": "2024-08-09T02:38:03.536321079Z",
  "startTime": "2024-08-09T02:38:42.650317129Z",
  "endTime": "2024-08-09T16:39:28.117398849Z",
  "updateTime": "2024-08-09T16:39:28.117398849Z",
  "status": "INFRA_FAILURE",
  "statusDetails": {
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "1af98bef7cb2a81b225f2e59e22d1962c05cf192",
      "ref": "refs/heads/main"
    }
  }
}
[16:39:28.514] Invocation finished in 14h1m26.213189666s with status FAILED