LUCI Scheduler :: chromium :: ToTMac

Status: ABORTED

Triggered by: -

Duration: 20 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMac"
>

Incoming triggers

2afa527778e5bca387a75d2ca4604d37ad326596 (11 months ago)
f91b05fcf4e5ed5fff284ebd4003a0e1a91aad06 (11 months ago)
e090c22bb9f30f91edf4a2d5dd05ec66d353cb9d (11 months ago)
2246af13eef5e786b2d6965a079f4c533edd6b2f (11 months ago)
c996a96bf438beda9b0d3c8074025903e04d18cc (11 months ago)
ca00966dc502ecc1c6a013464f2d013c7efb5f98 (11 months ago)
cc62009fe9bfbc758543ab4edcd3dc187910ae34 (11 months ago)
69d5f0d3af0cdfbb7b7f3652f8a7191e79a1a1a0 (11 months ago)
a7969b7c5c8d889afd69484d152a412f99f471af (11 months ago)
9397594129fbcd175c39056f8dc128d587eb7450 (11 months ago)
fd89e63b34c37de14767a4c257bce2dd24c9e375 (11 months ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "fd89e63b34c37de14767a4c257bce2dd24c9e375"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fd89e63b34c37de14767a4c257bce2dd24c9e375
gitiles_ref:refs/heads/main

Debug log (UTC)

[01:08:17.404] New invocation is queued and will start shortly
[01:08:18.579] Starting the invocation (attempt 1)
[01:08:18.604] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fd89e63b34c37de14767a4c257bce2dd24c9e375"
[01:08:18.604] Popped gitiles commit info from properties and tags
[01:08:18.604] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:08:18.604] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:08:18.604] Buildbucket request:
{
  "requestId": "8931283120751899360",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "fd89e63b34c37de14767a4c257bce2dd24c9e375",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8931283120751899360"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMac"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[01:08:19.240] Scheduled build:
{
  "id": "8765853058786476225",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "number": 30684,
  "createdBy": "project:chromium",
  "createTime": "2023-10-30T01:08:18.652325634Z",
  "updateTime": "2023-10-30T01:08:18.652325634Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "fd89e63b34c37de14767a4c257bce2dd24c9e375",
      "ref": "refs/heads/main"
    }
  }
}
[01:08:19.240] Task URL: https://cr-buildbucket.appspot.com/build/8765853058786476225
[01:08:19.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:2:0) after 6m47s
[01:08:20.683] Received PubSub notification, asking Buildbucket for the build status
[01:08:20.832] Build status: SCHEDULED
[01:11:39.865] Received PubSub notification, asking Buildbucket for the build status
[01:11:39.885] Build status: STARTED
[01:15:06.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:2:0)
[01:15:06.362] Build status: STARTED
[01:15:06.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:5:0) after 3m52s
[01:18:58.382] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:5:0)
[01:18:58.402] Build status: STARTED
[01:18:58.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:6:0) after 7m43s
[01:26:41.738] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:6:0)
[01:26:41.774] Build status: STARTED
[01:26:41.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:7:0) after 3m16s
[01:29:57.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:7:0)
[01:29:57.821] Build status: STARTED
[01:29:57.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:8:0) after 8m34s
[01:38:32.127] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:8:0)
[01:38:32.209] Build status: STARTED
[01:38:32.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:9:0) after 2m58s
[01:41:30.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:9:0)
[01:41:30.325] Build status: STARTED
[01:41:30.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:10:0) after 2m54s
[01:44:24.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:10:0)
[01:44:24.479] Build status: STARTED
[01:44:24.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:11:0) after 9m41s
[01:54:05.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:11:0)
[01:54:05.615] Build status: STARTED
[01:54:05.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:12:0) after 8m17s
[02:02:22.718] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:12:0)
[02:02:22.740] Build status: STARTED
[02:02:22.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:13:0) after 3m46s
[02:06:08.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:13:0)
[02:06:08.866] Build status: STARTED
[02:06:08.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:14:0) after 9m8s
[02:15:16.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:14:0)
[02:15:17.013] Build status: STARTED
[02:15:17.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:15:0) after 6m14s
[02:21:31.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:15:0)
[02:21:31.278] Build status: STARTED
[02:21:31.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:16:0) after 3m11s
[02:24:42.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:16:0)
[02:24:42.452] Build status: STARTED
[02:24:42.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:17:0) after 5m13s
[02:29:55.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:17:0)
[02:29:55.467] Build status: STARTED
[02:29:55.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:18:0) after 1m52s
[02:31:47.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:18:0)
[02:31:47.895] Build status: STARTED
[02:31:47.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:19:0) after 8m22s
[02:40:09.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:19:0)
[02:40:10.005] Build status: STARTED
[02:40:10.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:20:0) after 6m42s
[02:46:52.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:20:0)
[02:46:52.065] Build status: STARTED
[02:46:52.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:21:0) after 3m31s
[02:50:23.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:21:0)
[02:50:23.302] Build status: STARTED
[02:50:23.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:22:0) after 7m21s
[02:57:44.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:22:0)
[02:57:44.350] Build status: STARTED
[02:57:44.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:23:0) after 7m44s
[03:05:28.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:23:0)
[03:05:28.603] Build status: STARTED
[03:05:28.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:24:0) after 3m31s
[03:08:59.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:24:0)
[03:08:59.774] Build status: STARTED
[03:08:59.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:25:0) after 5m54s
[03:14:53.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:25:0)
[03:14:53.814] Build status: STARTED
[03:14:53.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:26:0) after 4m1s
[03:18:54.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:26:0)
[03:18:54.855] Build status: STARTED
[03:18:54.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:27:0) after 4m22s
[03:23:16.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:27:0)
[03:23:16.952] Build status: STARTED
[03:23:16.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:28:0) after 7m44s
[03:31:00.977] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:28:0)
[03:31:00.996] Build status: STARTED
[03:31:00.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:29:0) after 2m41s
[03:33:42.115] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:29:0)
[03:33:42.148] Build status: STARTED
[03:33:42.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:30:0) after 6m17s
[03:39:59.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:30:0)
[03:39:59.265] Build status: STARTED
[03:39:59.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:31:0) after 1m31s
[03:41:30.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:31:0)
[03:41:30.322] Build status: STARTED
[03:41:30.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:32:0) after 4m9s
[03:45:39.338] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:32:0)
[03:45:39.369] Build status: STARTED
[03:45:39.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:33:0) after 2m39s
[03:48:18.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:33:0)
[03:48:18.591] Build status: STARTED
[03:48:18.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:34:0) after 2m35s
[03:50:53.658] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:34:0)
[03:50:53.698] Build status: STARTED
[03:50:53.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:35:0) after 3m31s
[03:54:24.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:35:0)
[03:54:25.035] Build status: STARTED
[03:54:25.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:36:0) after 2m25s
[03:56:50.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:36:0)
[03:56:50.075] Build status: STARTED
[03:56:50.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:37:0) after 6m3s
[04:02:53.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:37:0)
[04:02:53.112] Build status: STARTED
[04:02:53.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:38:0) after 4m11s
[04:07:04.291] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:38:0)
[04:07:04.313] Build status: STARTED
[04:07:04.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:39:0) after 6m44s
[04:13:48.466] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:39:0)
[04:13:48.497] Build status: STARTED
[04:13:48.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:40:0) after 8m35s
[04:22:23.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:40:0)
[04:22:23.531] Build status: STARTED
[04:22:23.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:41:0) after 4m55s
[04:27:18.555] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:41:0)
[04:27:18.578] Build status: STARTED
[04:27:18.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:42:0) after 1m59s
[04:29:17.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:42:0)
[04:29:17.646] Build status: STARTED
[04:29:17.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:43:0) after 1m50s
[04:31:07.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:43:0)
[04:31:07.693] Build status: STARTED
[04:31:07.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:44:0) after 1m52s
[04:32:59.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:44:0)
[04:32:59.937] Build status: STARTED
[04:32:59.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:45:0) after 7m35s
[04:40:34.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:45:0)
[04:40:35.067] Build status: STARTED
[04:40:35.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:46:0) after 3m38s
[04:44:13.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:46:0)
[04:44:13.300] Build status: STARTED
[04:44:13.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:47:0) after 5m16s
[04:49:29.351] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:47:0)
[04:49:29.367] Build status: STARTED
[04:49:29.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:48:0) after 5m54s
[04:55:23.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:48:0)
[04:55:23.408] Build status: STARTED
[04:55:23.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:49:0) after 7m33s
[05:02:56.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:49:0)
[05:02:56.449] Build status: STARTED
[05:02:56.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:50:0) after 5m47s
[05:08:43.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:50:0)
[05:08:43.653] Build status: STARTED
[05:08:43.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:51:0) after 6m22s
[05:15:05.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:51:0)
[05:15:05.705] Build status: STARTED
[05:15:05.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:52:0) after 3m5s
[05:18:10.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:52:0)
[05:18:10.844] Build status: STARTED
[05:18:10.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:53:0) after 8m28s
[05:26:38.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:53:0)
[05:26:38.884] Build status: STARTED
[05:26:38.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:54:0) after 4m31s
[05:31:09.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:54:0)
[05:31:09.904] Build status: STARTED
[05:31:09.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:55:0) after 7m6s
[05:38:15.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:55:0)
[05:38:15.950] Build status: STARTED
[05:38:15.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:56:0) after 8m55s
[05:47:11.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:56:0)
[05:47:11.070] Build status: STARTED
[05:47:11.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:57:0) after 1m32s
[05:48:43.085] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:57:0)
[05:48:43.153] Build status: STARTED
[05:48:43.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:58:0) after 3m3s
[05:51:46.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:58:0)
[05:51:46.230] Build status: STARTED
[05:51:46.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:59:0) after 1m26s
[05:53:12.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:59:0)
[05:53:12.324] Build status: STARTED
[05:53:12.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:60:0) after 3m17s
[05:56:29.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:60:0)
[05:56:29.451] Build status: STARTED
[05:56:29.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:61:0) after 4m51s
[06:01:20.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:61:0)
[06:01:20.506] Build status: STARTED
[06:01:20.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:62:0) after 6m12s
[06:07:32.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:62:0)
[06:07:32.695] Build status: STARTED
[06:07:32.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:63:0) after 5m12s
[06:12:44.728] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:63:0)
[06:12:44.803] Build status: STARTED
[06:12:44.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:64:0) after 3m7s
[06:15:51.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:64:0)
[06:15:51.837] Build status: STARTED
[06:15:51.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:65:0) after 4m40s
[06:20:31.851] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:65:0)
[06:20:31.877] Build status: STARTED
[06:20:31.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:66:0) after 6m20s
[06:26:51.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:66:0)
[06:26:51.916] Build status: STARTED
[06:26:51.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:67:0) after 8m56s
[06:35:48.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:67:0)
[06:35:48.278] Build status: STARTED
[06:35:48.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:68:0) after 4m2s
[06:39:50.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:68:0)
[06:39:50.294] Build status: STARTED
[06:39:50.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:69:0) after 8m21s
[06:48:11.329] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:69:0)
[06:48:11.349] Build status: STARTED
[06:48:11.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:70:0) after 5m24s
[06:53:35.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:70:0)
[06:53:35.444] Build status: STARTED
[06:53:35.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:71:0) after 8m46s
[07:02:21.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:71:0)
[07:02:21.519] Build status: STARTED
[07:02:21.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:72:0) after 5m35s
[07:07:56.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:72:0)
[07:07:56.695] Build status: STARTED
[07:07:56.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:73:0) after 6m52s
[07:14:48.720] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:73:0)
[07:14:48.785] Build status: STARTED
[07:14:48.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:74:0) after 3m59s
[07:18:47.811] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:74:0)
[07:18:47.830] Build status: STARTED
[07:18:47.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:75:0) after 2m18s
[07:21:05.848] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:75:0)
[07:21:05.877] Build status: STARTED
[07:21:05.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:76:0) after 5m36s
[07:26:42.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:76:0)
[07:26:42.323] Build status: STARTED
[07:26:42.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:77:0) after 7m49s
[07:34:31.339] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:77:0)
[07:34:31.437] Build status: STARTED
[07:34:31.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:78:0) after 8m2s
[07:42:33.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:78:0)
[07:42:33.505] Build status: STARTED
[07:42:33.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:79:0) after 5m55s
[07:48:28.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:79:0)
[07:48:28.706] Build status: STARTED
[07:48:28.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:80:0) after 2m46s
[07:51:14.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:80:0)
[07:51:14.748] Build status: STARTED
[07:51:14.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:81:0) after 4m43s
[07:55:57.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:81:0)
[07:55:57.885] Build status: STARTED
[07:55:57.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:82:0) after 7m32s
[08:03:29.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:82:0)
[08:03:29.983] Build status: STARTED
[08:03:29.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:83:0) after 7m2s
[08:10:32.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:83:0)
[08:10:32.284] Build status: STARTED
[08:10:32.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:84:0) after 3m3s
[08:13:35.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:84:0)
[08:13:35.325] Build status: STARTED
[08:13:35.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:85:0) after 5m57s
[08:19:32.367] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:85:0)
[08:19:32.394] Build status: STARTED
[08:19:32.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:86:0) after 3m57s
[08:23:29.591] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:86:0)
[08:23:29.629] Build status: STARTED
[08:23:29.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:87:0) after 9m45s
[08:33:15.051] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:87:0)
[08:33:15.093] Build status: STARTED
[08:33:15.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:88:0) after 5m42s
[08:38:57.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:88:0)
[08:38:57.207] Build status: STARTED
[08:38:57.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:89:0) after 9m36s
[08:48:33.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:89:0)
[08:48:33.345] Build status: STARTED
[08:48:33.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:90:0) after 7m57s
[08:56:30.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:90:0)
[08:56:30.379] Build status: STARTED
[08:56:30.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:91:0) after 7m43s
[09:04:13.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:91:0)
[09:04:13.455] Build status: STARTED
[09:04:13.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:92:0) after 9m59s
[09:14:12.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:92:0)
[09:14:12.613] Build status: STARTED
[09:14:12.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:93:0) after 9m39s
[09:23:51.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:93:0)
[09:23:51.834] Build status: STARTED
[09:23:51.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:94:0) after 5m49s
[09:29:41.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:94:0)
[09:29:41.344] Build status: STARTED
[09:29:41.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:95:0) after 2m54s
[09:32:35.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:95:0)
[09:32:35.447] Build status: STARTED
[09:32:35.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:96:0) after 2m35s
[09:35:10.473] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:96:0)
[09:35:10.548] Build status: STARTED
[09:35:10.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:97:0) after 5m23s
[09:40:34.049] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:97:0)
[09:40:34.071] Build status: STARTED
[09:40:34.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:98:0) after 6m46s
[09:47:20.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:98:0)
[09:47:20.439] Build status: STARTED
[09:47:20.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:99:0) after 9m40s
[09:57:00.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:99:0)
[09:57:00.581] Build status: STARTED
[09:57:00.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:100:0) after 1m28s
[09:58:28.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:100:0)
[09:58:28.674] Build status: STARTED
[09:58:28.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:101:0) after 5m16s
[10:03:44.917] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:101:0)
[10:03:44.937] Build status: STARTED
[10:03:44.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:102:0) after 2m15s
[10:06:00.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:102:0)
[10:06:00.056] Build status: STARTED
[10:06:00.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:103:0) after 1m55s
[10:07:55.151] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:103:0)
[10:07:55.225] Build status: STARTED
[10:07:55.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:104:0) after 3m37s
[10:11:32.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:104:0)
[10:11:32.661] Build status: STARTED
[10:11:32.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:105:0) after 1m52s
[10:13:24.710] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:105:0)
[10:13:24.727] Build status: STARTED
[10:13:24.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:106:0) after 9m52s
[10:23:16.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:106:0)
[10:23:16.768] Build status: STARTED
[10:23:16.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:107:0) after 7m59s
[10:31:15.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:107:0)
[10:31:15.910] Build status: STARTED
[10:31:15.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:108:0) after 7m53s
[10:39:08.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:108:0)
[10:39:09.014] Build status: STARTED
[10:39:09.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:109:0) after 9m19s
[10:48:28.040] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:109:0)
[10:48:28.062] Build status: STARTED
[10:48:28.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:110:0) after 2m51s
[10:51:19.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:110:0)
[10:51:19.198] Build status: STARTED
[10:51:19.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:111:0) after 7m25s
[10:58:44.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:111:0)
[10:58:44.382] Build status: STARTED
[10:58:44.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:112:0) after 4m59s
[11:03:43.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:112:0)
[11:03:43.490] Build status: STARTED
[11:03:43.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:113:0) after 2m39s
[11:06:22.522] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:113:0)
[11:06:22.541] Build status: STARTED
[11:06:22.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:114:0) after 7m4s
[11:13:26.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:114:0)
[11:13:26.606] Build status: STARTED
[11:13:26.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:115:0) after 5m17s
[11:18:43.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:115:0)
[11:18:43.753] Build status: STARTED
[11:18:43.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:116:0) after 8m51s
[11:27:34.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:116:0)
[11:27:34.930] Build status: STARTED
[11:27:34.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:117:0) after 3m16s
[11:30:50.950] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:117:0)
[11:30:50.969] Build status: STARTED
[11:30:50.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:118:0) after 7m8s
[11:37:59.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:118:0)
[11:37:59.189] Build status: STARTED
[11:37:59.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:119:0) after 6m47s
[11:44:46.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:119:0)
[11:44:46.236] Build status: STARTED
[11:44:46.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:120:0) after 5m14s
[11:50:00.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:120:0)
[11:50:00.288] Build status: STARTED
[11:50:00.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:121:0) after 4m19s
[11:54:19.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:121:0)
[11:54:19.422] Build status: STARTED
[11:54:19.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:122:0) after 8m28s
[12:02:47.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:122:0)
[12:02:47.466] Build status: STARTED
[12:02:47.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:123:0) after 5m10s
[12:07:57.631] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:123:0)
[12:07:57.650] Build status: STARTED
[12:07:57.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:124:0) after 2m4s
[12:10:01.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:124:0)
[12:10:01.697] Build status: STARTED
[12:10:01.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:125:0) after 3m59s
[12:14:00.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:125:0)
[12:14:00.751] Build status: STARTED
[12:14:00.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:126:0) after 6m41s
[12:20:41.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:126:0)
[12:20:41.794] Build status: STARTED
[12:20:41.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:127:0) after 6m5s
[12:26:46.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:127:0)
[12:26:46.857] Build status: STARTED
[12:26:46.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:128:0) after 8m8s
[12:34:55.552] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:128:0)
[12:34:55.612] Build status: STARTED
[12:34:55.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:129:0) after 8m22s
[12:43:18.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:129:0)
[12:43:18.191] Build status: STARTED
[12:43:18.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:130:0) after 1m35s
[12:44:53.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:130:0)
[12:44:53.330] Build status: STARTED
[12:44:53.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:131:0) after 1m8s
[12:46:01.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:131:0)
[12:46:01.470] Build status: STARTED
[12:46:01.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:132:0) after 9m8s
[12:55:09.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:132:0)
[12:55:09.730] Build status: STARTED
[12:55:09.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:133:0) after 4m12s
[12:59:21.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:133:0)
[12:59:21.765] Build status: STARTED
[12:59:21.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:134:0) after 5m20s
[13:04:41.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:134:0)
[13:04:41.805] Build status: STARTED
[13:04:41.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:135:0) after 7m30s
[13:12:12.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:135:0)
[13:12:12.285] Build status: STARTED
[13:12:12.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:136:0) after 5m37s
[13:17:49.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:136:0)
[13:17:49.574] Build status: STARTED
[13:17:49.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:137:0) after 8m41s
[13:26:30.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:137:0)
[13:26:30.616] Build status: STARTED
[13:26:30.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:138:0) after 4m11s
[13:30:41.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:138:0)
[13:30:41.704] Build status: STARTED
[13:30:41.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:139:0) after 7m17s
[13:37:58.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:139:0)
[13:37:58.757] Build status: STARTED
[13:37:58.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:140:0) after 8m19s
[13:46:17.797] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:140:0)
[13:46:17.828] Build status: STARTED
[13:46:17.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:141:0) after 1m31s
[13:47:49.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:141:0)
[13:47:49.086] Build status: STARTED
[13:47:49.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:142:0) after 5m5s
[13:52:54.172] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:142:0)
[13:52:54.275] Build status: STARTED
[13:52:54.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:143:0) after 7m13s
[14:00:07.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:143:0)
[14:00:07.367] Build status: STARTED
[14:00:07.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:144:0) after 1m20s
[14:01:27.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:144:0)
[14:01:27.513] Build status: STARTED
[14:01:27.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:145:0) after 8m27s
[14:09:54.529] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:145:0)
[14:09:54.549] Build status: STARTED
[14:09:54.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:146:0) after 9m27s
[14:19:21.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:146:0)
[14:19:26.408] Build status: STARTED
[14:19:26.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:147:0) after 9m24s
[14:28:50.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:147:0)
[14:28:50.492] Build status: STARTED
[14:28:50.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:148:0) after 4m48s
[14:33:38.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:148:0)
[14:33:38.627] Build status: STARTED
[14:33:38.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:149:0) after 3m2s
[14:36:40.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:149:0)
[14:36:40.696] Build status: STARTED
[14:36:40.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:150:0) after 3m56s
[14:40:36.865] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:150:0)
[14:40:36.884] Build status: STARTED
[14:40:36.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:151:0) after 8m27s
[14:49:03.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:151:0)
[14:49:04.011] Build status: STARTED
[14:49:04.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:152:0) after 7m53s
[14:56:57.043] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:152:0)
[14:56:57.065] Build status: STARTED
[14:56:57.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:153:0) after 2m1s
[14:58:58.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:153:0)
[14:58:58.180] Build status: STARTED
[14:58:58.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:154:0) after 7m52s
[15:06:50.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:154:0)
[15:06:50.696] Build status: STARTED
[15:06:50.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:155:0) after 6m54s
[15:13:45.411] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:155:0)
[15:13:45.433] Build status: STARTED
[15:13:45.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:156:0) after 1m1s
[15:14:46.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:156:0)
[15:14:46.477] Build status: STARTED
[15:14:46.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:157:0) after 2m17s
[15:17:03.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:157:0)
[15:17:03.604] Build status: STARTED
[15:17:03.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:158:0) after 8m33s
[15:25:36.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:158:0)
[15:25:36.751] Build status: STARTED
[15:25:36.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:159:0) after 8m50s
[15:34:26.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:159:0)
[15:34:26.794] Build status: STARTED
[15:34:26.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:160:0) after 4m31s
[15:38:57.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:160:0)
[15:38:57.834] Build status: STARTED
[15:38:57.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:161:0) after 9m17s
[15:48:14.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:161:0)
[15:48:14.909] Build status: STARTED
[15:48:14.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:162:0) after 7m25s
[15:55:39.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:162:0)
[15:55:40.006] Build status: STARTED
[15:55:40.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:163:0) after 1m22s
[15:57:02.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:163:0)
[15:57:02.293] Build status: STARTED
[15:57:02.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:164:0) after 1m47s
[15:58:49.729] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:164:0)
[15:58:49.749] Build status: STARTED
[15:58:49.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:165:0) after 1m0s
[15:59:49.765] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:165:0)
[15:59:49.787] Build status: STARTED
[15:59:49.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:166:0) after 6m36s
[16:06:26.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:166:0)
[16:06:26.171] Build status: STARTED
[16:06:26.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:167:0) after 5m41s
[16:12:07.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:167:0)
[16:12:07.420] Build status: STARTED
[16:12:07.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:168:0) after 2m19s
[16:14:26.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:168:0)
[16:14:26.561] Build status: STARTED
[16:14:26.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:169:0) after 2m28s
[16:16:54.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:169:0)
[16:16:54.688] Build status: STARTED
[16:16:54.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:170:0) after 4m55s
[16:21:50.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:170:0)
[16:21:50.114] Build status: STARTED
[16:21:50.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:171:0) after 5m45s
[16:27:35.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:171:0)
[16:27:35.230] Build status: STARTED
[16:27:35.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:172:0) after 9m34s
[16:37:09.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:172:0)
[16:37:09.275] Build status: STARTED
[16:37:09.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:173:0) after 8m24s
[16:45:33.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:173:0)
[16:45:33.480] Build status: STARTED
[16:45:33.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:174:0) after 1m12s
[16:46:45.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:174:0)
[16:46:45.521] Build status: STARTED
[16:46:45.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:175:0) after 4m18s
[16:51:03.536] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:175:0)
[16:51:03.562] Build status: STARTED
[16:51:03.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:176:0) after 2m14s
[16:53:17.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:176:0)
[16:53:17.657] Build status: STARTED
[16:53:17.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:177:0) after 3m10s
[16:56:27.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:177:0)
[16:56:27.746] Build status: STARTED
[16:56:27.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:178:0) after 3m54s
[17:00:21.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:178:0)
[17:00:21.800] Build status: STARTED
[17:00:21.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:179:0) after 5m29s
[17:05:50.891] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:179:0)
[17:05:50.911] Build status: STARTED
[17:05:50.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:180:0) after 5m7s
[17:10:58.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:180:0)
[17:10:58.269] Build status: STARTED
[17:10:58.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:181:0) after 5m14s
[17:16:12.404] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:181:0)
[17:16:12.451] Build status: STARTED
[17:16:12.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:182:0) after 9m1s
[17:25:13.561] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:182:0)
[17:25:13.581] Build status: STARTED
[17:25:13.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:183:0) after 9m33s
[17:34:46.719] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:183:0)
[17:34:46.742] Build status: STARTED
[17:34:46.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:184:0) after 7m38s
[17:42:24.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:184:0)
[17:42:24.800] Build status: STARTED
[17:42:24.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:185:0) after 2m52s
[17:45:16.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:185:0)
[17:45:16.975] Build status: STARTED
[17:45:16.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:186:0) after 1m14s
[17:46:31.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:186:0)
[17:46:31.055] Build status: STARTED
[17:46:31.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:187:0) after 3m50s
[17:50:21.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:187:0)
[17:50:21.251] Build status: STARTED
[17:50:21.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:188:0) after 7m17s
[17:57:38.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:188:0)
[17:57:38.502] Build status: STARTED
[17:57:38.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:189:0) after 9m4s
[18:06:42.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:189:0)
[18:06:42.537] Build status: STARTED
[18:06:42.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:190:0) after 2m52s
[18:09:34.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:190:0)
[18:09:34.580] Build status: STARTED
[18:09:34.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:191:0) after 8m48s
[18:18:22.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:191:0)
[18:18:22.624] Build status: STARTED
[18:18:22.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:192:0) after 2m47s
[18:21:09.682] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:192:0)
[18:21:09.709] Build status: STARTED
[18:21:09.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:193:0) after 7m53s
[18:29:02.789] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:193:0)
[18:29:02.816] Build status: STARTED
[18:29:02.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:194:0) after 6m25s
[18:35:27.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:194:0)
[18:35:27.833] Build status: STARTED
[18:35:27.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:195:0) after 1m8s
[18:36:35.845] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:195:0)
[18:36:36.002] Build status: STARTED
[18:36:36.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:196:0) after 9m38s
[18:46:14.020] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:196:0)
[18:46:14.040] Build status: STARTED
[18:46:14.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:197:0) after 6m30s
[18:52:44.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:197:0)
[18:52:44.080] Build status: STARTED
[18:52:44.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:198:0) after 2m51s
[18:55:35.141] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:198:0)
[18:55:35.165] Build status: STARTED
[18:55:35.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:199:0) after 3m18s
[18:58:53.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:199:0)
[18:58:53.309] Build status: STARTED
[18:58:53.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:200:0) after 7m44s
[19:06:37.326] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:200:0)
[19:06:37.511] Build status: STARTED
[19:06:37.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:201:0) after 6m42s
[19:13:19.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:201:0)
[19:13:19.574] Build status: STARTED
[19:13:19.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:202:0) after 6m10s
[19:19:29.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:202:0)
[19:19:29.612] Build status: STARTED
[19:19:29.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:203:0) after 7m1s
[19:26:30.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:203:0)
[19:26:30.654] Build status: STARTED
[19:26:30.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:204:0) after 9m7s
[19:35:37.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:204:0)
[19:35:37.695] Build status: STARTED
[19:35:37.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:205:0) after 8m15s
[19:43:52.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:205:0)
[19:43:52.795] Build status: STARTED
[19:43:52.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:206:0) after 4m56s
[19:48:48.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:206:0)
[19:48:48.874] Build status: STARTED
[19:48:48.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:207:0) after 3m7s
[19:51:55.944] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:207:0)
[19:51:55.964] Build status: STARTED
[19:51:55.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:208:0) after 4m8s
[19:56:04.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:208:0)
[19:56:04.113] Build status: STARTED
[19:56:04.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:209:0) after 6m31s
[20:02:35.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:209:0)
[20:02:35.381] Build status: STARTED
[20:02:35.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:210:0) after 9m46s
[20:12:21.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:210:0)
[20:12:21.497] Build status: STARTED
[20:12:21.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:211:0) after 8m39s
[20:21:00.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:211:0)
[20:21:00.617] Build status: STARTED
[20:21:00.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:212:0) after 7m15s
[20:28:15.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:212:0)
[20:28:15.717] Build status: STARTED
[20:28:15.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:213:0) after 6m0s
[20:34:15.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:213:0)
[20:34:15.880] Build status: STARTED
[20:34:15.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:214:0) after 6m52s
[20:41:07.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:214:0)
[20:41:07.917] Build status: STARTED
[20:41:07.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:215:0) after 1m49s
[20:42:56.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:215:0)
[20:42:57.016] Build status: STARTED
[20:42:57.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:216:0) after 1m54s
[20:44:51.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:216:0)
[20:44:51.063] Build status: STARTED
[20:44:51.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:217:0) after 3m49s
[20:48:40.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:217:0)
[20:48:40.114] Build status: STARTED
[20:48:40.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:218:0) after 7m14s
[20:55:54.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:218:0)
[20:55:54.222] Build status: STARTED
[20:55:54.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:219:0) after 1m46s
[20:57:40.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:219:0)
[20:57:40.329] Build status: STARTED
[20:57:40.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:220:0) after 1m52s
[20:59:32.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:220:0)
[20:59:32.479] Build status: STARTED
[20:59:32.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:221:0) after 8m38s
[21:08:10.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:221:0)
[21:08:10.539] Build status: STARTED
[21:08:10.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8931283120751899360:222:0) after 7m39s
[21:11:52.127] Received PubSub notification, asking Buildbucket for the build status
[21:11:52.172] Build:
{
  "id": "8765853058786476225",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "number": 30684,
  "createdBy": "project:chromium",
  "createTime": "2023-10-30T01:08:18.652325634Z",
  "startTime": "2023-10-30T01:11:39.264026Z",
  "endTime": "2023-10-30T21:11:51.912920552Z",
  "updateTime": "2023-10-30T21:11:51.912920552Z",
  "status": "CANCELED",
  "statusDetails": {
    "timeout": {

    }
  },
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "fd89e63b34c37de14767a4c257bce2dd24c9e375",
      "ref": "refs/heads/main"
    }
  }
}
[21:11:52.173] Invocation finished in 20h3m34.778771222s with status ABORTED