LUCI Scheduler :: chromium :: ToTMac

Status: FAILED

Triggered by: -

Duration: 18 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMac"
>

Incoming triggers

7c765aeb2626d0589a3c8769850883938d24e5d0 (1 year ago)
0d5cb2c242a656d60531fefa9aebfc25a6dd615b (1 year ago)
537ea5d0e75516b642e1340efee63d94ddffe24e (1 year ago)
e800413526b30caa8e4eb091d8e60caa95f2153b (1 year ago)
bc5b7535ae7d4aae808f714990d54df48b27c3a4 (1 year ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "bc5b7535ae7d4aae808f714990d54df48b27c3a4"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc5b7535ae7d4aae808f714990d54df48b27c3a4
gitiles_ref:refs/heads/main

Debug log (UTC)

[02:56:42.853] New invocation is queued and will start shortly
[02:56:43.992] Starting the invocation (attempt 1)
[02:56:44.026] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc5b7535ae7d4aae808f714990d54df48b27c3a4"
[02:56:44.027] Popped gitiles commit info from properties and tags
[02:56:44.027] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:56:44.027] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:56:44.027] Buildbucket request:
{
  "requestId": "8902375867011443424",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "bc5b7535ae7d4aae808f714990d54df48b27c3a4",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8902375867011443424"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMac"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[02:56:44.611] Scheduled build:
{
  "id": "8736945805042440257",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "number": 32904,
  "createdBy": "project:chromium",
  "createTime": "2024-09-13T02:56:44.105115550Z",
  "updateTime": "2024-09-13T02:56:44.105115550Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "bc5b7535ae7d4aae808f714990d54df48b27c3a4",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[02:56:44.611] Task URL: https://cr-buildbucket.appspot.com/build/8736945805042440257
[02:56:44.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:2:0) after 6m50s
[02:56:45.520] Received PubSub notification, asking Buildbucket for the build status
[02:56:45.536] Build status: SCHEDULED
[02:57:29.294] Received PubSub notification, asking Buildbucket for the build status
[02:57:29.361] Build status: STARTED
[03:03:34.630] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:2:0)
[03:03:34.654] Build status: STARTED
[03:03:34.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:5:0) after 1m9s
[03:04:43.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:5:0)
[03:04:43.747] Build status: STARTED
[03:04:43.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:6:0) after 3m12s
[03:07:55.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:6:0)
[03:07:55.950] Build status: STARTED
[03:07:55.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:7:0) after 6m5s
[03:14:01.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:7:0)
[03:14:01.126] Build status: STARTED
[03:14:01.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:8:0) after 5m54s
[03:19:55.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:8:0)
[03:19:55.182] Build status: STARTED
[03:19:55.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:9:0) after 6m4s
[03:25:59.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:9:0)
[03:25:59.457] Build status: STARTED
[03:25:59.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:10:0) after 6m20s
[03:32:19.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:10:0)
[03:32:19.499] Build status: STARTED
[03:32:19.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:11:0) after 3m56s
[03:36:15.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:11:0)
[03:36:16.024] Build status: STARTED
[03:36:16.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:12:0) after 6m27s
[03:42:43.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:12:0)
[03:42:43.516] Build status: STARTED
[03:42:43.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:13:0) after 9m5s
[03:51:48.669] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:13:0)
[03:51:48.688] Build status: STARTED
[03:51:48.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:14:0) after 9m18s
[04:01:06.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:14:0)
[04:01:06.730] Build status: STARTED
[04:01:06.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:15:0) after 2m35s
[04:03:42.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:15:0)
[04:03:42.185] Build status: STARTED
[04:03:42.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:16:0) after 7m24s
[04:11:06.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:16:0)
[04:11:06.510] Build status: STARTED
[04:11:06.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:17:0) after 2m6s
[04:13:12.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:17:0)
[04:13:12.720] Build status: STARTED
[04:13:12.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:18:0) after 1m3s
[04:14:15.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:18:0)
[04:14:15.892] Build status: STARTED
[04:14:15.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:19:0) after 6m21s
[04:20:36.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:19:0)
[04:20:36.931] Build status: STARTED
[04:20:36.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:20:0) after 2m48s
[04:23:25.033] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:20:0)
[04:23:25.089] Build status: STARTED
[04:23:25.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:21:0) after 3m18s
[04:26:43.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:21:0)
[04:26:43.328] Build status: STARTED
[04:26:43.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:22:0) after 1m4s
[04:27:47.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:22:0)
[04:27:47.859] Build status: STARTED
[04:27:47.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:23:0) after 5m53s
[04:33:41.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:23:0)
[04:33:41.083] Build status: STARTED
[04:33:41.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:24:0) after 1m3s
[04:34:44.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:24:0)
[04:34:44.121] Build status: STARTED
[04:34:44.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:25:0) after 8m4s
[04:42:48.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:25:0)
[04:42:48.533] Build status: STARTED
[04:42:48.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:26:0) after 2m32s
[04:45:20.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:26:0)
[04:45:20.712] Build status: STARTED
[04:45:20.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:27:0) after 6m9s
[04:51:29.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:27:0)
[04:51:29.757] Build status: STARTED
[04:51:29.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:28:0) after 2m23s
[04:53:52.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:28:0)
[04:53:52.897] Build status: STARTED
[04:53:52.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:29:0) after 8m43s
[05:02:35.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:29:0)
[05:02:36.015] Build status: STARTED
[05:02:36.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:30:0) after 2m35s
[05:05:11.125] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:30:0)
[05:05:11.143] Build status: STARTED
[05:05:11.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:31:0) after 2m24s
[05:07:35.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:31:0)
[05:07:35.183] Build status: STARTED
[05:07:35.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:32:0) after 8m29s
[05:16:04.250] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:32:0)
[05:16:04.346] Build status: STARTED
[05:16:04.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:33:0) after 8m18s
[05:24:22.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:33:0)
[05:24:22.397] Build status: STARTED
[05:24:22.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:34:0) after 8m0s
[05:32:22.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:34:0)
[05:32:22.560] Build status: STARTED
[05:32:22.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:35:0) after 7m32s
[05:39:54.577] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:35:0)
[05:39:54.595] Build status: STARTED
[05:39:54.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:36:0) after 3m35s
[05:43:29.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:36:0)
[05:43:29.844] Build status: STARTED
[05:43:29.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:37:0) after 2m29s
[05:45:59.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:37:0)
[05:45:59.092] Build status: STARTED
[05:45:59.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:38:0) after 2m19s
[05:48:18.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:38:0)
[05:48:18.220] Build status: STARTED
[05:48:18.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:39:0) after 6m39s
[05:54:57.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:39:0)
[05:54:57.265] Build status: STARTED
[05:54:57.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:40:0) after 7m10s
[06:02:07.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:40:0)
[06:02:07.485] Build status: STARTED
[06:02:07.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:41:0) after 8m49s
[06:10:56.512] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:41:0)
[06:10:56.697] Build status: STARTED
[06:10:56.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:42:0) after 7m33s
[06:18:29.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:42:0)
[06:18:29.737] Build status: STARTED
[06:18:29.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:43:0) after 8m42s
[06:27:11.966] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:43:0)
[06:27:11.981] Build status: STARTED
[06:27:11.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:44:0) after 9m6s
[06:36:18.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:44:0)
[06:36:18.026] Build status: STARTED
[06:36:18.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:45:0) after 5m45s
[06:42:03.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:45:0)
[06:42:03.416] Build status: STARTED
[06:42:03.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:46:0) after 8m32s
[06:50:35.442] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:46:0)
[06:50:35.461] Build status: STARTED
[06:50:35.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:47:0) after 7m47s
[06:58:22.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:47:0)
[06:58:22.501] Build status: STARTED
[06:58:22.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:48:0) after 9m19s
[07:07:41.680] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:48:0)
[07:07:41.696] Build status: STARTED
[07:07:41.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:49:0) after 5m6s
[07:12:47.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:49:0)
[07:12:47.810] Build status: STARTED
[07:12:47.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:50:0) after 7m19s
[07:20:07.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:50:0)
[07:20:07.140] Build status: STARTED
[07:20:07.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:51:0) after 2m58s
[07:23:05.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:51:0)
[07:23:05.224] Build status: STARTED
[07:23:05.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:52:0) after 9m11s
[07:32:16.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:52:0)
[07:32:16.422] Build status: STARTED
[07:32:16.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:53:0) after 2m16s
[07:34:32.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:53:0)
[07:34:32.453] Build status: STARTED
[07:34:32.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:54:0) after 4m45s
[07:39:17.468] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:54:0)
[07:39:17.504] Build status: STARTED
[07:39:17.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:55:0) after 8m13s
[07:47:30.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:55:0)
[07:47:30.905] Build status: STARTED
[07:47:30.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:56:0) after 3m29s
[07:51:00.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:56:0)
[07:51:00.035] Build status: STARTED
[07:51:00.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:57:0) after 9m30s
[08:00:30.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:57:0)
[08:00:30.416] Build status: STARTED
[08:00:30.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:58:0) after 3m10s
[08:03:40.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:58:0)
[08:03:40.653] Build status: STARTED
[08:03:40.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:59:0) after 9m58s
[08:13:38.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:59:0)
[08:13:38.875] Build status: STARTED
[08:13:38.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:60:0) after 7m39s
[08:21:18.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:60:0)
[08:21:18.154] Build status: STARTED
[08:21:18.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:61:0) after 7m56s
[08:29:14.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:61:0)
[08:29:14.499] Build status: STARTED
[08:29:14.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:62:0) after 6m14s
[08:35:28.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:62:0)
[08:35:28.542] Build status: STARTED
[08:35:28.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:63:0) after 3m5s
[08:38:33.827] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:63:0)
[08:38:33.852] Build status: STARTED
[08:38:33.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:64:0) after 6m10s
[08:44:43.958] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:64:0)
[08:44:43.977] Build status: STARTED
[08:44:43.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:65:0) after 8m39s
[08:53:23.120] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:65:0)
[08:53:23.253] Build status: STARTED
[08:53:23.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:66:0) after 9m47s
[09:03:10.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:66:0)
[09:03:10.470] Build status: STARTED
[09:03:10.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:67:0) after 9m42s
[09:12:52.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:67:0)
[09:12:52.728] Build status: STARTED
[09:12:52.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:68:0) after 6m44s
[09:19:36.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:68:0)
[09:19:36.928] Build status: STARTED
[09:19:36.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:69:0) after 5m54s
[09:25:30.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:69:0)
[09:25:30.942] Build status: STARTED
[09:25:30.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:70:0) after 2m5s
[09:27:36.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:70:0)
[09:27:36.133] Build status: STARTED
[09:27:36.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:71:0) after 7m24s
[09:35:00.160] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:71:0)
[09:35:00.181] Build status: STARTED
[09:35:00.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:72:0) after 9m25s
[09:44:25.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:72:0)
[09:44:25.216] Build status: STARTED
[09:44:25.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:73:0) after 9m59s
[09:54:24.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:73:0)
[09:54:24.330] Build status: STARTED
[09:54:24.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:74:0) after 9m24s
[10:03:48.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:74:0)
[10:03:48.381] Build status: STARTED
[10:03:48.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:75:0) after 1m10s
[10:04:58.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:75:0)
[10:04:58.413] Build status: STARTED
[10:04:58.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:76:0) after 1m37s
[10:06:35.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:76:0)
[10:06:35.633] Build status: STARTED
[10:06:35.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:77:0) after 2m37s
[10:09:12.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:77:0)
[10:09:12.674] Build status: STARTED
[10:09:12.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:78:0) after 8m43s
[10:17:55.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:78:0)
[10:17:55.711] Build status: STARTED
[10:17:55.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:79:0) after 5m18s
[10:23:14.008] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:79:0)
[10:23:14.067] Build status: STARTED
[10:23:14.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:80:0) after 2m7s
[10:25:21.514] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:80:0)
[10:25:21.532] Build status: STARTED
[10:25:21.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:81:0) after 5m8s
[10:30:29.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:81:0)
[10:30:29.947] Build status: STARTED
[10:30:29.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:82:0) after 1m40s
[10:32:09.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:82:0)
[10:32:09.987] Build status: STARTED
[10:32:09.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:83:0) after 1m34s
[10:33:44.050] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:83:0)
[10:33:44.069] Build status: STARTED
[10:33:44.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:84:0) after 5m41s
[10:39:25.198] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:84:0)
[10:39:25.224] Build status: STARTED
[10:39:25.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:85:0) after 3m6s
[10:42:31.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:85:0)
[10:42:31.481] Build status: STARTED
[10:42:31.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:86:0) after 4m59s
[10:47:30.624] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:86:0)
[10:47:30.640] Build status: STARTED
[10:47:30.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:87:0) after 3m20s
[10:50:50.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:87:0)
[10:50:50.668] Build status: STARTED
[10:50:50.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:88:0) after 2m4s
[10:52:54.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:88:0)
[10:52:54.885] Build status: STARTED
[10:52:54.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:89:0) after 3m42s
[10:56:37.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:89:0)
[10:56:37.062] Build status: STARTED
[10:56:37.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:90:0) after 5m45s
[11:02:22.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:90:0)
[11:02:22.107] Build status: STARTED
[11:02:22.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:91:0) after 3m52s
[11:06:14.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:91:0)
[11:06:14.225] Build status: STARTED
[11:06:14.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:92:0) after 8m57s
[11:15:11.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:92:0)
[11:15:11.332] Build status: STARTED
[11:15:11.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:93:0) after 4m49s
[11:20:00.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:93:0)
[11:20:00.375] Build status: STARTED
[11:20:00.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:94:0) after 7m1s
[11:27:01.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:94:0)
[11:27:01.686] Build status: STARTED
[11:27:01.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:95:0) after 6m50s
[11:33:51.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:95:0)
[11:33:51.726] Build status: STARTED
[11:33:51.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:96:0) after 9m32s
[11:43:23.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:96:0)
[11:43:23.772] Build status: STARTED
[11:43:23.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:97:0) after 1m36s
[11:44:59.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:97:0)
[11:44:59.971] Build status: STARTED
[11:44:59.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:98:0) after 8m28s
[11:53:27.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:98:0)
[11:53:28.011] Build status: STARTED
[11:53:28.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:99:0) after 3m4s
[11:56:32.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:99:0)
[11:56:32.211] Build status: STARTED
[11:56:32.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:100:0) after 8m26s
[12:04:58.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:100:0)
[12:04:58.252] Build status: STARTED
[12:04:58.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:101:0) after 7m10s
[12:12:08.345] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:101:0)
[12:12:08.376] Build status: STARTED
[12:12:08.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:102:0) after 1m10s
[12:13:18.451] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:102:0)
[12:13:18.471] Build status: STARTED
[12:13:18.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:103:0) after 7m32s
[12:20:50.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:103:0)
[12:20:50.472] Build status: STARTED
[12:20:50.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:104:0) after 4m23s
[12:25:13.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:104:0)
[12:25:13.562] Build status: STARTED
[12:25:13.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:105:0) after 6m9s
[12:31:22.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:105:0)
[12:31:22.705] Build status: STARTED
[12:31:22.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:106:0) after 4m23s
[12:35:45.783] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:106:0)
[12:35:45.811] Build status: STARTED
[12:35:45.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:107:0) after 5m32s
[12:41:17.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:107:0)
[12:41:17.822] Build status: STARTED
[12:41:17.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:108:0) after 3m21s
[12:44:38.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:108:0)
[12:44:38.976] Build status: STARTED
[12:44:38.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:109:0) after 1m55s
[12:46:33.995] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:109:0)
[12:46:34.016] Build status: STARTED
[12:46:34.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:110:0) after 7m22s
[12:53:56.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:110:0)
[12:53:56.476] Build status: STARTED
[12:53:56.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:111:0) after 3m15s
[12:57:11.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:111:0)
[12:57:11.527] Build status: STARTED
[12:57:11.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:112:0) after 8m45s
[13:05:56.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:112:0)
[13:05:56.672] Build status: STARTED
[13:05:56.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:113:0) after 8m30s
[13:14:27.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:113:0)
[13:14:27.291] Build status: STARTED
[13:14:27.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:114:0) after 7m27s
[13:21:54.304] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:114:0)
[13:21:54.323] Build status: STARTED
[13:21:54.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:115:0) after 7m31s
[13:29:25.740] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:115:0)
[13:29:25.756] Build status: STARTED
[13:29:25.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:116:0) after 9m36s
[13:39:01.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:116:0)
[13:39:01.889] Build status: STARTED
[13:39:01.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:117:0) after 4m29s
[13:43:31.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:117:0)
[13:43:31.238] Build status: STARTED
[13:43:31.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:118:0) after 9m42s
[13:53:13.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:118:0)
[13:53:13.403] Build status: STARTED
[13:53:13.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:119:0) after 7m35s
[14:00:48.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:119:0)
[14:00:49.022] Build status: STARTED
[14:00:49.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:120:0) after 8m46s
[14:09:35.055] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:120:0)
[14:09:35.072] Build status: STARTED
[14:09:35.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:121:0) after 7m53s
[14:17:28.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:121:0)
[14:17:28.267] Build status: STARTED
[14:17:28.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:122:0) after 7m35s
[14:25:03.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:122:0)
[14:25:03.305] Build status: STARTED
[14:25:03.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:123:0) after 4m24s
[14:29:27.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:123:0)
[14:29:27.381] Build status: STARTED
[14:29:27.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:124:0) after 4m23s
[14:33:50.417] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:124:0)
[14:33:50.435] Build status: STARTED
[14:33:50.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:125:0) after 4m27s
[14:38:17.450] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:125:0)
[14:38:17.480] Build status: STARTED
[14:38:17.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:126:0) after 6m31s
[14:44:48.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:126:0)
[14:44:48.521] Build status: STARTED
[14:44:48.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:127:0) after 8m25s
[14:53:13.533] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:127:0)
[14:53:13.548] Build status: STARTED
[14:53:13.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:128:0) after 5m47s
[14:59:00.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:128:0)
[14:59:00.584] Build status: STARTED
[14:59:00.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:129:0) after 7m21s
[15:06:21.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:129:0)
[15:06:21.688] Build status: STARTED
[15:06:21.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:130:0) after 1m41s
[15:08:02.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:130:0)
[15:08:02.889] Build status: STARTED
[15:08:02.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:131:0) after 7m55s
[15:15:57.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:131:0)
[15:15:57.981] Build status: STARTED
[15:15:57.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:132:0) after 8m28s
[15:24:25.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:132:0)
[15:24:25.999] Build status: STARTED
[15:24:25.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:133:0) after 2m43s
[15:27:09.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:133:0)
[15:27:09.127] Build status: STARTED
[15:27:09.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:134:0) after 1m42s
[15:28:51.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:134:0)
[15:28:51.212] Build status: STARTED
[15:28:51.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:135:0) after 8m35s
[15:37:26.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:135:0)
[15:37:26.265] Build status: STARTED
[15:37:26.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:136:0) after 5m40s
[15:43:06.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:136:0)
[15:43:06.429] Build status: STARTED
[15:43:06.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:137:0) after 1m54s
[15:45:00.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:137:0)
[15:45:00.477] Build status: STARTED
[15:45:00.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:138:0) after 4m26s
[15:49:26.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:138:0)
[15:49:26.641] Build status: STARTED
[15:49:26.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:139:0) after 3m53s
[15:53:19.659] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:139:0)
[15:53:19.681] Build status: STARTED
[15:53:19.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:140:0) after 7m59s
[16:01:19.021] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:140:0)
[16:01:19.047] Build status: STARTED
[16:01:19.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:141:0) after 2m20s
[16:03:39.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:141:0)
[16:03:39.105] Build status: STARTED
[16:03:39.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:142:0) after 8m28s
[16:12:07.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:142:0)
[16:12:07.236] Build status: STARTED
[16:12:07.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:143:0) after 7m31s
[16:19:38.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:143:0)
[16:19:38.351] Build status: STARTED
[16:19:38.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:144:0) after 7m53s
[16:27:31.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:144:0)
[16:27:31.387] Build status: STARTED
[16:27:31.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:145:0) after 7m0s
[16:34:31.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:145:0)
[16:34:31.516] Build status: STARTED
[16:34:31.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:146:0) after 3m49s
[16:38:20.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:146:0)
[16:38:20.663] Build status: STARTED
[16:38:20.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:147:0) after 1m0s
[16:39:20.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:147:0)
[16:39:20.823] Build status: STARTED
[16:39:20.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:148:0) after 9m47s
[16:49:07.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:148:0)
[16:49:07.862] Build status: STARTED
[16:49:07.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:149:0) after 6m14s
[16:55:21.921] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:149:0)
[16:55:21.981] Build status: STARTED
[16:55:21.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:150:0) after 5m14s
[17:00:35.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:150:0)
[17:00:35.991] Build status: STARTED
[17:00:35.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:151:0) after 4m4s
[17:04:40.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:151:0)
[17:04:40.029] Build status: STARTED
[17:04:40.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:152:0) after 4m20s
[17:09:00.136] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:152:0)
[17:09:00.226] Build status: STARTED
[17:09:00.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:153:0) after 7m39s
[17:16:39.246] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:153:0)
[17:16:39.273] Build status: STARTED
[17:16:39.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:154:0) after 4m16s
[17:20:55.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:154:0)
[17:20:55.319] Build status: STARTED
[17:20:55.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:155:0) after 4m51s
[17:25:46.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:155:0)
[17:25:46.315] Build status: STARTED
[17:25:46.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:156:0) after 9m40s
[17:35:26.335] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:156:0)
[17:35:26.371] Build status: STARTED
[17:35:26.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:157:0) after 3m27s
[17:38:53.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:157:0)
[17:38:53.437] Build status: STARTED
[17:38:53.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:158:0) after 4m47s
[17:43:40.481] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:158:0)
[17:43:40.498] Build status: STARTED
[17:43:40.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:159:0) after 1m27s
[17:45:07.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:159:0)
[17:45:07.584] Build status: STARTED
[17:45:07.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:160:0) after 3m12s
[17:48:19.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:160:0)
[17:48:19.685] Build status: STARTED
[17:48:19.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:161:0) after 7m9s
[17:55:28.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:161:0)
[17:55:28.794] Build status: STARTED
[17:55:28.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:162:0) after 5m30s
[18:00:58.816] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:162:0)
[18:00:58.832] Build status: STARTED
[18:00:58.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:163:0) after 3m45s
[18:04:43.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:163:0)
[18:04:43.886] Build status: STARTED
[18:04:43.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:164:0) after 2m11s
[18:06:54.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:164:0)
[18:06:54.895] Build status: STARTED
[18:06:54.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:165:0) after 5m31s
[18:12:25.913] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:165:0)
[18:12:25.934] Build status: STARTED
[18:12:25.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:166:0) after 8m20s
[18:20:45.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:166:0)
[18:20:45.984] Build status: STARTED
[18:20:45.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:167:0) after 7m55s
[18:28:41.434] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:167:0)
[18:28:41.456] Build status: STARTED
[18:28:41.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:168:0) after 5m50s
[18:34:31.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:168:0)
[18:34:31.483] Build status: STARTED
[18:34:31.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:169:0) after 4m18s
[18:38:49.795] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:169:0)
[18:38:49.814] Build status: STARTED
[18:38:49.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:170:0) after 4m44s
[18:43:33.833] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:170:0)
[18:43:33.957] Build status: STARTED
[18:43:33.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:171:0) after 9m28s
[18:53:01.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:171:0)
[18:53:01.996] Build status: STARTED
[18:53:01.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:172:0) after 9m49s
[19:02:51.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:172:0)
[19:02:51.092] Build status: STARTED
[19:02:51.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:173:0) after 8m7s
[19:10:58.204] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:173:0)
[19:10:58.220] Build status: STARTED
[19:10:58.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:174:0) after 3m8s
[19:14:06.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:174:0)
[19:14:06.254] Build status: STARTED
[19:14:06.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:175:0) after 5m1s
[19:19:07.303] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:175:0)
[19:19:07.369] Build status: STARTED
[19:19:07.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:176:0) after 6m57s
[19:26:04.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:176:0)
[19:26:04.413] Build status: STARTED
[19:26:04.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:177:0) after 2m40s
[19:28:44.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:177:0)
[19:28:44.473] Build status: STARTED
[19:28:44.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:178:0) after 1m44s
[19:30:28.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:178:0)
[19:30:28.726] Build status: STARTED
[19:30:28.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:179:0) after 7m15s
[19:37:43.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:179:0)
[19:37:43.770] Build status: STARTED
[19:37:43.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:180:0) after 6m8s
[19:43:51.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:180:0)
[19:43:51.830] Build status: STARTED
[19:43:51.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:181:0) after 2m51s
[19:46:42.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:181:0)
[19:46:42.892] Build status: STARTED
[19:46:42.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:182:0) after 5m49s
[19:52:31.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:182:0)
[19:52:31.962] Build status: STARTED
[19:52:31.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:183:0) after 4m42s
[19:57:13.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:183:0)
[19:57:14.010] Build status: STARTED
[19:57:14.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:184:0) after 6m35s
[20:03:49.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:184:0)
[20:03:49.149] Build status: STARTED
[20:03:49.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:185:0) after 3m17s
[20:07:06.173] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:185:0)
[20:07:06.200] Build status: STARTED
[20:07:06.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:186:0) after 6m7s
[20:13:13.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:186:0)
[20:13:13.242] Build status: STARTED
[20:13:13.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:187:0) after 7m56s
[20:21:09.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:187:0)
[20:21:09.394] Build status: STARTED
[20:21:09.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:188:0) after 4m36s
[20:25:45.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:188:0)
[20:25:45.474] Build status: STARTED
[20:25:45.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:189:0) after 4m21s
[20:30:06.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:189:0)
[20:30:06.588] Build status: STARTED
[20:30:06.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:190:0) after 4m25s
[20:34:31.614] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:190:0)
[20:34:31.635] Build status: STARTED
[20:34:31.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:191:0) after 9m52s
[20:44:23.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:191:0)
[20:44:23.686] Build status: STARTED
[20:44:23.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:192:0) after 9m40s
[20:54:03.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:192:0)
[20:54:03.816] Build status: STARTED
[20:54:03.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:193:0) after 4m23s
[20:58:26.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:193:0)
[20:58:26.879] Build status: STARTED
[20:58:26.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:194:0) after 5m42s
[21:04:08.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:194:0)
[21:04:08.974] Build status: STARTED
[21:04:08.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:195:0) after 7m43s
[21:11:52.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:195:0)
[21:11:52.076] Build status: STARTED
[21:11:52.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:196:0) after 3m51s
[21:15:43.195] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:196:0)
[21:15:43.212] Build status: STARTED
[21:15:43.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:197:0) after 7m7s
[21:22:50.286] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:197:0)
[21:22:50.306] Build status: STARTED
[21:22:50.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:198:0) after 3m30s
[21:26:20.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:198:0)
[21:26:20.364] Build status: STARTED
[21:26:20.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:199:0) after 3m36s
[21:29:56.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:199:0)
[21:29:56.455] Build status: STARTED
[21:29:56.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8902375867011443424:200:0) after 4m45s
[21:33:11.923] Received PubSub notification, asking Buildbucket for the build status
[21:33:11.948] Build:
{
  "id": "8736945805042440257",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "number": 32904,
  "createdBy": "project:chromium",
  "createTime": "2024-09-13T02:56:44.105115550Z",
  "startTime": "2024-09-13T02:57:29.111028297Z",
  "endTime": "2024-09-13T21:33:11.297985571Z",
  "updateTime": "2024-09-13T21:33:11.297985571Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "bc5b7535ae7d4aae808f714990d54df48b27c3a4",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[21:33:11.948] Invocation finished in 18h36m29.104188378s with status FAILED