LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTMacASan"
>

Incoming triggers

1a93a0046bc6bce439a1c6db199677f0e71ed7de (4 years ago)
f064e64cf1845d1b801eca31850cd1301c2b35b0 (4 years ago)
39e84fb9c132ef1f2bd5054626ab6abb3de84e76 (4 years ago)
94e222dde3f73e1e48332eabcb03a91ae14bb6d4 (4 years ago)
cb2120b428c85a26e8bc62b0641d98a0a368a439 (4 years ago)
9ce75f90f1b02402af7ac756481d705e73a9ae26 (4 years ago)
bc7ace5073f30d2eb7b3e6dfc1f42252b3991133 (4 years ago)
c63cccb53ab9904598aff2a346348df0421b2112 (4 years ago)
1eacad09e92be0e66f5b193d4176bcf1291750a8 (4 years ago)
fcf78ebf87f058ddad4bd6906dcf2560a11cc305 (4 years ago)
0e6ac6164f21120ce8ece14725320b6b09ed96f7 (4 years ago)
171b147600dc963fec534459949332fe5f0e386b (4 years ago)
445fa0c85fcd89a7acf5e7ffb1ac2b8794131217 (4 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "445fa0c85fcd89a7acf5e7ffb1ac2b8794131217"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/445fa0c85fcd89a7acf5e7ffb1ac2b8794131217
gitiles_ref:refs/heads/main

Debug log (UTC)

[12:12:16.561] New invocation is queued and will start shortly
[12:12:17.750] Starting the invocation (attempt 1)
[12:12:17.791] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/445fa0c85fcd89a7acf5e7ffb1ac2b8794131217"
[12:12:17.791] Popped gitiles commit info from properties and tags
[12:12:17.791] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:12:17.792] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:12:17.792] Buildbucket request:
{
  "requestId": "9004171904324734656",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "445fa0c85fcd89a7acf5e7ffb1ac2b8794131217",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9004171904324734656"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[12:12:18.836] Scheduled build:
{
  "id": "8838741842210004896",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25421,
  "createdBy": "project:chromium",
  "createTime": "2021-08-16T12:12:17.947887Z",
  "updateTime": "2021-08-16T12:12:18.700208Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "445fa0c85fcd89a7acf5e7ffb1ac2b8794131217",
      "ref": "refs/heads/main"
    }
  }
}
[12:12:18.836] Task URL: https://cr-buildbucket.appspot.com/build/8838741842210004896
[12:12:18.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:2:0) after 8m24s
[12:12:32.451] Received PubSub notification, asking Buildbucket for the build status
[12:12:32.483] Build status: STARTED
[12:20:42.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:2:0)
[12:20:42.922] Build status: STARTED
[12:20:42.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:4:0) after 1m53s
[12:22:36.062] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:4:0)
[12:22:36.090] Build status: STARTED
[12:22:36.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:5:0) after 8m5s
[12:30:41.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:5:0)
[12:30:41.136] Build status: STARTED
[12:30:41.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:6:0) after 7m1s
[12:37:42.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:6:0)
[12:37:42.181] Build status: STARTED
[12:37:42.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:7:0) after 2m1s
[12:39:43.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:7:0)
[12:39:43.229] Build status: STARTED
[12:39:43.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:8:0) after 8m12s
[12:47:55.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:8:0)
[12:47:55.630] Build status: STARTED
[12:47:55.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:9:0) after 2m37s
[12:50:32.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:9:0)
[12:50:32.734] Build status: STARTED
[12:50:32.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:10:0) after 4m30s
[12:55:02.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:10:0)
[12:55:02.897] Build status: STARTED
[12:55:02.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:11:0) after 5m49s
[13:00:51.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:11:0)
[13:00:51.944] Build status: STARTED
[13:00:51.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:12:0) after 2m8s
[13:02:59.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:12:0)
[13:03:00.004] Build status: STARTED
[13:03:00.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:13:0) after 9m43s
[13:12:43.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:13:0)
[13:12:43.069] Build status: STARTED
[13:12:43.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:14:0) after 2m44s
[13:15:27.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:14:0)
[13:15:27.158] Build status: STARTED
[13:15:27.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:15:0) after 6m23s
[13:21:50.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:15:0)
[13:21:50.514] Build status: STARTED
[13:21:50.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:16:0) after 9m26s
[13:31:16.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:16:0)
[13:31:16.569] Build status: STARTED
[13:31:16.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:17:0) after 8m38s
[13:39:54.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:17:0)
[13:39:54.646] Build status: STARTED
[13:39:54.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:18:0) after 3m56s
[13:43:50.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:18:0)
[13:43:50.769] Build status: STARTED
[13:43:50.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:19:0) after 5m53s
[13:49:43.801] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:19:0)
[13:49:43.842] Build status: STARTED
[13:49:43.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:20:0) after 2m29s
[13:52:13.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:20:0)
[13:52:13.047] Build status: STARTED
[13:52:13.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:21:0) after 5m19s
[13:57:32.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:21:0)
[13:57:32.211] Build status: STARTED
[13:57:32.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:22:0) after 8m17s
[14:05:49.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:22:0)
[14:05:49.266] Build status: STARTED
[14:05:49.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:23:0) after 1m48s
[14:07:37.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:23:0)
[14:07:37.388] Build status: STARTED
[14:07:37.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:24:0) after 9m49s
[14:17:26.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:24:0)
[14:17:26.726] Build status: STARTED
[14:17:26.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:25:0) after 1m14s
[14:18:40.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:25:0)
[14:18:40.805] Build status: STARTED
[14:18:40.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:26:0) after 3m21s
[14:22:01.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:26:0)
[14:22:01.998] Build status: STARTED
[14:22:01.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:27:0) after 9m10s
[14:31:12.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:27:0)
[14:31:12.186] Build status: STARTED
[14:31:12.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:28:0) after 8m58s
[14:40:10.221] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:28:0)
[14:40:10.258] Build status: STARTED
[14:40:10.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:29:0) after 9m19s
[14:49:29.419] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:29:0)
[14:49:29.449] Build status: STARTED
[14:49:29.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:30:0) after 5m2s
[14:54:31.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:30:0)
[14:54:31.685] Build status: STARTED
[14:54:31.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:31:0) after 9m28s
[15:03:59.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:31:0)
[15:03:59.738] Build status: STARTED
[15:03:59.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:32:0) after 7m7s
[15:11:06.790] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:32:0)
[15:11:06.823] Build status: STARTED
[15:11:06.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:33:0) after 5m26s
[15:16:32.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:33:0)
[15:16:32.905] Build status: STARTED
[15:16:32.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:34:0) after 7m48s
[15:24:20.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:34:0)
[15:24:21.018] Build status: STARTED
[15:24:21.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:35:0) after 4m53s
[15:29:14.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:35:0)
[15:29:14.504] Build status: STARTED
[15:29:14.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:36:0) after 4m14s
[15:33:28.528] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:36:0)
[15:33:28.585] Build status: STARTED
[15:33:28.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:37:0) after 4m44s
[15:38:12.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:37:0)
[15:38:12.797] Build status: STARTED
[15:38:12.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:38:0) after 5m35s
[15:43:47.821] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:38:0)
[15:43:47.848] Build status: STARTED
[15:43:47.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:39:0) after 8m25s
[15:52:12.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:39:0)
[15:52:13.007] Build status: STARTED
[15:52:13.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:40:0) after 8m52s
[16:01:05.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:40:0)
[16:01:05.082] Build status: STARTED
[16:01:05.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:41:0) after 9m26s
[16:10:31.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:41:0)
[16:10:31.175] Build status: STARTED
[16:10:31.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:42:0) after 3m19s
[16:13:50.371] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:42:0)
[16:13:50.468] Build status: STARTED
[16:13:50.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:43:0) after 7m53s
[16:21:43.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:43:0)
[16:21:43.517] Build status: STARTED
[16:21:43.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:44:0) after 3m26s
[16:25:09.596] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:44:0)
[16:25:09.623] Build status: STARTED
[16:25:09.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:45:0) after 7m52s
[16:33:01.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:45:0)
[16:33:01.884] Build status: STARTED
[16:33:01.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:46:0) after 4m45s
[16:37:46.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:46:0)
[16:37:46.888] Build status: STARTED
[16:37:46.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:47:0) after 8m20s
[16:46:07.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:47:0)
[16:46:07.380] Build status: STARTED
[16:46:07.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:48:0) after 5m2s
[16:51:09.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:48:0)
[16:51:09.530] Build status: STARTED
[16:51:09.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:49:0) after 6m58s
[16:58:07.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:49:0)
[16:58:07.692] Build status: STARTED
[16:58:07.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:50:0) after 1m25s
[16:59:32.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:50:0)
[16:59:32.994] Build status: STARTED
[16:59:32.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:51:0) after 4m28s
[17:04:01.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:51:0)
[17:04:01.065] Build status: STARTED
[17:04:01.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:52:0) after 8m4s
[17:12:05.087] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:52:0)
[17:12:05.171] Build status: STARTED
[17:12:05.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:53:0) after 1m17s
[17:13:22.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:53:0)
[17:13:22.227] Build status: STARTED
[17:13:22.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:54:0) after 9m24s
[17:22:46.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:54:0)
[17:22:46.393] Build status: STARTED
[17:22:46.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:55:0) after 9m18s
[17:32:04.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:55:0)
[17:32:04.472] Build status: STARTED
[17:32:04.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:56:0) after 6m14s
[17:38:18.570] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:56:0)
[17:38:18.605] Build status: STARTED
[17:38:18.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:57:0) after 3m7s
[17:41:25.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:57:0)
[17:41:25.698] Build status: STARTED
[17:41:25.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:58:0) after 7m51s
[17:49:16.727] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:58:0)
[17:49:16.759] Build status: STARTED
[17:49:16.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:59:0) after 4m26s
[17:53:42.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:59:0)
[17:53:43.002] Build status: STARTED
[17:53:43.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:60:0) after 9m42s
[18:03:25.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:60:0)
[18:03:25.091] Build status: STARTED
[18:03:25.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:61:0) after 3m14s
[18:06:39.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:61:0)
[18:06:39.288] Build status: STARTED
[18:06:39.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:62:0) after 4m29s
[18:11:08.333] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:62:0)
[18:11:08.365] Build status: STARTED
[18:11:08.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:63:0) after 3m20s
[18:14:28.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:63:0)
[18:14:28.522] Build status: STARTED
[18:14:28.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:64:0) after 1m34s
[18:16:02.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:64:0)
[18:16:02.621] Build status: STARTED
[18:16:02.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:65:0) after 8m25s
[18:24:27.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:65:0)
[18:24:27.742] Build status: STARTED
[18:24:27.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:66:0) after 5m2s
[18:29:29.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:66:0)
[18:29:29.847] Build status: STARTED
[18:29:29.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:67:0) after 5m14s
[18:34:43.919] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:67:0)
[18:34:43.965] Build status: STARTED
[18:34:43.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:68:0) after 7m8s
[18:41:52.307] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:68:0)
[18:41:52.336] Build status: STARTED
[18:41:52.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:69:0) after 1m21s
[18:43:13.464] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:69:0)
[18:43:13.492] Build status: STARTED
[18:43:13.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:70:0) after 9m30s
[18:52:44.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:70:0)
[18:52:44.078] Build status: STARTED
[18:52:44.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:71:0) after 7m29s
[19:00:13.202] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:71:0)
[19:00:13.265] Build status: STARTED
[19:00:13.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:72:0) after 2m45s
[19:02:58.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:72:0)
[19:02:58.354] Build status: STARTED
[19:02:58.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:73:0) after 1m19s
[19:04:17.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:73:0)
[19:04:17.534] Build status: STARTED
[19:04:17.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:74:0) after 4m5s
[19:08:22.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:74:0)
[19:08:22.620] Build status: STARTED
[19:08:22.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:75:0) after 9m13s
[19:17:35.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:75:0)
[19:17:35.931] Build status: STARTED
[19:17:35.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:76:0) after 2m16s
[19:19:52.231] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:76:0)
[19:19:52.332] Build status: STARTED
[19:19:52.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:77:0) after 6m55s
[19:26:47.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:77:0)
[19:26:47.414] Build status: STARTED
[19:26:47.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:78:0) after 5m12s
[19:32:00.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:78:0)
[19:32:00.311] Build status: STARTED
[19:32:00.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:79:0) after 8m44s
[19:40:44.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:79:0)
[19:40:44.925] Build status: STARTED
[19:40:44.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:80:0) after 8m5s
[19:48:49.967] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:80:0)
[19:48:49.997] Build status: STARTED
[19:48:49.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:81:0) after 3m41s
[19:52:31.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:81:0)
[19:52:31.078] Build status: STARTED
[19:52:31.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:82:0) after 3m13s
[19:55:44.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:82:0)
[19:55:44.144] Build status: STARTED
[19:55:44.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:83:0) after 3m2s
[19:58:46.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:83:0)
[19:58:46.404] Build status: STARTED
[19:58:46.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:84:0) after 2m0s
[20:00:46.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:84:0)
[20:00:46.635] Build status: STARTED
[20:00:46.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:85:0) after 3m24s
[20:04:10.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:85:0)
[20:04:10.867] Build status: STARTED
[20:04:10.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:86:0) after 6m52s
[20:11:02.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:86:0)
[20:11:02.980] Build status: STARTED
[20:11:02.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:87:0) after 1m17s
[20:12:20.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:87:0)
[20:12:20.037] Build status: STARTED
[20:12:20.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:88:0) after 3m16s
[20:15:36.150] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:88:0)
[20:15:36.201] Build status: STARTED
[20:15:36.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:89:0) after 5m32s
[20:21:09.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:89:0)
[20:21:09.260] Build status: STARTED
[20:21:09.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:90:0) after 4m2s
[20:25:11.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:90:0)
[20:25:11.418] Build status: STARTED
[20:25:11.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:91:0) after 8m23s
[20:33:34.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:91:0)
[20:33:34.516] Build status: STARTED
[20:33:34.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:92:0) after 2m57s
[20:36:31.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:92:0)
[20:36:31.658] Build status: STARTED
[20:36:31.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:93:0) after 8m9s
[20:44:41.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:93:0)
[20:44:41.137] Build status: STARTED
[20:44:41.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:94:0) after 1m4s
[20:45:45.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:94:0)
[20:45:45.291] Build status: STARTED
[20:45:45.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:95:0) after 7m50s
[20:53:35.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:95:0)
[20:53:35.467] Build status: STARTED
[20:53:35.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:96:0) after 9m22s
[21:02:57.499] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:96:0)
[21:02:57.527] Build status: STARTED
[21:02:57.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:97:0) after 9m56s
[21:12:53.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:97:0)
[21:12:53.612] Build status: STARTED
[21:12:53.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:98:0) after 7m23s
[21:20:16.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:98:0)
[21:20:16.681] Build status: STARTED
[21:20:16.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:99:0) after 2m21s
[21:22:37.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:99:0)
[21:22:37.949] Build status: STARTED
[21:22:37.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:100:0) after 7m3s
[21:29:41.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:100:0)
[21:29:41.176] Build status: STARTED
[21:29:41.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:101:0) after 4m36s
[21:34:17.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:101:0)
[21:34:17.259] Build status: STARTED
[21:34:17.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:102:0) after 6m29s
[21:40:46.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:102:0)
[21:40:46.525] Build status: STARTED
[21:40:46.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:103:0) after 2m19s
[21:43:05.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:103:0)
[21:43:05.592] Build status: STARTED
[21:43:05.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:104:0) after 2m1s
[21:45:06.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:104:0)
[21:45:06.729] Build status: STARTED
[21:45:06.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:105:0) after 7m52s
[21:52:58.935] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:105:0)
[21:52:58.965] Build status: STARTED
[21:52:58.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:106:0) after 9m32s
[22:02:31.101] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:106:0)
[22:02:31.129] Build status: STARTED
[22:02:31.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:107:0) after 7m35s
[22:10:06.366] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:107:0)
[22:10:06.403] Build status: STARTED
[22:10:06.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:108:0) after 7m23s
[22:17:29.428] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:108:0)
[22:17:29.457] Build status: STARTED
[22:17:29.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:109:0) after 1m26s
[22:18:55.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:109:0)
[22:18:55.622] Build status: STARTED
[22:18:55.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004171904324734656:110:0) after 6m10s
[22:22:23.164] Received PubSub notification, asking Buildbucket for the build status
[22:22:23.204] Build:
{
  "id": "8838741842210004896",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25421,
  "createdBy": "project:chromium",
  "createTime": "2021-08-16T12:12:17.947887Z",
  "startTime": "2021-08-16T12:12:31.590682Z",
  "endTime": "2021-08-16T22:22:22.677886036Z",
  "updateTime": "2021-08-16T22:22:22.678702396Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "445fa0c85fcd89a7acf5e7ffb1ac2b8794131217",
      "ref": "refs/heads/main"
    }
  }
}
[22:22:23.204] Invocation finished in 10h10m6.657877138s with status FAILED