LUCI Scheduler :: chromium :: ToTLinuxASan

Status: FAILED

Triggered by: -

Duration: 7 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTLinuxASan"
>

Incoming triggers

4df7fa66222e3ff73d53b68c640ac014c46c5982 (4 years ago)
92dd63feb08e69926761bdb6062714d25394e670 (4 years ago)
b8919d7965c0836b75c13a2f3a71f77fd97557b2 (4 years ago)
94ae1342b5bf3f4a227459a5ac20a3c40d2c51c9 (4 years ago)
1b14fc20eaee1f7a6a381b114482aa96cdeba87b (4 years ago)
e37aa9b5b427a236272cf2c292e05caee38e9bc2 (4 years ago)
aa963fc49cb4730822497a94c527371493bf5725 (4 years ago)
c7e6a13309142ddff63d320c9fa7720c9efdfe30 (4 years ago)
d157421f9ca97946f85bb000101c90cc21bc2ae2 (4 years ago)
1a258474da61db7c7672947b25e308d0cdd487d8 (4 years ago)
60d48d5d2ccd02e40853a05e32d6abcdaa249380 (4 years ago)
566067a5a0147e7d59172dffe23a11486673bdbd (4 years ago)
0d97d59eb39790f1ffadce9769355d51b4daf772 (4 years ago)
504969101d0d2df7b4da433ff590ee1367b76eeb (4 years ago)
c955807d5b010c81b13220e9aace87e0014b6d3b (4 years ago)
5cc856a0455024e5e1dce538a8a5b7df902400f1 (4 years ago)
93057647d45aad81096c4085726da5c096caab82 (4 years ago)
d53b27ce37f6e9030bedf0d93cd060367aafb13d (4 years ago)
97dc0bee18030e09d22cb66b2d596d941036bdd9 (4 years ago)
3dbd5360a3997130fe09806b406eadd49723bdf7 (4 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "3dbd5360a3997130fe09806b406eadd49723bdf7"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3dbd5360a3997130fe09806b406eadd49723bdf7
gitiles_ref:refs/heads/main

Debug log (UTC)

[02:55:40.454] New invocation is queued and will start shortly
[02:55:41.612] Starting the invocation (attempt 1)
[02:55:41.644] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3dbd5360a3997130fe09806b406eadd49723bdf7"
[02:55:41.644] Popped gitiles commit info from properties and tags
[02:55:41.644] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:55:41.644] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:55:41.645] Buildbucket request:
{
  "requestId": "9002394983353495232",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "3dbd5360a3997130fe09806b406eadd49723bdf7",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9002394983353495232"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[02:55:42.157] Scheduled build:
{
  "id": "8836964921380813857",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxASan"
  },
  "number": 14200,
  "createdBy": "project:chromium",
  "createTime": "2021-09-05T02:55:41.704505772Z",
  "updateTime": "2021-09-05T02:55:41.978676132Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "3dbd5360a3997130fe09806b406eadd49723bdf7",
      "ref": "refs/heads/main"
    }
  }
}
[02:55:42.157] Task URL: https://cr-buildbucket.appspot.com/build/8836964921380813857
[02:55:42.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:2:0) after 5m5s
[02:58:26.251] Received PubSub notification, asking Buildbucket for the build status
[02:58:26.292] Build status: STARTED
[03:00:47.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:2:0)
[03:00:47.208] Build status: STARTED
[03:00:47.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:4:0) after 2m30s
[03:03:17.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:4:0)
[03:03:17.268] Build status: STARTED
[03:03:17.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:5:0) after 7m6s
[03:10:23.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:5:0)
[03:10:23.309] Build status: STARTED
[03:10:23.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:6:0) after 9m43s
[03:20:06.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:6:0)
[03:20:06.363] Build status: STARTED
[03:20:06.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:7:0) after 2m14s
[03:22:20.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:7:0)
[03:22:20.507] Build status: STARTED
[03:22:20.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:8:0) after 4m38s
[03:26:58.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:8:0)
[03:26:58.509] Build status: STARTED
[03:26:58.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:9:0) after 2m42s
[03:29:40.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:9:0)
[03:29:40.550] Build status: STARTED
[03:29:40.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:10:0) after 5m4s
[03:34:44.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:10:0)
[03:34:44.593] Build status: STARTED
[03:34:44.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:11:0) after 3m3s
[03:37:47.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:11:0)
[03:37:47.623] Build status: STARTED
[03:37:47.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:12:0) after 2m17s
[03:40:04.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:12:0)
[03:40:04.790] Build status: STARTED
[03:40:04.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:13:0) after 3m33s
[03:43:37.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:13:0)
[03:43:37.985] Build status: STARTED
[03:43:37.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:14:0) after 1m4s
[03:44:42.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:14:0)
[03:44:42.029] Build status: STARTED
[03:44:42.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:15:0) after 3m9s
[03:47:51.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:15:0)
[03:47:51.184] Build status: STARTED
[03:47:51.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:16:0) after 4m31s
[03:52:22.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:16:0)
[03:52:22.256] Build status: STARTED
[03:52:22.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:17:0) after 4m22s
[03:56:44.282] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:17:0)
[03:56:44.313] Build status: STARTED
[03:56:44.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:18:0) after 1m34s
[03:58:18.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:18:0)
[03:58:18.383] Build status: STARTED
[03:58:18.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:19:0) after 2m25s
[04:00:43.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:19:0)
[04:00:43.444] Build status: STARTED
[04:00:43.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:20:0) after 9m33s
[04:10:16.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:20:0)
[04:10:16.497] Build status: STARTED
[04:10:16.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:21:0) after 4m6s
[04:14:22.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:21:0)
[04:14:22.980] Build status: STARTED
[04:14:22.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:22:0) after 8m9s
[04:22:32.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:22:0)
[04:22:32.042] Build status: STARTED
[04:22:32.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:23:0) after 8m26s
[04:30:58.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:23:0)
[04:30:58.280] Build status: STARTED
[04:30:58.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:24:0) after 2m42s
[04:33:40.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:24:0)
[04:33:40.640] Build status: STARTED
[04:33:40.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:25:0) after 8m16s
[04:41:56.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:25:0)
[04:41:56.951] Build status: STARTED
[04:41:56.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:26:0) after 2m8s
[04:44:05.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:26:0)
[04:44:05.247] Build status: STARTED
[04:44:05.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:27:0) after 9m43s
[04:53:48.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:27:0)
[04:53:48.414] Build status: STARTED
[04:53:48.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:28:0) after 4m17s
[04:58:05.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:28:0)
[04:58:05.689] Build status: STARTED
[04:58:05.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:29:0) after 1m29s
[04:59:34.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:29:0)
[04:59:34.737] Build status: STARTED
[04:59:34.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:30:0) after 9m35s
[05:09:09.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:30:0)
[05:09:09.795] Build status: STARTED
[05:09:09.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:31:0) after 5m33s
[05:14:42.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:31:0)
[05:14:42.925] Build status: STARTED
[05:14:42.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:32:0) after 5m38s
[05:20:21.033] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:32:0)
[05:20:21.063] Build status: STARTED
[05:20:21.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:33:0) after 3m33s
[05:23:54.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:33:0)
[05:23:54.192] Build status: STARTED
[05:23:54.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:34:0) after 6m28s
[05:30:22.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:34:0)
[05:30:22.250] Build status: STARTED
[05:30:22.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:35:0) after 6m19s
[05:36:41.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:35:0)
[05:36:41.560] Build status: STARTED
[05:36:41.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:36:0) after 5m24s
[05:42:05.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:36:0)
[05:42:05.663] Build status: STARTED
[05:42:05.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:37:0) after 2m36s
[05:44:41.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:37:0)
[05:44:41.724] Build status: STARTED
[05:44:41.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:38:0) after 9m38s
[05:54:19.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:38:0)
[05:54:19.797] Build status: STARTED
[05:54:19.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:39:0) after 7m30s
[06:01:49.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:39:0)
[06:01:49.844] Build status: STARTED
[06:01:49.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:40:0) after 8m39s
[06:10:28.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:40:0)
[06:10:28.888] Build status: STARTED
[06:10:28.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:41:0) after 4m54s
[06:15:23.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:41:0)
[06:15:23.314] Build status: STARTED
[06:15:23.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:42:0) after 3m32s
[06:18:55.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:42:0)
[06:18:55.770] Build status: STARTED
[06:18:55.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:43:0) after 4m54s
[06:23:49.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:43:0)
[06:23:49.868] Build status: STARTED
[06:23:49.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:44:0) after 5m3s
[06:28:52.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:44:0)
[06:28:52.934] Build status: STARTED
[06:28:52.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:45:0) after 4m59s
[06:33:51.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:45:0)
[06:33:52.058] Build status: STARTED
[06:33:52.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:46:0) after 7m54s
[06:41:46.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:46:0)
[06:41:46.091] Build status: STARTED
[06:41:46.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:47:0) after 3m56s
[06:45:42.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:47:0)
[06:45:42.195] Build status: STARTED
[06:45:42.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:48:0) after 1m55s
[06:47:37.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:48:0)
[06:47:37.853] Build status: STARTED
[06:47:37.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:49:0) after 7m27s
[06:55:04.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:49:0)
[06:55:05.032] Build status: STARTED
[06:55:05.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:50:0) after 1m31s
[06:56:36.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:50:0)
[06:56:36.781] Build status: STARTED
[06:56:36.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:51:0) after 2m44s
[06:59:20.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:51:0)
[06:59:20.826] Build status: STARTED
[06:59:20.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:52:0) after 2m18s
[07:01:39.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:52:0)
[07:01:39.696] Build status: STARTED
[07:01:39.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:53:0) after 9m51s
[07:11:31.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:53:0)
[07:11:31.115] Build status: STARTED
[07:11:31.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:54:0) after 1m54s
[07:13:25.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:54:0)
[07:13:25.352] Build status: STARTED
[07:13:25.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:55:0) after 9m14s
[07:22:39.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:55:0)
[07:22:39.589] Build status: STARTED
[07:22:39.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:56:0) after 7m1s
[07:29:41.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:56:0)
[07:29:41.355] Build status: STARTED
[07:29:41.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:57:0) after 6m31s
[07:36:12.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:57:0)
[07:36:12.408] Build status: STARTED
[07:36:12.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:58:0) after 5m13s
[07:41:25.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:58:0)
[07:41:25.553] Build status: STARTED
[07:41:25.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:59:0) after 1m55s
[07:43:20.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:59:0)
[07:43:20.705] Build status: STARTED
[07:43:20.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:60:0) after 8m47s
[07:52:07.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:60:0)
[07:52:07.826] Build status: STARTED
[07:52:07.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:61:0) after 4m33s
[07:56:40.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:61:0)
[07:56:40.975] Build status: STARTED
[07:56:40.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:62:0) after 4m24s
[08:01:05.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:62:0)
[08:01:05.140] Build status: STARTED
[08:01:05.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:63:0) after 3m20s
[08:04:25.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:63:0)
[08:04:25.211] Build status: STARTED
[08:04:25.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:64:0) after 4m35s
[08:09:00.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:64:0)
[08:09:00.290] Build status: STARTED
[08:09:00.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:65:0) after 1m22s
[08:10:22.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:65:0)
[08:10:22.358] Build status: STARTED
[08:10:22.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:66:0) after 8m47s
[08:19:09.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:66:0)
[08:19:09.461] Build status: STARTED
[08:19:09.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:67:0) after 1m33s
[08:20:42.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:67:0)
[08:20:42.668] Build status: STARTED
[08:20:42.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:68:0) after 5m29s
[08:26:11.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:68:0)
[08:26:11.727] Build status: STARTED
[08:26:11.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:69:0) after 6m44s
[08:32:55.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:69:0)
[08:32:55.946] Build status: STARTED
[08:32:55.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:70:0) after 8m54s
[08:41:49.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:70:0)
[08:41:50.000] Build status: STARTED
[08:41:50.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:71:0) after 7m19s
[08:49:10.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:71:0)
[08:49:10.269] Build status: STARTED
[08:49:10.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:72:0) after 8m2s
[08:57:12.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:72:0)
[08:57:12.366] Build status: STARTED
[08:57:12.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:73:0) after 5m12s
[09:02:24.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:73:0)
[09:02:24.669] Build status: STARTED
[09:02:24.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:74:0) after 2m13s
[09:04:37.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:74:0)
[09:04:37.768] Build status: STARTED
[09:04:37.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:75:0) after 7m36s
[09:12:14.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:75:0)
[09:12:14.413] Build status: STARTED
[09:12:14.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:76:0) after 6m26s
[09:18:40.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:76:0)
[09:18:40.476] Build status: STARTED
[09:18:40.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:77:0) after 2m45s
[09:21:25.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:77:0)
[09:21:25.582] Build status: STARTED
[09:21:25.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:78:0) after 9m30s
[09:30:55.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:78:0)
[09:30:55.891] Build status: STARTED
[09:30:55.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:79:0) after 6m33s
[09:37:28.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:79:0)
[09:37:29.017] Build status: STARTED
[09:37:29.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:80:0) after 8m21s
[09:45:50.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:80:0)
[09:45:50.031] Build status: STARTED
[09:45:50.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:81:0) after 8m40s
[09:54:30.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:81:0)
[09:54:30.328] Build status: STARTED
[09:54:30.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:82:0) after 9m7s
[10:03:37.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:82:0)
[10:03:37.375] Build status: STARTED
[10:03:37.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:83:0) after 2m22s
[10:06:00.114] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:83:0)
[10:06:00.172] Build status: STARTED
[10:06:00.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:84:0) after 3m52s
[10:09:52.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:84:0)
[10:09:52.243] Build status: STARTED
[10:09:52.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:85:0) after 3m40s
[10:13:32.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:85:0)
[10:13:32.861] Build status: STARTED
[10:13:32.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:86:0) after 2m36s
[10:16:08.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:86:0)
[10:16:08.940] Build status: STARTED
[10:16:08.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:87:0) after 2m11s
[10:18:20.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:87:0)
[10:18:20.188] Build status: STARTED
[10:18:20.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:88:0) after 7m30s
[10:25:50.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:88:0)
[10:25:50.238] Build status: STARTED
[10:25:50.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:89:0) after 2m13s
[10:28:03.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:89:0)
[10:28:03.779] Build status: STARTED
[10:28:03.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:9002394983353495232:90:0) after 9m33s
[10:29:31.850] Received PubSub notification, asking Buildbucket for the build status
[10:29:31.877] Build:
{
  "id": "8836964921380813857",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxASan"
  },
  "number": 14200,
  "createdBy": "project:chromium",
  "createTime": "2021-09-05T02:55:41.704505772Z",
  "startTime": "2021-09-05T02:58:25.707274Z",
  "endTime": "2021-09-05T10:29:31.348768859Z",
  "updateTime": "2021-09-05T10:29:31.349289630Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "3dbd5360a3997130fe09806b406eadd49723bdf7",
      "ref": "refs/heads/main"
    }
  }
}
[10:29:31.877] Invocation finished in 7h33m51.437550993s with status FAILED