LUCI Scheduler :: chromium :: ToTLinuxMSan

Status: FAILED

Triggered by: -

Duration: 7 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxMSan"
>

Incoming triggers

ae4407f53e5ea8d615cd86fce9176573560412b8 (3 years ago)
7496f848b8951f74973007f085709946926cad09 (3 years ago)
63213277c07d741de65afe00d021640e0e5c560e (3 years ago)
6aa13a42aa41dbe10cc297e39128e74b8dd52257 (3 years ago)
7119a40af3d60c621f2d3ef2f6f0265e7370f961 (3 years ago)
796a44a7f546bd41c61e8c0aafded2eebc17a352 (3 years ago)
97767aede017024cefae4c28e2894d8de4605303 (3 years ago)
ab41dad25c1f9b39c6d848f1be41ba01a8664fff (3 years ago)
1710a82f45a25b4f5615079138c34d2e50529beb (3 years ago)
b886ec59380f374ecb047980c6bd126190eb8afd (3 years ago)
d6532b93bd35db44d5ce3a6552b66fd57089981d (3 years ago)
d7e37cbd179fae51f8d7e6c0bbc5fcd8d366b83d (3 years ago)
f4d9f8cf88450f2e3bd72d77873fbcb61e743647 (3 years ago)
f7ff2c1cc7c2dbfbb52929b01edb657142c57a79 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "f7ff2c1cc7c2dbfbb52929b01edb657142c57a79"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7ff2c1cc7c2dbfbb52929b01edb657142c57a79
gitiles_ref:refs/heads/main

Debug log (UTC)

[19:07:48.942] New invocation is queued and will start shortly
[19:07:50.370] Starting the invocation (attempt 1)
[19:07:50.412] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f7ff2c1cc7c2dbfbb52929b01edb657142c57a79"
[19:07:50.412] Popped gitiles commit info from properties and tags
[19:07:50.412] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:07:50.412] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:07:50.412] Buildbucket request:
{
  "requestId": "8976966670908489648",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "f7ff2c1cc7c2dbfbb52929b01edb657142c57a79",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8976966670908489648"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxMSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[19:07:51.171] Scheduled build:
{
  "id": "8811536608627204753",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 15588,
  "createdBy": "project:chromium",
  "createTime": "2022-06-12T19:07:50.486825068Z",
  "updateTime": "2022-06-12T19:07:50.486825068Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "f7ff2c1cc7c2dbfbb52929b01edb657142c57a79",
      "ref": "refs/heads/main"
    }
  }
}
[19:07:51.171] Task URL: https://cr-buildbucket.appspot.com/build/8811536608627204753
[19:07:51.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:2:0) after 1m17s
[19:09:08.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:2:0)
[19:09:08.613] Build status: SCHEDULED
[19:09:08.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:3:0) after 6m15s
[19:11:02.811] Received PubSub notification, asking Buildbucket for the build status
[19:11:02.850] Build status: STARTED
[19:15:23.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:3:0)
[19:15:23.836] Build status: STARTED
[19:15:23.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:5:0) after 2m18s
[19:17:41.853] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:5:0)
[19:17:41.890] Build status: STARTED
[19:17:41.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:6:0) after 3m27s
[19:21:08.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:6:0)
[19:21:08.936] Build status: STARTED
[19:21:08.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:7:0) after 1m40s
[19:22:49.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:7:0)
[19:22:49.953] Build status: STARTED
[19:22:49.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:8:0) after 9m18s
[19:32:08.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:8:0)
[19:32:08.718] Build status: STARTED
[19:32:08.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:9:0) after 9m44s
[19:41:52.794] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:9:0)
[19:41:52.825] Build status: STARTED
[19:41:52.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:10:0) after 7m16s
[19:49:08.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:10:0)
[19:49:08.994] Build status: STARTED
[19:49:08.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:11:0) after 1m57s
[19:51:06.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:11:0)
[19:51:06.346] Build status: STARTED
[19:51:06.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:12:0) after 7m32s
[19:58:38.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:12:0)
[19:58:38.426] Build status: STARTED
[19:58:38.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:13:0) after 7m35s
[20:06:13.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:13:0)
[20:06:13.465] Build status: STARTED
[20:06:13.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:14:0) after 8m2s
[20:14:15.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:14:0)
[20:14:15.614] Build status: STARTED
[20:14:15.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:15:0) after 6m30s
[20:20:45.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:15:0)
[20:20:45.660] Build status: STARTED
[20:20:45.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:16:0) after 6m7s
[20:26:52.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:16:0)
[20:26:52.706] Build status: STARTED
[20:26:52.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:17:0) after 5m26s
[20:32:18.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:17:0)
[20:32:18.787] Build status: STARTED
[20:32:18.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:18:0) after 1m19s
[20:33:37.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:18:0)
[20:33:37.836] Build status: STARTED
[20:33:37.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:19:0) after 8m41s
[20:42:18.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:19:0)
[20:42:18.910] Build status: STARTED
[20:42:18.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:20:0) after 2m56s
[20:45:14.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:20:0)
[20:45:14.952] Build status: STARTED
[20:45:14.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:21:0) after 9m11s
[20:54:26.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:21:0)
[20:54:26.264] Build status: STARTED
[20:54:26.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:22:0) after 4m7s
[20:58:33.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:22:0)
[20:58:33.590] Build status: STARTED
[20:58:33.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:23:0) after 3m34s
[21:02:07.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:23:0)
[21:02:07.613] Build status: STARTED
[21:02:07.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:24:0) after 5m4s
[21:07:12.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:24:0)
[21:07:12.259] Build status: STARTED
[21:07:12.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:25:0) after 3m44s
[21:10:56.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:25:0)
[21:10:56.319] Build status: STARTED
[21:10:56.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:26:0) after 6m33s
[21:17:29.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:26:0)
[21:17:29.574] Build status: STARTED
[21:17:29.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:27:0) after 4m58s
[21:22:28.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:27:0)
[21:22:28.034] Build status: STARTED
[21:22:28.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:28:0) after 3m48s
[21:26:16.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:28:0)
[21:26:16.079] Build status: STARTED
[21:26:16.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:29:0) after 4m51s
[21:31:07.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:29:0)
[21:31:07.243] Build status: STARTED
[21:31:07.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:30:0) after 8m40s
[21:39:47.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:30:0)
[21:39:47.407] Build status: STARTED
[21:39:47.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:31:0) after 2m13s
[21:42:00.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:31:0)
[21:42:00.541] Build status: STARTED
[21:42:00.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:32:0) after 5m21s
[21:47:21.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:32:0)
[21:47:21.598] Build status: STARTED
[21:47:21.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:33:0) after 8m45s
[21:56:06.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:33:0)
[21:56:06.669] Build status: STARTED
[21:56:06.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:34:0) after 2m35s
[21:58:41.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:34:0)
[21:58:41.685] Build status: STARTED
[21:58:41.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:35:0) after 7m17s
[22:05:58.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:35:0)
[22:05:58.934] Build status: STARTED
[22:05:58.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:36:0) after 4m0s
[22:09:58.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:36:0)
[22:09:58.988] Build status: STARTED
[22:09:58.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:37:0) after 9m52s
[22:19:51.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:37:0)
[22:19:51.437] Build status: STARTED
[22:19:51.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:38:0) after 7m21s
[22:27:12.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:38:0)
[22:27:12.844] Build status: STARTED
[22:27:12.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:39:0) after 5m48s
[22:33:00.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:39:0)
[22:33:00.988] Build status: STARTED
[22:33:00.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:40:0) after 8m45s
[22:41:46.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:40:0)
[22:41:46.065] Build status: STARTED
[22:41:46.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:41:0) after 4m19s
[22:46:05.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:41:0)
[22:46:05.592] Build status: STARTED
[22:46:05.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:42:0) after 8m17s
[22:54:23.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:42:0)
[22:54:23.150] Build status: STARTED
[22:54:23.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:43:0) after 2m13s
[22:56:36.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:43:0)
[22:56:36.218] Build status: STARTED
[22:56:36.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:44:0) after 2m28s
[22:59:04.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:44:0)
[22:59:04.366] Build status: STARTED
[22:59:04.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:45:0) after 8m17s
[23:07:21.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:45:0)
[23:07:21.482] Build status: STARTED
[23:07:21.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:46:0) after 5m45s
[23:13:06.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:46:0)
[23:13:06.584] Build status: STARTED
[23:13:06.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:47:0) after 9m40s
[23:22:46.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:47:0)
[23:22:46.831] Build status: STARTED
[23:22:46.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:48:0) after 9m18s
[23:32:04.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:48:0)
[23:32:05.030] Build status: STARTED
[23:32:05.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:49:0) after 6m41s
[23:38:46.144] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:49:0)
[23:38:46.178] Build status: STARTED
[23:38:46.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:50:0) after 4m50s
[23:43:36.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:50:0)
[23:43:36.361] Build status: STARTED
[23:43:36.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:51:0) after 9m24s
[23:53:00.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:51:0)
[23:53:00.414] Build status: STARTED
[23:53:00.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:52:0) after 8m58s
[00:01:58.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:52:0)
[00:01:58.554] Build status: STARTED
[00:01:58.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:53:0) after 7m28s
[00:09:26.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:53:0)
[00:09:26.622] Build status: STARTED
[00:09:26.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:54:0) after 8m6s
[00:17:32.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:54:0)
[00:17:32.678] Build status: STARTED
[00:17:32.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:55:0) after 4m4s
[00:21:37.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:55:0)
[00:21:37.106] Build status: STARTED
[00:21:37.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:56:0) after 7m42s
[00:29:19.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:56:0)
[00:29:19.152] Build status: STARTED
[00:29:19.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:57:0) after 2m6s
[00:31:25.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:57:0)
[00:31:25.199] Build status: STARTED
[00:31:25.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:58:0) after 6m40s
[00:38:05.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:58:0)
[00:38:05.323] Build status: STARTED
[00:38:05.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:59:0) after 9m13s
[00:47:18.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:59:0)
[00:47:18.376] Build status: STARTED
[00:47:18.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:60:0) after 1m35s
[00:48:53.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:60:0)
[00:48:53.461] Build status: STARTED
[00:48:53.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:61:0) after 1m53s
[00:50:46.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:61:0)
[00:50:46.468] Build status: STARTED
[00:50:46.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:62:0) after 7m0s
[00:57:46.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:62:0)
[00:57:46.712] Build status: STARTED
[00:57:46.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:63:0) after 1m58s
[00:59:44.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:63:0)
[00:59:44.867] Build status: STARTED
[00:59:44.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:64:0) after 5m22s
[01:05:07.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:64:0)
[01:05:07.084] Build status: STARTED
[01:05:07.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:65:0) after 2m14s
[01:07:21.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:65:0)
[01:07:21.332] Build status: STARTED
[01:07:21.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:66:0) after 8m15s
[01:15:36.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:66:0)
[01:15:36.375] Build status: STARTED
[01:15:36.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:67:0) after 6m0s
[01:21:36.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:67:0)
[01:21:36.947] Build status: STARTED
[01:21:36.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:68:0) after 4m56s
[01:26:33.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:68:0)
[01:26:33.449] Build status: STARTED
[01:26:33.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:69:0) after 7m5s
[01:33:38.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:69:0)
[01:33:38.499] Build status: STARTED
[01:33:38.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:70:0) after 3m46s
[01:37:24.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:70:0)
[01:37:24.539] Build status: STARTED
[01:37:24.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:71:0) after 3m16s
[01:40:40.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:71:0)
[01:40:40.606] Build status: STARTED
[01:40:40.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:72:0) after 2m1s
[01:42:41.626] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:72:0)
[01:42:41.649] Build status: STARTED
[01:42:41.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:73:0) after 7m11s
[01:49:52.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:73:0)
[01:49:52.892] Build status: STARTED
[01:49:52.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:74:0) after 6m33s
[01:56:26.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:74:0)
[01:56:26.034] Build status: STARTED
[01:56:26.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:75:0) after 4m50s
[02:01:16.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:75:0)
[02:01:16.121] Build status: STARTED
[02:01:16.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:76:0) after 5m3s
[02:06:19.141] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:76:0)
[02:06:19.178] Build status: STARTED
[02:06:19.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:77:0) after 8m32s
[02:14:51.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:77:0)
[02:14:51.217] Build status: STARTED
[02:14:51.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:78:0) after 6m34s
[02:21:25.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:78:0)
[02:21:25.339] Build status: STARTED
[02:21:25.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976966670908489648:79:0) after 5m4s
[02:24:00.890] Received PubSub notification, asking Buildbucket for the build status
[02:24:00.922] Build:
{
  "id": "8811536608627204753",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 15588,
  "createdBy": "project:chromium",
  "createTime": "2022-06-12T19:07:50.486825068Z",
  "startTime": "2022-06-12T19:11:02.215247Z",
  "endTime": "2022-06-13T02:24:00.401325065Z",
  "updateTime": "2022-06-13T02:24:00.401325065Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "f7ff2c1cc7c2dbfbb52929b01edb657142c57a79",
      "ref": "refs/heads/main"
    }
  }
}
[02:24:00.922] Invocation finished in 7h16m11.995662716s with status FAILED