LUCI Scheduler :: chromium :: ToTLinuxTSan

Status: FAILED

Triggered by: -

Duration: 7 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxTSan"
>

Incoming triggers

0314db5371f202bfc01b538189c0bd640263af4b (2 years ago)
e7070e6b06de5cd90e114a23c273e0e7fd4c5a50 (2 years ago)
60dcee31c48a167f83608fb19c09fea2a02c2e49 (2 years ago)
dfab3fc519106992eed94c2cce3a527f663c3fb4 (2 years ago)
80fec56e0d55b2dda39b8f9869b7f6591996e21c (2 years ago)
4a8ed7e775109c8ec8678fcdc3e99376914017f3 (2 years ago)
9db1997a00d9a3ac72a54241e242b20fd56ad52c (2 years ago)
1e7659c30e989c8b35882967673aa7c6e9f86103 (2 years ago)
e9e7957880f189b9c6b3013b99d560a61cdd6651 (2 years ago)
d437f79d12502e11c24e8cc1247be7089b6f224f (2 years ago)
3a345d9b86fbc3fbd79bed0d624f5b89e2642874 (2 years ago)
3d2fa650bc3d36debe82cb7ca6b273a976de8bc7 (2 years ago)
ffed24f5804c00f60931d373c387b3171e92e951 (2 years ago)
a2af564b5b4d8594e143245bb200f4f1ddfe6490 (2 years ago)
0f4274192883efd1461392b8e6d546e692f2b742 (2 years ago)
83eb52a5d46d8ce40006b8908275e2a04eef8cb6 (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "83eb52a5d46d8ce40006b8908275e2a04eef8cb6"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/83eb52a5d46d8ce40006b8908275e2a04eef8cb6
gitiles_ref:refs/heads/main

Debug log (UTC)

[23:43:42.632] New invocation is queued and will start shortly
[23:43:47.997] Starting the invocation (attempt 1)
[23:43:48.035] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/83eb52a5d46d8ce40006b8908275e2a04eef8cb6"
[23:43:48.035] Popped gitiles commit info from properties and tags
[23:43:48.035] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:43:48.035] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:43:48.036] Buildbucket request:
{
  "requestId": "8952850520045137776",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "83eb52a5d46d8ce40006b8908275e2a04eef8cb6",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8952850520045137776"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxTSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[23:43:48.493] Scheduled build:
{
  "id": "8787420453596537393",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 16151,
  "createdBy": "project:chromium",
  "createTime": "2023-03-05T23:43:48.150581040Z",
  "updateTime": "2023-03-05T23:43:48.150581040Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "83eb52a5d46d8ce40006b8908275e2a04eef8cb6",
      "ref": "refs/heads/main"
    }
  }
}
[23:43:48.493] Task URL: https://cr-buildbucket.appspot.com/build/8787420453596537393
[23:43:48.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:2:0) after 2m8s
[23:44:10.171] Received PubSub notification, asking Buildbucket for the build status
[23:44:10.199] Build status: STARTED
[23:45:56.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:2:0)
[23:45:56.644] Build status: STARTED
[23:45:56.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:4:0) after 6m57s
[23:52:53.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:4:0)
[23:52:53.681] Build status: STARTED
[23:52:53.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:5:0) after 1m38s
[23:54:31.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:5:0)
[23:54:31.740] Build status: STARTED
[23:54:31.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:6:0) after 7m23s
[00:01:54.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:6:0)
[00:01:54.796] Build status: STARTED
[00:01:54.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:7:0) after 4m5s
[00:05:59.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:7:0)
[00:05:59.833] Build status: STARTED
[00:05:59.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:8:0) after 4m20s
[00:10:19.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:8:0)
[00:10:19.888] Build status: STARTED
[00:10:19.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:9:0) after 6m35s
[00:16:54.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:9:0)
[00:16:54.933] Build status: STARTED
[00:16:54.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:10:0) after 3m9s
[00:20:03.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:10:0)
[00:20:04.181] Build status: STARTED
[00:20:04.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:11:0) after 3m14s
[00:23:18.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:11:0)
[00:23:18.221] Build status: STARTED
[00:23:18.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:12:0) after 6m45s
[00:30:03.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:12:0)
[00:30:03.526] Build status: STARTED
[00:30:03.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:13:0) after 2m50s
[00:32:53.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:13:0)
[00:32:53.583] Build status: STARTED
[00:32:53.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:14:0) after 7m0s
[00:39:53.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:14:0)
[00:39:53.652] Build status: STARTED
[00:39:53.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:15:0) after 6m51s
[00:46:44.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:15:0)
[00:46:44.772] Build status: STARTED
[00:46:44.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:16:0) after 8m30s
[00:55:14.796] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:16:0)
[00:55:14.822] Build status: STARTED
[00:55:14.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:17:0) after 1m33s
[00:56:47.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:17:0)
[00:56:47.887] Build status: STARTED
[00:56:47.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:18:0) after 6m53s
[01:03:40.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:18:0)
[01:03:40.977] Build status: STARTED
[01:03:40.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:19:0) after 1m24s
[01:05:05.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:19:0)
[01:05:05.041] Build status: STARTED
[01:05:05.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:20:0) after 4m29s
[01:09:34.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:20:0)
[01:09:34.086] Build status: STARTED
[01:09:34.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:21:0) after 6m30s
[01:16:04.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:21:0)
[01:16:04.159] Build status: STARTED
[01:16:04.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:22:0) after 3m42s
[01:19:46.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:22:0)
[01:19:46.273] Build status: STARTED
[01:19:46.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:23:0) after 6m2s
[01:25:48.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:23:0)
[01:25:48.353] Build status: STARTED
[01:25:48.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:24:0) after 8m40s
[01:34:28.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:24:0)
[01:34:28.432] Build status: STARTED
[01:34:28.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:25:0) after 4m32s
[01:39:00.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:25:0)
[01:39:00.473] Build status: STARTED
[01:39:00.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:26:0) after 1m3s
[01:40:03.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:26:0)
[01:40:03.514] Build status: STARTED
[01:40:03.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:27:0) after 5m6s
[01:45:09.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:27:0)
[01:45:09.667] Build status: STARTED
[01:45:09.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:28:0) after 1m39s
[01:46:49.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:28:0)
[01:46:49.047] Build status: STARTED
[01:46:49.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:29:0) after 5m45s
[01:52:34.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:29:0)
[01:52:34.090] Build status: STARTED
[01:52:34.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:30:0) after 5m13s
[01:57:47.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:30:0)
[01:57:47.270] Build status: STARTED
[01:57:47.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:31:0) after 9m26s
[02:07:13.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:31:0)
[02:07:13.314] Build status: STARTED
[02:07:13.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:32:0) after 1m32s
[02:08:45.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:32:0)
[02:08:45.460] Build status: STARTED
[02:08:45.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:33:0) after 9m16s
[02:18:01.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:33:0)
[02:18:01.732] Build status: STARTED
[02:18:01.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:34:0) after 8m32s
[02:26:33.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:34:0)
[02:26:33.771] Build status: STARTED
[02:26:33.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:35:0) after 9m29s
[02:36:02.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:35:0)
[02:36:02.878] Build status: STARTED
[02:36:02.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:36:0) after 8m16s
[02:44:19.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:36:0)
[02:44:19.305] Build status: STARTED
[02:44:19.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:37:0) after 9m40s
[02:53:59.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:37:0)
[02:53:59.679] Build status: STARTED
[02:53:59.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:38:0) after 9m27s
[03:03:26.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:38:0)
[03:03:26.935] Build status: STARTED
[03:03:26.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:39:0) after 1m13s
[03:04:39.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:39:0)
[03:04:40.136] Build status: STARTED
[03:04:40.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:40:0) after 3m14s
[03:07:54.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:40:0)
[03:07:54.188] Build status: STARTED
[03:07:54.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:41:0) after 7m1s
[03:14:55.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:41:0)
[03:14:55.305] Build status: STARTED
[03:14:55.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:42:0) after 3m20s
[03:18:15.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:42:0)
[03:18:15.445] Build status: STARTED
[03:18:15.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:43:0) after 4m19s
[03:22:34.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:43:0)
[03:22:34.484] Build status: STARTED
[03:22:34.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:44:0) after 8m57s
[03:31:31.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:44:0)
[03:31:31.531] Build status: STARTED
[03:31:31.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:45:0) after 7m23s
[03:38:54.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:45:0)
[03:38:54.773] Build status: STARTED
[03:38:54.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:46:0) after 7m21s
[03:46:16.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:46:0)
[03:46:16.074] Build status: STARTED
[03:46:16.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:47:0) after 8m21s
[03:54:37.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:47:0)
[03:54:37.071] Build status: STARTED
[03:54:37.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:48:0) after 1m25s
[03:56:02.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:48:0)
[03:56:02.315] Build status: STARTED
[03:56:02.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:49:0) after 3m53s
[03:59:55.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:49:0)
[03:59:55.497] Build status: STARTED
[03:59:55.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:50:0) after 8m52s
[04:08:47.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:50:0)
[04:08:47.666] Build status: STARTED
[04:08:47.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:51:0) after 9m41s
[04:18:28.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:51:0)
[04:18:28.732] Build status: STARTED
[04:18:28.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:52:0) after 7m42s
[04:26:10.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:52:0)
[04:26:10.783] Build status: STARTED
[04:26:10.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:53:0) after 3m14s
[04:29:24.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:53:0)
[04:29:24.946] Build status: STARTED
[04:29:24.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:54:0) after 7m13s
[04:36:37.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:54:0)
[04:36:37.988] Build status: STARTED
[04:36:37.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:55:0) after 6m51s
[04:43:29.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:55:0)
[04:43:29.039] Build status: STARTED
[04:43:29.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:56:0) after 8m47s
[04:52:16.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:56:0)
[04:52:16.164] Build status: STARTED
[04:52:16.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:57:0) after 7m27s
[04:59:43.186] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:57:0)
[04:59:43.308] Build status: STARTED
[04:59:43.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:58:0) after 7m36s
[05:07:19.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:58:0)
[05:07:19.419] Build status: STARTED
[05:07:19.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:59:0) after 2m56s
[05:10:15.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:59:0)
[05:10:15.627] Build status: STARTED
[05:10:15.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:60:0) after 3m43s
[05:13:58.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:60:0)
[05:13:58.771] Build status: STARTED
[05:13:58.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:61:0) after 3m9s
[05:17:08.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:61:0)
[05:17:08.303] Build status: STARTED
[05:17:08.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:62:0) after 9m48s
[05:26:56.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:62:0)
[05:26:56.596] Build status: STARTED
[05:26:56.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:63:0) after 3m12s
[05:30:08.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:63:0)
[05:30:08.744] Build status: STARTED
[05:30:08.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:64:0) after 7m49s
[05:37:57.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:64:0)
[05:37:57.782] Build status: STARTED
[05:37:57.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:65:0) after 9m11s
[05:47:08.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:65:0)
[05:47:08.842] Build status: STARTED
[05:47:08.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:66:0) after 1m45s
[05:48:53.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:66:0)
[05:48:53.939] Build status: STARTED
[05:48:53.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:67:0) after 2m38s
[05:51:31.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:67:0)
[05:51:31.977] Build status: STARTED
[05:51:31.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:68:0) after 9m31s
[06:01:03.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:68:0)
[06:01:03.124] Build status: STARTED
[06:01:03.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:69:0) after 3m15s
[06:04:18.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:69:0)
[06:04:18.181] Build status: STARTED
[06:04:18.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:70:0) after 2m3s
[06:06:21.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:70:0)
[06:06:21.407] Build status: STARTED
[06:06:21.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:71:0) after 5m3s
[06:11:24.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:71:0)
[06:11:24.516] Build status: STARTED
[06:11:24.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:72:0) after 4m20s
[06:15:44.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:72:0)
[06:15:44.587] Build status: STARTED
[06:15:44.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:73:0) after 2m50s
[06:18:34.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:73:0)
[06:18:34.724] Build status: STARTED
[06:18:34.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:74:0) after 5m14s
[06:23:48.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:74:0)
[06:23:48.769] Build status: STARTED
[06:23:48.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:75:0) after 8m47s
[06:32:35.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:75:0)
[06:32:35.833] Build status: STARTED
[06:32:35.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:76:0) after 1m58s
[06:34:34.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:76:0)
[06:34:34.076] Build status: STARTED
[06:34:34.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:77:0) after 3m19s
[06:37:53.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:77:0)
[06:37:53.142] Build status: STARTED
[06:37:53.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:78:0) after 8m20s
[06:46:13.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:78:0)
[06:46:13.283] Build status: STARTED
[06:46:13.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:79:0) after 9m28s
[06:55:41.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:79:0)
[06:55:41.431] Build status: STARTED
[06:55:41.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:80:0) after 2m9s
[06:57:50.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:80:0)
[06:57:50.600] Build status: STARTED
[06:57:50.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:81:0) after 8m3s
[07:05:53.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:81:0)
[07:05:53.825] Build status: STARTED
[07:05:53.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:82:0) after 5m5s
[07:10:58.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:82:0)
[07:10:58.880] Build status: STARTED
[07:10:58.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8952850520045137776:83:0) after 8m42s
[07:11:26.162] Received PubSub notification, asking Buildbucket for the build status
[07:11:26.228] Build:
{
  "id": "8787420453596537393",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 16151,
  "createdBy": "project:chromium",
  "createTime": "2023-03-05T23:43:48.150581040Z",
  "startTime": "2023-03-05T23:44:09.698670Z",
  "endTime": "2023-03-06T07:11:24.454903078Z",
  "updateTime": "2023-03-06T07:11:24.454903078Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "83eb52a5d46d8ce40006b8908275e2a04eef8cb6",
      "ref": "refs/heads/main"
    }
  }
}
[07:11:26.228] Invocation finished in 7h27m43.612467931s with status FAILED