1. All projects
  2. chromium
  3. ToTLinuxTSan
  4. 8953130800198330944
Status: FAILED
Triggered by: -
Duration: 7 hours
Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxTSan"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "4a36a30e24f212efa8f07977380c327f0ef9ddee"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4a36a30e24f212efa8f07977380c327f0ef9ddee
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[21:28:46.642] New invocation is queued and will start shortly
[21:28:47.778] Starting the invocation (attempt 1)
[21:28:47.816] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4a36a30e24f212efa8f07977380c327f0ef9ddee"
[21:28:47.816] Popped gitiles commit info from properties and tags
[21:28:47.816] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:28:47.818] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:28:47.818] Buildbucket request:
{
  "requestId": "8953130800198330944",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "4a36a30e24f212efa8f07977380c327f0ef9ddee",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8953130800198330944"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxTSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[21:28:48.321] Scheduled build:
{
  "id": "8787700738150427889",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 16142,
  "createdBy": "project:chromium",
  "createTime": "2023-03-02T21:28:47.969047117Z",
  "updateTime": "2023-03-02T21:28:47.969047117Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "4a36a30e24f212efa8f07977380c327f0ef9ddee",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[21:28:48.321] Task URL: https://cr-buildbucket.appspot.com/build/8787700738150427889
[21:28:48.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:2:0) after 7m11s
[21:30:46.743] Received PubSub notification, asking Buildbucket for the build status
[21:30:46.904] Build status: STARTED
[21:35:59.616] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:2:0)
[21:35:59.658] Build status: STARTED
[21:35:59.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:4:0) after 5m16s
[21:41:15.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:4:0)
[21:41:15.944] Build status: STARTED
[21:41:15.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:5:0) after 6m47s
[21:48:03.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:5:0)
[21:48:03.242] Build status: STARTED
[21:48:03.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:6:0) after 4m31s
[21:52:34.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:6:0)
[21:52:34.508] Build status: STARTED
[21:52:34.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:7:0) after 5m4s
[21:57:38.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:7:0)
[21:57:38.678] Build status: STARTED
[21:57:38.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:8:0) after 8m28s
[22:06:06.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:8:0)
[22:06:06.861] Build status: STARTED
[22:06:06.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:9:0) after 1m29s
[22:07:35.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:9:0)
[22:07:35.915] Build status: STARTED
[22:07:35.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:10:0) after 4m26s
[22:12:02.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:10:0)
[22:12:02.107] Build status: STARTED
[22:12:02.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:11:0) after 4m33s
[22:16:35.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:11:0)
[22:16:35.169] Build status: STARTED
[22:16:35.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:12:0) after 7m24s
[22:23:59.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:12:0)
[22:23:59.225] Build status: STARTED
[22:23:59.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:13:0) after 4m20s
[22:28:19.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:13:0)
[22:28:19.337] Build status: STARTED
[22:28:19.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:14:0) after 4m32s
[22:32:51.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:14:0)
[22:32:51.985] Build status: STARTED
[22:32:51.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:15:0) after 6m34s
[22:39:26.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:15:0)
[22:39:26.616] Build status: STARTED
[22:39:26.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:16:0) after 1m1s
[22:40:27.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:16:0)
[22:40:27.846] Build status: STARTED
[22:40:27.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:17:0) after 6m16s
[22:46:43.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:17:0)
[22:46:43.933] Build status: STARTED
[22:46:43.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:18:0) after 7m21s
[22:54:04.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:18:0)
[22:54:04.981] Build status: STARTED
[22:54:04.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:19:0) after 3m3s
[22:57:08.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:19:0)
[22:57:08.094] Build status: STARTED
[22:57:08.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:20:0) after 2m22s
[22:59:30.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:20:0)
[22:59:30.284] Build status: STARTED
[22:59:30.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:21:0) after 5m37s
[23:05:07.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:21:0)
[23:05:07.363] Build status: STARTED
[23:05:07.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:22:0) after 4m6s
[23:09:13.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:22:0)
[23:09:13.687] Build status: STARTED
[23:09:13.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:23:0) after 3m59s
[23:13:12.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:23:0)
[23:13:12.788] Build status: STARTED
[23:13:12.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:24:0) after 6m23s
[23:19:36.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:24:0)
[23:19:36.261] Build status: STARTED
[23:19:36.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:25:0) after 9m18s
[23:28:54.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:25:0)
[23:28:54.307] Build status: STARTED
[23:28:54.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:26:0) after 6m29s
[23:35:23.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:26:0)
[23:35:23.597] Build status: STARTED
[23:35:23.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:27:0) after 3m51s
[23:39:14.643] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:27:0)
[23:39:14.671] Build status: STARTED
[23:39:14.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:28:0) after 7m17s
[23:46:31.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:28:0)
[23:46:31.739] Build status: STARTED
[23:46:31.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:29:0) after 2m47s
[23:49:18.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:29:0)
[23:49:18.829] Build status: STARTED
[23:49:18.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:30:0) after 6m17s
[23:55:35.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:30:0)
[23:55:35.890] Build status: STARTED
[23:55:35.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:31:0) after 4m17s
[23:59:53.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:31:0)
[23:59:53.219] Build status: STARTED
[23:59:53.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:32:0) after 6m32s
[00:06:25.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:32:0)
[00:06:25.317] Build status: STARTED
[00:06:25.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:33:0) after 4m4s
[00:10:29.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:33:0)
[00:10:29.670] Build status: STARTED
[00:10:29.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:34:0) after 8m43s
[00:19:13.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:34:0)
[00:19:13.217] Build status: STARTED
[00:19:13.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:35:0) after 6m1s
[00:25:14.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:35:0)
[00:25:14.293] Build status: STARTED
[00:25:14.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:36:0) after 5m45s
[00:30:59.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:36:0)
[00:30:59.511] Build status: STARTED
[00:30:59.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:37:0) after 9m0s
[00:39:59.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:37:0)
[00:39:59.654] Build status: STARTED
[00:39:59.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:38:0) after 3m33s
[00:43:32.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:38:0)
[00:43:32.799] Build status: STARTED
[00:43:32.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:39:0) after 6m15s
[00:49:47.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:39:0)
[00:49:47.984] Build status: STARTED
[00:49:47.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:40:0) after 2m28s
[00:52:16.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:40:0)
[00:52:16.138] Build status: STARTED
[00:52:16.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:41:0) after 2m25s
[00:54:41.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:41:0)
[00:54:41.163] Build status: STARTED
[00:54:41.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:42:0) after 7m49s
[01:02:30.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:42:0)
[01:02:30.793] Build status: STARTED
[01:02:30.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:43:0) after 4m9s
[01:06:40.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:43:0)
[01:06:40.042] Build status: STARTED
[01:06:40.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:44:0) after 4m18s
[01:10:58.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:44:0)
[01:10:58.060] Build status: STARTED
[01:10:58.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:45:0) after 8m57s
[01:19:55.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:45:0)
[01:19:55.204] Build status: STARTED
[01:19:55.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:46:0) after 7m10s
[01:27:05.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:46:0)
[01:27:05.275] Build status: STARTED
[01:27:05.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:47:0) after 4m5s
[01:31:10.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:47:0)
[01:31:10.328] Build status: STARTED
[01:31:10.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:48:0) after 8m58s
[01:40:09.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:48:0)
[01:40:09.214] Build status: STARTED
[01:40:09.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:49:0) after 1m36s
[01:41:45.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:49:0)
[01:41:45.279] Build status: STARTED
[01:41:45.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:50:0) after 6m43s
[01:48:28.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:50:0)
[01:48:28.631] Build status: STARTED
[01:48:28.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:51:0) after 7m43s
[01:56:11.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:51:0)
[01:56:11.649] Build status: STARTED
[01:56:11.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:52:0) after 2m21s
[01:58:33.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:52:0)
[01:58:33.122] Build status: STARTED
[01:58:33.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:53:0) after 5m11s
[02:03:44.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:53:0)
[02:03:44.270] Build status: STARTED
[02:03:44.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:54:0) after 8m21s
[02:12:05.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:54:0)
[02:12:05.470] Build status: STARTED
[02:12:05.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:55:0) after 6m11s
[02:18:16.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:55:0)
[02:18:16.707] Build status: STARTED
[02:18:16.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:56:0) after 7m39s
[02:25:55.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:56:0)
[02:25:55.758] Build status: STARTED
[02:25:55.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:57:0) after 9m3s
[02:34:58.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:57:0)
[02:34:58.801] Build status: STARTED
[02:34:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:58:0) after 7m21s
[02:42:20.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:58:0)
[02:42:20.293] Build status: STARTED
[02:42:20.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:59:0) after 2m30s
[02:44:50.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:59:0)
[02:44:50.752] Build status: STARTED
[02:44:50.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:60:0) after 3m56s
[02:48:47.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:60:0)
[02:48:47.144] Build status: STARTED
[02:48:47.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:61:0) after 9m16s
[02:58:03.306] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:61:0)
[02:58:03.335] Build status: STARTED
[02:58:03.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:62:0) after 2m17s
[03:00:20.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:62:0)
[03:00:20.555] Build status: STARTED
[03:00:20.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:63:0) after 9m20s
[03:09:41.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:63:0)
[03:09:41.249] Build status: STARTED
[03:09:41.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:64:0) after 3m32s
[03:13:13.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:64:0)
[03:13:13.463] Build status: STARTED
[03:13:13.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:65:0) after 3m1s
[03:16:14.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:65:0)
[03:16:14.704] Build status: STARTED
[03:16:14.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:66:0) after 6m43s
[03:22:57.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:66:0)
[03:22:58.009] Build status: STARTED
[03:22:58.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:67:0) after 2m27s
[03:25:25.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:67:0)
[03:25:25.089] Build status: STARTED
[03:25:25.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:68:0) after 5m59s
[03:31:24.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:68:0)
[03:31:24.263] Build status: STARTED
[03:31:24.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:69:0) after 7m45s
[03:39:09.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:69:0)
[03:39:09.717] Build status: STARTED
[03:39:09.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:70:0) after 2m21s
[03:41:30.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:70:0)
[03:41:30.919] Build status: STARTED
[03:41:30.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:71:0) after 7m37s
[03:49:08.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:71:0)
[03:49:08.111] Build status: STARTED
[03:49:08.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:72:0) after 6m38s
[03:55:46.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:72:0)
[03:55:46.454] Build status: STARTED
[03:55:46.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:73:0) after 7m33s
[04:03:19.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:73:0)
[04:03:19.821] Build status: STARTED
[04:03:19.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:74:0) after 8m14s
[04:11:33.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:74:0)
[04:11:33.925] Build status: STARTED
[04:11:33.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:75:0) after 3m1s
[04:14:35.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:75:0)
[04:14:35.383] Build status: STARTED
[04:14:35.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:76:0) after 7m48s
[04:22:23.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:76:0)
[04:22:23.436] Build status: STARTED
[04:22:23.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:77:0) after 3m28s
[04:25:51.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:77:0)
[04:25:51.687] Build status: STARTED
[04:25:51.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:78:0) after 3m34s
[04:29:25.710] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:78:0)
[04:29:25.736] Build status: STARTED
[04:29:25.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:79:0) after 4m5s
[04:33:30.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:79:0)
[04:33:30.990] Build status: STARTED
[04:33:30.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:80:0) after 1m27s
[04:34:58.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:80:0)
[04:34:58.340] Build status: STARTED
[04:34:58.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:81:0) after 7m58s
[04:42:56.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:81:0)
[04:42:56.506] Build status: STARTED
[04:42:56.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:82:0) after 3m21s
[04:46:17.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:82:0)
[04:46:17.567] Build status: STARTED
[04:46:17.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:83:0) after 2m23s
[04:48:40.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:83:0)
[04:48:40.629] Build status: STARTED
[04:48:40.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:84:0) after 4m29s
[04:53:09.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:84:0)
[04:53:09.679] Build status: STARTED
[04:53:09.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:85:0) after 8m45s
[05:01:54.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:85:0)
[05:01:54.930] Build status: STARTED
[05:01:54.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8953130800198330944:86:0) after 9m48s
[05:04:52.819] Received PubSub notification, asking Buildbucket for the build status
[05:04:52.851] Build:
{
  "id": "8787700738150427889",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 16142,
  "createdBy": "project:chromium",
  "createTime": "2023-03-02T21:28:47.969047117Z",
  "startTime": "2023-03-02T21:30:44.155159Z",
  "endTime": "2023-03-03T05:04:52.450971391Z",
  "updateTime": "2023-03-03T05:04:52.450971391Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "4a36a30e24f212efa8f07977380c327f0ef9ddee",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[05:04:52.851] Invocation finished in 7h36m6.217646099s with status FAILED