LUCI Scheduler :: chromium :: ToTLinuxTSan

Status: FAILED

Triggered by: -

Duration: 7 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxTSan"
>

Incoming triggers

820ca85d1e918a399abf471d97b37d99be892f1f (2 weeks ago)
43070b6fe305155de4f416928e716232a12620ac (2 weeks ago)
ea2d045990729803d562d94095c685ee3c9091c1 (2 weeks ago)
f9a0ee96d8d24228458a82bda5e6dd0c6d9e073d (2 weeks ago)
e8cca3dfc97a61eb23d48e5f8221152555ee2476 (2 weeks ago)
29ecc698161c0bff9fc32a0c9c77477e71d6f45a (2 weeks ago)
fb1d7a1cc44b54819bdc85a56bec43dd60de4e92 (2 weeks ago)
8fd3a2b8d815b21fb9bb9b4ddf549716613b4ebc (2 weeks ago)
e713993442d70a55f615392e2d5d0def093d94b1 (2 weeks ago)
e27466d86cf5de65cbc8dd7ef8e32ec99f51aa5c (2 weeks ago)
3c87e17705ab947f009779dae410c8b6325bec82 (2 weeks ago)
16197070c31a24b6574d07e6c14d9e6f4c419f63 (2 weeks ago)
2623731cfd32de012aa9a64faba9303786af320d (2 weeks ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "2623731cfd32de012aa9a64faba9303786af320d"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2623731cfd32de012aa9a64faba9303786af320d
gitiles_ref:refs/heads/main

Debug log (UTC)

[21:47:06.838] New invocation is queued and will start shortly
[21:47:08.066] Starting the invocation (attempt 1)
[21:47:08.091] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2623731cfd32de012aa9a64faba9303786af320d"
[21:47:08.091] Popped gitiles commit info from properties and tags
[21:47:08.091] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:47:08.091] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:47:08.091] Buildbucket request:
{
  "requestId": "8871592376799166992",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "2623731cfd32de012aa9a64faba9303786af320d",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8871592376799166992"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxTSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[21:47:08.591] Scheduled build:
{
  "id": "8706162314767472097",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 26877,
  "createdBy": "project:chromium",
  "createTime": "2025-08-18T21:47:08.150518389Z",
  "updateTime": "2025-08-18T21:47:08.150518389Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "2623731cfd32de012aa9a64faba9303786af320d",
      "ref": "refs/heads/main"
    }
  }
}
[21:47:08.591] Task URL: https://cr-buildbucket.appspot.com/build/8706162314767472097
[21:47:08.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:2:0) after 2m1s
[21:47:17.310] Received PubSub notification, asking Buildbucket for the build status
[21:47:17.333] Build status: SCHEDULED
[21:47:47.218] Received PubSub notification, asking Buildbucket for the build status
[21:47:47.233] Build status: STARTED
[21:49:09.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:2:0)
[21:49:09.654] Build status: STARTED
[21:49:09.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:5:0) after 5m49s
[21:54:58.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:5:0)
[21:54:58.751] Build status: STARTED
[21:54:58.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:6:0) after 5m46s
[22:00:44.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:6:0)
[22:00:44.786] Build status: STARTED
[22:00:44.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:7:0) after 7m15s
[22:07:59.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:7:0)
[22:07:59.817] Build status: STARTED
[22:07:59.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:8:0) after 1m34s
[22:09:33.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:8:0)
[22:09:33.860] Build status: STARTED
[22:09:33.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:9:0) after 4m33s
[22:14:06.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:9:0)
[22:14:06.941] Build status: STARTED
[22:14:06.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:10:0) after 4m36s
[22:18:42.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:10:0)
[22:18:43.002] Build status: STARTED
[22:18:43.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:11:0) after 7m54s
[22:26:37.066] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:11:0)
[22:26:37.085] Build status: STARTED
[22:26:37.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:12:0) after 7m58s
[22:34:35.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:12:0)
[22:34:35.122] Build status: STARTED
[22:34:35.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:13:0) after 5m9s
[22:39:44.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:13:0)
[22:39:44.139] Build status: STARTED
[22:39:44.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:14:0) after 4m19s
[22:44:03.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:14:0)
[22:44:03.249] Build status: STARTED
[22:44:03.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:15:0) after 6m3s
[22:50:06.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:15:0)
[22:50:06.379] Build status: STARTED
[22:50:06.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:16:0) after 1m6s
[22:51:12.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:16:0)
[22:51:12.415] Build status: STARTED
[22:51:12.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:17:0) after 4m33s
[22:55:45.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:17:0)
[22:55:45.450] Build status: STARTED
[22:55:45.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:18:0) after 3m34s
[22:59:19.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:18:0)
[22:59:19.540] Build status: STARTED
[22:59:19.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:19:0) after 6m33s
[23:05:52.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:19:0)
[23:05:52.692] Build status: STARTED
[23:05:52.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:20:0) after 4m7s
[23:09:59.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:20:0)
[23:09:59.765] Build status: STARTED
[23:09:59.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:21:0) after 1m17s
[23:11:16.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:21:0)
[23:11:16.986] Build status: STARTED
[23:11:16.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:22:0) after 9m6s
[23:20:23.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:22:0)
[23:20:23.022] Build status: STARTED
[23:20:23.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:23:0) after 8m59s
[23:29:22.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:23:0)
[23:29:22.151] Build status: STARTED
[23:29:22.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:24:0) after 5m13s
[23:34:35.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:24:0)
[23:34:35.343] Build status: STARTED
[23:34:35.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:25:0) after 4m18s
[23:38:53.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:25:0)
[23:38:53.398] Build status: STARTED
[23:38:53.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:26:0) after 8m25s
[23:47:18.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:26:0)
[23:47:18.548] Build status: STARTED
[23:47:18.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:27:0) after 6m11s
[23:53:29.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:27:0)
[23:53:29.651] Build status: STARTED
[23:53:29.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:28:0) after 9m45s
[00:03:14.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:28:0)
[00:03:14.698] Build status: STARTED
[00:03:14.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:29:0) after 8m27s
[00:11:41.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:29:0)
[00:11:41.732] Build status: STARTED
[00:11:41.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:30:0) after 1m57s
[00:13:38.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:30:0)
[00:13:38.769] Build status: STARTED
[00:13:38.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:31:0) after 3m40s
[00:17:18.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:31:0)
[00:17:18.933] Build status: STARTED
[00:17:18.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:32:0) after 3m14s
[00:20:33.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:32:0)
[00:20:33.082] Build status: STARTED
[00:20:33.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:33:0) after 5m46s
[00:26:19.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:33:0)
[00:26:19.205] Build status: STARTED
[00:26:19.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:34:0) after 1m31s
[00:27:50.226] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:34:0)
[00:27:50.295] Build status: STARTED
[00:27:50.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:35:0) after 4m28s
[00:32:18.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:35:0)
[00:32:18.393] Build status: STARTED
[00:32:18.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:36:0) after 1m24s
[00:33:42.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:36:0)
[00:33:42.483] Build status: STARTED
[00:33:42.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:37:0) after 1m23s
[00:35:05.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:37:0)
[00:35:05.626] Build status: STARTED
[00:35:05.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:38:0) after 5m32s
[00:40:37.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:38:0)
[00:40:37.734] Build status: STARTED
[00:40:37.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:39:0) after 4m3s
[00:44:40.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:39:0)
[00:44:40.780] Build status: STARTED
[00:44:40.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:40:0) after 4m28s
[00:49:08.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:40:0)
[00:49:08.841] Build status: STARTED
[00:49:08.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:41:0) after 7m52s
[00:57:00.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:41:0)
[00:57:00.928] Build status: STARTED
[00:57:00.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:42:0) after 8m8s
[01:05:09.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:42:0)
[01:05:09.066] Build status: STARTED
[01:05:09.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:43:0) after 7m41s
[01:12:50.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:43:0)
[01:12:50.215] Build status: STARTED
[01:12:50.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:44:0) after 7m50s
[01:20:40.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:44:0)
[01:20:40.215] Build status: STARTED
[01:20:40.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:45:0) after 6m8s
[01:26:48.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:45:0)
[01:26:48.317] Build status: STARTED
[01:26:48.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:46:0) after 7m24s
[01:34:12.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:46:0)
[01:34:12.407] Build status: STARTED
[01:34:12.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:47:0) after 4m18s
[01:38:30.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:47:0)
[01:38:30.503] Build status: STARTED
[01:38:30.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:48:0) after 9m46s
[01:48:16.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:48:0)
[01:48:16.547] Build status: STARTED
[01:48:16.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:49:0) after 5m31s
[01:53:47.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:49:0)
[01:53:47.625] Build status: STARTED
[01:53:47.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:50:0) after 7m51s
[02:01:38.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:50:0)
[02:01:38.662] Build status: STARTED
[02:01:38.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:51:0) after 2m36s
[02:04:14.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:51:0)
[02:04:14.785] Build status: STARTED
[02:04:14.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:52:0) after 2m8s
[02:06:22.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:52:0)
[02:06:22.846] Build status: STARTED
[02:06:22.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:53:0) after 5m39s
[02:12:01.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:53:0)
[02:12:01.884] Build status: STARTED
[02:12:01.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:54:0) after 7m46s
[02:19:47.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:54:0)
[02:19:47.921] Build status: STARTED
[02:19:47.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:55:0) after 3m42s
[02:23:29.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:55:0)
[02:23:29.952] Build status: STARTED
[02:23:29.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:56:0) after 8m25s
[02:31:55.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:56:0)
[02:31:55.101] Build status: STARTED
[02:31:55.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:57:0) after 5m23s
[02:37:18.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:57:0)
[02:37:18.246] Build status: STARTED
[02:37:18.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:58:0) after 2m12s
[02:39:30.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:58:0)
[02:39:30.283] Build status: STARTED
[02:39:30.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:59:0) after 4m45s
[02:44:15.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:59:0)
[02:44:15.336] Build status: STARTED
[02:44:15.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:60:0) after 1m51s
[02:46:06.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:60:0)
[02:46:06.369] Build status: STARTED
[02:46:06.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:61:0) after 2m46s
[02:48:52.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:61:0)
[02:48:52.383] Build status: STARTED
[02:48:52.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:62:0) after 9m10s
[02:58:02.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:62:0)
[02:58:02.521] Build status: STARTED
[02:58:02.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:63:0) after 8m18s
[03:06:20.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:63:0)
[03:06:20.727] Build status: STARTED
[03:06:20.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:64:0) after 5m34s
[03:11:54.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:64:0)
[03:11:54.817] Build status: STARTED
[03:11:54.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:65:0) after 4m47s
[03:16:41.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:65:0)
[03:16:41.938] Build status: STARTED
[03:16:41.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:66:0) after 7m37s
[03:24:19.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:66:0)
[03:24:19.065] Build status: STARTED
[03:24:19.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:67:0) after 5m3s
[03:29:22.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:67:0)
[03:29:22.105] Build status: STARTED
[03:29:22.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:68:0) after 3m38s
[03:33:00.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:68:0)
[03:33:00.162] Build status: STARTED
[03:33:00.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:69:0) after 1m48s
[03:34:48.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:69:0)
[03:34:48.597] Build status: STARTED
[03:34:48.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:70:0) after 5m2s
[03:39:50.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:70:0)
[03:39:50.638] Build status: STARTED
[03:39:50.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:71:0) after 2m42s
[03:42:32.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:71:0)
[03:42:32.705] Build status: STARTED
[03:42:32.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:72:0) after 7m57s
[03:50:29.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:72:0)
[03:50:29.805] Build status: STARTED
[03:50:29.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:73:0) after 4m51s
[03:55:20.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:73:0)
[03:55:20.841] Build status: STARTED
[03:55:20.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:74:0) after 1m24s
[03:56:44.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:74:0)
[03:56:44.895] Build status: STARTED
[03:56:44.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:75:0) after 7m29s
[04:04:13.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:75:0)
[04:04:13.920] Build status: STARTED
[04:04:13.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:76:0) after 4m41s
[04:08:54.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:76:0)
[04:08:54.955] Build status: STARTED
[04:08:54.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:77:0) after 9m1s
[04:17:56.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:77:0)
[04:17:56.058] Build status: STARTED
[04:17:56.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:78:0) after 2m7s
[04:20:03.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:78:0)
[04:20:03.105] Build status: STARTED
[04:20:03.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:79:0) after 8m11s
[04:28:14.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:79:0)
[04:28:14.318] Build status: STARTED
[04:28:14.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:80:0) after 6m43s
[04:34:57.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:80:0)
[04:34:57.855] Build status: STARTED
[04:34:57.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:81:0) after 3m11s
[04:38:08.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:81:0)
[04:38:08.895] Build status: STARTED
[04:38:08.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:82:0) after 4m1s
[04:42:09.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:82:0)
[04:42:09.963] Build status: STARTED
[04:42:09.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:83:0) after 8m42s
[04:50:52.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:83:0)
[04:50:52.099] Build status: STARTED
[04:50:52.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871592376799166992:84:0) after 4m57s
[04:54:05.420] Received PubSub notification, asking Buildbucket for the build status
[04:54:05.438] Build:
{
  "id": "8706162314767472097",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 26877,
  "createdBy": "project:chromium",
  "createTime": "2025-08-18T21:47:08.150518389Z",
  "startTime": "2025-08-18T21:47:46.986583448Z",
  "endTime": "2025-08-19T04:54:05.143614390Z",
  "updateTime": "2025-08-19T04:54:05.143614390Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "2623731cfd32de012aa9a64faba9303786af320d",
      "ref": "refs/heads/main"
    }
  }
}
[04:54:05.438] Invocation finished in 7h6m58.60917206s with status FAILED