LUCI Scheduler :: chromium :: ToTLinuxTSan

Status: FAILED

Triggered by: -

Duration: 8 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxTSan"
>

Incoming triggers

c5241fb9bd746d8acc7dee1b8222a7d85afb3bc0 (1 week ago)
baaf656d86dadd739eaf9566d64580f379eecee6 (1 week ago)
31d7844aeba41eca65921787a15c74df119c77d9 (1 week ago)
52b02c884f2fdd3c7f53456df185f7dd13c763b5 (1 week ago)
b9bb0f7a6740bfa8c5c831da7d9de930feec75d4 (1 week ago)
76e2feaacc1f926d8da30198cc2d6c250020565f (1 week ago)
92840e3a42a4bafae96412801767d30769121fcf (1 week ago)
b4f8bf2e92718d6832e901f1fcd143a20423bdd1 (1 week ago)
ca27d26f6bfc5b3f35adc9a217f1e54e4124a4ea (1 week ago)
602f0530ae80491f8d493ad931b44835ba46d23b (1 week ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "602f0530ae80491f8d493ad931b44835ba46d23b"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/602f0530ae80491f8d493ad931b44835ba46d23b
gitiles_ref:refs/heads/main

Debug log (UTC)

[01:08:04.335] New invocation is queued and will start shortly
[01:08:05.406] Starting the invocation (attempt 1)
[01:08:05.440] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/602f0530ae80491f8d493ad931b44835ba46d23b"
[01:08:05.440] Popped gitiles commit info from properties and tags
[01:08:05.441] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:08:05.441] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:08:05.441] Buildbucket request:
{
  "requestId": "8874660030459417280",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "602f0530ae80491f8d493ad931b44835ba46d23b",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8874660030459417280"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxTSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[01:08:06.058] Scheduled build:
{
  "id": "8709229968546190673",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 26191,
  "createdBy": "project:chromium",
  "createTime": "2025-07-16T01:08:05.529341070Z",
  "updateTime": "2025-07-16T01:08:05.529341070Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "602f0530ae80491f8d493ad931b44835ba46d23b",
      "ref": "refs/heads/main"
    }
  }
}
[01:08:06.058] Task URL: https://cr-buildbucket.appspot.com/build/8709229968546190673
[01:08:06.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:2:0) after 6m28s
[01:08:06.150] Received PubSub notification, asking Buildbucket for the build status
[01:08:06.179] Build status: SCHEDULED
[01:08:59.825] Received PubSub notification, asking Buildbucket for the build status
[01:08:59.864] Build status: STARTED
[01:14:34.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:2:0)
[01:14:34.130] Build status: STARTED
[01:14:34.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:5:0) after 9m37s
[01:24:11.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:5:0)
[01:24:11.215] Build status: STARTED
[01:24:11.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:6:0) after 8m24s
[01:32:35.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:6:0)
[01:32:35.277] Build status: STARTED
[01:32:35.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:7:0) after 4m1s
[01:36:36.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:7:0)
[01:36:36.428] Build status: STARTED
[01:36:36.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:8:0) after 6m8s
[01:42:44.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:8:0)
[01:42:44.499] Build status: STARTED
[01:42:44.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:9:0) after 8m47s
[01:51:31.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:9:0)
[01:51:31.667] Build status: STARTED
[01:51:31.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:10:0) after 8m11s
[01:59:42.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:10:0)
[01:59:42.743] Build status: STARTED
[01:59:42.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:11:0) after 6m20s
[02:06:02.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:11:0)
[02:06:02.789] Build status: STARTED
[02:06:02.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:12:0) after 9m3s
[02:15:05.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:12:0)
[02:15:05.865] Build status: STARTED
[02:15:05.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:13:0) after 5m22s
[02:20:27.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:13:0)
[02:20:28.015] Build status: STARTED
[02:20:28.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:14:0) after 8m23s
[02:28:51.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:14:0)
[02:28:51.281] Build status: STARTED
[02:28:51.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:15:0) after 4m44s
[02:33:35.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:15:0)
[02:33:35.322] Build status: STARTED
[02:33:35.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:16:0) after 9m51s
[02:43:26.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:16:0)
[02:43:26.363] Build status: STARTED
[02:43:26.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:17:0) after 5m16s
[02:48:42.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:17:0)
[02:48:42.400] Build status: STARTED
[02:48:42.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:18:0) after 3m52s
[02:52:34.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:18:0)
[02:52:34.441] Build status: STARTED
[02:52:34.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:19:0) after 2m45s
[02:55:19.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:19:0)
[02:55:19.586] Build status: STARTED
[02:55:19.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:20:0) after 4m12s
[02:59:31.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:20:0)
[02:59:31.595] Build status: STARTED
[02:59:31.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:21:0) after 8m45s
[03:08:16.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:21:0)
[03:08:16.725] Build status: STARTED
[03:08:16.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:22:0) after 9m38s
[03:17:54.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:22:0)
[03:17:54.789] Build status: STARTED
[03:17:54.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:23:0) after 1m16s
[03:19:10.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:23:0)
[03:19:10.846] Build status: STARTED
[03:19:10.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:24:0) after 1m21s
[03:20:31.866] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:24:0)
[03:20:31.884] Build status: STARTED
[03:20:31.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:25:0) after 8m19s
[03:28:50.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:25:0)
[03:28:50.928] Build status: STARTED
[03:28:50.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:26:0) after 9m10s
[03:38:00.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:26:0)
[03:38:00.979] Build status: STARTED
[03:38:00.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:27:0) after 9m55s
[03:47:55.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:27:0)
[03:47:56.024] Build status: STARTED
[03:47:56.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:28:0) after 4m28s
[03:52:24.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:28:0)
[03:52:24.059] Build status: STARTED
[03:52:24.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:29:0) after 3m0s
[03:55:24.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:29:0)
[03:55:24.149] Build status: STARTED
[03:55:24.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:30:0) after 5m17s
[04:00:41.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:30:0)
[04:00:41.202] Build status: STARTED
[04:00:41.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:31:0) after 5m9s
[04:05:50.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:31:0)
[04:05:50.245] Build status: STARTED
[04:05:50.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:32:0) after 6m5s
[04:11:55.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:32:0)
[04:11:55.300] Build status: STARTED
[04:11:55.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:33:0) after 9m43s
[04:21:38.321] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:33:0)
[04:21:38.352] Build status: STARTED
[04:21:38.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:34:0) after 7m42s
[04:29:20.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:34:0)
[04:29:20.417] Build status: STARTED
[04:29:20.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:35:0) after 6m1s
[04:35:21.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:35:0)
[04:35:21.673] Build status: STARTED
[04:35:21.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:36:0) after 3m43s
[04:39:04.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:36:0)
[04:39:04.717] Build status: STARTED
[04:39:04.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:37:0) after 9m13s
[04:48:17.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:37:0)
[04:48:17.768] Build status: STARTED
[04:48:17.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:38:0) after 4m3s
[04:52:20.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:38:0)
[04:52:20.813] Build status: STARTED
[04:52:20.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:39:0) after 2m25s
[04:54:45.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:39:0)
[04:54:45.952] Build status: STARTED
[04:54:45.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:40:0) after 7m54s
[05:02:39.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:40:0)
[05:02:39.996] Build status: STARTED
[05:02:39.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:41:0) after 4m13s
[05:06:53.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:41:0)
[05:06:53.098] Build status: STARTED
[05:06:53.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:42:0) after 9m40s
[05:16:33.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:42:0)
[05:16:33.728] Build status: STARTED
[05:16:33.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:43:0) after 8m4s
[05:24:37.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:43:0)
[05:24:37.770] Build status: STARTED
[05:24:37.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:44:0) after 5m59s
[05:30:36.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:44:0)
[05:30:36.821] Build status: STARTED
[05:30:36.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:45:0) after 3m30s
[05:34:06.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:45:0)
[05:34:06.953] Build status: STARTED
[05:34:06.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:46:0) after 8m52s
[05:42:58.995] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:46:0)
[05:42:59.015] Build status: STARTED
[05:42:59.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:47:0) after 3m42s
[05:46:41.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:47:0)
[05:46:41.034] Build status: STARTED
[05:46:41.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:48:0) after 4m51s
[05:51:32.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:48:0)
[05:51:32.234] Build status: STARTED
[05:51:32.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:49:0) after 8m53s
[06:00:25.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:49:0)
[06:00:25.442] Build status: STARTED
[06:00:25.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:50:0) after 2m58s
[06:03:23.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:50:0)
[06:03:23.638] Build status: STARTED
[06:03:23.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:51:0) after 3m17s
[06:06:40.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:51:0)
[06:06:40.761] Build status: STARTED
[06:06:40.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:52:0) after 4m33s
[06:11:14.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:52:0)
[06:11:14.137] Build status: STARTED
[06:11:14.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:53:0) after 5m27s
[06:16:41.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:53:0)
[06:16:41.524] Build status: STARTED
[06:16:41.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:54:0) after 9m18s
[06:25:59.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:54:0)
[06:25:59.592] Build status: STARTED
[06:25:59.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:55:0) after 9m9s
[06:35:08.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:55:0)
[06:35:08.740] Build status: STARTED
[06:35:08.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:56:0) after 5m6s
[06:40:15.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:56:0)
[06:40:15.523] Build status: STARTED
[06:40:15.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:57:0) after 1m1s
[06:41:16.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:57:0)
[06:41:16.851] Build status: STARTED
[06:41:16.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:58:0) after 1m32s
[06:42:49.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:58:0)
[06:42:49.124] Build status: STARTED
[06:42:49.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:59:0) after 9m41s
[06:52:30.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:59:0)
[06:52:30.941] Build status: STARTED
[06:52:30.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:60:0) after 4m44s
[06:57:14.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:60:0)
[06:57:15.059] Build status: STARTED
[06:57:15.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:61:0) after 2m58s
[07:00:13.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:61:0)
[07:00:13.097] Build status: STARTED
[07:00:13.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:62:0) after 2m49s
[07:03:02.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:62:0)
[07:03:02.149] Build status: STARTED
[07:03:02.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:63:0) after 5m30s
[07:08:32.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:63:0)
[07:08:32.235] Build status: STARTED
[07:08:32.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:64:0) after 6m3s
[07:14:35.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:64:0)
[07:14:35.568] Build status: STARTED
[07:14:35.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:65:0) after 7m48s
[07:22:23.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:65:0)
[07:22:23.707] Build status: STARTED
[07:22:23.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:66:0) after 2m9s
[07:24:32.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:66:0)
[07:24:32.747] Build status: STARTED
[07:24:32.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:67:0) after 4m33s
[07:29:05.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:67:0)
[07:29:05.784] Build status: STARTED
[07:29:05.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:68:0) after 1m23s
[07:30:28.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:68:0)
[07:30:28.832] Build status: STARTED
[07:30:28.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:69:0) after 5m28s
[07:35:56.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:69:0)
[07:35:56.876] Build status: STARTED
[07:35:56.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:70:0) after 1m30s
[07:37:26.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:70:0)
[07:37:26.914] Build status: STARTED
[07:37:26.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:71:0) after 1m36s
[07:39:02.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:71:0)
[07:39:02.960] Build status: STARTED
[07:39:02.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:72:0) after 5m50s
[07:44:53.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:72:0)
[07:44:53.041] Build status: STARTED
[07:44:53.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:73:0) after 9m56s
[07:54:49.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:73:0)
[07:54:49.094] Build status: STARTED
[07:54:49.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:74:0) after 4m30s
[07:59:19.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:74:0)
[07:59:19.140] Build status: STARTED
[07:59:19.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:75:0) after 2m32s
[08:01:51.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:75:0)
[08:01:51.230] Build status: STARTED
[08:01:51.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:76:0) after 2m22s
[08:04:13.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:76:0)
[08:04:13.817] Build status: STARTED
[08:04:13.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:77:0) after 3m10s
[08:07:23.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:77:0)
[08:07:23.857] Build status: STARTED
[08:07:23.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:78:0) after 8m37s
[08:16:00.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:78:0)
[08:16:00.954] Build status: STARTED
[08:16:00.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:79:0) after 6m47s
[08:22:48.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:79:0)
[08:22:48.080] Build status: STARTED
[08:22:48.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:80:0) after 8m42s
[08:31:30.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:80:0)
[08:31:30.332] Build status: STARTED
[08:31:30.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:81:0) after 1m43s
[08:33:13.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:81:0)
[08:33:13.384] Build status: STARTED
[08:33:13.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:82:0) after 4m16s
[08:37:29.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:82:0)
[08:37:29.480] Build status: STARTED
[08:37:29.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:83:0) after 9m19s
[08:46:48.547] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:83:0)
[08:46:48.564] Build status: STARTED
[08:46:48.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:84:0) after 7m40s
[08:54:28.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:84:0)
[08:54:28.613] Build status: STARTED
[08:54:28.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:85:0) after 5m29s
[08:59:57.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:85:0)
[08:59:57.756] Build status: STARTED
[08:59:57.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:86:0) after 6m37s
[09:06:34.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:86:0)
[09:06:34.940] Build status: STARTED
[09:06:34.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:87:0) after 2m49s
[09:09:24.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:87:0)
[09:09:24.189] Build status: STARTED
[09:09:24.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874660030459417280:88:0) after 1m7s
[09:10:05.015] Received PubSub notification, asking Buildbucket for the build status
[09:10:05.027] Build:
{
  "id": "8709229968546190673",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 26191,
  "createdBy": "project:chromium",
  "createTime": "2025-07-16T01:08:05.529341070Z",
  "startTime": "2025-07-16T01:08:59.475988553Z",
  "endTime": "2025-07-16T09:10:03.266620353Z",
  "updateTime": "2025-07-16T09:10:03.266620353Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "602f0530ae80491f8d493ad931b44835ba46d23b",
      "ref": "refs/heads/main"
    }
  }
}
[09:10:05.027] Invocation finished in 8h2m0.706065226s with status FAILED