LUCI Scheduler :: chromium :: ToTLinuxTSan

Status: FAILED

Triggered by: -

Duration: 7 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxTSan"
>

Incoming triggers

1753b986ec2f24ef9458c741dcd06ab1a1f45d40 (1 year ago)
13fca4e4a406efbeeb35bc2ad8d281e0d0c4c0bd (1 year ago)
50a4030b3c7113ae2b6077e22e15b204b3164a59 (1 year ago)
149a07ef50960306fb9a40281ef125a3a67c41df (1 year ago)
71047efbd7851b689d47cc8a196b0bc6192ed77a (1 year ago)
60cc90d7af0785f56937f27de67cbf36a493b715 (1 year ago)
cca0aea285e8c1ccbccdb51366df4f6beb220528 (1 year ago)
7deca44398a9c6147f8b1f3a3ca91497eb4f267e (1 year ago)
f4d8af7465197681e8be8fd97dc0d3e1978f4c3e (1 year ago)
79d6771ec75525d412a0a2be15aa61ab6c9f4bff (1 year ago)
9d11ef1c20a22a34787ddc96aa736c8896cf13e1 (1 year ago)
7eda06a658c06f762ab961f37bbfaa7b0a36aa75 (1 year ago)
6cd34714671dcf4c4cd641d94268692ea7c97e53 (1 year ago)
84024a09f723cc0295274fd00473c2ab6de9b44c (1 year ago)
210c4aa11e7dc1a40433df354fee05cc9ae0bc0d (1 year ago)
67a36225665f1ef09d0d8abd2c0d0119a0b6435b (1 year ago)
fb46af15a15150d2f509b95ea513e3ce022458ab (1 year ago)
68cc430e260668db17f8029e0b86f8da4bf2a1f6 (1 year ago)
4e95f9f997478f334fe346432aff37a425e682bf (1 year ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "4e95f9f997478f334fe346432aff37a425e682bf"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e95f9f997478f334fe346432aff37a425e682bf
gitiles_ref:refs/heads/main

Debug log (UTC)

[21:42:55.212] New invocation is queued and will start shortly
[21:42:56.716] Starting the invocation (attempt 1)
[21:42:56.740] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e95f9f997478f334fe346432aff37a425e682bf"
[21:42:56.740] Popped gitiles commit info from properties and tags
[21:42:56.740] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:42:56.741] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:42:56.741] Buildbucket request:
{
  "requestId": "8902667400119232464",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "4e95f9f997478f334fe346432aff37a425e682bf",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8902667400119232464"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxTSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[21:42:57.299] Scheduled build:
{
  "id": "8737237337778045425",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 22586,
  "createdBy": "project:chromium",
  "createTime": "2024-09-09T21:42:56.823555058Z",
  "updateTime": "2024-09-09T21:42:56.823555058Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "4e95f9f997478f334fe346432aff37a425e682bf",
      "ref": "refs/heads/main"
    }
  }
}
[21:42:57.299] Task URL: https://cr-buildbucket.appspot.com/build/8737237337778045425
[21:42:57.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:2:0) after 5m36s
[21:42:58.231] Received PubSub notification, asking Buildbucket for the build status
[21:42:58.255] Build status: SCHEDULED
[21:44:07.009] Received PubSub notification, asking Buildbucket for the build status
[21:44:07.026] Build status: STARTED
[21:48:33.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:2:0)
[21:48:33.362] Build status: STARTED
[21:48:33.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:5:0) after 3m21s
[21:51:54.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:5:0)
[21:51:54.421] Build status: STARTED
[21:51:54.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:6:0) after 3m9s
[21:55:03.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:6:0)
[21:55:03.461] Build status: STARTED
[21:55:03.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:7:0) after 3m58s
[21:59:01.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:7:0)
[21:59:01.495] Build status: STARTED
[21:59:01.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:8:0) after 2m59s
[22:02:00.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:8:0)
[22:02:00.545] Build status: STARTED
[22:02:00.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:9:0) after 7m29s
[22:09:29.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:9:0)
[22:09:29.585] Build status: STARTED
[22:09:29.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:10:0) after 9m43s
[22:19:12.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:10:0)
[22:19:12.761] Build status: STARTED
[22:19:12.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:11:0) after 8m16s
[22:27:28.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:11:0)
[22:27:28.854] Build status: STARTED
[22:27:28.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:12:0) after 6m41s
[22:34:09.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:12:0)
[22:34:09.897] Build status: STARTED
[22:34:09.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:13:0) after 4m25s
[22:38:34.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:13:0)
[22:38:35.027] Build status: STARTED
[22:38:35.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:14:0) after 2m52s
[22:41:27.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:14:0)
[22:41:27.220] Build status: STARTED
[22:41:27.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:15:0) after 2m10s
[22:43:37.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:15:0)
[22:43:37.307] Build status: STARTED
[22:43:37.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:16:0) after 6m37s
[22:50:14.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:16:0)
[22:50:14.341] Build status: STARTED
[22:50:14.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:17:0) after 1m48s
[22:52:02.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:17:0)
[22:52:02.421] Build status: STARTED
[22:52:02.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:18:0) after 9m0s
[23:01:02.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:18:0)
[23:01:02.629] Build status: STARTED
[23:01:02.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:19:0) after 1m48s
[23:02:51.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:19:0)
[23:02:51.330] Build status: STARTED
[23:02:51.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:20:0) after 8m15s
[23:11:06.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:20:0)
[23:11:06.365] Build status: STARTED
[23:11:06.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:21:0) after 3m6s
[23:14:12.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:21:0)
[23:14:12.413] Build status: STARTED
[23:14:12.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:22:0) after 8m3s
[23:22:15.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:22:0)
[23:22:15.470] Build status: STARTED
[23:22:15.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:23:0) after 8m13s
[23:30:28.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:23:0)
[23:30:28.546] Build status: STARTED
[23:30:28.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:24:0) after 7m21s
[23:37:49.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:24:0)
[23:37:49.581] Build status: STARTED
[23:37:49.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:25:0) after 3m55s
[23:41:44.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:25:0)
[23:41:44.675] Build status: STARTED
[23:41:44.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:26:0) after 6m11s
[23:47:55.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:26:0)
[23:47:55.717] Build status: STARTED
[23:47:55.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:27:0) after 2m27s
[23:50:22.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:27:0)
[23:50:22.770] Build status: STARTED
[23:50:22.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:28:0) after 1m11s
[23:51:33.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:28:0)
[23:51:33.948] Build status: STARTED
[23:51:33.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:29:0) after 7m45s
[23:59:19.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:29:0)
[23:59:19.086] Build status: STARTED
[23:59:19.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:30:0) after 4m12s
[00:03:31.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:30:0)
[00:03:31.264] Build status: STARTED
[00:03:31.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:31:0) after 6m5s
[00:09:36.277] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:31:0)
[00:09:36.300] Build status: STARTED
[00:09:36.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:32:0) after 8m30s
[00:18:06.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:32:0)
[00:18:06.340] Build status: STARTED
[00:18:06.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:33:0) after 4m19s
[00:22:25.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:33:0)
[00:22:25.448] Build status: STARTED
[00:22:25.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:34:0) after 5m46s
[00:28:11.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:34:0)
[00:28:11.507] Build status: STARTED
[00:28:11.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:35:0) after 5m53s
[00:34:04.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:35:0)
[00:34:04.644] Build status: STARTED
[00:34:04.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:36:0) after 5m7s
[00:39:11.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:36:0)
[00:39:11.687] Build status: STARTED
[00:39:11.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:37:0) after 8m16s
[00:47:27.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:37:0)
[00:47:27.823] Build status: STARTED
[00:47:27.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:38:0) after 1m24s
[00:48:51.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:38:0)
[00:48:51.896] Build status: STARTED
[00:48:51.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:39:0) after 2m49s
[00:51:41.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:39:0)
[00:51:41.048] Build status: STARTED
[00:51:41.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:40:0) after 9m33s
[01:01:14.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:40:0)
[01:01:14.086] Build status: STARTED
[01:01:14.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:41:0) after 4m10s
[01:05:24.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:41:0)
[01:05:24.121] Build status: STARTED
[01:05:24.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:42:0) after 7m56s
[01:13:20.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:42:0)
[01:13:20.168] Build status: STARTED
[01:13:20.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:43:0) after 6m37s
[01:19:57.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:43:0)
[01:19:57.212] Build status: STARTED
[01:19:57.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:44:0) after 8m48s
[01:28:45.232] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:44:0)
[01:28:45.253] Build status: STARTED
[01:28:45.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:45:0) after 8m33s
[01:37:18.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:45:0)
[01:37:18.303] Build status: STARTED
[01:37:18.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:46:0) after 6m42s
[01:44:00.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:46:0)
[01:44:00.335] Build status: STARTED
[01:44:00.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:47:0) after 9m10s
[01:53:10.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:47:0)
[01:53:10.370] Build status: STARTED
[01:53:10.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:48:0) after 2m54s
[01:56:04.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:48:0)
[01:56:04.479] Build status: STARTED
[01:56:04.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:49:0) after 6m4s
[02:02:08.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:49:0)
[02:02:08.535] Build status: STARTED
[02:02:08.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:50:0) after 8m1s
[02:10:09.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:50:0)
[02:10:09.731] Build status: STARTED
[02:10:09.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:51:0) after 4m10s
[02:14:19.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:51:0)
[02:14:19.773] Build status: STARTED
[02:14:19.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:52:0) after 7m24s
[02:21:43.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:52:0)
[02:21:43.814] Build status: STARTED
[02:21:43.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:53:0) after 6m37s
[02:28:20.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:53:0)
[02:28:20.887] Build status: STARTED
[02:28:20.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:54:0) after 5m26s
[02:33:47.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:54:0)
[02:33:47.025] Build status: STARTED
[02:33:47.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:55:0) after 1m9s
[02:34:56.046] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:55:0)
[02:34:56.074] Build status: STARTED
[02:34:56.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:56:0) after 7m17s
[02:42:13.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:56:0)
[02:42:13.173] Build status: STARTED
[02:42:13.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:57:0) after 5m19s
[02:47:32.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:57:0)
[02:47:32.209] Build status: STARTED
[02:47:32.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:58:0) after 8m30s
[02:56:02.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:58:0)
[02:56:02.248] Build status: STARTED
[02:56:02.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:59:0) after 2m40s
[02:58:42.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:59:0)
[02:58:42.283] Build status: STARTED
[02:58:42.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:60:0) after 1m42s
[03:00:24.318] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:60:0)
[03:00:24.353] Build status: STARTED
[03:00:24.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:61:0) after 9m21s
[03:09:45.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:61:0)
[03:09:45.556] Build status: STARTED
[03:09:45.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:62:0) after 7m43s
[03:17:28.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:62:0)
[03:17:28.601] Build status: STARTED
[03:17:28.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:63:0) after 4m19s
[03:21:47.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:63:0)
[03:21:47.644] Build status: STARTED
[03:21:47.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:64:0) after 1m29s
[03:23:16.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:64:0)
[03:23:16.769] Build status: STARTED
[03:23:16.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:65:0) after 8m32s
[03:31:48.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:65:0)
[03:31:48.845] Build status: STARTED
[03:31:48.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:66:0) after 2m52s
[03:34:40.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:66:0)
[03:34:40.936] Build status: STARTED
[03:34:40.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:67:0) after 8m32s
[03:43:12.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:67:0)
[03:43:12.992] Build status: STARTED
[03:43:12.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:68:0) after 1m22s
[03:44:35.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:68:0)
[03:44:35.313] Build status: STARTED
[03:44:35.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:69:0) after 3m2s
[03:47:37.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:69:0)
[03:47:37.442] Build status: STARTED
[03:47:37.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:70:0) after 4m46s
[03:52:23.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:70:0)
[03:52:23.497] Build status: STARTED
[03:52:23.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:71:0) after 7m52s
[04:00:15.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:71:0)
[04:00:15.523] Build status: STARTED
[04:00:15.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:72:0) after 9m18s
[04:09:33.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:72:0)
[04:09:33.608] Build status: STARTED
[04:09:33.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:73:0) after 4m13s
[04:13:46.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:73:0)
[04:13:46.649] Build status: STARTED
[04:13:46.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:74:0) after 1m43s
[04:15:29.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:74:0)
[04:15:29.674] Build status: STARTED
[04:15:29.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:75:0) after 3m58s
[04:19:27.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:75:0)
[04:19:27.682] Build status: STARTED
[04:19:27.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:76:0) after 6m18s
[04:25:45.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:76:0)
[04:25:45.729] Build status: STARTED
[04:25:45.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:77:0) after 4m6s
[04:29:51.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:77:0)
[04:29:51.786] Build status: STARTED
[04:29:51.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:78:0) after 4m28s
[04:34:19.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:78:0)
[04:34:19.843] Build status: STARTED
[04:34:19.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:79:0) after 2m36s
[04:36:55.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:79:0)
[04:36:55.883] Build status: STARTED
[04:36:55.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:80:0) after 7m42s
[04:44:37.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:80:0)
[04:44:37.960] Build status: STARTED
[04:44:37.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:81:0) after 4m21s
[04:48:58.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:81:0)
[04:48:59.032] Build status: STARTED
[04:48:59.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:82:0) after 9m4s
[04:58:03.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:82:0)
[04:58:03.118] Build status: STARTED
[04:58:03.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:83:0) after 7m31s
[05:05:34.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:83:0)
[05:05:34.181] Build status: STARTED
[05:05:34.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:84:0) after 9m19s
[05:14:53.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:84:0)
[05:14:53.232] Build status: STARTED
[05:14:53.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8902667400119232464:85:0) after 6m27s
[05:19:32.449] Received PubSub notification, asking Buildbucket for the build status
[05:19:32.475] Build:
{
  "id": "8737237337778045425",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 22586,
  "createdBy": "project:chromium",
  "createTime": "2024-09-09T21:42:56.823555058Z",
  "startTime": "2024-09-09T21:44:06.458507788Z",
  "endTime": "2024-09-10T05:19:32.058029522Z",
  "updateTime": "2024-09-10T05:19:32.058029522Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "4e95f9f997478f334fe346432aff37a425e682bf",
      "ref": "refs/heads/main"
    }
  }
}
[05:19:32.475] Invocation finished in 7h36m37.267655678s with status FAILED