1. All projects
  2. chromium
  3. ToTLinuxMSan
  4. 8874030641638811856
Status: FAILED
Triggered by: -
Duration: 8 hours
Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxMSan"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "1b0180a5a96422bc2d3a801994af85f3e7b1f046"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1b0180a5a96422bc2d3a801994af85f3e7b1f046
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[23:51:56.284] New invocation is queued and will start shortly
[23:51:57.360] Starting the invocation (attempt 1)
[23:51:57.393] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1b0180a5a96422bc2d3a801994af85f3e7b1f046"
[23:51:57.393] Popped gitiles commit info from properties and tags
[23:51:57.393] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:51:57.394] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:51:57.394] Buildbucket request:
{
  "requestId": "8874030641638811856",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "1b0180a5a96422bc2d3a801994af85f3e7b1f046",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8874030641638811856"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxMSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[23:51:57.888] Scheduled build:
{
  "id": "8708600579741959617",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 27840,
  "createdBy": "project:chromium",
  "createTime": "2025-07-22T23:51:57.467789783Z",
  "updateTime": "2025-07-22T23:51:57.467789783Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "1b0180a5a96422bc2d3a801994af85f3e7b1f046",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[23:51:57.888] Task URL: https://cr-buildbucket.appspot.com/build/8708600579741959617
[23:51:57.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:2:0) after 2m48s
[23:51:58.869] Received PubSub notification, asking Buildbucket for the build status
[23:51:58.889] Build status: SCHEDULED
[23:53:22.415] Received PubSub notification, asking Buildbucket for the build status
[23:53:22.470] Build status: STARTED
[23:54:45.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:2:0)
[23:54:45.976] Build status: STARTED
[23:54:45.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:5:0) after 8m7s
[00:02:53.048] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:5:0)
[00:02:53.091] Build status: STARTED
[00:02:53.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:6:0) after 6m55s
[00:09:48.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:6:0)
[00:09:48.508] Build status: STARTED
[00:09:48.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:7:0) after 2m40s
[00:12:29.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:7:0)
[00:12:29.388] Build status: STARTED
[00:12:29.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:8:0) after 3m36s
[00:16:05.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:8:0)
[00:16:05.729] Build status: STARTED
[00:16:05.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:9:0) after 7m41s
[00:23:46.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:9:0)
[00:23:46.837] Build status: STARTED
[00:23:46.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:10:0) after 7m31s
[00:31:18.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:10:0)
[00:31:18.131] Build status: STARTED
[00:31:18.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:11:0) after 7m18s
[00:38:36.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:11:0)
[00:38:36.186] Build status: STARTED
[00:38:36.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:12:0) after 9m21s
[00:47:57.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:12:0)
[00:47:57.197] Build status: STARTED
[00:47:57.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:13:0) after 4m6s
[00:52:03.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:13:0)
[00:52:03.276] Build status: STARTED
[00:52:03.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:14:0) after 2m20s
[00:54:23.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:14:0)
[00:54:23.387] Build status: STARTED
[00:54:23.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:15:0) after 4m36s
[00:58:59.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:15:0)
[00:58:59.491] Build status: STARTED
[00:58:59.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:16:0) after 9m35s
[01:08:35.015] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:16:0)
[01:08:35.043] Build status: STARTED
[01:08:35.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:17:0) after 5m11s
[01:13:46.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:17:0)
[01:13:46.162] Build status: STARTED
[01:13:46.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:18:0) after 1m11s
[01:14:57.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:18:0)
[01:14:57.401] Build status: STARTED
[01:14:57.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:19:0) after 6m3s
[01:21:00.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:19:0)
[01:21:00.703] Build status: STARTED
[01:21:00.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:20:0) after 5m35s
[01:26:35.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:20:0)
[01:26:35.727] Build status: STARTED
[01:26:35.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:21:0) after 1m19s
[01:27:54.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:21:0)
[01:27:54.809] Build status: STARTED
[01:27:54.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:22:0) after 4m27s
[01:32:22.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:22:0)
[01:32:22.456] Build status: STARTED
[01:32:22.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:23:0) after 9m7s
[01:41:29.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:23:0)
[01:41:29.816] Build status: STARTED
[01:41:29.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:24:0) after 4m8s
[01:45:37.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:24:0)
[01:45:37.902] Build status: STARTED
[01:45:37.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:25:0) after 9m56s
[01:55:33.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:25:0)
[01:55:33.948] Build status: STARTED
[01:55:33.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:26:0) after 2m27s
[01:58:01.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:26:0)
[01:58:01.271] Build status: STARTED
[01:58:01.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:27:0) after 1m2s
[01:59:03.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:27:0)
[01:59:03.369] Build status: STARTED
[01:59:03.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:28:0) after 9m21s
[02:08:24.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:28:0)
[02:08:24.477] Build status: STARTED
[02:08:24.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:29:0) after 4m14s
[02:12:38.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:29:0)
[02:12:38.629] Build status: STARTED
[02:12:38.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:30:0) after 9m5s
[02:21:43.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:30:0)
[02:21:43.834] Build status: STARTED
[02:21:43.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:31:0) after 3m55s
[02:25:38.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:31:0)
[02:25:38.888] Build status: STARTED
[02:25:38.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:32:0) after 8m13s
[02:33:51.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:32:0)
[02:33:51.935] Build status: STARTED
[02:33:51.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:33:0) after 9m33s
[02:43:25.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:33:0)
[02:43:25.023] Build status: STARTED
[02:43:25.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:34:0) after 1m49s
[02:45:14.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:34:0)
[02:45:14.351] Build status: STARTED
[02:45:14.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:35:0) after 4m25s
[02:49:39.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:35:0)
[02:49:39.389] Build status: STARTED
[02:49:39.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:36:0) after 6m26s
[02:56:05.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:36:0)
[02:56:05.602] Build status: STARTED
[02:56:05.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:37:0) after 1m47s
[02:57:52.700] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:37:0)
[02:57:52.729] Build status: STARTED
[02:57:52.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:38:0) after 3m35s
[03:01:27.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:38:0)
[03:01:27.796] Build status: STARTED
[03:01:27.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:39:0) after 6m29s
[03:07:56.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:39:0)
[03:07:56.872] Build status: STARTED
[03:07:56.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:40:0) after 6m17s
[03:14:13.903] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:40:0)
[03:14:13.947] Build status: STARTED
[03:14:13.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:41:0) after 6m0s
[03:20:13.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:41:0)
[03:20:13.992] Build status: STARTED
[03:20:13.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:42:0) after 5m20s
[03:25:34.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:42:0)
[03:25:34.076] Build status: STARTED
[03:25:34.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:43:0) after 1m18s
[03:26:52.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:43:0)
[03:26:52.130] Build status: STARTED
[03:26:52.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:44:0) after 1m17s
[03:28:09.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:44:0)
[03:28:09.191] Build status: STARTED
[03:28:09.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:45:0) after 5m35s
[03:33:44.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:45:0)
[03:33:44.239] Build status: STARTED
[03:33:44.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:46:0) after 6m6s
[03:39:50.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:46:0)
[03:39:50.365] Build status: STARTED
[03:39:50.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:47:0) after 8m59s
[03:48:49.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:47:0)
[03:48:49.512] Build status: STARTED
[03:48:49.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:48:0) after 6m50s
[03:55:39.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:48:0)
[03:55:39.559] Build status: STARTED
[03:55:39.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:49:0) after 5m17s
[04:00:56.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:49:0)
[04:00:56.680] Build status: STARTED
[04:00:56.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:50:0) after 9m25s
[04:10:21.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:50:0)
[04:10:21.746] Build status: STARTED
[04:10:21.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:51:0) after 3m33s
[04:13:54.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:51:0)
[04:13:54.802] Build status: STARTED
[04:13:54.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:52:0) after 3m50s
[04:17:44.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:52:0)
[04:17:44.909] Build status: STARTED
[04:17:44.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:53:0) after 2m26s
[04:20:10.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:53:0)
[04:20:10.965] Build status: STARTED
[04:20:10.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:54:0) after 1m47s
[04:21:57.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:54:0)
[04:21:58.007] Build status: STARTED
[04:21:58.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:55:0) after 9m48s
[04:31:46.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:55:0)
[04:31:46.123] Build status: STARTED
[04:31:46.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:56:0) after 2m33s
[04:34:19.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:56:0)
[04:34:19.381] Build status: STARTED
[04:34:19.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:57:0) after 1m16s
[04:35:35.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:57:0)
[04:35:35.524] Build status: STARTED
[04:35:35.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:58:0) after 5m35s
[04:41:10.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:58:0)
[04:41:10.769] Build status: STARTED
[04:41:10.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:59:0) after 8m6s
[04:49:16.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:59:0)
[04:49:16.832] Build status: STARTED
[04:49:16.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:60:0) after 4m48s
[04:54:04.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:60:0)
[04:54:05.005] Build status: STARTED
[04:54:05.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:61:0) after 1m56s
[04:56:01.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:61:0)
[04:56:01.053] Build status: STARTED
[04:56:01.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:62:0) after 2m15s
[04:58:16.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:62:0)
[04:58:16.453] Build status: STARTED
[04:58:16.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:63:0) after 1m5s
[04:59:21.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:63:0)
[04:59:21.638] Build status: STARTED
[04:59:21.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:64:0) after 1m43s
[05:01:04.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:64:0)
[05:01:04.815] Build status: STARTED
[05:01:04.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:65:0) after 1m30s
[05:02:35.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:65:0)
[05:02:35.098] Build status: STARTED
[05:02:35.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:66:0) after 9m49s
[05:12:24.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:66:0)
[05:12:24.265] Build status: STARTED
[05:12:24.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:67:0) after 7m26s
[05:19:50.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:67:0)
[05:19:50.403] Build status: STARTED
[05:19:50.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:68:0) after 1m18s
[05:21:08.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:68:0)
[05:21:08.674] Build status: STARTED
[05:21:08.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:69:0) after 9m25s
[05:30:33.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:69:0)
[05:30:33.748] Build status: STARTED
[05:30:33.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:70:0) after 3m16s
[05:33:49.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:70:0)
[05:33:49.931] Build status: STARTED
[05:33:49.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:71:0) after 1m44s
[05:35:34.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:71:0)
[05:35:34.078] Build status: STARTED
[05:35:34.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:72:0) after 2m7s
[05:37:41.276] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:72:0)
[05:37:41.294] Build status: STARTED
[05:37:41.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:73:0) after 5m55s
[05:43:37.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:73:0)
[05:43:37.199] Build status: STARTED
[05:43:37.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:74:0) after 5m14s
[05:48:51.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:74:0)
[05:48:51.338] Build status: STARTED
[05:48:51.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:75:0) after 1m25s
[05:50:16.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:75:0)
[05:50:16.508] Build status: STARTED
[05:50:16.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:76:0) after 6m8s
[05:56:24.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:76:0)
[05:56:24.755] Build status: STARTED
[05:56:24.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:77:0) after 9m17s
[06:05:42.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:77:0)
[06:05:42.291] Build status: STARTED
[06:05:42.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:78:0) after 9m29s
[06:15:11.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:78:0)
[06:15:11.557] Build status: STARTED
[06:15:11.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:79:0) after 2m11s
[06:17:22.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:79:0)
[06:17:22.842] Build status: STARTED
[06:17:22.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:80:0) after 5m34s
[06:22:57.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:80:0)
[06:22:57.126] Build status: STARTED
[06:22:57.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:81:0) after 5m4s
[06:28:01.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:81:0)
[06:28:01.306] Build status: STARTED
[06:28:01.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:82:0) after 7m8s
[06:35:09.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:82:0)
[06:35:09.511] Build status: STARTED
[06:35:09.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:83:0) after 6m54s
[06:42:03.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:83:0)
[06:42:03.633] Build status: STARTED
[06:42:03.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:84:0) after 8m8s
[06:50:11.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:84:0)
[06:50:11.691] Build status: STARTED
[06:50:11.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:85:0) after 4m23s
[06:54:34.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:85:0)
[06:54:34.848] Build status: STARTED
[06:54:34.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:86:0) after 8m1s
[07:02:36.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:86:0)
[07:02:36.053] Build status: STARTED
[07:02:36.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:87:0) after 9m20s
[07:11:56.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:87:0)
[07:11:56.115] Build status: STARTED
[07:11:56.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:88:0) after 2m58s
[07:14:54.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:88:0)
[07:14:54.209] Build status: STARTED
[07:14:54.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:89:0) after 7m13s
[07:22:07.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:89:0)
[07:22:07.258] Build status: STARTED
[07:22:07.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:90:0) after 5m26s
[07:27:33.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:90:0)
[07:27:33.305] Build status: STARTED
[07:27:33.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:91:0) after 8m29s
[07:36:02.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:91:0)
[07:36:02.363] Build status: STARTED
[07:36:02.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:92:0) after 3m52s
[07:39:54.520] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:92:0)
[07:39:54.545] Build status: STARTED
[07:39:54.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:93:0) after 1m45s
[07:41:39.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:93:0)
[07:41:39.685] Build status: STARTED
[07:41:39.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:94:0) after 9m35s
[07:51:14.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:94:0)
[07:51:14.738] Build status: STARTED
[07:51:14.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:95:0) after 3m5s
[07:54:19.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:95:0)
[07:54:19.793] Build status: STARTED
[07:54:19.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:96:0) after 4m42s
[07:59:01.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:96:0)
[07:59:01.843] Build status: STARTED
[07:59:01.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:97:0) after 5m17s
[08:04:18.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:97:0)
[08:04:18.934] Build status: STARTED
[08:04:18.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:98:0) after 9m35s
[08:13:53.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:98:0)
[08:13:53.982] Build status: STARTED
[08:13:53.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:99:0) after 2m42s
[08:16:36.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:99:0)
[08:16:36.766] Build status: STARTED
[08:16:36.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:100:0) after 8m6s
[08:24:43.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:100:0)
[08:24:43.220] Build status: STARTED
[08:24:43.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:101:0) after 6m50s
[08:31:33.225] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:101:0)
[08:31:33.246] Build status: STARTED
[08:31:33.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:102:0) after 6m33s
[08:38:06.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:102:0)
[08:38:06.500] Build status: STARTED
[08:38:06.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:103:0) after 4m10s
[08:42:16.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:103:0)
[08:42:16.600] Build status: STARTED
[08:42:16.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8874030641638811856:104:0) after 7m29s
[08:43:37.157] Received PubSub notification, asking Buildbucket for the build status
[08:43:37.176] Build:
{
  "id": "8708600579741959617",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 27840,
  "createdBy": "project:chromium",
  "createTime": "2025-07-22T23:51:57.467789783Z",
  "startTime": "2025-07-22T23:53:22.176659378Z",
  "endTime": "2025-07-23T08:43:36.647221106Z",
  "updateTime": "2025-07-23T08:43:36.647221106Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "1b0180a5a96422bc2d3a801994af85f3e7b1f046",
      "ref": "refs/heads/main"
    }
  },
  "canary": true
}
[08:43:37.176] Invocation finished in 8h51m40.902045s with status FAILED