1. All projects
  2. chromium
  3. ToTLinuxMSan
  4. 8868875546324410240
Status: FAILED
Triggered by: -
Duration: 8 hours
Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699) 

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxMSan"
>

Incoming triggers

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "81022a1199d68a25e70f2baa10b3928ddd4c8fac"
}

Incoming tags

  • buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/81022a1199d68a25e70f2baa10b3928ddd4c8fac
  • gitiles_ref:refs/heads/main

Debug log (UTC)

[21:29:58.285] New invocation is queued and will start shortly
[21:29:59.400] Starting the invocation (attempt 1)
[21:29:59.437] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/81022a1199d68a25e70f2baa10b3928ddd4c8fac"
[21:29:59.437] Popped gitiles commit info from properties and tags
[21:29:59.437] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:29:59.437] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:29:59.437] Buildbucket request:
{
  "requestId": "8868875546324410240",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "81022a1199d68a25e70f2baa10b3928ddd4c8fac",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8868875546324410240"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxMSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[21:30:00.078] Scheduled build:
{
  "id": "8703445484384166865",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 28630,
  "createdBy": "project:chromium",
  "createTime": "2025-09-17T21:29:59.508492069Z",
  "updateTime": "2025-09-17T21:29:59.508492069Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "81022a1199d68a25e70f2baa10b3928ddd4c8fac",
      "ref": "refs/heads/main"
    }
  }
}
[21:30:00.078] Task URL: https://cr-buildbucket.appspot.com/build/8703445484384166865
[21:30:00.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:2:0) after 3m44s
[21:30:01.098] Received PubSub notification, asking Buildbucket for the build status
[21:30:01.125] Build status: SCHEDULED
[21:31:04.939] Received PubSub notification, asking Buildbucket for the build status
[21:31:04.960] Build status: STARTED
[21:33:44.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:2:0)
[21:33:44.130] Build status: STARTED
[21:33:44.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:5:0) after 4m18s
[21:38:02.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:5:0)
[21:38:02.212] Build status: STARTED
[21:38:02.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:6:0) after 8m29s
[21:46:31.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:6:0)
[21:46:31.408] Build status: STARTED
[21:46:31.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:7:0) after 6m44s
[21:53:15.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:7:0)
[21:53:15.453] Build status: STARTED
[21:53:15.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:8:0) after 8m21s
[22:01:36.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:8:0)
[22:01:36.507] Build status: STARTED
[22:01:36.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:9:0) after 7m22s
[22:08:58.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:9:0)
[22:08:58.541] Build status: STARTED
[22:08:58.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:10:0) after 6m39s
[22:15:37.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:10:0)
[22:15:37.575] Build status: STARTED
[22:15:37.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:11:0) after 4m33s
[22:20:10.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:11:0)
[22:20:10.693] Build status: STARTED
[22:20:10.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:12:0) after 4m7s
[22:24:17.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:12:0)
[22:24:17.742] Build status: STARTED
[22:24:17.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:13:0) after 6m21s
[22:30:38.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:13:0)
[22:30:38.968] Build status: STARTED
[22:30:38.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:14:0) after 9m39s
[22:40:18.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:14:0)
[22:40:18.078] Build status: STARTED
[22:40:18.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:15:0) after 2m27s
[22:42:45.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:15:0)
[22:42:45.180] Build status: STARTED
[22:42:45.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:16:0) after 3m39s
[22:46:24.294] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:16:0)
[22:46:24.332] Build status: STARTED
[22:46:24.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:17:0) after 5m19s
[22:51:43.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:17:0)
[22:51:43.371] Build status: STARTED
[22:51:43.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:18:0) after 9m24s
[23:01:07.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:18:0)
[23:01:07.438] Build status: STARTED
[23:01:07.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:19:0) after 1m30s
[23:02:37.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:19:0)
[23:02:37.593] Build status: STARTED
[23:02:37.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:20:0) after 8m36s
[23:11:13.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:20:0)
[23:11:13.659] Build status: STARTED
[23:11:13.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:21:0) after 5m49s
[23:17:02.692] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:21:0)
[23:17:02.723] Build status: STARTED
[23:17:02.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:22:0) after 2m38s
[23:19:40.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:22:0)
[23:19:40.744] Build status: STARTED
[23:19:40.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:23:0) after 4m21s
[23:24:01.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:23:0)
[23:24:01.880] Build status: STARTED
[23:24:01.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:24:0) after 9m0s
[23:33:01.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:24:0)
[23:33:01.992] Build status: STARTED
[23:33:01.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:25:0) after 8m15s
[23:41:17.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:25:0)
[23:41:17.133] Build status: STARTED
[23:41:17.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:26:0) after 2m46s
[23:44:03.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:26:0)
[23:44:03.240] Build status: STARTED
[23:44:03.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:27:0) after 9m58s
[23:54:01.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:27:0)
[23:54:01.351] Build status: STARTED
[23:54:01.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:28:0) after 3m46s
[23:57:47.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:28:0)
[23:57:47.496] Build status: STARTED
[23:57:47.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:29:0) after 5m6s
[00:02:53.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:29:0)
[00:02:53.664] Build status: STARTED
[00:02:53.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:30:0) after 3m51s
[00:06:44.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:30:0)
[00:06:44.714] Build status: STARTED
[00:06:44.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:31:0) after 6m27s
[00:13:11.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:31:0)
[00:13:11.791] Build status: STARTED
[00:13:11.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:32:0) after 4m23s
[00:17:34.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:32:0)
[00:17:34.841] Build status: STARTED
[00:17:34.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:33:0) after 1m8s
[00:18:42.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:33:0)
[00:18:42.888] Build status: STARTED
[00:18:42.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:34:0) after 1m8s
[00:19:50.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:34:0)
[00:19:51.008] Build status: STARTED
[00:19:51.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:35:0) after 8m31s
[00:28:22.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:35:0)
[00:28:22.066] Build status: STARTED
[00:28:22.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:36:0) after 8m18s
[00:36:40.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:36:0)
[00:36:40.250] Build status: STARTED
[00:36:40.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:37:0) after 3m35s
[00:40:15.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:37:0)
[00:40:15.440] Build status: STARTED
[00:40:15.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:38:0) after 8m1s
[00:48:16.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:38:0)
[00:48:16.478] Build status: STARTED
[00:48:16.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:39:0) after 8m31s
[00:56:47.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:39:0)
[00:56:47.606] Build status: STARTED
[00:56:47.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:40:0) after 8m43s
[01:05:30.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:40:0)
[01:05:30.642] Build status: STARTED
[01:05:30.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:41:0) after 4m17s
[01:09:47.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:41:0)
[01:09:47.711] Build status: STARTED
[01:09:47.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:42:0) after 3m58s
[01:13:45.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:42:0)
[01:13:45.712] Build status: STARTED
[01:13:45.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:43:0) after 7m42s
[01:21:27.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:43:0)
[01:21:27.764] Build status: STARTED
[01:21:27.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:44:0) after 1m41s
[01:23:08.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:44:0)
[01:23:08.879] Build status: STARTED
[01:23:08.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:45:0) after 2m17s
[01:25:25.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:45:0)
[01:25:25.929] Build status: STARTED
[01:25:25.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:46:0) after 2m27s
[01:27:53.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:46:0)
[01:27:53.041] Build status: STARTED
[01:27:53.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:47:0) after 6m13s
[01:34:06.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:47:0)
[01:34:06.108] Build status: STARTED
[01:34:06.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:48:0) after 5m29s
[01:39:35.137] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:48:0)
[01:39:35.154] Build status: STARTED
[01:39:35.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:49:0) after 3m37s
[01:43:12.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:49:0)
[01:43:12.262] Build status: STARTED
[01:43:12.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:50:0) after 4m46s
[01:47:58.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:50:0)
[01:47:58.358] Build status: STARTED
[01:47:58.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:51:0) after 9m39s
[01:57:37.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:51:0)
[01:57:37.440] Build status: STARTED
[01:57:37.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:52:0) after 1m3s
[01:58:40.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:52:0)
[01:58:40.473] Build status: STARTED
[01:58:40.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:53:0) after 2m13s
[02:00:53.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:53:0)
[02:00:53.507] Build status: STARTED
[02:00:53.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:54:0) after 6m4s
[02:06:57.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:54:0)
[02:06:57.593] Build status: STARTED
[02:06:57.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:55:0) after 9m57s
[02:16:54.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:55:0)
[02:16:54.644] Build status: STARTED
[02:16:54.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:56:0) after 7m23s
[02:24:17.737] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:56:0)
[02:24:17.753] Build status: STARTED
[02:24:17.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:57:0) after 9m44s
[02:34:01.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:57:0)
[02:34:01.802] Build status: STARTED
[02:34:01.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:58:0) after 6m0s
[02:40:01.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:58:0)
[02:40:01.971] Build status: STARTED
[02:40:01.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:59:0) after 7m53s
[02:47:54.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:59:0)
[02:47:55.010] Build status: STARTED
[02:47:55.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:60:0) after 6m25s
[02:54:20.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:60:0)
[02:54:20.058] Build status: STARTED
[02:54:20.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:61:0) after 1m58s
[02:56:18.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:61:0)
[02:56:18.100] Build status: STARTED
[02:56:18.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:62:0) after 9m26s
[03:05:44.142] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:62:0)
[03:05:44.246] Build status: STARTED
[03:05:44.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:63:0) after 5m1s
[03:10:45.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:63:0)
[03:10:45.303] Build status: STARTED
[03:10:45.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:64:0) after 9m57s
[03:20:42.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:64:0)
[03:20:42.350] Build status: STARTED
[03:20:42.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:65:0) after 1m1s
[03:21:43.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:65:0)
[03:21:43.387] Build status: STARTED
[03:21:43.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:66:0) after 6m20s
[03:28:03.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:66:0)
[03:28:03.525] Build status: STARTED
[03:28:03.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:67:0) after 6m58s
[03:35:01.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:67:0)
[03:35:01.732] Build status: STARTED
[03:35:01.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:68:0) after 4m30s
[03:39:31.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:68:0)
[03:39:31.800] Build status: STARTED
[03:39:31.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:69:0) after 5m36s
[03:45:07.822] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:69:0)
[03:45:07.839] Build status: STARTED
[03:45:07.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:70:0) after 5m33s
[03:50:40.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:70:0)
[03:50:40.938] Build status: STARTED
[03:50:40.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:71:0) after 8m37s
[03:59:17.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:71:0)
[03:59:17.989] Build status: STARTED
[03:59:17.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:72:0) after 3m11s
[04:02:29.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:72:0)
[04:02:29.030] Build status: STARTED
[04:02:29.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:73:0) after 8m35s
[04:11:04.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:73:0)
[04:11:04.176] Build status: STARTED
[04:11:04.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:74:0) after 3m44s
[04:14:48.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:74:0)
[04:14:48.244] Build status: STARTED
[04:14:48.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:75:0) after 2m20s
[04:17:08.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:75:0)
[04:17:08.351] Build status: STARTED
[04:17:08.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:76:0) after 1m34s
[04:18:42.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:76:0)
[04:18:42.459] Build status: STARTED
[04:18:42.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:77:0) after 8m55s
[04:27:37.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:77:0)
[04:27:37.502] Build status: STARTED
[04:27:37.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:78:0) after 6m35s
[04:34:12.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:78:0)
[04:34:12.637] Build status: STARTED
[04:34:12.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:79:0) after 5m32s
[04:39:44.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:79:0)
[04:39:44.693] Build status: STARTED
[04:39:44.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:80:0) after 7m35s
[04:47:19.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:80:0)
[04:47:19.765] Build status: STARTED
[04:47:19.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:81:0) after 7m42s
[04:55:01.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:81:0)
[04:55:01.905] Build status: STARTED
[04:55:01.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:82:0) after 8m44s
[05:03:45.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:82:0)
[05:03:45.989] Build status: STARTED
[05:03:45.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:83:0) after 7m36s
[05:11:22.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:83:0)
[05:11:22.039] Build status: STARTED
[05:11:22.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:84:0) after 4m22s
[05:15:44.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:84:0)
[05:15:44.136] Build status: STARTED
[05:15:44.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:85:0) after 1m52s
[05:17:36.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:85:0)
[05:17:36.932] Build status: STARTED
[05:17:36.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:86:0) after 1m49s
[05:19:26.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:86:0)
[05:19:26.312] Build status: STARTED
[05:19:26.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:87:0) after 4m8s
[05:23:34.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:87:0)
[05:23:34.365] Build status: STARTED
[05:23:34.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:88:0) after 6m58s
[05:30:32.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:88:0)
[05:30:32.411] Build status: STARTED
[05:30:32.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:89:0) after 2m14s
[05:32:46.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:89:0)
[05:32:46.457] Build status: STARTED
[05:32:46.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8868875546324410240:90:0) after 9m31s
[05:40:40.334] Received PubSub notification, asking Buildbucket for the build status
[05:40:40.390] Build:
{
  "id": "8703445484384166865",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 28630,
  "createdBy": "project:chromium",
  "createTime": "2025-09-17T21:29:59.508492069Z",
  "startTime": "2025-09-17T21:31:04.655183862Z",
  "endTime": "2025-09-18T05:40:39.331210061Z",
  "updateTime": "2025-09-18T05:40:39.331210061Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "81022a1199d68a25e70f2baa10b3928ddd4c8fac",
      "ref": "refs/heads/main"
    }
  }
}
[05:40:40.390] Invocation finished in 8h10m42.116616883s with status FAILED