LUCI Scheduler :: chromium :: ToTLinuxMSan

Status: FAILED

Triggered by: -

Duration: 8 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxMSan"
>

Incoming triggers

88efed9323558a4122522e02712d6a2f9ba9b34a (3 years ago)
48098510917c78202b3ddc280264e89e5859f3dc (3 years ago)
01f78e68c207313cdb7136a04afbabafe206f57b (3 years ago)
7d532591d56f535e7b3841786b92aa50224d2940 (3 years ago)
9d6811764af478a4aa159d069b578dee2269fe00 (3 years ago)
b471cba4eafb8069b58e4cb37b49b24c49ac8a8f (3 years ago)
f0c6eb6b323b4d19ab609ccfda70269e9c75c185 (3 years ago)
f29a8b2ae8a4b7d46ae8b494fa2fbac9ac27fa37 (3 years ago)
04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130
gitiles_ref:refs/heads/main

Debug log (UTC)

[10:37:20.106] New invocation is queued and will start shortly
[10:41:45.777] Starting the invocation (attempt 1)
[10:41:45.823] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130"
[10:41:45.823] Popped gitiles commit info from properties and tags
[10:41:45.823] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:41:45.823] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:41:45.824] Buildbucket request:
{
  "requestId": "8967214315197392704",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8967214315197392704"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxMSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[10:41:47.094] Scheduled build:
{
  "id": "8801783975830713969",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 16953,
  "createdBy": "project:chromium",
  "createTime": "2022-09-28T10:41:45.902418916Z",
  "updateTime": "2022-09-28T10:41:45.902418916Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130",
      "ref": "refs/heads/main"
    }
  }
}
[10:41:47.094] Task URL: https://cr-buildbucket.appspot.com/build/8801783975830713969
[10:41:47.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:2:0) after 9m11s
[10:42:13.722] Received PubSub notification, asking Buildbucket for the build status
[10:42:13.798] Build status: STARTED
[10:50:58.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:2:0)
[10:50:58.138] Build status: STARTED
[10:50:58.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:4:0) after 9m53s
[11:00:51.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:4:0)
[11:00:51.414] Build status: STARTED
[11:00:51.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:5:0) after 8m44s
[11:09:35.489] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:5:0)
[11:09:35.537] Build status: STARTED
[11:09:35.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:6:0) after 1m43s
[11:11:18.834] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:6:0)
[11:11:18.861] Build status: STARTED
[11:11:18.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:7:0) after 6m55s
[11:18:13.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:7:0)
[11:18:13.915] Build status: STARTED
[11:18:13.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:8:0) after 8m57s
[11:27:10.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:8:0)
[11:27:10.964] Build status: STARTED
[11:27:10.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:9:0) after 5m50s
[11:33:01.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:9:0)
[11:33:01.197] Build status: STARTED
[11:33:01.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:10:0) after 8m51s
[11:41:52.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:10:0)
[11:41:52.627] Build status: STARTED
[11:41:52.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:11:0) after 4m48s
[11:46:40.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:11:0)
[11:46:40.803] Build status: STARTED
[11:46:40.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:12:0) after 5m50s
[11:52:30.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:12:0)
[11:52:30.861] Build status: STARTED
[11:52:30.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:13:0) after 2m28s
[11:54:58.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:13:0)
[11:54:58.992] Build status: STARTED
[11:54:58.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:14:0) after 5m9s
[12:00:08.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:14:0)
[12:00:08.213] Build status: STARTED
[12:00:08.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:15:0) after 1m19s
[12:01:27.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:15:0)
[12:01:27.428] Build status: STARTED
[12:01:27.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:16:0) after 6m37s
[12:08:04.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:16:0)
[12:08:04.481] Build status: STARTED
[12:08:04.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:17:0) after 8m57s
[12:17:01.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:17:0)
[12:17:01.778] Build status: STARTED
[12:17:01.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:18:0) after 7m0s
[12:24:01.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:18:0)
[12:24:01.887] Build status: STARTED
[12:24:01.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:19:0) after 7m26s
[12:31:28.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:19:0)
[12:31:28.219] Build status: STARTED
[12:31:28.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:20:0) after 8m36s
[12:40:04.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:20:0)
[12:40:04.542] Build status: STARTED
[12:40:04.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:21:0) after 4m13s
[12:44:17.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:21:0)
[12:44:17.586] Build status: STARTED
[12:44:17.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:22:0) after 7m31s
[12:51:48.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:22:0)
[12:51:48.633] Build status: STARTED
[12:51:48.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:23:0) after 4m56s
[12:56:44.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:23:0)
[12:56:44.693] Build status: STARTED
[12:56:44.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:24:0) after 2m56s
[12:59:40.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:24:0)
[12:59:40.864] Build status: STARTED
[12:59:40.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:25:0) after 2m42s
[13:02:23.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:25:0)
[13:02:23.052] Build status: STARTED
[13:02:23.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:26:0) after 2m11s
[13:04:34.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:26:0)
[13:04:34.213] Build status: STARTED
[13:04:34.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:27:0) after 6m16s
[13:10:50.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:27:0)
[13:10:50.261] Build status: STARTED
[13:10:50.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:28:0) after 2m20s
[13:13:10.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:28:0)
[13:13:10.520] Build status: STARTED
[13:13:10.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:29:0) after 6m36s
[13:19:46.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:29:0)
[13:19:46.569] Build status: STARTED
[13:19:46.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:30:0) after 2m2s
[13:21:48.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:30:0)
[13:21:48.614] Build status: STARTED
[13:21:48.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:31:0) after 5m3s
[13:26:51.744] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:31:0)
[13:26:51.767] Build status: STARTED
[13:26:51.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:32:0) after 5m45s
[13:32:36.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:32:0)
[13:32:36.869] Build status: STARTED
[13:32:36.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:33:0) after 8m28s
[13:41:04.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:33:0)
[13:41:05.014] Build status: STARTED
[13:41:05.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:34:0) after 4m28s
[13:45:33.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:34:0)
[13:45:33.152] Build status: STARTED
[13:45:33.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:35:0) after 7m32s
[13:53:05.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:35:0)
[13:53:05.546] Build status: STARTED
[13:53:05.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:36:0) after 3m28s
[13:56:33.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:36:0)
[13:56:33.594] Build status: STARTED
[13:56:33.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:37:0) after 5m29s
[14:02:02.664] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:37:0)
[14:02:02.685] Build status: STARTED
[14:02:02.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:38:0) after 9m28s
[14:11:30.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:38:0)
[14:11:30.741] Build status: STARTED
[14:11:30.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:39:0) after 6m23s
[14:17:53.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:39:0)
[14:17:53.787] Build status: STARTED
[14:17:53.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:40:0) after 9m25s
[14:27:18.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:40:0)
[14:27:18.828] Build status: STARTED
[14:27:18.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:41:0) after 7m36s
[14:34:54.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:41:0)
[14:34:54.876] Build status: STARTED
[14:34:54.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:42:0) after 5m57s
[14:40:52.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:42:0)
[14:40:52.199] Build status: STARTED
[14:40:52.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:43:0) after 4m22s
[14:45:14.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:43:0)
[14:45:14.365] Build status: STARTED
[14:45:14.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:44:0) after 4m3s
[14:49:17.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:44:0)
[14:49:17.642] Build status: STARTED
[14:49:17.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:45:0) after 5m1s
[14:54:18.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:45:0)
[14:54:19.013] Build status: STARTED
[14:54:19.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:46:0) after 9m23s
[15:03:42.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:46:0)
[15:03:42.124] Build status: STARTED
[15:03:42.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:47:0) after 5m46s
[15:09:28.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:47:0)
[15:09:28.188] Build status: STARTED
[15:09:28.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:48:0) after 5m14s
[15:14:42.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:48:0)
[15:14:42.258] Build status: STARTED
[15:14:42.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:49:0) after 9m4s
[15:23:46.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:49:0)
[15:23:46.703] Build status: STARTED
[15:23:46.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:50:0) after 9m51s
[15:33:37.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:50:0)
[15:33:37.837] Build status: STARTED
[15:33:37.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:51:0) after 5m29s
[15:39:06.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:51:0)
[15:39:06.914] Build status: STARTED
[15:39:06.914] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:52:0) after 5m28s
[15:44:34.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:52:0)
[15:44:34.958] Build status: STARTED
[15:44:34.958] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:53:0) after 5m47s
[15:50:23.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:53:0)
[15:50:23.236] Build status: STARTED
[15:50:23.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:54:0) after 1m38s
[15:52:01.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:54:0)
[15:52:01.533] Build status: STARTED
[15:52:01.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:55:0) after 5m28s
[15:57:29.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:55:0)
[15:57:29.578] Build status: STARTED
[15:57:29.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:56:0) after 1m8s
[15:58:37.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:56:0)
[15:58:37.678] Build status: STARTED
[15:58:37.678] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:57:0) after 1m9s
[15:59:46.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:57:0)
[15:59:46.762] Build status: STARTED
[15:59:46.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:58:0) after 6m34s
[16:06:20.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:58:0)
[16:06:20.859] Build status: STARTED
[16:06:20.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:59:0) after 9m19s
[16:15:39.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:59:0)
[16:15:39.922] Build status: STARTED
[16:15:39.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:60:0) after 2m15s
[16:17:54.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:60:0)
[16:17:54.989] Build status: STARTED
[16:17:54.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:61:0) after 8m30s
[16:26:25.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:61:0)
[16:26:25.221] Build status: STARTED
[16:26:25.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:62:0) after 1m3s
[16:27:28.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:62:0)
[16:27:28.315] Build status: STARTED
[16:27:28.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:63:0) after 7m2s
[16:34:30.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:63:0)
[16:34:30.510] Build status: STARTED
[16:34:30.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:64:0) after 7m51s
[16:42:21.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:64:0)
[16:42:21.595] Build status: STARTED
[16:42:21.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:65:0) after 9m31s
[16:51:52.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:65:0)
[16:51:52.693] Build status: STARTED
[16:51:52.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:66:0) after 4m47s
[16:56:39.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:66:0)
[16:56:39.837] Build status: STARTED
[16:56:39.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:67:0) after 1m44s
[16:58:23.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:67:0)
[16:58:23.894] Build status: STARTED
[16:58:23.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:68:0) after 1m0s
[16:59:23.951] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:68:0)
[16:59:23.974] Build status: STARTED
[16:59:23.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:69:0) after 6m1s
[17:05:25.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:69:0)
[17:05:25.159] Build status: STARTED
[17:05:25.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:70:0) after 9m43s
[17:15:08.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:70:0)
[17:15:08.299] Build status: STARTED
[17:15:08.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:71:0) after 1m13s
[17:16:21.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:71:0)
[17:16:21.352] Build status: STARTED
[17:16:21.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:72:0) after 5m11s
[17:21:32.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:72:0)
[17:21:32.398] Build status: STARTED
[17:21:32.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:73:0) after 6m40s
[17:28:12.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:73:0)
[17:28:12.533] Build status: STARTED
[17:28:12.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:74:0) after 7m53s
[17:36:05.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:74:0)
[17:36:05.869] Build status: STARTED
[17:36:05.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:75:0) after 7m0s
[17:43:05.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:75:0)
[17:43:05.921] Build status: STARTED
[17:43:05.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:76:0) after 5m27s
[17:48:33.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:76:0)
[17:48:33.298] Build status: STARTED
[17:48:33.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:77:0) after 9m2s
[17:57:35.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:77:0)
[17:57:35.354] Build status: STARTED
[17:57:35.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:78:0) after 4m56s
[18:02:31.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:78:0)
[18:02:31.664] Build status: STARTED
[18:02:31.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:79:0) after 9m39s
[18:12:10.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:79:0)
[18:12:10.729] Build status: STARTED
[18:12:10.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:80:0) after 8m58s
[18:21:08.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:80:0)
[18:21:08.825] Build status: STARTED
[18:21:08.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:81:0) after 4m28s
[18:25:37.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:81:0)
[18:25:37.037] Build status: STARTED
[18:25:37.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:82:0) after 5m2s
[18:30:39.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:82:0)
[18:30:39.134] Build status: STARTED
[18:30:39.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:83:0) after 3m35s
[18:34:14.156] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:83:0)
[18:34:14.194] Build status: STARTED
[18:34:14.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:84:0) after 6m6s
[18:40:20.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:84:0)
[18:40:20.260] Build status: STARTED
[18:40:20.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:85:0) after 9m26s
[18:49:46.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:85:0)
[18:49:46.628] Build status: STARTED
[18:49:46.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:86:0) after 3m5s
[18:52:51.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:86:0)
[18:52:51.849] Build status: STARTED
[18:52:51.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:87:0) after 6m56s
[18:59:47.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:87:0)
[18:59:47.961] Build status: STARTED
[18:59:47.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:88:0) after 2m37s
[19:02:24.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:88:0)
[19:02:25.014] Build status: STARTED
[19:02:25.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:89:0) after 8m46s
[19:11:11.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:89:0)
[19:11:11.070] Build status: STARTED
[19:11:11.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:90:0) after 1m28s
[19:12:39.107] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:90:0)
[19:12:39.129] Build status: STARTED
[19:12:39.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8967214315197392704:91:0) after 5m23s
[19:14:35.313] Received PubSub notification, asking Buildbucket for the build status
[19:14:35.342] Build:
{
  "id": "8801783975830713969",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 16953,
  "createdBy": "project:chromium",
  "createTime": "2022-09-28T10:41:45.902418916Z",
  "startTime": "2022-09-28T10:42:13.259562Z",
  "endTime": "2022-09-28T19:14:34.992386271Z",
  "updateTime": "2022-09-28T19:14:34.992386271Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "04f6b8c68d6462d6fc7a00d8deaef0cb8f5ec130",
      "ref": "refs/heads/main"
    }
  }
}
[19:14:35.343] Invocation finished in 8h37m15.249861714s with status FAILED