LUCI Scheduler :: chromium :: ToTLinuxMSan

Status: FAILED

Triggered by: -

Duration: 7 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxMSan"
>

Incoming triggers

dcc5bf9ad213def864b2e0b154615e3182d69ab6 (3 years ago)
664df7ac214af2f88a6ee61cc0820de2c018db0e (3 years ago)
990640740bbdecd1b4a7ba58612f72d43866b1aa (3 years ago)
d35c44f0f4f3001bed8101281538002a28dccabd (3 years ago)
f5f88eae43975ec5a95be3047164079b1082a9b9 (3 years ago)
6d1a930ad1122246c6eaceef77e1da68137f0aeb (3 years ago)
9bb5c05815386035814c6a08f1bdbfdebef085bb (3 years ago)
f7d6f20bc1788bed423b3cd9daad32eb0af71c27 (3 years ago)
afcfbab649b17369123728edb6429a253e57fb97 (3 years ago)
0a1a204d70537035f78b898274ed38f3739c719d (3 years ago)
3b34399247d1e59327251bcc9f55badd7e932197 (3 years ago)
828825c1ceccc16501c254f9eab9c51df40ea843 (3 years ago)
82730a9822fae635a8255208b240890c04fd8505 (3 years ago)
50f23c75c0dafd4d24187eb0571a7a59eed7dbc5 (3 years ago)
9db5741912ae8f856b59dd796150cf41fcd4724b (3 years ago)
1061907a6530e370e8db189ee752e5033a03aab8 (3 years ago)
0f1a361ffe96c5b57654bab1c12f1bec47a13d1e (3 years ago)
92329ed0332134be6325036ebcbc5a6a8c5fde98 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "92329ed0332134be6325036ebcbc5a6a8c5fde98"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/92329ed0332134be6325036ebcbc5a6a8c5fde98
gitiles_ref:refs/heads/main

Debug log (UTC)

[02:24:02.211] New invocation is queued and will start shortly
[02:24:03.386] Starting the invocation (attempt 1)
[02:24:03.430] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/92329ed0332134be6325036ebcbc5a6a8c5fde98"
[02:24:03.430] Popped gitiles commit info from properties and tags
[02:24:03.430] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:24:03.430] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:24:03.430] Buildbucket request:
{
  "requestId": "8976939226249242960",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "92329ed0332134be6325036ebcbc5a6a8c5fde98",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8976939226249242960"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxMSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[02:24:03.938] Scheduled build:
{
  "id": "8811509164239987969",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 15589,
  "createdBy": "project:chromium",
  "createTime": "2022-06-13T02:24:03.494492448Z",
  "updateTime": "2022-06-13T02:24:03.494492448Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "92329ed0332134be6325036ebcbc5a6a8c5fde98",
      "ref": "refs/heads/main"
    }
  }
}
[02:24:03.938] Task URL: https://cr-buildbucket.appspot.com/build/8811509164239987969
[02:24:03.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:2:0) after 7m36s
[02:27:39.380] Received PubSub notification, asking Buildbucket for the build status
[02:27:39.400] Build status: STARTED
[02:31:39.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:2:0)
[02:31:40.022] Build status: STARTED
[02:31:40.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:4:0) after 6m10s
[02:37:50.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:4:0)
[02:37:50.073] Build status: STARTED
[02:37:50.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:5:0) after 6m34s
[02:44:24.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:5:0)
[02:44:24.362] Build status: STARTED
[02:44:24.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:6:0) after 6m25s
[02:50:49.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:6:0)
[02:50:49.480] Build status: STARTED
[02:50:49.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:7:0) after 6m38s
[02:57:28.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:7:0)
[02:57:28.273] Build status: STARTED
[02:57:28.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:8:0) after 2m19s
[02:59:47.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:8:0)
[02:59:47.321] Build status: STARTED
[02:59:47.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:9:0) after 1m2s
[03:00:49.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:9:0)
[03:00:49.365] Build status: STARTED
[03:00:49.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:10:0) after 5m9s
[03:05:58.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:10:0)
[03:05:58.715] Build status: STARTED
[03:05:58.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:11:0) after 7m57s
[03:13:55.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:11:0)
[03:13:55.846] Build status: STARTED
[03:13:55.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:12:0) after 9m2s
[03:22:57.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:12:0)
[03:22:57.882] Build status: STARTED
[03:22:57.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:13:0) after 9m42s
[03:32:39.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:13:0)
[03:32:40.075] Build status: STARTED
[03:32:40.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:14:0) after 6m42s
[03:39:22.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:14:0)
[03:39:22.499] Build status: STARTED
[03:39:22.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:15:0) after 1m12s
[03:40:34.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:15:0)
[03:40:34.802] Build status: STARTED
[03:40:34.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:16:0) after 3m36s
[03:44:10.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:16:0)
[03:44:10.854] Build status: STARTED
[03:44:10.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:17:0) after 9m43s
[03:53:54.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:17:0)
[03:53:54.174] Build status: STARTED
[03:53:54.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:18:0) after 4m7s
[03:58:01.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:18:0)
[03:58:01.226] Build status: STARTED
[03:58:01.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:19:0) after 9m35s
[04:07:36.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:19:0)
[04:07:36.267] Build status: STARTED
[04:07:36.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:20:0) after 7m30s
[04:15:06.300] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:20:0)
[04:15:06.321] Build status: STARTED
[04:15:06.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:21:0) after 8m16s
[04:23:22.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:21:0)
[04:23:22.373] Build status: STARTED
[04:23:22.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:22:0) after 2m12s
[04:25:34.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:22:0)
[04:25:34.427] Build status: STARTED
[04:25:34.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:23:0) after 3m26s
[04:29:00.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:23:0)
[04:29:00.469] Build status: STARTED
[04:29:00.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:24:0) after 2m11s
[04:31:11.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:24:0)
[04:31:11.547] Build status: STARTED
[04:31:11.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:25:0) after 5m19s
[04:36:30.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:25:0)
[04:36:30.941] Build status: STARTED
[04:36:30.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:26:0) after 3m34s
[04:40:05.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:26:0)
[04:40:05.382] Build status: STARTED
[04:40:05.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:27:0) after 6m49s
[04:46:54.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:27:0)
[04:46:54.938] Build status: STARTED
[04:46:54.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:28:0) after 3m53s
[04:50:47.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:28:0)
[04:50:48.027] Build status: STARTED
[04:50:48.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:29:0) after 3m12s
[04:54:00.146] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:29:0)
[04:54:00.169] Build status: STARTED
[04:54:00.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:30:0) after 5m28s
[04:59:28.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:30:0)
[04:59:28.264] Build status: STARTED
[04:59:28.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:31:0) after 9m50s
[05:09:18.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:31:0)
[05:09:18.323] Build status: STARTED
[05:09:18.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:32:0) after 4m46s
[05:14:04.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:32:0)
[05:14:04.378] Build status: STARTED
[05:14:04.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:33:0) after 6m38s
[05:20:42.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:33:0)
[05:20:42.539] Build status: STARTED
[05:20:42.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:34:0) after 6m34s
[05:27:16.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:34:0)
[05:27:16.988] Build status: STARTED
[05:27:16.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:35:0) after 2m57s
[05:30:14.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:35:0)
[05:30:14.041] Build status: STARTED
[05:30:14.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:36:0) after 6m14s
[05:36:28.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:36:0)
[05:36:28.083] Build status: STARTED
[05:36:28.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:37:0) after 9m58s
[05:46:26.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:37:0)
[05:46:26.336] Build status: STARTED
[05:46:26.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:38:0) after 6m50s
[05:53:16.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:38:0)
[05:53:16.409] Build status: STARTED
[05:53:16.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:39:0) after 7m0s
[06:00:17.013] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:39:0)
[06:00:17.036] Build status: STARTED
[06:00:17.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:40:0) after 7m34s
[06:07:51.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:40:0)
[06:07:51.534] Build status: STARTED
[06:07:51.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:41:0) after 7m2s
[06:14:53.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:41:0)
[06:14:53.574] Build status: STARTED
[06:14:53.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:42:0) after 8m34s
[06:23:27.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:42:0)
[06:23:27.615] Build status: STARTED
[06:23:27.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:43:0) after 4m12s
[06:27:39.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:43:0)
[06:27:39.666] Build status: STARTED
[06:27:39.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:44:0) after 1m45s
[06:29:24.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:44:0)
[06:29:24.967] Build status: STARTED
[06:29:24.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:45:0) after 7m10s
[06:36:34.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:45:0)
[06:36:35.027] Build status: STARTED
[06:36:35.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:46:0) after 7m20s
[06:43:55.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:46:0)
[06:43:55.422] Build status: STARTED
[06:43:55.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:47:0) after 3m6s
[06:47:01.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:47:0)
[06:47:01.497] Build status: STARTED
[06:47:01.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:48:0) after 2m43s
[06:49:44.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:48:0)
[06:49:44.680] Build status: STARTED
[06:49:44.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:49:0) after 6m0s
[06:55:45.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:49:0)
[06:55:45.023] Build status: STARTED
[06:55:45.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:50:0) after 2m43s
[06:58:28.094] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:50:0)
[06:58:28.118] Build status: STARTED
[06:58:28.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:51:0) after 9m19s
[07:07:47.433] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:51:0)
[07:07:47.456] Build status: STARTED
[07:07:47.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:52:0) after 1m36s
[07:09:23.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:52:0)
[07:09:23.538] Build status: STARTED
[07:09:23.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:53:0) after 2m21s
[07:11:44.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:53:0)
[07:11:44.579] Build status: STARTED
[07:11:44.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:54:0) after 7m12s
[07:18:56.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:54:0)
[07:18:56.666] Build status: STARTED
[07:18:56.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:55:0) after 6m18s
[07:25:14.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:55:0)
[07:25:14.736] Build status: STARTED
[07:25:14.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:56:0) after 6m16s
[07:31:30.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:56:0)
[07:31:30.791] Build status: STARTED
[07:31:30.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:57:0) after 8m17s
[07:39:47.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:57:0)
[07:39:48.003] Build status: STARTED
[07:39:48.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:58:0) after 4m52s
[07:44:40.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:58:0)
[07:44:40.066] Build status: STARTED
[07:44:40.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:59:0) after 7m10s
[07:51:50.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:59:0)
[07:51:50.258] Build status: STARTED
[07:51:50.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:60:0) after 3m51s
[07:55:41.595] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:60:0)
[07:55:41.617] Build status: STARTED
[07:55:41.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:61:0) after 5m31s
[08:01:12.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:61:0)
[08:01:12.669] Build status: STARTED
[08:01:12.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:62:0) after 1m42s
[08:02:54.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:62:0)
[08:02:54.862] Build status: STARTED
[08:02:54.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:63:0) after 3m41s
[08:06:35.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:63:0)
[08:06:36.131] Build status: STARTED
[08:06:36.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:64:0) after 4m24s
[08:11:00.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:64:0)
[08:11:00.558] Build status: STARTED
[08:11:00.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:65:0) after 6m21s
[08:17:21.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:65:0)
[08:17:21.635] Build status: STARTED
[08:17:21.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:66:0) after 6m38s
[08:23:59.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:66:0)
[08:23:59.791] Build status: STARTED
[08:23:59.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:67:0) after 7m51s
[08:31:50.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:67:0)
[08:31:50.910] Build status: STARTED
[08:31:50.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:68:0) after 8m36s
[08:40:27.019] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:68:0)
[08:40:27.042] Build status: STARTED
[08:40:27.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:69:0) after 4m14s
[08:44:41.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:69:0)
[08:44:41.321] Build status: STARTED
[08:44:41.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:70:0) after 5m14s
[08:49:55.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:70:0)
[08:49:55.373] Build status: STARTED
[08:49:55.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:71:0) after 7m23s
[08:57:18.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:71:0)
[08:57:18.415] Build status: STARTED
[08:57:18.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:72:0) after 7m54s
[09:05:12.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:72:0)
[09:05:12.565] Build status: STARTED
[09:05:12.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:73:0) after 6m3s
[09:11:15.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:73:0)
[09:11:15.887] Build status: STARTED
[09:11:15.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:74:0) after 3m10s
[09:14:26.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:74:0)
[09:14:26.304] Build status: STARTED
[09:14:26.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:75:0) after 2m14s
[09:16:40.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:75:0)
[09:16:40.361] Build status: STARTED
[09:16:40.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:76:0) after 7m43s
[09:24:23.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:76:0)
[09:24:23.609] Build status: STARTED
[09:24:23.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:77:0) after 8m40s
[09:33:03.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:77:0)
[09:33:03.779] Build status: STARTED
[09:33:03.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:78:0) after 2m22s
[09:35:25.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:78:0)
[09:35:25.829] Build status: STARTED
[09:35:25.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:79:0) after 5m59s
[09:41:24.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:79:0)
[09:41:24.979] Build status: STARTED
[09:41:24.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxMSan:8976939226249242960:80:0) after 2m52s
[09:43:08.799] Received PubSub notification, asking Buildbucket for the build status
[09:43:08.820] Build:
{
  "id": "8811509164239987969",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxMSan"
  },
  "number": 15589,
  "createdBy": "project:chromium",
  "createTime": "2022-06-13T02:24:03.494492448Z",
  "startTime": "2022-06-13T02:27:38.859292Z",
  "endTime": "2022-06-13T09:43:00.820301266Z",
  "updateTime": "2022-06-13T09:43:00.820301266Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "92329ed0332134be6325036ebcbc5a6a8c5fde98",
      "ref": "refs/heads/main"
    }
  }
}
[09:43:08.820] Invocation finished in 7h19m6.626370165s with status FAILED