LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTMacASan"
>

Incoming triggers

3d0faddd981f27f15f144c0f2f4b3d1cb94ec681 (4 years ago)
de55370b5eeceea6bb1486b62f3bad5ff2fef83d (4 years ago)
f89008a3896b98342dc1574b75c876b021262502 (4 years ago)
4964823ec0a9d8d00eb3bf501cca1f52d0c5a7dd (4 years ago)
b57193e07c317496a3530cf8a9825f701270e45b (4 years ago)
a0ca030181c88be5d90cccbd1741dea748be013c (4 years ago)
b3b90e302494abdbaff83f8af91f794f63cd85c7 (4 years ago)
326a02370a6135b3230d220bc1edecb4928faeb1 (4 years ago)
18eea8ce4cc9add6cf321c65ae4ad2f23e07b078 (4 years ago)
777de5b2a69df4ea917f0eed03d25fcf5049d44f (4 years ago)
d56b34b8c8399c4f600c11f296fd2a1816e2d160 (4 years ago)
d6cecb5374d9ffa3962aec26cf32d10c7b5d7cc8 (4 years ago)
299979e88b4ac40882f6594f9aba29609d80349e (4 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "299979e88b4ac40882f6594f9aba29609d80349e"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/299979e88b4ac40882f6594f9aba29609d80349e
gitiles_ref:refs/heads/main

Debug log (UTC)

[05:39:07.002] New invocation is queued and will start shortly
[05:39:08.162] Starting the invocation (attempt 1)
[05:39:08.193] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/299979e88b4ac40882f6594f9aba29609d80349e"
[05:39:08.193] Popped gitiles commit info from properties and tags
[05:39:08.193] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:39:08.194] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:39:08.194] Buildbucket request:
{
  "requestId": "8999847985384688576",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "299979e88b4ac40882f6594f9aba29609d80349e",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8999847985384688576"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[05:39:08.700] Scheduled build:
{
  "id": "8834417923373061681",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25598,
  "createdBy": "project:chromium",
  "createTime": "2021-10-03T05:39:08.288338563Z",
  "updateTime": "2021-10-03T05:39:08.552462307Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "299979e88b4ac40882f6594f9aba29609d80349e",
      "ref": "refs/heads/main"
    }
  }
}
[05:39:08.700] Task URL: https://cr-buildbucket.appspot.com/build/8834417923373061681
[05:39:08.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:2:0) after 4m15s
[05:39:47.615] Received PubSub notification, asking Buildbucket for the build status
[05:39:47.646] Build status: STARTED
[05:43:24.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:2:0)
[05:43:24.563] Build status: STARTED
[05:43:24.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:4:0) after 6m51s
[05:50:15.594] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:4:0)
[05:50:15.621] Build status: STARTED
[05:50:15.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:5:0) after 2m21s
[05:52:36.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:5:0)
[05:52:36.665] Build status: STARTED
[05:52:36.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:6:0) after 2m44s
[05:55:20.684] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:6:0)
[05:55:20.715] Build status: STARTED
[05:55:20.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:7:0) after 9m41s
[06:05:01.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:7:0)
[06:05:01.825] Build status: STARTED
[06:05:01.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:8:0) after 7m52s
[06:12:53.986] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:8:0)
[06:12:54.025] Build status: STARTED
[06:12:54.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:9:0) after 6m15s
[06:19:09.042] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:9:0)
[06:19:09.079] Build status: STARTED
[06:19:09.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:10:0) after 6m9s
[06:25:18.095] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:10:0)
[06:25:18.130] Build status: STARTED
[06:25:18.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:11:0) after 6m43s
[06:32:01.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:11:0)
[06:32:01.912] Build status: STARTED
[06:32:01.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:12:0) after 8m0s
[06:40:02.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:12:0)
[06:40:02.292] Build status: STARTED
[06:40:02.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:13:0) after 1m3s
[06:41:05.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:13:0)
[06:41:05.483] Build status: STARTED
[06:41:05.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:14:0) after 5m3s
[06:46:09.164] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:14:0)
[06:46:09.199] Build status: STARTED
[06:46:09.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:15:0) after 8m50s
[06:54:59.226] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:15:0)
[06:54:59.251] Build status: STARTED
[06:54:59.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:16:0) after 1m44s
[06:56:43.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:16:0)
[06:56:43.368] Build status: STARTED
[06:56:43.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:17:0) after 2m51s
[06:59:34.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:17:0)
[06:59:34.441] Build status: STARTED
[06:59:34.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:18:0) after 6m44s
[07:06:18.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:18:0)
[07:06:18.642] Build status: STARTED
[07:06:18.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:19:0) after 4m32s
[07:10:50.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:19:0)
[07:10:50.791] Build status: STARTED
[07:10:50.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:20:0) after 6m22s
[07:17:13.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:20:0)
[07:17:13.176] Build status: STARTED
[07:17:13.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:21:0) after 4m48s
[07:22:01.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:21:0)
[07:22:01.498] Build status: STARTED
[07:22:01.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:22:0) after 2m18s
[07:24:19.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:22:0)
[07:24:19.554] Build status: STARTED
[07:24:19.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:23:0) after 6m43s
[07:31:02.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:23:0)
[07:31:02.849] Build status: STARTED
[07:31:02.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:24:0) after 6m9s
[07:37:11.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:24:0)
[07:37:11.892] Build status: STARTED
[07:37:11.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:25:0) after 7m21s
[07:44:33.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:25:0)
[07:44:33.121] Build status: STARTED
[07:44:33.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:26:0) after 3m17s
[07:47:50.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:26:0)
[07:47:50.307] Build status: STARTED
[07:47:50.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:27:0) after 4m1s
[07:51:51.328] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:27:0)
[07:51:51.406] Build status: STARTED
[07:51:51.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:28:0) after 2m57s
[07:54:48.768] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:28:0)
[07:54:48.804] Build status: STARTED
[07:54:48.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:29:0) after 5m45s
[08:00:33.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:29:0)
[08:00:33.999] Build status: STARTED
[08:00:33.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:30:0) after 1m11s
[08:01:45.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:30:0)
[08:01:45.048] Build status: STARTED
[08:01:45.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:31:0) after 8m42s
[08:10:27.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:31:0)
[08:10:27.238] Build status: STARTED
[08:10:27.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:32:0) after 8m57s
[08:19:24.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:32:0)
[08:19:24.506] Build status: STARTED
[08:19:24.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:33:0) after 8m47s
[08:28:11.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:33:0)
[08:28:11.571] Build status: STARTED
[08:28:11.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:34:0) after 5m42s
[08:33:53.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:34:0)
[08:33:53.758] Build status: STARTED
[08:33:53.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:35:0) after 2m38s
[08:36:31.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:35:0)
[08:36:31.830] Build status: STARTED
[08:36:31.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:36:0) after 7m5s
[08:43:36.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:36:0)
[08:43:36.874] Build status: STARTED
[08:43:36.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:37:0) after 4m16s
[08:47:53.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:37:0)
[08:47:53.065] Build status: STARTED
[08:47:53.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:38:0) after 9m44s
[08:57:37.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:38:0)
[08:57:37.112] Build status: STARTED
[08:57:37.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:39:0) after 3m21s
[09:00:58.133] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:39:0)
[09:00:58.160] Build status: STARTED
[09:00:58.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:40:0) after 3m53s
[09:04:51.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:40:0)
[09:04:51.198] Build status: STARTED
[09:04:51.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:41:0) after 7m24s
[09:12:15.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:41:0)
[09:12:15.332] Build status: STARTED
[09:12:15.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:42:0) after 4m29s
[09:16:44.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:42:0)
[09:16:44.748] Build status: STARTED
[09:16:44.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:43:0) after 2m57s
[09:19:41.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:43:0)
[09:19:41.967] Build status: STARTED
[09:19:41.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:44:0) after 5m20s
[09:25:01.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:44:0)
[09:25:02.011] Build status: STARTED
[09:25:02.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:45:0) after 2m39s
[09:27:41.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:45:0)
[09:27:41.179] Build status: STARTED
[09:27:41.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:46:0) after 1m59s
[09:29:40.409] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:46:0)
[09:29:40.438] Build status: STARTED
[09:29:40.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:47:0) after 3m23s
[09:33:03.483] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:47:0)
[09:33:03.515] Build status: STARTED
[09:33:03.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:48:0) after 1m23s
[09:34:26.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:48:0)
[09:34:26.565] Build status: STARTED
[09:34:26.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:49:0) after 6m53s
[09:41:19.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:49:0)
[09:41:19.643] Build status: STARTED
[09:41:19.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:50:0) after 8m0s
[09:49:19.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:50:0)
[09:49:19.693] Build status: STARTED
[09:49:19.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:51:0) after 1m52s
[09:51:11.711] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:51:0)
[09:51:11.738] Build status: STARTED
[09:51:11.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:52:0) after 7m18s
[09:58:29.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:52:0)
[09:58:29.819] Build status: STARTED
[09:58:29.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:53:0) after 9m6s
[10:07:35.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:53:0)
[10:07:35.868] Build status: STARTED
[10:07:35.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:54:0) after 8m21s
[10:15:57.211] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:54:0)
[10:15:57.241] Build status: STARTED
[10:15:57.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:55:0) after 4m59s
[10:20:56.260] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:55:0)
[10:20:56.290] Build status: STARTED
[10:20:56.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:56:0) after 5m52s
[10:26:48.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:56:0)
[10:26:48.337] Build status: STARTED
[10:26:48.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:57:0) after 8m22s
[10:35:10.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:57:0)
[10:35:10.407] Build status: STARTED
[10:35:10.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:58:0) after 2m9s
[10:37:19.424] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:58:0)
[10:37:19.452] Build status: STARTED
[10:37:19.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:59:0) after 8m47s
[10:46:06.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:59:0)
[10:46:06.518] Build status: STARTED
[10:46:06.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:60:0) after 4m57s
[10:51:03.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:60:0)
[10:51:03.578] Build status: STARTED
[10:51:03.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:61:0) after 7m16s
[10:58:19.925] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:61:0)
[10:58:19.953] Build status: STARTED
[10:58:19.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:62:0) after 1m21s
[10:59:40.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:62:0)
[10:59:41.008] Build status: STARTED
[10:59:41.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:63:0) after 5m57s
[11:05:38.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:63:0)
[11:05:38.072] Build status: STARTED
[11:05:38.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:64:0) after 7m44s
[11:13:22.248] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:64:0)
[11:13:22.274] Build status: STARTED
[11:13:22.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:65:0) after 4m28s
[11:17:50.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:65:0)
[11:17:50.424] Build status: STARTED
[11:17:50.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:66:0) after 5m49s
[11:23:39.446] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:66:0)
[11:23:39.479] Build status: STARTED
[11:23:39.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:67:0) after 4m52s
[11:28:31.498] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:67:0)
[11:28:31.524] Build status: STARTED
[11:28:31.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:68:0) after 8m38s
[11:37:09.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:68:0)
[11:37:09.796] Build status: STARTED
[11:37:09.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:69:0) after 1m48s
[11:38:58.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:69:0)
[11:38:58.136] Build status: STARTED
[11:38:58.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:70:0) after 4m0s
[11:42:58.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:70:0)
[11:42:58.187] Build status: STARTED
[11:42:58.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:71:0) after 7m45s
[11:50:43.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:71:0)
[11:50:43.235] Build status: STARTED
[11:50:43.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:72:0) after 7m12s
[11:57:55.253] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:72:0)
[11:57:55.279] Build status: STARTED
[11:57:55.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:73:0) after 2m41s
[12:00:36.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:73:0)
[12:00:36.337] Build status: STARTED
[12:00:36.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:74:0) after 7m15s
[12:07:51.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:74:0)
[12:07:51.383] Build status: STARTED
[12:07:51.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:75:0) after 5m18s
[12:13:09.400] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:75:0)
[12:13:09.457] Build status: STARTED
[12:13:09.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:76:0) after 4m33s
[12:17:42.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:76:0)
[12:17:42.502] Build status: STARTED
[12:17:42.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:77:0) after 3m40s
[12:21:22.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:77:0)
[12:21:22.572] Build status: STARTED
[12:21:22.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:78:0) after 3m5s
[12:24:27.661] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:78:0)
[12:24:27.694] Build status: STARTED
[12:24:27.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:79:0) after 6m52s
[12:31:19.936] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:79:0)
[12:31:19.967] Build status: STARTED
[12:31:19.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:80:0) after 1m44s
[12:33:03.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:80:0)
[12:33:04.015] Build status: STARTED
[12:33:04.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:81:0) after 3m14s
[12:36:18.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:81:0)
[12:36:18.477] Build status: STARTED
[12:36:18.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:82:0) after 6m54s
[12:43:12.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:82:0)
[12:43:12.553] Build status: STARTED
[12:43:12.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:83:0) after 3m11s
[12:46:23.580] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:83:0)
[12:46:23.658] Build status: STARTED
[12:46:23.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:84:0) after 6m44s
[12:53:07.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:84:0)
[12:53:07.702] Build status: STARTED
[12:53:07.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:85:0) after 4m6s
[12:57:13.815] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:85:0)
[12:57:13.841] Build status: STARTED
[12:57:13.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:86:0) after 6m2s
[13:03:15.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:86:0)
[13:03:15.889] Build status: STARTED
[13:03:15.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:87:0) after 1m15s
[13:04:30.907] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:87:0)
[13:04:30.953] Build status: STARTED
[13:04:30.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:88:0) after 4m54s
[13:09:25.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:88:0)
[13:09:25.272] Build status: STARTED
[13:09:25.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:89:0) after 9m13s
[13:18:38.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:89:0)
[13:18:38.309] Build status: STARTED
[13:18:38.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:90:0) after 1m43s
[13:20:21.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:90:0)
[13:20:21.370] Build status: STARTED
[13:20:21.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:91:0) after 9m53s
[13:30:14.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:91:0)
[13:30:14.501] Build status: STARTED
[13:30:14.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:92:0) after 4m3s
[13:34:17.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:92:0)
[13:34:17.656] Build status: STARTED
[13:34:17.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:93:0) after 6m14s
[13:40:31.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:93:0)
[13:40:31.706] Build status: STARTED
[13:40:31.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:94:0) after 9m49s
[13:50:20.752] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:94:0)
[13:50:20.790] Build status: STARTED
[13:50:20.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:95:0) after 8m25s
[13:58:45.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:95:0)
[13:58:45.834] Build status: STARTED
[13:58:45.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:96:0) after 4m45s
[14:03:30.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:96:0)
[14:03:31.054] Build status: STARTED
[14:03:31.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:97:0) after 2m42s
[14:06:13.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:97:0)
[14:06:13.109] Build status: STARTED
[14:06:13.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:98:0) after 3m34s
[14:09:47.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:98:0)
[14:09:47.161] Build status: STARTED
[14:09:47.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:99:0) after 8m18s
[14:18:05.453] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:99:0)
[14:18:05.478] Build status: STARTED
[14:18:05.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:100:0) after 8m47s
[14:26:52.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:100:0)
[14:26:52.565] Build status: STARTED
[14:26:52.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:101:0) after 2m19s
[14:29:11.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:101:0)
[14:29:11.627] Build status: STARTED
[14:29:11.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:102:0) after 5m42s
[14:34:53.807] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:102:0)
[14:34:53.848] Build status: STARTED
[14:34:53.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:103:0) after 3m26s
[14:38:20.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:103:0)
[14:38:20.091] Build status: STARTED
[14:38:20.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:104:0) after 2m16s
[14:40:36.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:104:0)
[14:40:36.332] Build status: STARTED
[14:40:36.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:105:0) after 5m19s
[14:45:55.354] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:105:0)
[14:45:55.394] Build status: STARTED
[14:45:55.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:106:0) after 5m46s
[14:51:41.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:106:0)
[14:51:41.459] Build status: STARTED
[14:51:41.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:107:0) after 7m58s
[14:59:39.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:107:0)
[14:59:39.503] Build status: STARTED
[14:59:39.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:108:0) after 5m11s
[15:04:50.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:108:0)
[15:04:50.558] Build status: STARTED
[15:04:50.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:109:0) after 7m41s
[15:12:31.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:109:0)
[15:12:31.595] Build status: STARTED
[15:12:31.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:110:0) after 5m56s
[15:18:27.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:110:0)
[15:18:27.617] Build status: STARTED
[15:18:27.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:111:0) after 1m9s
[15:19:36.637] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:111:0)
[15:19:36.662] Build status: STARTED
[15:19:36.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:112:0) after 3m16s
[15:22:52.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:112:0)
[15:22:52.714] Build status: STARTED
[15:22:52.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:113:0) after 1m40s
[15:24:32.735] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:113:0)
[15:24:32.762] Build status: STARTED
[15:24:32.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:114:0) after 7m24s
[15:31:56.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:114:0)
[15:31:56.810] Build status: STARTED
[15:31:56.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:115:0) after 2m12s
[15:34:09.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:115:0)
[15:34:09.264] Build status: STARTED
[15:34:09.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:116:0) after 1m46s
[15:35:55.519] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:116:0)
[15:35:55.569] Build status: STARTED
[15:35:55.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:117:0) after 4m33s
[15:40:29.230] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:117:0)
[15:40:29.301] Build status: STARTED
[15:40:29.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:118:0) after 2m6s
[15:42:35.673] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:118:0)
[15:42:35.704] Build status: STARTED
[15:42:35.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8999847985384688576:119:0) after 5m41s
[15:46:52.718] Received PubSub notification, asking Buildbucket for the build status
[15:46:52.761] Build:
{
  "id": "8834417923373061681",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25598,
  "createdBy": "project:chromium",
  "createTime": "2021-10-03T05:39:08.288338563Z",
  "startTime": "2021-10-03T05:39:46.883932Z",
  "endTime": "2021-10-03T15:46:52.398905405Z",
  "updateTime": "2021-10-03T15:46:52.399390622Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "299979e88b4ac40882f6594f9aba29609d80349e",
      "ref": "refs/heads/main"
    }
  }
}
[15:46:52.761] Invocation finished in 10h7m45.775525865s with status FAILED