LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTMacASan"
>

Incoming triggers

b955a5cd72f551aa0c915171dad4ca3e96eaa1de (4 years ago)
dc9986e5c69b5bae26d157e51a94edd11b23936f (4 years ago)
3c2e93f77176a6dbf3c28614f00869e549b031d5 (4 years ago)
02bda3815aec9b1635bee761dd062950ddf4fe2f (4 years ago)
290ed05b7aa821cdcc8cd92d5453e1481a141298 (4 years ago)
e2b1fa3fcf7c23e662c7c328e2979666f8eb1dde (4 years ago)
851b78d9051f3a82112e32bfa2331d5020f231aa (4 years ago)
c781cf710792ab1d7f72a38163352eedb4029120 (4 years ago)
a135f48025c437e11555ab10a5a79e388cee03a4 (4 years ago)
4fb27f655d3c10e5c4f9636acc55f377112eb422 (4 years ago)
1ba8c13a33e0c9826286d5e5fa534ce7ec367f53 (4 years ago)
29702b8b93b0857cbb77d6193d2eb41f143613ab (4 years ago)
e6f6eddd03f09cf73cf98a4dd54533057972bfa1 (4 years ago)
7e7cd35b61c3a1b8af3ab1f00468074e761ce6ca (4 years ago)
8c4a2370612035574d7d8ad5887d75a6c05aad7d (4 years ago)
57c91cbea36ee8b98976bd1a1a2bb4da7277257c (4 years ago)
d5a836f185b985c2d199fbf3aa3a1734a07ce91a (4 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "d5a836f185b985c2d199fbf3aa3a1734a07ce91a"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d5a836f185b985c2d199fbf3aa3a1734a07ce91a
gitiles_ref:refs/heads/main

Debug log (UTC)

[05:29:29.133] New invocation is queued and will start shortly
[05:29:30.268] Starting the invocation (attempt 1)
[05:29:30.307] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d5a836f185b985c2d199fbf3aa3a1734a07ce91a"
[05:29:30.307] Popped gitiles commit info from properties and tags
[05:29:30.307] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:29:30.308] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:29:30.308] Buildbucket request:
{
  "requestId": "9004922021442854496",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "d5a836f185b985c2d199fbf3aa3a1734a07ce91a",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9004922021442854496"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[05:29:30.769] Scheduled build:
{
  "id": "8839491959478847953",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25363,
  "createdBy": "project:chromium",
  "createTime": "2021-08-08T05:29:30.373280842Z",
  "updateTime": "2021-08-08T05:29:30.622794663Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "d5a836f185b985c2d199fbf3aa3a1734a07ce91a",
      "ref": "refs/heads/main"
    }
  }
}
[05:29:30.769] Task URL: https://cr-buildbucket.appspot.com/build/8839491959478847953
[05:29:30.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:2:0) after 6m40s
[05:30:20.221] Received PubSub notification, asking Buildbucket for the build status
[05:30:20.246] Build status: STARTED
[05:36:10.796] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:2:0)
[05:36:10.821] Build status: STARTED
[05:36:10.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:4:0) after 3m38s
[05:39:49.488] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:4:0)
[05:39:49.518] Build status: STARTED
[05:39:49.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:5:0) after 6m56s
[05:46:45.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:5:0)
[05:46:45.730] Build status: STARTED
[05:46:45.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:6:0) after 5m14s
[05:51:59.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:6:0)
[05:51:59.780] Build status: STARTED
[05:51:59.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:7:0) after 6m45s
[05:58:44.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:7:0)
[05:58:44.974] Build status: STARTED
[05:58:44.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:8:0) after 6m45s
[06:05:30.077] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:8:0)
[06:05:30.119] Build status: STARTED
[06:05:30.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:9:0) after 2m1s
[06:07:31.181] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:9:0)
[06:07:31.215] Build status: STARTED
[06:07:31.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:10:0) after 1m7s
[06:08:38.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:10:0)
[06:08:38.661] Build status: STARTED
[06:08:38.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:11:0) after 9m35s
[06:18:13.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:11:0)
[06:18:13.881] Build status: STARTED
[06:18:13.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:12:0) after 8m47s
[06:27:01.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:12:0)
[06:27:01.067] Build status: STARTED
[06:27:01.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:13:0) after 5m42s
[06:32:43.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:13:0)
[06:32:43.112] Build status: STARTED
[06:32:43.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:14:0) after 1m17s
[06:34:00.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:14:0)
[06:34:00.159] Build status: STARTED
[06:34:00.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:15:0) after 6m41s
[06:40:41.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:15:0)
[06:40:41.548] Build status: STARTED
[06:40:41.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:16:0) after 5m50s
[06:46:31.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:16:0)
[06:46:31.614] Build status: STARTED
[06:46:31.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:17:0) after 5m53s
[06:52:24.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:17:0)
[06:52:24.976] Build status: STARTED
[06:52:24.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:18:0) after 1m16s
[06:53:40.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:18:0)
[06:53:41.035] Build status: STARTED
[06:53:41.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:19:0) after 2m58s
[06:56:39.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:19:0)
[06:56:39.352] Build status: STARTED
[06:56:39.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:20:0) after 4m19s
[07:00:58.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:20:0)
[07:00:58.606] Build status: STARTED
[07:00:58.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:21:0) after 6m26s
[07:07:24.628] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:21:0)
[07:07:24.654] Build status: STARTED
[07:07:24.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:22:0) after 6m45s
[07:14:09.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:22:0)
[07:14:09.853] Build status: STARTED
[07:14:09.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:23:0) after 7m58s
[07:22:08.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:23:0)
[07:22:08.162] Build status: STARTED
[07:22:08.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:24:0) after 1m46s
[07:23:54.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:24:0)
[07:23:54.233] Build status: STARTED
[07:23:54.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:25:0) after 6m9s
[07:30:03.524] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:25:0)
[07:30:03.555] Build status: STARTED
[07:30:03.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:26:0) after 4m56s
[07:34:59.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:26:0)
[07:34:59.682] Build status: STARTED
[07:34:59.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:27:0) after 2m49s
[07:37:48.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:27:0)
[07:37:48.960] Build status: STARTED
[07:37:48.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:28:0) after 8m2s
[07:45:50.991] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:28:0)
[07:45:51.019] Build status: STARTED
[07:45:51.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:29:0) after 9m8s
[07:54:59.059] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:29:0)
[07:54:59.087] Build status: STARTED
[07:54:59.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:30:0) after 6m59s
[08:01:58.104] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:30:0)
[08:01:58.156] Build status: STARTED
[08:01:58.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:31:0) after 4m12s
[08:06:10.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:31:0)
[08:06:10.462] Build status: STARTED
[08:06:10.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:32:0) after 8m32s
[08:14:42.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:32:0)
[08:14:42.614] Build status: STARTED
[08:14:42.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:33:0) after 7m18s
[08:22:00.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:33:0)
[08:22:00.862] Build status: STARTED
[08:22:00.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:34:0) after 4m11s
[08:26:11.885] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:34:0)
[08:26:11.910] Build status: STARTED
[08:26:11.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:35:0) after 5m48s
[08:31:59.928] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:35:0)
[08:31:59.957] Build status: STARTED
[08:31:59.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:36:0) after 4m53s
[08:36:52.982] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:36:0)
[08:36:53.008] Build status: STARTED
[08:36:53.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:37:0) after 9m12s
[08:46:05.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:37:0)
[08:46:05.205] Build status: STARTED
[08:46:05.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:38:0) after 7m56s
[08:54:01.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:38:0)
[08:54:01.322] Build status: STARTED
[08:54:01.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:39:0) after 9m52s
[09:03:53.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:39:0)
[09:03:53.381] Build status: STARTED
[09:03:53.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:40:0) after 2m49s
[09:06:42.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:40:0)
[09:06:42.572] Build status: STARTED
[09:06:42.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:41:0) after 7m58s
[09:14:40.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:41:0)
[09:14:40.674] Build status: STARTED
[09:14:40.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:42:0) after 5m39s
[09:20:19.693] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:42:0)
[09:20:19.719] Build status: STARTED
[09:20:19.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:43:0) after 3m27s
[09:23:46.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:43:0)
[09:23:46.783] Build status: STARTED
[09:23:46.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:44:0) after 1m47s
[09:25:33.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:44:0)
[09:25:33.860] Build status: STARTED
[09:25:33.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:45:0) after 1m54s
[09:27:27.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:45:0)
[09:27:27.906] Build status: STARTED
[09:27:27.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:46:0) after 1m25s
[09:28:52.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:46:0)
[09:28:52.950] Build status: STARTED
[09:28:52.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:47:0) after 2m32s
[09:31:25.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:47:0)
[09:31:25.297] Build status: STARTED
[09:31:25.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:48:0) after 8m26s
[09:39:51.425] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:48:0)
[09:39:51.454] Build status: STARTED
[09:39:51.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:49:0) after 5m35s
[09:45:26.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:49:0)
[09:45:26.633] Build status: STARTED
[09:45:26.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:50:0) after 4m12s
[09:49:38.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:50:0)
[09:49:38.682] Build status: STARTED
[09:49:38.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:51:0) after 8m27s
[09:58:05.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:51:0)
[09:58:05.752] Build status: STARTED
[09:58:05.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:52:0) after 4m30s
[10:02:35.952] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:52:0)
[10:02:35.983] Build status: STARTED
[10:02:35.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:53:0) after 6m26s
[10:09:02.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:53:0)
[10:09:02.694] Build status: STARTED
[10:09:02.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:54:0) after 5m16s
[10:14:18.753] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:54:0)
[10:14:18.785] Build status: STARTED
[10:14:18.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:55:0) after 9m0s
[10:23:18.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:55:0)
[10:23:18.929] Build status: STARTED
[10:23:18.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:56:0) after 1m14s
[10:24:33.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:56:0)
[10:24:33.198] Build status: STARTED
[10:24:33.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:57:0) after 5m40s
[10:30:13.219] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:57:0)
[10:30:13.251] Build status: STARTED
[10:30:13.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:58:0) after 9m41s
[10:39:54.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:58:0)
[10:39:54.308] Build status: STARTED
[10:39:54.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:59:0) after 7m48s
[10:47:43.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:59:0)
[10:47:43.187] Build status: STARTED
[10:47:43.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:60:0) after 7m12s
[10:54:55.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:60:0)
[10:54:55.234] Build status: STARTED
[10:54:55.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:61:0) after 2m27s
[10:57:22.252] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:61:0)
[10:57:22.286] Build status: STARTED
[10:57:22.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:62:0) after 8m33s
[11:05:55.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:62:0)
[11:05:55.472] Build status: STARTED
[11:05:55.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:63:0) after 9m7s
[11:15:02.502] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:63:0)
[11:15:02.532] Build status: STARTED
[11:15:02.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:64:0) after 3m7s
[11:18:09.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:64:0)
[11:18:09.629] Build status: STARTED
[11:18:09.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:65:0) after 9m35s
[11:27:44.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:65:0)
[11:27:44.758] Build status: STARTED
[11:27:44.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:66:0) after 7m22s
[11:35:07.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:66:0)
[11:35:07.586] Build status: STARTED
[11:35:07.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:67:0) after 4m48s
[11:39:55.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:67:0)
[11:39:55.731] Build status: STARTED
[11:39:55.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:68:0) after 6m28s
[11:46:23.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:68:0)
[11:46:23.924] Build status: STARTED
[11:46:23.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:69:0) after 1m51s
[11:48:14.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:69:0)
[11:48:14.993] Build status: STARTED
[11:48:14.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:70:0) after 1m49s
[11:50:04.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:70:0)
[11:50:04.494] Build status: STARTED
[11:50:04.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:71:0) after 7m45s
[11:57:49.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:71:0)
[11:57:49.542] Build status: STARTED
[11:57:49.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:72:0) after 5m25s
[12:03:14.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:72:0)
[12:03:14.724] Build status: STARTED
[12:03:14.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:73:0) after 1m14s
[12:04:28.850] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:73:0)
[12:04:28.880] Build status: STARTED
[12:04:28.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:74:0) after 9m37s
[12:14:05.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:74:0)
[12:14:05.911] Build status: STARTED
[12:14:05.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:75:0) after 4m53s
[12:18:59.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:75:0)
[12:18:59.042] Build status: STARTED
[12:18:59.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:76:0) after 1m2s
[12:20:01.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:76:0)
[12:20:01.135] Build status: STARTED
[12:20:01.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:77:0) after 4m0s
[12:24:01.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:77:0)
[12:24:01.193] Build status: STARTED
[12:24:01.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:78:0) after 6m13s
[12:30:14.215] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:78:0)
[12:30:14.246] Build status: STARTED
[12:30:14.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:79:0) after 2m35s
[12:32:49.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:79:0)
[12:32:49.304] Build status: STARTED
[12:32:49.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:80:0) after 2m58s
[12:35:47.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:80:0)
[12:35:47.351] Build status: STARTED
[12:35:47.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:81:0) after 4m20s
[12:40:07.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:81:0)
[12:40:07.422] Build status: STARTED
[12:40:07.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:82:0) after 1m13s
[12:41:20.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:82:0)
[12:41:20.478] Build status: STARTED
[12:41:20.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:83:0) after 5m7s
[12:46:27.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:83:0)
[12:46:27.734] Build status: STARTED
[12:46:27.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:84:0) after 8m56s
[12:55:23.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:84:0)
[12:55:23.870] Build status: STARTED
[12:55:23.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:85:0) after 9m51s
[13:05:14.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:85:0)
[13:05:14.921] Build status: STARTED
[13:05:14.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:86:0) after 9m15s
[13:14:29.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:86:0)
[13:14:30.004] Build status: STARTED
[13:14:30.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:87:0) after 3m26s
[13:17:56.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:87:0)
[13:17:56.070] Build status: STARTED
[13:17:56.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:88:0) after 2m21s
[13:20:17.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:88:0)
[13:20:17.321] Build status: STARTED
[13:20:17.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:89:0) after 5m18s
[13:25:35.384] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:89:0)
[13:25:35.441] Build status: STARTED
[13:25:35.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:90:0) after 4m30s
[13:30:05.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:90:0)
[13:30:05.499] Build status: STARTED
[13:30:05.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:91:0) after 3m11s
[13:33:16.527] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:91:0)
[13:33:16.557] Build status: STARTED
[13:33:16.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:92:0) after 1m58s
[13:35:14.576] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:92:0)
[13:35:14.603] Build status: STARTED
[13:35:14.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:93:0) after 9m51s
[13:45:05.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:93:0)
[13:45:05.659] Build status: STARTED
[13:45:05.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:94:0) after 9m16s
[13:54:21.681] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:94:0)
[13:54:21.711] Build status: STARTED
[13:54:21.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:95:0) after 8m16s
[14:02:37.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:95:0)
[14:02:37.778] Build status: STARTED
[14:02:37.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:96:0) after 2m4s
[14:04:41.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:96:0)
[14:04:41.833] Build status: STARTED
[14:04:41.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:97:0) after 5m6s
[14:09:47.856] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:97:0)
[14:09:47.886] Build status: STARTED
[14:09:47.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:98:0) after 9m7s
[14:18:54.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:98:0)
[14:18:54.937] Build status: STARTED
[14:18:54.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:99:0) after 3m45s
[14:22:39.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:99:0)
[14:22:39.992] Build status: STARTED
[14:22:39.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:100:0) after 2m32s
[14:25:12.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:100:0)
[14:25:12.061] Build status: STARTED
[14:25:12.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:101:0) after 9m24s
[14:34:36.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:101:0)
[14:34:36.296] Build status: STARTED
[14:34:36.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:102:0) after 4m45s
[14:39:21.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:102:0)
[14:39:21.627] Build status: STARTED
[14:39:21.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:103:0) after 1m45s
[14:41:07.179] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:103:0)
[14:41:07.219] Build status: STARTED
[14:41:07.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:104:0) after 4m3s
[14:45:10.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:104:0)
[14:45:10.277] Build status: STARTED
[14:45:10.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:105:0) after 6m34s
[14:51:44.666] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:105:0)
[14:51:44.696] Build status: STARTED
[14:51:44.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:106:0) after 1m59s
[14:53:43.989] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:106:0)
[14:53:44.035] Build status: STARTED
[14:53:44.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:107:0) after 6m31s
[15:00:15.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:107:0)
[15:00:15.269] Build status: STARTED
[15:00:15.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:108:0) after 1m51s
[15:02:06.297] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:108:0)
[15:02:06.379] Build status: STARTED
[15:02:06.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:109:0) after 2m25s
[15:04:31.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:109:0)
[15:04:31.430] Build status: STARTED
[15:04:31.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:110:0) after 5m47s
[15:10:18.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:110:0)
[15:10:18.512] Build status: STARTED
[15:10:18.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:111:0) after 1m3s
[15:11:21.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:111:0)
[15:11:21.567] Build status: STARTED
[15:11:21.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:112:0) after 5m47s
[15:17:08.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:112:0)
[15:17:08.623] Build status: STARTED
[15:17:08.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:113:0) after 2m45s
[15:19:53.722] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:113:0)
[15:19:53.764] Build status: STARTED
[15:19:53.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:114:0) after 4m34s
[15:24:28.026] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:114:0)
[15:24:28.068] Build status: STARTED
[15:24:28.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:115:0) after 8m21s
[15:32:49.395] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:115:0)
[15:32:49.493] Build status: STARTED
[15:32:49.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9004922021442854496:116:0) after 6m4s
[15:32:56.528] Received PubSub notification, asking Buildbucket for the build status
[15:32:56.554] Build:
{
  "id": "8839491959478847953",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25363,
  "createdBy": "project:chromium",
  "createTime": "2021-08-08T05:29:30.373280842Z",
  "startTime": "2021-08-08T05:30:19.431062Z",
  "endTime": "2021-08-08T15:32:56.063091498Z",
  "updateTime": "2021-08-08T15:32:56.063769296Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "d5a836f185b985c2d199fbf3aa3a1734a07ce91a",
      "ref": "refs/heads/main"
    }
  }
}
[15:32:56.554] Invocation finished in 10h3m27.437453524s with status FAILED