LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 14 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacASan"
>

Incoming triggers

159bb3bf876292290584489da6aae0987daab19c (3 years ago)
bc1f8174aba198d7a76ccab5c88f6e85fdca778b (3 years ago)
b929570a2e8f9e10e19bc4dcc034d2e211481da9 (3 years ago)
c2c04bd05e0cf81151a544f55bf34ee65d5214f7 (3 years ago)
fa3147f86270e418ffafe040522af475499203e4 (3 years ago)
afb5704b271532a40659bdab03b56bc60aa2dc33 (3 years ago)
3d7ce071825fa9c923137f02a3c55a0e41a70aa8 (3 years ago)
98792a12c21c4cb8d34cbc2485679bfc752b5b28 (3 years ago)
4109ca19a5d598d743cec8354291071e68a4f094 (3 years ago)
b6ee387ac39ef4f55d224360c4a789ac651aa680 (3 years ago)
c46b58720052f3fc09741427d94eab4763aad38d (3 years ago)
21ba33ad62ef84e458a82d7a6ec78e3986c4a679 (3 years ago)
bc6102c201f986b0cd4671bcd9acdbdbb6c6c512 (3 years ago)
e553231a108b7cfa88ca61c967937274af266a82 (3 years ago)
d71236040f3b1092b317cc064cc58af0ecd2012f (3 years ago)
71f139b7b101e39f9b9a7342a7248c1f1389a014 (3 years ago)
20be17b1772d07dcad7914db3993ad13f1b7f8b8 (3 years ago)
d07d5af8a549ad2aa8799dca9c75fa26bf0399fb (3 years ago)
98c03f24882555ad9e63ee591ead733b6be53569 (3 years ago)
5367263f9010135ece714fd1343155d2dc0086c4 (3 years ago)
dfbcb728aff46e5d0c37555090c96f8d75a9e04e (3 years ago)
dbc1292c37a53b2593cfbd5a478be98ed0e20c27 (3 years ago)
2e78dc7dda2f516b8ef2bb25d0e9be6268a39523 (3 years ago)
1f552f776162d3d873af3b8c2c24646673a963a1 (3 years ago)
5315638f6310d1a4e105169449b0f5fbe842bb85 (3 years ago)
a7bc9619649051367f0cb5834f797d41e9a49473 (3 years ago)
d5a6f734dd793028eb90a9c5945e1df0a2af8f74 (3 years ago)
9f1e3231c0fdcd1ef15679217f6f2d3958426e58 (3 years ago)
a50162748d58fc58913bf6614943ddbe526e5317 (3 years ago)
696a7c1ddd442caf95981aeda83237d10a6c4b12 (3 years ago)
5f0737672e867401d1c400d6250ef1690bbd633d (3 years ago)
6e7c231d98609a50033c04a20976a09a921492ca (3 years ago)
66c216cda9b8b9bde763f7d0f940647feeebdf78 (3 years ago)
2496aa1c4ec1efe1655ee5870bb15a0dbc7b5c6a (3 years ago)
30cdac6d33385024911167f2fbb1c2957649f6d2 (3 years ago)
14ebfbc42a5360fc42b34dfaea4c5153f335f04a (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "14ebfbc42a5360fc42b34dfaea4c5153f335f04a"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/14ebfbc42a5360fc42b34dfaea4c5153f335f04a
gitiles_ref:refs/heads/main

Debug log (UTC)

[14:14:25.712] New invocation is queued and will start shortly
[14:14:26.828] Starting the invocation (attempt 1)
[14:14:26.873] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/14ebfbc42a5360fc42b34dfaea4c5153f335f04a"
[14:14:26.873] Popped gitiles commit info from properties and tags
[14:14:26.873] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:14:26.874] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:14:26.874] Buildbucket request:
{
  "requestId": "8975082592939030896",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "14ebfbc42a5360fc42b34dfaea4c5153f335f04a",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8975082592939030896"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[14:14:27.442] Scheduled build:
{
  "id": "8809652530943270065",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 27078,
  "createdBy": "project:chromium",
  "createTime": "2022-07-03T14:14:26.984502888Z",
  "updateTime": "2022-07-03T14:14:26.984502888Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "14ebfbc42a5360fc42b34dfaea4c5153f335f04a",
      "ref": "refs/heads/main"
    }
  }
}
[14:14:27.442] Task URL: https://cr-buildbucket.appspot.com/build/8809652530943270065
[14:14:27.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:2:0) after 3m53s
[14:18:20.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:2:0)
[14:18:20.544] Build status: SCHEDULED
[14:18:20.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:3:0) after 6m10s
[14:24:30.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:3:0)
[14:24:30.586] Build status: SCHEDULED
[14:24:30.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:4:0) after 9m33s
[14:34:03.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:4:0)
[14:34:03.632] Build status: SCHEDULED
[14:34:03.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:5:0) after 6m21s
[14:40:24.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:5:0)
[14:40:24.688] Build status: SCHEDULED
[14:40:24.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:6:0) after 6m58s
[14:47:22.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:6:0)
[14:47:22.725] Build status: SCHEDULED
[14:47:22.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:7:0) after 8m50s
[14:56:12.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:7:0)
[14:56:12.985] Build status: SCHEDULED
[14:56:12.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:8:0) after 5m53s
[15:02:06.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:8:0)
[15:02:06.045] Build status: SCHEDULED
[15:02:06.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:9:0) after 4m19s
[15:06:25.078] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:9:0)
[15:06:25.098] Build status: SCHEDULED
[15:06:25.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:10:0) after 4m10s
[15:10:35.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:10:0)
[15:10:35.171] Build status: SCHEDULED
[15:10:35.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:11:0) after 7m22s
[15:17:57.203] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:11:0)
[15:17:57.240] Build status: SCHEDULED
[15:17:57.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:12:0) after 7m23s
[15:25:20.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:12:0)
[15:25:20.275] Build status: SCHEDULED
[15:25:20.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:13:0) after 6m3s
[15:31:23.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:13:0)
[15:31:23.438] Build status: SCHEDULED
[15:31:23.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:14:0) after 3m9s
[15:34:32.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:14:0)
[15:34:32.590] Build status: SCHEDULED
[15:34:32.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:15:0) after 4m26s
[15:38:58.707] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:15:0)
[15:38:58.738] Build status: SCHEDULED
[15:38:58.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:16:0) after 3m24s
[15:42:22.923] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:16:0)
[15:42:22.963] Build status: SCHEDULED
[15:42:22.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:17:0) after 1m38s
[15:44:01.035] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:17:0)
[15:44:01.069] Build status: SCHEDULED
[15:44:01.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:18:0) after 4m52s
[15:48:53.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:18:0)
[15:48:53.111] Build status: SCHEDULED
[15:48:53.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:19:0) after 6m39s
[15:55:32.138] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:19:0)
[15:55:32.170] Build status: SCHEDULED
[15:55:32.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:20:0) after 8m27s
[16:03:59.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:20:0)
[16:03:59.255] Build status: SCHEDULED
[16:03:59.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:21:0) after 2m50s
[16:06:49.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:21:0)
[16:06:49.296] Build status: SCHEDULED
[16:06:49.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:22:0) after 9m34s
[16:16:23.320] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:22:0)
[16:16:23.350] Build status: SCHEDULED
[16:16:23.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:23:0) after 6m12s
[16:22:35.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:23:0)
[16:22:35.406] Build status: SCHEDULED
[16:22:35.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:24:0) after 8m48s
[16:31:23.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:24:0)
[16:31:23.462] Build status: SCHEDULED
[16:31:23.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:25:0) after 6m45s
[16:38:08.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:25:0)
[16:38:08.552] Build status: SCHEDULED
[16:38:08.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:26:0) after 6m25s
[16:44:34.068] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:26:0)
[16:44:34.098] Build status: SCHEDULED
[16:44:34.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:27:0) after 5m54s
[16:50:28.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:27:0)
[16:50:28.164] Build status: SCHEDULED
[16:50:28.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:28:0) after 6m41s
[16:52:10.471] Received PubSub notification, asking Buildbucket for the build status
[16:52:10.516] Build status: STARTED
[16:57:09.218] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:28:0)
[16:57:09.251] Build status: STARTED
[16:57:09.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:30:0) after 7m30s
[17:04:39.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:30:0)
[17:04:39.293] Build status: STARTED
[17:04:39.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:31:0) after 8m51s
[17:13:30.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:31:0)
[17:13:30.385] Build status: STARTED
[17:13:30.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:32:0) after 6m54s
[17:20:24.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:32:0)
[17:20:24.531] Build status: STARTED
[17:20:24.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:33:0) after 9m56s
[17:30:20.636] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:33:0)
[17:30:20.670] Build status: STARTED
[17:30:20.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:34:0) after 1m11s
[17:31:31.691] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:34:0)
[17:31:31.711] Build status: STARTED
[17:31:31.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:35:0) after 5m43s
[17:37:14.858] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:35:0)
[17:37:14.887] Build status: STARTED
[17:37:14.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:36:0) after 3m26s
[17:40:40.904] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:36:0)
[17:40:40.938] Build status: STARTED
[17:40:40.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:37:0) after 7m31s
[17:48:11.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:37:0)
[17:48:12.010] Build status: STARTED
[17:48:12.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:38:0) after 8m37s
[17:56:49.052] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:38:0)
[17:56:49.091] Build status: STARTED
[17:56:49.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:39:0) after 3m16s
[18:00:05.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:39:0)
[18:00:05.229] Build status: STARTED
[18:00:05.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:40:0) after 5m3s
[18:05:08.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:40:0)
[18:05:08.298] Build status: STARTED
[18:05:08.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:41:0) after 6m59s
[18:12:07.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:41:0)
[18:12:07.359] Build status: STARTED
[18:12:07.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:42:0) after 4m8s
[18:16:15.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:42:0)
[18:16:15.529] Build status: STARTED
[18:16:15.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:43:0) after 9m24s
[18:25:39.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:43:0)
[18:25:39.685] Build status: STARTED
[18:25:39.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:44:0) after 3m28s
[18:29:07.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:44:0)
[18:29:07.843] Build status: STARTED
[18:29:07.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:45:0) after 9m57s
[18:39:04.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:45:0)
[18:39:05.027] Build status: STARTED
[18:39:05.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:46:0) after 7m44s
[18:46:49.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:46:0)
[18:46:49.138] Build status: STARTED
[18:46:49.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:47:0) after 2m36s
[18:49:25.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:47:0)
[18:49:25.188] Build status: STARTED
[18:49:25.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:48:0) after 9m11s
[18:58:36.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:48:0)
[18:58:36.220] Build status: STARTED
[18:58:36.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:49:0) after 3m11s
[19:01:47.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:49:0)
[19:01:47.271] Build status: STARTED
[19:01:47.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:50:0) after 7m1s
[19:08:48.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:50:0)
[19:08:48.379] Build status: STARTED
[19:08:48.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:51:0) after 9m59s
[19:18:47.401] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:51:0)
[19:18:47.421] Build status: STARTED
[19:18:47.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:52:0) after 3m37s
[19:22:24.443] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:52:0)
[19:22:24.476] Build status: STARTED
[19:22:24.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:53:0) after 5m6s
[19:27:30.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:53:0)
[19:27:30.569] Build status: STARTED
[19:27:30.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:54:0) after 1m18s
[19:28:48.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:54:0)
[19:28:48.616] Build status: STARTED
[19:28:48.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:55:0) after 8m10s
[19:36:58.639] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:55:0)
[19:36:58.680] Build status: STARTED
[19:36:58.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:56:0) after 3m40s
[19:40:38.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:56:0)
[19:40:38.770] Build status: STARTED
[19:40:38.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:57:0) after 7m7s
[19:47:45.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:57:0)
[19:47:45.817] Build status: STARTED
[19:47:45.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:58:0) after 5m33s
[19:53:19.058] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:58:0)
[19:53:19.089] Build status: STARTED
[19:53:19.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:59:0) after 7m13s
[20:00:32.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:59:0)
[20:00:32.145] Build status: STARTED
[20:00:32.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:60:0) after 7m45s
[20:08:17.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:60:0)
[20:08:17.351] Build status: STARTED
[20:08:17.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:61:0) after 2m11s
[20:10:28.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:61:0)
[20:10:28.394] Build status: STARTED
[20:10:28.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:62:0) after 1m56s
[20:12:24.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:62:0)
[20:12:24.434] Build status: STARTED
[20:12:24.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:63:0) after 2m1s
[20:14:25.643] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:63:0)
[20:14:25.664] Build status: STARTED
[20:14:25.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:64:0) after 7m17s
[20:21:42.764] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:64:0)
[20:21:42.788] Build status: STARTED
[20:21:42.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:65:0) after 3m35s
[20:25:17.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:65:0)
[20:25:17.948] Build status: STARTED
[20:25:17.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:66:0) after 6m9s
[20:31:27.071] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:66:0)
[20:31:27.178] Build status: STARTED
[20:31:27.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:67:0) after 5m49s
[20:37:16.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:67:0)
[20:37:16.238] Build status: STARTED
[20:37:16.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:68:0) after 2m32s
[20:39:48.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:68:0)
[20:39:48.257] Build status: STARTED
[20:39:48.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:69:0) after 2m53s
[20:42:41.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:69:0)
[20:42:41.359] Build status: STARTED
[20:42:41.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:70:0) after 2m42s
[20:45:23.480] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:70:0)
[20:45:23.503] Build status: STARTED
[20:45:23.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:71:0) after 6m34s
[20:51:57.692] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:71:0)
[20:51:57.727] Build status: STARTED
[20:51:57.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:72:0) after 1m14s
[20:53:11.747] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:72:0)
[20:53:11.779] Build status: STARTED
[20:53:11.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:73:0) after 2m5s
[20:55:16.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:73:0)
[20:55:16.825] Build status: STARTED
[20:55:16.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:74:0) after 1m4s
[20:56:20.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:74:0)
[20:56:20.887] Build status: STARTED
[20:56:20.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:75:0) after 8m20s
[21:04:40.920] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:75:0)
[21:04:40.971] Build status: STARTED
[21:04:40.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:76:0) after 1m7s
[21:05:47.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:76:0)
[21:05:48.051] Build status: STARTED
[21:05:48.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:77:0) after 7m58s
[21:13:46.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:77:0)
[21:13:46.362] Build status: STARTED
[21:13:46.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:78:0) after 9m10s
[21:22:56.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:78:0)
[21:22:56.498] Build status: STARTED
[21:22:56.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:79:0) after 9m45s
[21:32:41.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:79:0)
[21:32:41.612] Build status: STARTED
[21:32:41.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:80:0) after 1m53s
[21:34:34.663] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:80:0)
[21:34:34.712] Build status: STARTED
[21:34:34.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:81:0) after 1m43s
[21:36:18.158] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:81:0)
[21:36:18.188] Build status: STARTED
[21:36:18.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:82:0) after 1m26s
[21:37:44.212] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:82:0)
[21:37:44.260] Build status: STARTED
[21:37:44.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:83:0) after 2m54s
[21:40:38.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:83:0)
[21:40:38.741] Build status: STARTED
[21:40:38.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:84:0) after 6m27s
[21:47:05.937] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:84:0)
[21:47:05.971] Build status: STARTED
[21:47:05.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:85:0) after 7m10s
[21:54:15.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:85:0)
[21:54:16.023] Build status: STARTED
[21:54:16.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:86:0) after 4m41s
[21:58:57.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:86:0)
[21:58:57.078] Build status: STARTED
[21:58:57.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:87:0) after 1m9s
[22:00:06.532] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:87:0)
[22:00:06.564] Build status: STARTED
[22:00:06.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:88:0) after 2m10s
[22:02:16.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:88:0)
[22:02:16.854] Build status: STARTED
[22:02:16.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:89:0) after 1m2s
[22:03:19.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:89:0)
[22:03:19.248] Build status: STARTED
[22:03:19.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:90:0) after 8m10s
[22:11:30.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:90:0)
[22:11:30.321] Build status: STARTED
[22:11:30.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:91:0) after 2m24s
[22:13:54.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:91:0)
[22:13:54.384] Build status: STARTED
[22:13:54.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:92:0) after 1m12s
[22:15:06.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:92:0)
[22:15:06.772] Build status: STARTED
[22:15:06.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:93:0) after 9m33s
[22:24:40.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:93:0)
[22:24:41.069] Build status: STARTED
[22:24:41.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:94:0) after 8m22s
[22:33:03.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:94:0)
[22:33:03.112] Build status: STARTED
[22:33:03.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:95:0) after 7m26s
[22:40:29.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:95:0)
[22:40:29.269] Build status: STARTED
[22:40:29.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:96:0) after 9m24s
[22:49:53.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:96:0)
[22:49:53.532] Build status: STARTED
[22:49:53.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:97:0) after 2m15s
[22:52:09.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:97:0)
[22:52:09.319] Build status: STARTED
[22:52:09.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:98:0) after 1m57s
[22:54:06.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:98:0)
[22:54:06.445] Build status: STARTED
[22:54:06.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:99:0) after 6m32s
[23:00:38.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:99:0)
[23:00:38.496] Build status: STARTED
[23:00:38.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:100:0) after 9m45s
[23:10:23.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:100:0)
[23:10:23.546] Build status: STARTED
[23:10:23.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:101:0) after 9m7s
[23:19:30.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:101:0)
[23:19:30.920] Build status: STARTED
[23:19:30.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:102:0) after 1m44s
[23:21:15.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:102:0)
[23:21:15.181] Build status: STARTED
[23:21:15.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:103:0) after 6m12s
[23:27:27.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:103:0)
[23:27:27.227] Build status: STARTED
[23:27:27.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:104:0) after 5m12s
[23:32:39.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:104:0)
[23:32:39.625] Build status: STARTED
[23:32:39.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:105:0) after 2m26s
[23:35:05.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:105:0)
[23:35:05.672] Build status: STARTED
[23:35:05.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:106:0) after 1m34s
[23:36:39.694] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:106:0)
[23:36:39.742] Build status: STARTED
[23:36:39.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:107:0) after 7m24s
[23:44:03.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:107:0)
[23:44:03.865] Build status: STARTED
[23:44:03.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:108:0) after 2m4s
[23:46:08.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:108:0)
[23:46:08.084] Build status: STARTED
[23:46:08.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:109:0) after 2m42s
[23:48:50.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:109:0)
[23:48:50.130] Build status: STARTED
[23:48:50.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:110:0) after 6m58s
[23:55:48.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:110:0)
[23:55:48.193] Build status: STARTED
[23:55:48.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:111:0) after 3m38s
[23:59:26.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:111:0)
[23:59:26.394] Build status: STARTED
[23:59:26.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:112:0) after 8m49s
[00:08:15.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:112:0)
[00:08:15.642] Build status: STARTED
[00:08:15.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:113:0) after 3m1s
[00:11:17.217] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:113:0)
[00:11:17.236] Build status: STARTED
[00:11:17.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:114:0) after 6m36s
[00:17:53.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:114:0)
[00:17:53.449] Build status: STARTED
[00:17:53.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:115:0) after 9m16s
[00:27:09.475] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:115:0)
[00:27:09.498] Build status: STARTED
[00:27:09.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:116:0) after 9m28s
[00:36:38.262] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:116:0)
[00:36:38.283] Build status: STARTED
[00:36:38.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:117:0) after 1m50s
[00:38:28.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:117:0)
[00:38:28.338] Build status: STARTED
[00:38:28.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:118:0) after 7m22s
[00:45:50.709] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:118:0)
[00:45:50.739] Build status: STARTED
[00:45:50.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:119:0) after 8m16s
[00:54:06.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:119:0)
[00:54:06.810] Build status: STARTED
[00:54:06.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:120:0) after 1m46s
[00:55:52.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:120:0)
[00:55:52.850] Build status: STARTED
[00:55:52.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:121:0) after 3m21s
[00:59:14.322] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:121:0)
[00:59:14.357] Build status: STARTED
[00:59:14.357] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:122:0) after 9m15s
[01:08:29.381] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:122:0)
[01:08:29.401] Build status: STARTED
[01:08:29.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:123:0) after 1m29s
[01:09:58.420] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:123:0)
[01:09:58.457] Build status: STARTED
[01:09:58.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:124:0) after 9m51s
[01:19:49.600] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:124:0)
[01:19:49.631] Build status: STARTED
[01:19:49.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:125:0) after 9m27s
[01:29:16.968] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:125:0)
[01:29:17.008] Build status: STARTED
[01:29:17.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:126:0) after 6m12s
[01:35:29.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:126:0)
[01:35:29.050] Build status: STARTED
[01:35:29.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:127:0) after 5m40s
[01:41:09.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:127:0)
[01:41:09.200] Build status: STARTED
[01:41:09.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:128:0) after 8m48s
[01:49:57.615] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:128:0)
[01:49:57.637] Build status: STARTED
[01:49:57.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:129:0) after 5m7s
[01:55:04.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:129:0)
[01:55:04.708] Build status: STARTED
[01:55:04.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:130:0) after 6m36s
[02:01:40.909] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:130:0)
[02:01:40.930] Build status: STARTED
[02:01:40.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:131:0) after 2m29s
[02:04:10.140] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:131:0)
[02:04:10.161] Build status: STARTED
[02:04:10.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:132:0) after 5m0s
[02:09:10.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:132:0)
[02:09:10.230] Build status: STARTED
[02:09:10.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:133:0) after 5m30s
[02:14:40.621] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:133:0)
[02:14:40.655] Build status: STARTED
[02:14:40.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:134:0) after 6m39s
[02:21:20.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:134:0)
[02:21:20.255] Build status: STARTED
[02:21:20.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:135:0) after 6m40s
[02:28:00.279] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:135:0)
[02:28:00.300] Build status: STARTED
[02:28:00.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:136:0) after 4m33s
[02:32:33.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:136:0)
[02:32:33.373] Build status: STARTED
[02:32:33.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:137:0) after 7m30s
[02:40:03.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:137:0)
[02:40:03.419] Build status: STARTED
[02:40:03.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:138:0) after 3m3s
[02:43:06.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:138:0)
[02:43:06.481] Build status: STARTED
[02:43:06.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:139:0) after 2m8s
[02:45:14.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:139:0)
[02:45:14.546] Build status: STARTED
[02:45:14.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:140:0) after 9m29s
[02:54:44.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:140:0)
[02:54:44.070] Build status: STARTED
[02:54:44.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:141:0) after 8m35s
[03:03:19.886] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:141:0)
[03:03:19.915] Build status: STARTED
[03:03:19.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:142:0) after 5m5s
[03:08:25.457] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:142:0)
[03:08:25.480] Build status: STARTED
[03:08:25.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:143:0) after 7m30s
[03:15:55.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:143:0)
[03:15:55.538] Build status: STARTED
[03:15:55.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:144:0) after 3m7s
[03:19:02.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:144:0)
[03:19:02.643] Build status: STARTED
[03:19:02.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:145:0) after 9m39s
[03:28:41.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:145:0)
[03:28:41.874] Build status: STARTED
[03:28:41.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:146:0) after 4m23s
[03:33:04.905] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:146:0)
[03:33:04.925] Build status: STARTED
[03:33:04.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:147:0) after 8m36s
[03:41:40.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:147:0)
[03:41:40.979] Build status: STARTED
[03:41:40.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:148:0) after 8m37s
[03:50:18.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:148:0)
[03:50:18.029] Build status: STARTED
[03:50:18.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:149:0) after 3m37s
[03:53:55.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:149:0)
[03:53:55.242] Build status: STARTED
[03:53:55.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:150:0) after 5m21s
[03:59:16.264] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:150:0)
[03:59:16.295] Build status: STARTED
[03:59:16.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:151:0) after 9m9s
[04:08:25.387] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:151:0)
[04:08:25.409] Build status: STARTED
[04:08:25.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:152:0) after 4m38s
[04:13:03.526] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:152:0)
[04:13:03.554] Build status: STARTED
[04:13:03.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:153:0) after 9m50s
[04:22:53.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:153:0)
[04:22:53.643] Build status: STARTED
[04:22:53.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:154:0) after 2m17s
[04:25:10.668] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:154:0)
[04:25:10.705] Build status: STARTED
[04:25:10.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:155:0) after 4m13s
[04:29:23.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:155:0)
[04:29:23.917] Build status: STARTED
[04:29:23.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:156:0) after 6m30s
[04:35:54.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:156:0)
[04:35:54.143] Build status: STARTED
[04:35:54.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8975082592939030896:157:0) after 6m47s
[04:41:45.656] Received PubSub notification, asking Buildbucket for the build status
[04:41:45.674] Build:
{
  "id": "8809652530943270065",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 27078,
  "createdBy": "project:chromium",
  "createTime": "2022-07-03T14:14:26.984502888Z",
  "startTime": "2022-07-03T16:52:06.971659Z",
  "endTime": "2022-07-04T04:41:45.273525770Z",
  "updateTime": "2022-07-04T04:41:45.273525770Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "14ebfbc42a5360fc42b34dfaea4c5153f335f04a",
      "ref": "refs/heads/main"
    }
  }
}
[04:41:45.674] Invocation finished in 14h27m19.976820808s with status FAILED