LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 9 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTMacASan"
>

Incoming triggers

88caf3b95eef1404951e8ae92ad7e0453a7bce71 (4 years ago)
293ba6ca816d837689596fb609c1eb2d647f415d (4 years ago)
325e359a0f7305a22b8837128a072acf64b16f5e (4 years ago)
f1d5e1510637c5f4a1edcb12b52e5007e3e5609e (4 years ago)
577de280bf9fffe4c7307f6f0215cd32aeeed13b (4 years ago)
8b200504934060c4cfeb2efc873632e3578ee80c (4 years ago)
c591d1170452c12368edecfd4af2eb699e20eb70 (4 years ago)
ad3aae7ba6147e172d4cb3db504c5c97ba5541b4 (4 years ago)
1671cb98699bda5cbd3c5a475d115b11d3a8ae24 (4 years ago)
3c0df65cdbc47ff4bc9b1d3f560f47a4a2405f55 (4 years ago)
0e434a7a8677e1673cd3fe87d5328dab1fad36df (4 years ago)
05e1dfeef38a23efa0a4f7207f6e2bbcb26312ea (4 years ago)
d8333668b11d44f13f7406065f5f97a4bb19dfe9 (4 years ago)
5ef3f9d5df5ffdab46fca2b60e3fabf3e4cd2217 (4 years ago)
c0b97b084be85a646cee2012aeee78b06b560096 (4 years ago)
37eb4c8f8276f2349a2fa197e1704cf86cc01da8 (4 years ago)
753a021675cdf7672438b55d9bdd1c1599d15a04 (4 years ago)
76a5995bae30ec21d194cfd01732c8ed7e726125 (4 years ago)
a6e56e5440a5dd48445cbd421404ebb968a096bb (4 years ago)
f09b10d1cd6ac2933d9ab3893711b617bb06a253 (4 years ago)
7cb1424fbc600760652cd669d2d0a98fe09d0f98 (4 years ago)
acac03779ccd95f1cfc3aa54c6bb7a42e4f820d2 (4 years ago)
9efa44d35fdca52985b9146d97a9614ba4722d16 (4 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "9efa44d35fdca52985b9146d97a9614ba4722d16"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9efa44d35fdca52985b9146d97a9614ba4722d16
gitiles_ref:refs/heads/main

Debug log (UTC)

[21:43:02.406] New invocation is queued and will start shortly
[21:43:03.672] Starting the invocation (attempt 1)
[21:43:03.705] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9efa44d35fdca52985b9146d97a9614ba4722d16"
[21:43:03.705] Popped gitiles commit info from properties and tags
[21:43:03.705] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:43:03.705] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:43:03.706] Buildbucket request:
{
  "requestId": "9003048831358257264",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "9efa44d35fdca52985b9146d97a9614ba4722d16",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9003048831358257264"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[21:43:04.364] Scheduled build:
{
  "id": "8837618769239151681",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25451,
  "createdBy": "project:chromium",
  "createTime": "2021-08-28T21:43:03.794064413Z",
  "updateTime": "2021-08-28T21:43:04.156573146Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "9efa44d35fdca52985b9146d97a9614ba4722d16",
      "ref": "refs/heads/main"
    }
  }
}
[21:43:04.364] Task URL: https://cr-buildbucket.appspot.com/build/8837618769239151681
[21:43:04.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:2:0) after 7m57s
[21:43:18.541] Received PubSub notification, asking Buildbucket for the build status
[21:43:18.570] Build status: STARTED
[21:51:01.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:2:0)
[21:51:01.502] Build status: STARTED
[21:51:01.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:4:0) after 9m50s
[22:00:51.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:4:0)
[22:00:51.584] Build status: STARTED
[22:00:51.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:5:0) after 2m48s
[22:03:39.632] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:5:0)
[22:03:39.673] Build status: STARTED
[22:03:39.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:6:0) after 2m13s
[22:05:52.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:6:0)
[22:05:52.719] Build status: STARTED
[22:05:52.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:7:0) after 9m57s
[22:15:50.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:7:0)
[22:15:50.241] Build status: STARTED
[22:15:50.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:8:0) after 5m27s
[22:21:17.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:8:0)
[22:21:17.294] Build status: STARTED
[22:21:17.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:9:0) after 3m0s
[22:24:17.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:9:0)
[22:24:17.345] Build status: STARTED
[22:24:17.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:10:0) after 7m3s
[22:31:20.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:10:0)
[22:31:20.923] Build status: STARTED
[22:31:20.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:11:0) after 7m14s
[22:38:34.940] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:11:0)
[22:38:34.967] Build status: STARTED
[22:38:34.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:12:0) after 2m21s
[22:40:55.985] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:12:0)
[22:40:56.026] Build status: STARTED
[22:40:56.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:13:0) after 1m1s
[22:41:57.147] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:13:0)
[22:41:57.179] Build status: STARTED
[22:41:57.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:14:0) after 8m7s
[22:50:04.405] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:14:0)
[22:50:04.433] Build status: STARTED
[22:50:04.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:15:0) after 5m30s
[22:55:34.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:15:0)
[22:55:35.009] Build status: STARTED
[22:55:35.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:16:0) after 5m13s
[23:00:48.063] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:16:0)
[23:00:48.100] Build status: STARTED
[23:00:48.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:17:0) after 9m52s
[23:10:40.494] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:17:0)
[23:10:40.526] Build status: STARTED
[23:10:40.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:18:0) after 8m32s
[23:19:13.242] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:18:0)
[23:19:13.281] Build status: STARTED
[23:19:13.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:19:0) after 3m8s
[23:22:21.275] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:19:0)
[23:22:21.359] Build status: STARTED
[23:22:21.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:20:0) after 8m47s
[23:31:08.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:20:0)
[23:31:08.623] Build status: STARTED
[23:31:08.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:21:0) after 8m34s
[23:39:43.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:21:0)
[23:39:43.039] Build status: STARTED
[23:39:43.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:22:0) after 9m36s
[23:49:19.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:22:0)
[23:49:19.120] Build status: STARTED
[23:49:19.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:23:0) after 2m30s
[23:51:49.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:23:0)
[23:51:49.192] Build status: STARTED
[23:51:49.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:24:0) after 8m57s
[00:00:46.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:24:0)
[00:00:46.849] Build status: STARTED
[00:00:46.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:25:0) after 3m4s
[00:03:51.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:25:0)
[00:03:51.239] Build status: STARTED
[00:03:51.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:26:0) after 9m1s
[00:12:52.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:26:0)
[00:12:52.684] Build status: STARTED
[00:12:52.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:27:0) after 7m13s
[00:20:05.788] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:27:0)
[00:20:05.817] Build status: STARTED
[00:20:05.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:28:0) after 9m0s
[00:29:05.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:28:0)
[00:29:06.001] Build status: STARTED
[00:29:06.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:29:0) after 4m30s
[00:33:36.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:29:0)
[00:33:36.080] Build status: STARTED
[00:33:36.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:30:0) after 6m31s
[00:40:07.426] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:30:0)
[00:40:07.477] Build status: STARTED
[00:40:07.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:31:0) after 1m42s
[00:41:51.237] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:31:0)
[00:41:51.268] Build status: STARTED
[00:41:51.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:32:0) after 4m48s
[00:46:39.491] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:32:0)
[00:46:39.521] Build status: STARTED
[00:46:39.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:33:0) after 1m50s
[00:48:29.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:33:0)
[00:48:29.572] Build status: STARTED
[00:48:29.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:34:0) after 8m40s
[00:57:09.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:34:0)
[00:57:09.622] Build status: STARTED
[00:57:09.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:35:0) after 6m53s
[01:04:02.648] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:35:0)
[01:04:02.679] Build status: STARTED
[01:04:02.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:36:0) after 5m58s
[01:10:00.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:36:0)
[01:10:00.828] Build status: STARTED
[01:10:00.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:37:0) after 3m22s
[01:13:22.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:37:0)
[01:13:22.907] Build status: STARTED
[01:13:22.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:38:0) after 7m32s
[01:20:55.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:38:0)
[01:20:55.093] Build status: STARTED
[01:20:55.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:39:0) after 1m5s
[01:22:00.130] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:39:0)
[01:22:00.156] Build status: STARTED
[01:22:00.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:40:0) after 4m59s
[01:26:59.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:40:0)
[01:26:59.210] Build status: STARTED
[01:26:59.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:41:0) after 4m9s
[01:31:08.368] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:41:0)
[01:31:08.400] Build status: STARTED
[01:31:08.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:42:0) after 4m1s
[01:35:09.487] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:42:0)
[01:35:09.531] Build status: STARTED
[01:35:09.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:43:0) after 5m42s
[01:40:51.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:43:0)
[01:40:51.919] Build status: STARTED
[01:40:51.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:44:0) after 8m44s
[01:49:36.149] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:44:0)
[01:49:36.188] Build status: STARTED
[01:49:36.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:45:0) after 7m3s
[01:56:39.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:45:0)
[01:56:39.783] Build status: STARTED
[01:56:39.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:46:0) after 9m9s
[02:05:48.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:46:0)
[02:05:48.959] Build status: STARTED
[02:05:48.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:47:0) after 7m38s
[02:13:27.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:47:0)
[02:13:27.201] Build status: STARTED
[02:13:27.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:48:0) after 5m23s
[02:18:50.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:48:0)
[02:18:50.347] Build status: STARTED
[02:18:50.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:49:0) after 8m8s
[02:26:58.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:49:0)
[02:26:58.411] Build status: STARTED
[02:26:58.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:50:0) after 4m28s
[02:31:26.435] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:50:0)
[02:31:26.462] Build status: STARTED
[02:31:26.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:51:0) after 2m9s
[02:33:35.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:51:0)
[02:33:35.527] Build status: STARTED
[02:33:35.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:52:0) after 9m59s
[02:43:34.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:52:0)
[02:43:34.572] Build status: STARTED
[02:43:34.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:53:0) after 1m41s
[02:45:15.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:53:0)
[02:45:15.793] Build status: STARTED
[02:45:15.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:54:0) after 8m20s
[02:53:35.817] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:54:0)
[02:53:35.884] Build status: STARTED
[02:53:35.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:55:0) after 1m23s
[02:54:58.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:55:0)
[02:54:58.945] Build status: STARTED
[02:54:58.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:56:0) after 9m1s
[03:04:00.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:56:0)
[03:04:00.633] Build status: STARTED
[03:04:00.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:57:0) after 7m42s
[03:11:42.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:57:0)
[03:11:42.637] Build status: STARTED
[03:11:42.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:58:0) after 7m40s
[03:19:22.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:58:0)
[03:19:22.731] Build status: STARTED
[03:19:22.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:59:0) after 6m1s
[03:25:24.135] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:59:0)
[03:25:24.167] Build status: STARTED
[03:25:24.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:60:0) after 4m35s
[03:29:59.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:60:0)
[03:29:59.217] Build status: STARTED
[03:29:59.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:61:0) after 3m51s
[03:33:50.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:61:0)
[03:33:50.575] Build status: STARTED
[03:33:50.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:62:0) after 9m3s
[03:42:53.895] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:62:0)
[03:42:53.926] Build status: STARTED
[03:42:53.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:63:0) after 5m28s
[03:48:21.949] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:63:0)
[03:48:21.984] Build status: STARTED
[03:48:21.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:64:0) after 1m6s
[03:49:28.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:64:0)
[03:49:28.044] Build status: STARTED
[03:49:28.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:65:0) after 1m14s
[03:50:42.117] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:65:0)
[03:50:42.182] Build status: STARTED
[03:50:42.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:66:0) after 9m32s
[04:00:14.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:66:0)
[04:00:14.350] Build status: STARTED
[04:00:14.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:67:0) after 3m10s
[04:03:24.372] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:67:0)
[04:03:24.401] Build status: STARTED
[04:03:24.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:68:0) after 9m19s
[04:12:43.860] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:68:0)
[04:12:43.897] Build status: STARTED
[04:12:43.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:69:0) after 5m56s
[04:18:40.075] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:69:0)
[04:18:40.114] Build status: STARTED
[04:18:40.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:70:0) after 1m27s
[04:20:07.269] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:70:0)
[04:20:07.302] Build status: STARTED
[04:20:07.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:71:0) after 4m13s
[04:24:20.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:71:0)
[04:24:20.712] Build status: STARTED
[04:24:20.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:72:0) after 5m26s
[04:29:47.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:72:0)
[04:29:47.789] Build status: STARTED
[04:29:47.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:73:0) after 3m33s
[04:33:21.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:73:0)
[04:33:21.413] Build status: STARTED
[04:33:21.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:74:0) after 8m56s
[04:42:17.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:74:0)
[04:42:17.705] Build status: STARTED
[04:42:17.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:75:0) after 1m41s
[04:43:58.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:75:0)
[04:43:58.772] Build status: STARTED
[04:43:58.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:76:0) after 2m25s
[04:46:23.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:76:0)
[04:46:23.855] Build status: STARTED
[04:46:23.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:77:0) after 7m38s
[04:54:01.838] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:77:0)
[04:54:01.868] Build status: STARTED
[04:54:01.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:78:0) after 3m19s
[04:57:20.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:78:0)
[04:57:21.006] Build status: STARTED
[04:57:21.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:79:0) after 5m40s
[05:03:01.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:79:0)
[05:03:01.063] Build status: STARTED
[05:03:01.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:80:0) after 6m30s
[05:09:31.086] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:80:0)
[05:09:31.114] Build status: STARTED
[05:09:31.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:81:0) after 8m30s
[05:18:01.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:81:0)
[05:18:01.205] Build status: STARTED
[05:18:01.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:82:0) after 1m12s
[05:19:13.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:82:0)
[05:19:13.354] Build status: STARTED
[05:19:13.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:83:0) after 7m6s
[05:26:19.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:83:0)
[05:26:19.364] Build status: STARTED
[05:26:19.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:84:0) after 1m53s
[05:28:12.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:84:0)
[05:28:12.654] Build status: STARTED
[05:28:12.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:85:0) after 8m26s
[05:36:38.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:85:0)
[05:36:38.702] Build status: STARTED
[05:36:38.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:86:0) after 9m36s
[05:46:15.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:86:0)
[05:46:15.407] Build status: STARTED
[05:46:15.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:87:0) after 6m47s
[05:53:02.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:87:0)
[05:53:02.580] Build status: STARTED
[05:53:02.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:88:0) after 2m44s
[05:55:46.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:88:0)
[05:55:46.685] Build status: STARTED
[05:55:46.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:89:0) after 9m45s
[06:05:31.721] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:89:0)
[06:05:31.763] Build status: STARTED
[06:05:31.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:90:0) after 4m50s
[06:10:21.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:90:0)
[06:10:21.819] Build status: STARTED
[06:10:21.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:91:0) after 6m27s
[06:16:48.872] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:91:0)
[06:16:48.984] Build status: STARTED
[06:16:48.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:92:0) after 8m8s
[06:24:58.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:92:0)
[06:24:58.196] Build status: STARTED
[06:24:58.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:93:0) after 6m18s
[06:31:16.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:93:0)
[06:31:16.380] Build status: STARTED
[06:31:16.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:94:0) after 3m38s
[06:34:54.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:94:0)
[06:34:54.427] Build status: STARTED
[06:34:54.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:95:0) after 1m54s
[06:36:48.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:95:0)
[06:36:48.715] Build status: STARTED
[06:36:48.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:96:0) after 1m36s
[06:38:24.849] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:96:0)
[06:38:24.878] Build status: STARTED
[06:38:24.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:97:0) after 2m42s
[06:41:06.916] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:97:0)
[06:41:06.961] Build status: STARTED
[06:41:06.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:98:0) after 2m33s
[06:43:39.997] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:98:0)
[06:43:40.025] Build status: STARTED
[06:43:40.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:99:0) after 1m54s
[06:45:34.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:99:0)
[06:45:34.504] Build status: STARTED
[06:45:34.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:100:0) after 2m7s
[06:47:41.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:100:0)
[06:47:41.807] Build status: STARTED
[06:47:41.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:101:0) after 9m58s
[06:57:39.831] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:101:0)
[06:57:39.870] Build status: STARTED
[06:57:39.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:102:0) after 5m35s
[07:03:15.161] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:102:0)
[07:03:15.193] Build status: STARTED
[07:03:15.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:103:0) after 3m0s
[07:06:15.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:103:0)
[07:06:15.529] Build status: STARTED
[07:06:15.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:104:0) after 8m16s
[07:14:32.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:104:0)
[07:14:32.811] Build status: STARTED
[07:14:32.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:105:0) after 7m20s
[07:21:52.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:105:0)
[07:21:52.859] Build status: STARTED
[07:21:52.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:106:0) after 3m17s
[07:25:10.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:106:0)
[07:25:10.160] Build status: STARTED
[07:25:10.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:107:0) after 7m44s
[07:32:54.180] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:107:0)
[07:32:54.208] Build status: STARTED
[07:32:54.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:108:0) after 6m12s
[07:39:06.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:108:0)
[07:39:06.317] Build status: STARTED
[07:39:06.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9003048831358257264:109:0) after 6m16s
[07:40:37.871] Received PubSub notification, asking Buildbucket for the build status
[07:40:37.907] Build:
{
  "id": "8837618769239151681",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25451,
  "createdBy": "project:chromium",
  "createTime": "2021-08-28T21:43:03.794064413Z",
  "startTime": "2021-08-28T21:43:17.848627Z",
  "endTime": "2021-08-29T07:40:37.572036846Z",
  "updateTime": "2021-08-29T07:40:37.572613800Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "9efa44d35fdca52985b9146d97a9614ba4722d16",
      "ref": "refs/heads/main"
    }
  }
}
[07:40:37.907] Invocation finished in 9h57m35.516440794s with status FAILED