LUCI Scheduler :: chromium :: ToTMac (dbg)

Status: FAILED

Triggered by: -

Duration: 11 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMac (dbg)"
>

Incoming triggers

326532f6c22322226bc65bca99d3abe0430d9ad4 (3 years ago)
ba891a840c7f6ace10f5ef21d5a531b03fc775ac (3 years ago)
4f8d7067836396713a647800f246d7c80bb8539e (3 years ago)
75e10e9e22ba6a687e897acbc15358817a862bbf (3 years ago)
0d2cfaf9b651e0b327467b80e864a0e2101661f9 (3 years ago)
df40e1a6c91cd43e96e77780164b8a4830e4aa66 (3 years ago)
e44e60c9c9c48d39393b41993324b1d4f0339c37 (3 years ago)
da95088c2128f22267f34da844cbd2f73f4cada0 (3 years ago)
620611ea082da10f8865efeb41a96231b987239a (3 years ago)
a8b872aa9fe9cdd6d5bed731fdaa9314bf6d37d3 (3 years ago)
d9079a3ad7523488196afda4c2b8cbb311bce6ad (3 years ago)
a46c2148af9c85e17354aa0853b3e0006505127f (3 years ago)
99f60fa2c2d54a4a8402eda3adba7518afa480c0 (3 years ago)
159bb3bf876292290584489da6aae0987daab19c (3 years ago)
bc1f8174aba198d7a76ccab5c88f6e85fdca778b (3 years ago)
b929570a2e8f9e10e19bc4dcc034d2e211481da9 (3 years ago)
c2c04bd05e0cf81151a544f55bf34ee65d5214f7 (3 years ago)
fa3147f86270e418ffafe040522af475499203e4 (3 years ago)
afb5704b271532a40659bdab03b56bc60aa2dc33 (3 years ago)
3d7ce071825fa9c923137f02a3c55a0e41a70aa8 (3 years ago)
98792a12c21c4cb8d34cbc2485679bfc752b5b28 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "98792a12c21c4cb8d34cbc2485679bfc752b5b28"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/98792a12c21c4cb8d34cbc2485679bfc752b5b28
gitiles_ref:refs/heads/main

Debug log (UTC)

[02:17:16.469] New invocation is queued and will start shortly
[02:17:17.573] Starting the invocation (attempt 1)
[02:17:17.619] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/98792a12c21c4cb8d34cbc2485679bfc752b5b28"
[02:17:17.619] Popped gitiles commit info from properties and tags
[02:17:17.619] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:17:17.620] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:17:17.620] Buildbucket request:
{
  "requestId": "8975127712370363408",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac (dbg)"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "98792a12c21c4cb8d34cbc2485679bfc752b5b28",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8975127712370363408"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMac (dbg)"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[02:17:18.126] Scheduled build:
{
  "id": "8809697650437566065",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac (dbg)"
  },
  "number": 28651,
  "createdBy": "project:chromium",
  "createTime": "2022-07-03T02:17:17.681655933Z",
  "updateTime": "2022-07-03T02:17:17.681655933Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "98792a12c21c4cb8d34cbc2485679bfc752b5b28",
      "ref": "refs/heads/main"
    }
  }
}
[02:17:18.126] Task URL: https://cr-buildbucket.appspot.com/build/8809697650437566065
[02:17:18.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:2:0) after 9m13s
[02:26:31.142] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:2:0)
[02:26:31.167] Build status: SCHEDULED
[02:26:31.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:3:0) after 3m13s
[02:29:44.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:3:0)
[02:29:44.202] Build status: SCHEDULED
[02:29:44.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:4:0) after 6m19s
[02:36:03.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:4:0)
[02:36:03.255] Build status: SCHEDULED
[02:36:03.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:5:0) after 5m42s
[02:41:45.271] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:5:0)
[02:41:45.293] Build status: SCHEDULED
[02:41:45.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:6:0) after 5m28s
[02:47:13.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:6:0)
[02:47:13.404] Build status: SCHEDULED
[02:47:13.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:7:0) after 3m33s
[02:50:46.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:7:0)
[02:50:46.505] Build status: SCHEDULED
[02:50:46.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:8:0) after 8m33s
[02:59:19.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:8:0)
[02:59:19.582] Build status: SCHEDULED
[02:59:19.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:9:0) after 3m37s
[03:02:56.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:9:0)
[03:02:56.631] Build status: SCHEDULED
[03:02:56.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:10:0) after 5m0s
[03:07:56.650] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:10:0)
[03:07:56.683] Build status: SCHEDULED
[03:07:56.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:11:0) after 3m58s
[03:11:54.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:11:0)
[03:11:54.784] Build status: SCHEDULED
[03:11:54.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:12:0) after 9m13s
[03:21:07.973] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:12:0)
[03:21:08.009] Build status: SCHEDULED
[03:21:08.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:13:0) after 6m49s
[03:27:57.116] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:13:0)
[03:27:57.154] Build status: SCHEDULED
[03:27:57.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:14:0) after 7m55s
[03:35:52.276] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:14:0)
[03:35:52.298] Build status: SCHEDULED
[03:35:52.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:15:0) after 2m55s
[03:38:47.317] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:15:0)
[03:38:47.344] Build status: SCHEDULED
[03:38:47.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:16:0) after 9m29s
[03:48:16.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:16:0)
[03:48:16.400] Build status: SCHEDULED
[03:48:16.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:17:0) after 1m55s
[03:50:11.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:17:0)
[03:50:11.534] Build status: SCHEDULED
[03:50:11.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:18:0) after 4m6s
[03:54:17.557] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:18:0)
[03:54:17.580] Build status: SCHEDULED
[03:54:17.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:19:0) after 1m43s
[03:56:00.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:19:0)
[03:56:00.609] Build status: SCHEDULED
[03:56:00.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:20:0) after 9m58s
[04:05:58.626] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:20:0)
[04:05:58.648] Build status: SCHEDULED
[04:05:58.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:21:0) after 4m53s
[04:10:51.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:21:0)
[04:10:51.709] Build status: SCHEDULED
[04:10:51.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:22:0) after 7m46s
[04:18:37.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:22:0)
[04:18:37.827] Build status: SCHEDULED
[04:18:37.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:23:0) after 6m3s
[04:24:40.847] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:23:0)
[04:24:40.886] Build status: SCHEDULED
[04:24:40.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:24:0) after 3m59s
[04:28:40.238] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:24:0)
[04:28:40.272] Build status: SCHEDULED
[04:28:40.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:25:0) after 9m33s
[04:38:13.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:25:0)
[04:38:13.327] Build status: SCHEDULED
[04:38:13.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:26:0) after 5m17s
[04:43:30.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:26:0)
[04:43:30.890] Build status: SCHEDULED
[04:43:30.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:27:0) after 9m34s
[04:53:05.184] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:27:0)
[04:53:05.217] Build status: SCHEDULED
[04:53:05.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:28:0) after 9m44s
[05:02:49.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:28:0)
[05:02:49.274] Build status: SCHEDULED
[05:02:49.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:29:0) after 6m16s
[05:05:50.483] Received PubSub notification, asking Buildbucket for the build status
[05:05:50.512] Build status: STARTED
[05:09:05.301] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:29:0)
[05:09:05.353] Build status: STARTED
[05:09:05.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:31:0) after 8m14s
[05:17:19.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:31:0)
[05:17:19.401] Build status: STARTED
[05:17:19.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:32:0) after 9m58s
[05:27:17.444] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:32:0)
[05:27:17.463] Build status: STARTED
[05:27:17.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:33:0) after 1m13s
[05:28:30.543] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:33:0)
[05:28:30.580] Build status: STARTED
[05:28:30.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:34:0) after 7m21s
[05:35:52.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:34:0)
[05:35:52.355] Build status: STARTED
[05:35:52.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:35:0) after 8m0s
[05:43:52.413] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:35:0)
[05:43:52.440] Build status: STARTED
[05:43:52.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:36:0) after 4m4s
[05:47:56.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:36:0)
[05:47:56.593] Build status: STARTED
[05:47:56.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:37:0) after 1m32s
[05:49:28.667] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:37:0)
[05:49:28.699] Build status: STARTED
[05:49:28.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:38:0) after 7m6s
[05:56:34.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:38:0)
[05:56:34.844] Build status: STARTED
[05:56:34.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:39:0) after 1m47s
[05:58:22.132] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:39:0)
[05:58:22.164] Build status: STARTED
[05:58:22.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:40:0) after 1m45s
[06:00:07.327] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:40:0)
[06:00:07.348] Build status: STARTED
[06:00:07.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:41:0) after 5m54s
[06:06:01.509] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:41:0)
[06:06:01.542] Build status: STARTED
[06:06:01.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:42:0) after 6m45s
[06:12:46.562] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:42:0)
[06:12:46.708] Build status: STARTED
[06:12:46.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:43:0) after 8m22s
[06:21:08.903] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:43:0)
[06:21:08.924] Build status: STARTED
[06:21:08.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:44:0) after 1m12s
[06:22:21.139] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:44:0)
[06:22:21.162] Build status: STARTED
[06:22:21.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:45:0) after 4m14s
[06:26:35.183] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:45:0)
[06:26:35.218] Build status: STARTED
[06:26:35.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:46:0) after 5m46s
[06:32:21.227] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:46:0)
[06:32:21.254] Build status: STARTED
[06:32:21.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:47:0) after 2m19s
[06:34:40.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:47:0)
[06:34:40.362] Build status: STARTED
[06:34:40.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:48:0) after 6m23s
[06:41:03.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:48:0)
[06:41:03.451] Build status: STARTED
[06:41:03.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:49:0) after 2m55s
[06:43:58.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:49:0)
[06:43:58.490] Build status: STARTED
[06:43:58.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:50:0) after 8m29s
[06:52:27.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:50:0)
[06:52:27.544] Build status: STARTED
[06:52:27.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:51:0) after 2m42s
[06:55:09.587] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:51:0)
[06:55:09.610] Build status: STARTED
[06:55:09.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:52:0) after 4m32s
[06:59:41.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:52:0)
[06:59:42.045] Build status: STARTED
[06:59:42.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:53:0) after 4m37s
[07:04:19.088] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:53:0)
[07:04:19.119] Build status: STARTED
[07:04:19.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:54:0) after 2m7s
[07:06:26.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:54:0)
[07:06:26.211] Build status: STARTED
[07:06:26.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:55:0) after 2m39s
[07:09:05.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:55:0)
[07:09:05.577] Build status: STARTED
[07:09:05.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:56:0) after 1m8s
[07:10:13.724] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:56:0)
[07:10:13.748] Build status: STARTED
[07:10:13.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:57:0) after 9m59s
[07:20:12.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:57:0)
[07:20:12.799] Build status: STARTED
[07:20:12.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:58:0) after 7m37s
[07:27:49.823] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:58:0)
[07:27:49.859] Build status: STARTED
[07:27:49.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:59:0) after 1m10s
[07:28:59.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:59:0)
[07:29:00.061] Build status: STARTED
[07:29:00.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:60:0) after 4m8s
[07:33:08.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:60:0)
[07:33:08.171] Build status: STARTED
[07:33:08.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:61:0) after 1m6s
[07:34:14.220] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:61:0)
[07:34:14.248] Build status: STARTED
[07:34:14.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:62:0) after 6m46s
[07:41:00.273] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:62:0)
[07:41:00.308] Build status: STARTED
[07:41:00.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:63:0) after 5m58s
[07:46:58.427] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:63:0)
[07:46:58.452] Build status: STARTED
[07:46:58.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:64:0) after 2m22s
[07:49:20.586] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:64:0)
[07:49:20.620] Build status: STARTED
[07:49:20.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:65:0) after 1m22s
[07:50:42.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:65:0)
[07:50:42.665] Build status: STARTED
[07:50:42.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:66:0) after 8m55s
[07:59:37.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:66:0)
[07:59:37.789] Build status: STARTED
[07:59:37.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:67:0) after 8m2s
[08:07:39.839] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:67:0)
[08:07:39.876] Build status: STARTED
[08:07:39.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:68:0) after 6m5s
[08:13:44.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:68:0)
[08:13:44.934] Build status: STARTED
[08:13:44.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:69:0) after 3m47s
[08:17:32.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:69:0)
[08:17:32.053] Build status: STARTED
[08:17:32.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:70:0) after 6m25s
[08:23:57.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:70:0)
[08:23:57.112] Build status: STARTED
[08:23:57.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:71:0) after 5m5s
[08:29:02.196] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:71:0)
[08:29:02.233] Build status: STARTED
[08:29:02.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:72:0) after 9m56s
[08:38:58.452] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:72:0)
[08:38:58.479] Build status: STARTED
[08:38:58.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:73:0) after 8m9s
[08:47:07.497] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:73:0)
[08:47:07.647] Build status: STARTED
[08:47:07.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:74:0) after 8m35s
[08:55:42.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:74:0)
[08:55:42.871] Build status: STARTED
[08:55:42.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:75:0) after 3m3s
[08:58:45.894] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:75:0)
[08:58:45.918] Build status: STARTED
[08:58:45.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:76:0) after 2m32s
[09:01:17.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:76:0)
[09:01:17.972] Build status: STARTED
[09:01:17.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:77:0) after 4m26s
[09:05:43.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:77:0)
[09:05:44.026] Build status: STARTED
[09:05:44.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:78:0) after 8m35s
[09:14:19.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:78:0)
[09:14:19.163] Build status: STARTED
[09:14:19.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:79:0) after 4m1s
[09:18:20.763] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:79:0)
[09:18:20.802] Build status: STARTED
[09:18:20.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:80:0) after 7m21s
[09:25:41.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:80:0)
[09:25:41.857] Build status: STARTED
[09:25:41.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:81:0) after 6m33s
[09:32:14.877] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:81:0)
[09:32:14.918] Build status: STARTED
[09:32:14.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:82:0) after 2m3s
[09:34:18.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:82:0)
[09:34:18.799] Build status: STARTED
[09:34:18.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:83:0) after 5m43s
[09:40:01.889] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:83:0)
[09:40:01.910] Build status: STARTED
[09:40:01.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:84:0) after 7m49s
[09:47:50.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:84:0)
[09:47:51.885] Build status: STARTED
[09:47:51.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:85:0) after 2m2s
[09:49:53.932] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:85:0)
[09:49:53.956] Build status: STARTED
[09:49:53.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:86:0) after 6m50s
[09:56:43.975] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:86:0)
[09:56:44.009] Build status: STARTED
[09:56:44.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:87:0) after 3m28s
[10:00:12.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:87:0)
[10:00:12.061] Build status: STARTED
[10:00:12.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:88:0) after 3m6s
[10:03:18.084] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:88:0)
[10:03:18.106] Build status: STARTED
[10:03:18.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:89:0) after 2m51s
[10:06:09.206] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:89:0)
[10:06:09.238] Build status: STARTED
[10:06:09.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:90:0) after 4m8s
[10:10:17.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:90:0)
[10:10:17.337] Build status: STARTED
[10:10:17.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:91:0) after 4m27s
[10:14:44.820] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:91:0)
[10:14:44.854] Build status: STARTED
[10:14:44.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:92:0) after 1m29s
[10:16:13.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:92:0)
[10:16:13.948] Build status: STARTED
[10:16:13.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:93:0) after 9m34s
[10:25:47.971] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:93:0)
[10:25:48.009] Build status: STARTED
[10:25:48.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:94:0) after 4m1s
[10:29:49.176] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:94:0)
[10:29:49.211] Build status: STARTED
[10:29:49.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:95:0) after 3m23s
[10:33:12.234] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:95:0)
[10:33:12.258] Build status: STARTED
[10:33:12.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:96:0) after 9m10s
[10:42:22.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:96:0)
[10:42:22.309] Build status: STARTED
[10:42:22.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:97:0) after 7m53s
[10:50:15.447] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:97:0)
[10:50:15.917] Build status: STARTED
[10:50:15.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:98:0) after 3m44s
[10:53:59.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:98:0)
[10:53:59.965] Build status: STARTED
[10:53:59.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:99:0) after 5m51s
[10:59:51.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:99:0)
[10:59:51.062] Build status: STARTED
[10:59:51.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:100:0) after 8m46s
[11:08:37.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:100:0)
[11:08:37.495] Build status: STARTED
[11:08:37.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:101:0) after 3m41s
[11:12:18.516] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:101:0)
[11:12:18.550] Build status: STARTED
[11:12:18.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:102:0) after 6m38s
[11:18:56.674] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:102:0)
[11:18:56.710] Build status: STARTED
[11:18:56.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:103:0) after 8m7s
[11:27:03.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:103:0)
[11:27:03.770] Build status: STARTED
[11:27:03.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:104:0) after 8m6s
[11:35:10.073] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:104:0)
[11:35:10.095] Build status: STARTED
[11:35:10.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:105:0) after 5m33s
[11:40:43.247] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:105:0)
[11:40:43.285] Build status: STARTED
[11:40:43.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:106:0) after 3m23s
[11:44:06.308] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:106:0)
[11:44:06.362] Build status: STARTED
[11:44:06.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:107:0) after 3m52s
[11:47:58.714] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:107:0)
[11:47:58.739] Build status: STARTED
[11:47:58.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:108:0) after 5m50s
[11:53:48.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:108:0)
[11:53:48.830] Build status: STARTED
[11:53:48.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:109:0) after 6m19s
[12:00:07.880] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:109:0)
[12:00:07.921] Build status: STARTED
[12:00:07.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:110:0) after 9m47s
[12:09:54.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:110:0)
[12:09:54.976] Build status: STARTED
[12:09:54.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:111:0) after 8m18s
[12:18:13.003] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:111:0)
[12:18:13.066] Build status: STARTED
[12:18:13.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:112:0) after 2m42s
[12:20:55.284] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:112:0)
[12:20:55.337] Build status: STARTED
[12:20:55.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:113:0) after 7m54s
[12:28:49.436] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:113:0)
[12:28:49.498] Build status: STARTED
[12:28:49.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:114:0) after 2m27s
[12:31:16.518] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:114:0)
[12:31:16.589] Build status: STARTED
[12:31:16.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:115:0) after 6m28s
[12:37:44.897] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:115:0)
[12:37:44.919] Build status: STARTED
[12:37:44.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:116:0) after 4m37s
[12:42:22.100] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:116:0)
[12:42:22.126] Build status: STARTED
[12:42:22.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:117:0) after 4m10s
[12:46:32.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:117:0)
[12:46:32.377] Build status: STARTED
[12:46:32.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:118:0) after 3m48s
[12:50:20.699] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:118:0)
[12:50:20.734] Build status: STARTED
[12:50:20.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:119:0) after 1m10s
[12:51:30.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:119:0)
[12:51:30.801] Build status: STARTED
[12:51:30.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:120:0) after 3m13s
[12:54:44.019] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:120:0)
[12:54:44.056] Build status: STARTED
[12:54:44.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:121:0) after 3m15s
[12:57:59.083] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:121:0)
[12:57:59.102] Build status: STARTED
[12:57:59.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:122:0) after 6m33s
[13:04:32.277] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:122:0)
[13:04:32.310] Build status: STARTED
[13:04:32.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:123:0) after 5m56s
[13:10:28.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:123:0)
[13:10:28.541] Build status: STARTED
[13:10:28.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:124:0) after 4m12s
[13:14:40.566] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:124:0)
[13:14:40.603] Build status: STARTED
[13:14:40.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:125:0) after 6m19s
[13:20:59.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:125:0)
[13:20:59.761] Build status: STARTED
[13:20:59.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:126:0) after 7m59s
[13:28:58.814] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:126:0)
[13:28:58.870] Build status: STARTED
[13:28:58.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:127:0) after 6m28s
[13:35:26.892] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:127:0)
[13:35:26.913] Build status: STARTED
[13:35:26.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:128:0) after 4m46s
[13:40:13.137] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:128:0)
[13:40:13.169] Build status: STARTED
[13:40:13.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:129:0) after 3m17s
[13:43:30.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:129:0)
[13:43:30.225] Build status: STARTED
[13:43:30.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:130:0) after 3m27s
[13:46:57.249] Handling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:130:0)
[13:46:57.306] Build status: STARTED
[13:46:57.306] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac (dbg):8975127712370363408:131:0) after 6m54s
[13:53:47.303] Received PubSub notification, asking Buildbucket for the build status
[13:53:47.333] Build:
{
  "id": "8809697650437566065",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac (dbg)"
  },
  "number": 28651,
  "createdBy": "project:chromium",
  "createTime": "2022-07-03T02:17:17.681655933Z",
  "startTime": "2022-07-03T05:05:49.930491Z",
  "endTime": "2022-07-03T13:53:47.003210089Z",
  "updateTime": "2022-07-03T13:53:47.003210089Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "98792a12c21c4cb8d34cbc2485679bfc752b5b28",
      "ref": "refs/heads/main"
    }
  }
}
[13:53:47.333] Invocation finished in 11h36m30.878330789s with status FAILED