LUCI Scheduler :: chromium :: ToTMac

Status: FAILED

Triggered by: -

Duration: 12 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMac"
>

Incoming triggers

1976c81461a110749b0198e13086b126d180e8fb (3 years ago)
76a526fece47c2a02ad72e3858d544e5c4573370 (3 years ago)
31cc072c1b8d9a00d2561b51b62fd205f5a165aa (3 years ago)
8908447e319ba5fa4ee7ee6e005db602566fedd7 (3 years ago)
ae4407f53e5ea8d615cd86fce9176573560412b8 (3 years ago)
7496f848b8951f74973007f085709946926cad09 (3 years ago)
63213277c07d741de65afe00d021640e0e5c560e (3 years ago)
6aa13a42aa41dbe10cc297e39128e74b8dd52257 (3 years ago)
7119a40af3d60c621f2d3ef2f6f0265e7370f961 (3 years ago)
796a44a7f546bd41c61e8c0aafded2eebc17a352 (3 years ago)
97767aede017024cefae4c28e2894d8de4605303 (3 years ago)
ab41dad25c1f9b39c6d848f1be41ba01a8664fff (3 years ago)
1710a82f45a25b4f5615079138c34d2e50529beb (3 years ago)
b886ec59380f374ecb047980c6bd126190eb8afd (3 years ago)
d6532b93bd35db44d5ce3a6552b66fd57089981d (3 years ago)
d7e37cbd179fae51f8d7e6c0bbc5fcd8d366b83d (3 years ago)
f4d9f8cf88450f2e3bd72d77873fbcb61e743647 (3 years ago)
f7ff2c1cc7c2dbfbb52929b01edb657142c57a79 (3 years ago)
dcc5bf9ad213def864b2e0b154615e3182d69ab6 (3 years ago)
664df7ac214af2f88a6ee61cc0820de2c018db0e (3 years ago)
990640740bbdecd1b4a7ba58612f72d43866b1aa (3 years ago)
d35c44f0f4f3001bed8101281538002a28dccabd (3 years ago)
f5f88eae43975ec5a95be3047164079b1082a9b9 (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "f5f88eae43975ec5a95be3047164079b1082a9b9"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f5f88eae43975ec5a95be3047164079b1082a9b9
gitiles_ref:refs/heads/main

Debug log (UTC)

[21:21:51.304] New invocation is queued and will start shortly
[21:21:52.450] Starting the invocation (attempt 1)
[21:21:52.487] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f5f88eae43975ec5a95be3047164079b1082a9b9"
[21:21:52.487] Popped gitiles commit info from properties and tags
[21:21:52.487] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:21:52.487] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:21:52.487] Buildbucket request:
{
  "requestId": "8976958237882204992",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "f5f88eae43975ec5a95be3047164079b1082a9b9",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8976958237882204992"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMac"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[21:21:53.132] Scheduled build:
{
  "id": "8811528175899094321",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "number": 27924,
  "createdBy": "project:chromium",
  "createTime": "2022-06-12T21:21:52.563426454Z",
  "updateTime": "2022-06-12T21:21:52.563426454Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "f5f88eae43975ec5a95be3047164079b1082a9b9",
      "ref": "refs/heads/main"
    }
  }
}
[21:21:53.132] Task URL: https://cr-buildbucket.appspot.com/build/8811528175899094321
[21:21:53.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:2:0) after 7m46s
[21:29:39.350] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:2:0)
[21:29:39.382] Build status: SCHEDULED
[21:29:39.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:3:0) after 5m34s
[21:35:13.402] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:3:0)
[21:35:13.433] Build status: SCHEDULED
[21:35:13.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:4:0) after 4m41s
[21:39:54.619] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:4:0)
[21:39:54.651] Build status: SCHEDULED
[21:39:54.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:5:0) after 7m59s
[21:47:53.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:5:0)
[21:47:53.991] Build status: SCHEDULED
[21:47:53.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:6:0) after 5m30s
[21:53:24.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:6:0)
[21:53:24.231] Build status: SCHEDULED
[21:53:24.231] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:7:0) after 3m49s
[21:57:13.257] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:7:0)
[21:57:13.280] Build status: SCHEDULED
[21:57:13.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:8:0) after 5m26s
[22:02:24.146] Received PubSub notification, asking Buildbucket for the build status
[22:02:24.180] Build status: STARTED
[22:02:39.505] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:8:0)
[22:02:39.543] Build status: STARTED
[22:02:39.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:10:0) after 8m16s
[22:10:55.834] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:10:0)
[22:10:55.866] Build status: STARTED
[22:10:55.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:11:0) after 7m55s
[22:18:50.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:11:0)
[22:18:50.998] Build status: STARTED
[22:18:50.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:12:0) after 7m12s
[22:26:03.017] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:12:0)
[22:26:03.037] Build status: STARTED
[22:26:03.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:13:0) after 2m35s
[22:28:38.998] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:13:0)
[22:28:39.015] Build status: STARTED
[22:28:39.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:14:0) after 9m53s
[22:38:32.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:14:0)
[22:38:32.066] Build status: STARTED
[22:38:32.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:15:0) after 5m16s
[22:43:48.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:15:0)
[22:43:48.124] Build status: STARTED
[22:43:48.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:16:0) after 2m58s
[22:46:46.143] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:16:0)
[22:46:46.179] Build status: STARTED
[22:46:46.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:17:0) after 6m34s
[22:53:20.696] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:17:0)
[22:53:20.727] Build status: STARTED
[22:53:20.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:18:0) after 9m39s
[23:02:59.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:18:0)
[23:02:59.774] Build status: STARTED
[23:02:59.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:19:0) after 8m24s
[23:11:23.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:19:0)
[23:11:23.868] Build status: STARTED
[23:11:23.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:20:0) after 3m40s
[23:15:04.225] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:20:0)
[23:15:04.249] Build status: STARTED
[23:15:04.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:21:0) after 5m29s
[23:20:33.627] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:21:0)
[23:20:33.647] Build status: STARTED
[23:20:33.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:22:0) after 3m9s
[23:23:42.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:22:0)
[23:23:42.697] Build status: STARTED
[23:23:42.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:23:0) after 5m31s
[23:29:13.813] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:23:0)
[23:29:13.834] Build status: STARTED
[23:29:13.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:24:0) after 7m55s
[23:37:08.965] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:24:0)
[23:37:08.989] Build status: STARTED
[23:37:08.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:25:0) after 4m28s
[23:41:37.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:25:0)
[23:41:37.031] Build status: STARTED
[23:41:37.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:26:0) after 7m35s
[23:49:12.500] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:26:0)
[23:49:12.570] Build status: STARTED
[23:49:12.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:27:0) after 5m54s
[23:55:06.670] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:27:0)
[23:55:06.693] Build status: STARTED
[23:55:06.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:28:0) after 5m53s
[00:00:59.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:28:0)
[00:00:59.765] Build status: STARTED
[00:00:59.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:29:0) after 4m53s
[00:05:52.784] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:29:0)
[00:05:52.818] Build status: STARTED
[00:05:52.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:30:0) after 5m24s
[00:11:16.836] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:30:0)
[00:11:16.877] Build status: STARTED
[00:11:16.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:31:0) after 3m47s
[00:15:03.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:31:0)
[00:15:03.932] Build status: STARTED
[00:15:03.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:32:0) after 9m58s
[00:25:01.951] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:32:0)
[00:25:01.989] Build status: STARTED
[00:25:01.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:33:0) after 3m21s
[00:28:23.007] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:33:0)
[00:28:23.029] Build status: STARTED
[00:28:23.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:34:0) after 4m17s
[00:32:40.398] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:34:0)
[00:32:40.423] Build status: STARTED
[00:32:40.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:35:0) after 7m21s
[00:40:01.506] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:35:0)
[00:40:01.527] Build status: STARTED
[00:40:01.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:36:0) after 6m10s
[00:46:11.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:36:0)
[00:46:11.722] Build status: STARTED
[00:46:11.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:37:0) after 8m19s
[00:54:30.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:37:0)
[00:54:30.777] Build status: STARTED
[00:54:30.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:38:0) after 4m41s
[00:59:11.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:38:0)
[00:59:11.901] Build status: STARTED
[00:59:11.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:39:0) after 3m0s
[01:02:11.924] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:39:0)
[01:02:11.950] Build status: STARTED
[01:02:11.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:40:0) after 3m18s
[01:05:29.994] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:40:0)
[01:05:30.019] Build status: STARTED
[01:05:30.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:41:0) after 1m24s
[01:06:54.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:41:0)
[01:06:54.196] Build status: STARTED
[01:06:54.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:42:0) after 9m17s
[01:16:11.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:42:0)
[01:16:11.593] Build status: STARTED
[01:16:11.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:43:0) after 4m59s
[01:21:10.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:43:0)
[01:21:10.631] Build status: STARTED
[01:21:10.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:44:0) after 3m33s
[01:24:43.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:44:0)
[01:24:43.799] Build status: STARTED
[01:24:43.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:45:0) after 1m1s
[01:25:44.943] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:45:0)
[01:25:44.963] Build status: STARTED
[01:25:44.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:46:0) after 5m53s
[01:31:37.983] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:46:0)
[01:31:38.010] Build status: STARTED
[01:31:38.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:47:0) after 5m31s
[01:37:09.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:47:0)
[01:37:09.024] Build status: STARTED
[01:37:09.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:48:0) after 2m19s
[01:39:28.053] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:48:0)
[01:39:28.079] Build status: STARTED
[01:39:28.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:49:0) after 7m48s
[01:47:16.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:49:0)
[01:47:16.116] Build status: STARTED
[01:47:16.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:50:0) after 7m50s
[01:55:06.126] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:50:0)
[01:55:06.158] Build status: STARTED
[01:55:06.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:51:0) after 1m47s
[01:56:53.175] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:51:0)
[01:56:53.200] Build status: STARTED
[01:56:53.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:52:0) after 4m32s
[02:01:25.305] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:52:0)
[02:01:25.346] Build status: STARTED
[02:01:25.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:53:0) after 4m29s
[02:05:54.558] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:53:0)
[02:05:54.584] Build status: STARTED
[02:05:54.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:54:0) after 6m39s
[02:12:33.748] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:54:0)
[02:12:33.770] Build status: STARTED
[02:12:33.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:55:0) after 8m15s
[02:20:48.990] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:55:0)
[02:20:49.023] Build status: STARTED
[02:20:49.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:56:0) after 1m51s
[02:22:40.106] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:56:0)
[02:22:40.182] Build status: STARTED
[02:22:40.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:57:0) after 1m30s
[02:24:10.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:57:0)
[02:24:10.237] Build status: STARTED
[02:24:10.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:58:0) after 3m10s
[02:27:20.223] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:58:0)
[02:27:20.247] Build status: STARTED
[02:27:20.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:59:0) after 3m34s
[02:30:54.325] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:59:0)
[02:30:54.367] Build status: STARTED
[02:30:54.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:60:0) after 9m43s
[02:40:37.388] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:60:0)
[02:40:37.419] Build status: STARTED
[02:40:37.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:61:0) after 6m14s
[02:46:51.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:61:0)
[02:46:51.538] Build status: STARTED
[02:46:51.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:62:0) after 2m30s
[02:49:21.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:62:0)
[02:49:21.777] Build status: STARTED
[02:49:21.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:63:0) after 8m52s
[02:58:13.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:63:0)
[02:58:13.838] Build status: STARTED
[02:58:13.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:64:0) after 1m37s
[02:59:50.859] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:64:0)
[02:59:50.879] Build status: STARTED
[02:59:50.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:65:0) after 1m36s
[03:01:26.900] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:65:0)
[03:01:26.924] Build status: STARTED
[03:01:26.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:66:0) after 3m41s
[03:05:07.948] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:66:0)
[03:05:07.980] Build status: STARTED
[03:05:07.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:67:0) after 7m45s
[03:12:53.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:67:0)
[03:12:53.398] Build status: STARTED
[03:12:53.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:68:0) after 9m4s
[03:21:57.416] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:68:0)
[03:21:57.440] Build status: STARTED
[03:21:57.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:69:0) after 7m16s
[03:29:13.484] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:69:0)
[03:29:13.518] Build status: STARTED
[03:29:13.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:70:0) after 6m42s
[03:35:55.841] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:70:0)
[03:35:55.862] Build status: STARTED
[03:35:55.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:71:0) after 6m59s
[03:42:54.884] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:71:0)
[03:42:54.947] Build status: STARTED
[03:42:54.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:72:0) after 7m27s
[03:50:21.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:72:0)
[03:50:22.018] Build status: STARTED
[03:50:22.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:73:0) after 6m9s
[03:56:31.080] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:73:0)
[03:56:31.100] Build status: STARTED
[03:56:31.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:74:0) after 1m2s
[03:57:33.129] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:74:0)
[03:57:33.152] Build status: STARTED
[03:57:33.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:75:0) after 1m48s
[03:59:21.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:75:0)
[03:59:21.507] Build status: STARTED
[03:59:21.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:76:0) after 8m14s
[04:07:35.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:76:0)
[04:07:35.692] Build status: STARTED
[04:07:35.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:77:0) after 1m11s
[04:08:46.812] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:77:0)
[04:08:46.850] Build status: STARTED
[04:08:46.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:78:0) after 3m43s
[04:12:29.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:78:0)
[04:12:29.933] Build status: STARTED
[04:12:29.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:79:0) after 2m55s
[04:15:24.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:79:0)
[04:15:24.976] Build status: STARTED
[04:15:24.977] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:80:0) after 1m0s
[04:16:24.957] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:80:0)
[04:16:24.979] Build status: STARTED
[04:16:24.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:81:0) after 8m29s
[04:24:53.999] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:81:0)
[04:24:54.021] Build status: STARTED
[04:24:54.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:82:0) after 3m23s
[04:28:17.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:82:0)
[04:28:17.275] Build status: STARTED
[04:28:17.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:83:0) after 5m12s
[04:33:29.348] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:83:0)
[04:33:29.371] Build status: STARTED
[04:33:29.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:84:0) after 1m38s
[04:35:08.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:84:0)
[04:35:08.199] Build status: STARTED
[04:35:08.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:85:0) after 7m58s
[04:43:06.390] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:85:0)
[04:43:06.413] Build status: STARTED
[04:43:06.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:86:0) after 3m26s
[04:46:32.593] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:86:0)
[04:46:32.613] Build status: STARTED
[04:46:32.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:87:0) after 5m31s
[04:52:03.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:87:0)
[04:52:03.697] Build status: STARTED
[04:52:03.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:88:0) after 6m39s
[04:58:42.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:88:0)
[04:58:42.719] Build status: STARTED
[04:58:42.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:89:0) after 8m5s
[05:06:47.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:89:0)
[05:06:47.772] Build status: STARTED
[05:06:47.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:90:0) after 7m34s
[05:14:21.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:90:0)
[05:14:21.823] Build status: STARTED
[05:14:21.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:91:0) after 2m31s
[05:16:52.844] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:91:0)
[05:16:52.865] Build status: STARTED
[05:16:52.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:92:0) after 3m2s
[05:19:54.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:92:0)
[05:19:54.953] Build status: STARTED
[05:19:54.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:93:0) after 4m14s
[05:24:09.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:93:0)
[05:24:09.151] Build status: STARTED
[05:24:09.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:94:0) after 1m6s
[05:25:15.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:94:0)
[05:25:15.675] Build status: STARTED
[05:25:15.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:95:0) after 7m27s
[05:32:43.826] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:95:0)
[05:32:43.846] Build status: STARTED
[05:32:43.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:96:0) after 5m22s
[05:38:05.867] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:96:0)
[05:38:05.887] Build status: STARTED
[05:38:05.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:97:0) after 9m55s
[05:48:01.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:97:0)
[05:48:01.270] Build status: STARTED
[05:48:01.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:98:0) after 2m12s
[05:50:13.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:98:0)
[05:50:13.324] Build status: STARTED
[05:50:13.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:99:0) after 5m40s
[05:55:53.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:99:0)
[05:55:53.582] Build status: STARTED
[05:55:53.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:100:0) after 4m5s
[05:59:58.749] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:100:0)
[05:59:58.774] Build status: STARTED
[05:59:58.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:101:0) after 5m29s
[06:05:27.969] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:101:0)
[06:05:28.000] Build status: STARTED
[06:05:28.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:102:0) after 7m35s
[06:13:03.190] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:102:0)
[06:13:03.212] Build status: STARTED
[06:13:03.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:103:0) after 2m29s
[06:15:32.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:103:0)
[06:15:32.297] Build status: STARTED
[06:15:32.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:104:0) after 9m13s
[06:24:45.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:104:0)
[06:24:45.447] Build status: STARTED
[06:24:45.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:105:0) after 2m27s
[06:27:12.592] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:105:0)
[06:27:12.635] Build status: STARTED
[06:27:12.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:106:0) after 4m55s
[06:32:08.312] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:106:0)
[06:32:08.353] Build status: STARTED
[06:32:08.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:107:0) after 4m7s
[06:36:15.394] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:107:0)
[06:36:15.450] Build status: STARTED
[06:36:15.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:108:0) after 3m40s
[06:39:55.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:108:0)
[06:39:55.788] Build status: STARTED
[06:39:55.788] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:109:0) after 4m2s
[06:43:58.256] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:109:0)
[06:43:58.288] Build status: STARTED
[06:43:58.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:110:0) after 3m40s
[06:47:38.517] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:110:0)
[06:47:38.561] Build status: STARTED
[06:47:38.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:111:0) after 5m11s
[06:52:49.585] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:111:0)
[06:52:49.616] Build status: STARTED
[06:52:49.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:112:0) after 1m45s
[06:54:34.683] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:112:0)
[06:54:34.744] Build status: STARTED
[06:54:34.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:113:0) after 5m20s
[06:59:54.853] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:113:0)
[06:59:54.874] Build status: STARTED
[06:59:54.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:114:0) after 9m46s
[07:09:41.098] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:114:0)
[07:09:41.119] Build status: STARTED
[07:09:41.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:115:0) after 4m11s
[07:13:52.145] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:115:0)
[07:13:52.165] Build status: STARTED
[07:13:52.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:116:0) after 9m52s
[07:23:44.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:116:0)
[07:23:44.289] Build status: STARTED
[07:23:44.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:117:0) after 4m59s
[07:28:43.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:117:0)
[07:28:43.502] Build status: STARTED
[07:28:43.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:118:0) after 9m25s
[07:38:08.602] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:118:0)
[07:38:08.625] Build status: STARTED
[07:38:08.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:119:0) after 3m7s
[07:41:15.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:119:0)
[07:41:15.908] Build status: STARTED
[07:41:15.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:120:0) after 8m27s
[07:49:43.082] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:120:0)
[07:49:43.118] Build status: STARTED
[07:49:43.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:121:0) after 3m30s
[07:53:13.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:121:0)
[07:53:13.213] Build status: STARTED
[07:53:13.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:122:0) after 6m17s
[07:59:30.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:122:0)
[07:59:30.401] Build status: STARTED
[07:59:30.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:123:0) after 9m19s
[08:08:49.625] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:123:0)
[08:08:49.731] Build status: STARTED
[08:08:49.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:124:0) after 5m42s
[08:14:31.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:124:0)
[08:14:31.748] Build status: STARTED
[08:14:31.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:125:0) after 2m5s
[08:16:36.910] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:125:0)
[08:16:36.940] Build status: STARTED
[08:16:36.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:126:0) after 3m39s
[08:20:15.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:126:0)
[08:20:16.043] Build status: STARTED
[08:20:16.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:127:0) after 9m28s
[08:29:44.092] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:127:0)
[08:29:44.130] Build status: STARTED
[08:29:44.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:128:0) after 6m5s
[08:35:49.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:128:0)
[08:35:49.174] Build status: STARTED
[08:35:49.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:129:0) after 4m45s
[08:40:34.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:129:0)
[08:40:34.339] Build status: STARTED
[08:40:34.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:130:0) after 9m51s
[08:50:25.361] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:130:0)
[08:50:25.394] Build status: STARTED
[08:50:25.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:131:0) after 2m41s
[08:53:06.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:131:0)
[08:53:06.463] Build status: STARTED
[08:53:06.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:132:0) after 2m54s
[08:56:00.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:132:0)
[08:56:00.850] Build status: STARTED
[08:56:00.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:133:0) after 7m33s
[09:03:33.874] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:133:0)
[09:03:33.906] Build status: STARTED
[09:03:33.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:134:0) after 4m46s
[09:08:19.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:134:0)
[09:08:19.954] Build status: STARTED
[09:08:19.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:135:0) after 7m16s
[09:15:35.984] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:135:0)
[09:15:36.011] Build status: STARTED
[09:15:36.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:136:0) after 4m48s
[09:20:24.454] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:136:0)
[09:20:24.475] Build status: STARTED
[09:20:24.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:137:0) after 5m32s
[09:25:56.578] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:137:0)
[09:25:56.616] Build status: STARTED
[09:25:56.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8976958237882204992:138:0) after 2m45s
[09:27:09.739] Received PubSub notification, asking Buildbucket for the build status
[09:27:09.766] Build:
{
  "id": "8811528175899094321",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMac"
  },
  "number": 27924,
  "createdBy": "project:chromium",
  "createTime": "2022-06-12T21:21:52.563426454Z",
  "startTime": "2022-06-12T22:02:23.300979Z",
  "endTime": "2022-06-13T09:27:09.138935445Z",
  "updateTime": "2022-06-13T09:27:09.138935445Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "f5f88eae43975ec5a95be3047164079b1082a9b9",
      "ref": "refs/heads/main"
    }
  }
}
[09:27:09.766] Invocation finished in 12h5m18.477285139s with status FAILED