LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 11 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTMacASan"
>

Incoming triggers

9912436bd81648365afe89d1614f47160dc176e4 (3 years ago)
c1c4a8b01bae70b753380f2090e8beb933136dc5 (3 years ago)
2a37a40c369fd7e74963462c6afca0207d82c99c (3 years ago)
a2212e3e4ffec990e436069bf14d833a507476b3 (3 years ago)
7ff0d9e46a49cbff05fde5f43868cbb815d21a89 (3 years ago)
91a2fd838a6a7ee5c442f5b61945e3cdc6c78649 (3 years ago)
b04b950b0c49c4882dd49609b707b38050949a3e (3 years ago)
1c868f12a5f4513e259bc6d6338926ff335a6bd8 (3 years ago)
f60d131889a296f4c68ad77dc2452ad41904c87c (3 years ago)
aaa4471e38c6fc13c8ade095d1bb380653a15734 (3 years ago)
cadf731793a11da5a9fbfbd82719441cdde440fc (3 years ago)
3532f8197cb408477e9f6e97ae509b75c1e5c9dc (3 years ago)
66244f0ba202eb57497e6ab3abb9bd3b54c26a03 (3 years ago)
4ab653e149626fea7ac96d1981ca82e2a4a7dddd (3 years ago)
74425a2b68a6272c38966b7eb20a2fa478e676c6 (3 years ago)
43ba91f400cafe7f0c5c78f91457326ae97ff1d0 (3 years ago)
d2c85ed6f4b40a44901a05a9b26b3c69c9bc3aa3 (3 years ago)
26d667a6b095d557c1efadc779bce4ed3cf16895 (3 years ago)
f446a9071b573aec32eaf3302a54aa358e3d93cd (3 years ago)
a47f7317ce45da6e817e65d19bc0d612da3c355e (3 years ago)
7b2e7a33e4493b6fbe5168b68655698af04dce0b (3 years ago)
fc3c1249ecc450798aabe99c294cda945d0e954d (3 years ago)
ed9aab0703cb7227ebc9178fcbc9c109cf3040b7 (3 years ago)
b3a0bc8c44ffdb68cde8417a85a1007b3c6bb6a9 (3 years ago)
302d8999914cec0ffd93926631f3bf3118815393 (3 years ago)
4e380580ed5ee7a4267d1ef411b2379f4462869e (3 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "4e380580ed5ee7a4267d1ef411b2379f4462869e"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e380580ed5ee7a4267d1ef411b2379f4462869e
gitiles_ref:refs/heads/main

Debug log (UTC)

[05:28:05.395] New invocation is queued and will start shortly
[05:28:06.539] Starting the invocation (attempt 1)
[05:28:06.584] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4e380580ed5ee7a4267d1ef411b2379f4462869e"
[05:28:06.584] Popped gitiles commit info from properties and tags
[05:28:06.584] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:28:06.584] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:28:06.584] Buildbucket request:
{
  "requestId": "8982363464613026800",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "4e380580ed5ee7a4267d1ef411b2379f4462869e",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8982363464613026800"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[05:28:07.190] Scheduled build:
{
  "id": "8816933402638878113",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 26800,
  "createdBy": "project:chromium",
  "createTime": "2022-04-14T05:28:06.646706166Z",
  "updateTime": "2022-04-14T05:28:06.646706166Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "4e380580ed5ee7a4267d1ef411b2379f4462869e",
      "ref": "refs/heads/main"
    }
  }
}
[05:28:07.190] Task URL: https://cr-buildbucket.appspot.com/build/8816933402638878113
[05:28:07.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:2:0) after 4m6s
[05:32:13.243] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:2:0)
[05:32:13.277] Build status: SCHEDULED
[05:32:13.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:3:0) after 1m11s
[05:33:24.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:3:0)
[05:33:24.312] Build status: SCHEDULED
[05:33:24.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:4:0) after 2m0s
[05:35:24.441] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:4:0)
[05:35:24.468] Build status: SCHEDULED
[05:35:24.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:5:0) after 1m10s
[05:36:34.878] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:5:0)
[05:36:34.930] Build status: SCHEDULED
[05:36:34.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:6:0) after 5m7s
[05:41:41.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:6:0)
[05:41:41.980] Build status: SCHEDULED
[05:41:41.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:7:0) after 9m10s
[05:50:52.633] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:7:0)
[05:50:52.653] Build status: SCHEDULED
[05:50:52.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:8:0) after 3m32s
[05:54:07.588] Received PubSub notification, asking Buildbucket for the build status
[05:54:07.610] Build status: STARTED
[05:54:24.832] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:8:0)
[05:54:24.875] Build status: STARTED
[05:54:24.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:10:0) after 7m27s
[06:01:51.976] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:10:0)
[06:01:52.007] Build status: STARTED
[06:01:52.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:11:0) after 4m46s
[06:06:38.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:11:0)
[06:06:38.550] Build status: STARTED
[06:06:38.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:12:0) after 1m26s
[06:08:04.575] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:12:0)
[06:08:04.606] Build status: STARTED
[06:08:04.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:13:0) after 2m52s
[06:10:56.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:13:0)
[06:10:56.733] Build status: STARTED
[06:10:56.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:14:0) after 2m10s
[06:13:06.882] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:14:0)
[06:13:06.955] Build status: STARTED
[06:13:06.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:15:0) after 4m37s
[06:17:44.300] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:15:0)
[06:17:44.328] Build status: STARTED
[06:17:44.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:16:0) after 9m21s
[06:27:05.346] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:16:0)
[06:27:05.370] Build status: STARTED
[06:27:05.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:17:0) after 1m56s
[06:29:01.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:17:0)
[06:29:01.589] Build status: STARTED
[06:29:01.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:18:0) after 7m16s
[06:36:17.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:18:0)
[06:36:17.697] Build status: STARTED
[06:36:17.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:19:0) after 2m20s
[06:38:37.744] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:19:0)
[06:38:37.767] Build status: STARTED
[06:38:37.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:20:0) after 9m33s
[06:48:10.787] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:20:0)
[06:48:10.808] Build status: STARTED
[06:48:10.808] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:21:0) after 4m30s
[06:52:40.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:21:0)
[06:52:40.967] Build status: STARTED
[06:52:40.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:22:0) after 3m47s
[06:56:28.023] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:22:0)
[06:56:28.063] Build status: STARTED
[06:56:28.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:23:0) after 6m8s
[07:02:36.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:23:0)
[07:02:36.130] Build status: STARTED
[07:02:36.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:24:0) after 6m20s
[07:08:56.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:24:0)
[07:08:56.169] Build status: STARTED
[07:08:56.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:25:0) after 7m15s
[07:16:11.391] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:25:0)
[07:16:11.424] Build status: STARTED
[07:16:11.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:26:0) after 8m42s
[07:24:53.472] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:26:0)
[07:24:53.520] Build status: STARTED
[07:24:53.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:27:0) after 7m47s
[07:32:40.835] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:27:0)
[07:32:40.856] Build status: STARTED
[07:32:40.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:28:0) after 9m1s
[07:41:41.876] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:28:0)
[07:41:41.901] Build status: STARTED
[07:41:41.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:29:0) after 6m34s
[07:48:16.065] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:29:0)
[07:48:16.090] Build status: STARTED
[07:48:16.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:30:0) after 2m8s
[07:50:24.108] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:30:0)
[07:50:24.173] Build status: STARTED
[07:50:24.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:31:0) after 2m0s
[07:52:24.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:31:0)
[07:52:24.242] Build status: STARTED
[07:52:24.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:32:0) after 5m23s
[07:57:47.263] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:32:0)
[07:57:47.295] Build status: STARTED
[07:57:47.295] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:33:0) after 6m33s
[08:04:20.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:33:0)
[08:04:20.492] Build status: STARTED
[08:04:20.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:34:0) after 8m20s
[08:12:40.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:34:0)
[08:12:40.592] Build status: STARTED
[08:12:40.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:35:0) after 8m33s
[08:21:13.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:35:0)
[08:21:13.802] Build status: STARTED
[08:21:13.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:36:0) after 4m16s
[08:25:29.819] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:36:0)
[08:25:29.843] Build status: STARTED
[08:25:29.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:37:0) after 4m0s
[08:29:30.353] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:37:0)
[08:29:30.391] Build status: STARTED
[08:29:30.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:38:0) after 7m48s
[08:37:18.412] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:38:0)
[08:37:18.436] Build status: STARTED
[08:37:18.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:39:0) after 5m10s
[08:42:28.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:39:0)
[08:42:28.750] Build status: STARTED
[08:42:28.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:40:0) after 5m58s
[08:48:26.871] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:40:0)
[08:48:26.895] Build status: STARTED
[08:48:26.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:41:0) after 6m51s
[08:55:18.069] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:41:0)
[08:55:18.093] Build status: STARTED
[08:55:18.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:42:0) after 5m47s
[09:01:05.330] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:42:0)
[09:01:05.390] Build status: STARTED
[09:01:05.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:43:0) after 6m4s
[09:07:09.713] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:43:0)
[09:07:09.737] Build status: STARTED
[09:07:09.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:44:0) after 7m14s
[09:14:23.770] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:44:0)
[09:14:23.809] Build status: STARTED
[09:14:23.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:45:0) after 2m4s
[09:16:27.926] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:45:0)
[09:16:27.966] Build status: STARTED
[09:16:27.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:46:0) after 7m42s
[09:24:10.047] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:46:0)
[09:24:10.073] Build status: STARTED
[09:24:10.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:47:0) after 7m53s
[09:32:03.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:47:0)
[09:32:03.440] Build status: STARTED
[09:32:03.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:48:0) after 5m5s
[09:37:09.163] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:48:0)
[09:37:09.190] Build status: STARTED
[09:37:09.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:49:0) after 7m16s
[09:44:25.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:49:0)
[09:44:25.496] Build status: STARTED
[09:44:25.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:50:0) after 3m51s
[09:48:16.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:50:0)
[09:48:16.690] Build status: STARTED
[09:48:16.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:51:0) after 1m39s
[09:49:55.703] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:51:0)
[09:49:55.725] Build status: STARTED
[09:49:55.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:52:0) after 6m13s
[09:56:08.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:52:0)
[09:56:08.777] Build status: STARTED
[09:56:08.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:53:0) after 8m14s
[10:04:22.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:53:0)
[10:04:22.885] Build status: STARTED
[10:04:22.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:54:0) after 7m53s
[10:12:15.908] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:54:0)
[10:12:15.929] Build status: STARTED
[10:12:15.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:55:0) after 8m12s
[10:20:28.001] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:55:0)
[10:20:28.025] Build status: STARTED
[10:20:28.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:56:0) after 9m59s
[10:30:27.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:56:0)
[10:30:27.176] Build status: STARTED
[10:30:27.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:57:0) after 7m0s
[10:37:27.289] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:57:0)
[10:37:27.313] Build status: STARTED
[10:37:27.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:58:0) after 2m31s
[10:39:58.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:58:0)
[10:39:58.530] Build status: STARTED
[10:39:58.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:59:0) after 5m37s
[10:45:35.530] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:59:0)
[10:45:35.569] Build status: STARTED
[10:45:35.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:60:0) after 8m12s
[10:53:47.947] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:60:0)
[10:53:48.063] Build status: STARTED
[10:53:48.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:61:0) after 4m52s
[10:58:40.324] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:61:0)
[10:58:40.348] Build status: STARTED
[10:58:40.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:62:0) after 2m7s
[11:00:47.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:62:0)
[11:00:47.501] Build status: STARTED
[11:00:47.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:63:0) after 3m33s
[11:04:20.550] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:63:0)
[11:04:20.575] Build status: STARTED
[11:04:20.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:64:0) after 9m39s
[11:13:59.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:64:0)
[11:13:59.637] Build status: STARTED
[11:13:59.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:65:0) after 4m53s
[11:18:52.675] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:65:0)
[11:18:52.699] Build status: STARTED
[11:18:52.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:66:0) after 6m33s
[11:25:25.869] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:66:0)
[11:25:25.901] Build status: STARTED
[11:25:25.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:67:0) after 9m1s
[11:34:27.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:67:0)
[11:34:27.096] Build status: STARTED
[11:34:27.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:68:0) after 3m52s
[11:38:19.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:68:0)
[11:38:19.769] Build status: STARTED
[11:38:19.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:69:0) after 7m34s
[11:45:53.780] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:69:0)
[11:45:53.818] Build status: STARTED
[11:45:53.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:70:0) after 7m53s
[11:53:46.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:70:0)
[11:53:46.952] Build status: STARTED
[11:53:46.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:71:0) after 4m20s
[11:58:06.978] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:71:0)
[11:58:07.010] Build status: STARTED
[11:58:07.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:72:0) after 8m51s
[12:06:58.000] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:72:0)
[12:06:58.035] Build status: STARTED
[12:06:58.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:73:0) after 1m19s
[12:08:17.188] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:73:0)
[12:08:17.225] Build status: STARTED
[12:08:17.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:74:0) after 4m32s
[12:12:49.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:74:0)
[12:12:49.604] Build status: STARTED
[12:12:49.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:75:0) after 5m3s
[12:17:52.883] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:75:0)
[12:17:52.909] Build status: STARTED
[12:17:52.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:76:0) after 1m36s
[12:19:28.942] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:76:0)
[12:19:29.033] Build status: STARTED
[12:19:29.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:77:0) after 5m51s
[12:25:20.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:77:0)
[12:25:20.043] Build status: STARTED
[12:25:20.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:78:0) after 1m26s
[12:26:46.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:78:0)
[12:26:46.141] Build status: STARTED
[12:26:46.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:79:0) after 9m37s
[12:36:23.197] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:79:0)
[12:36:23.229] Build status: STARTED
[12:36:23.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:80:0) after 7m36s
[12:43:59.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:80:0)
[12:43:59.760] Build status: STARTED
[12:43:59.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:81:0) after 2m6s
[12:46:05.779] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:81:0)
[12:46:05.824] Build status: STARTED
[12:46:05.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:82:0) after 8m43s
[12:54:48.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:82:0)
[12:54:48.884] Build status: STARTED
[12:54:48.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:83:0) after 8m42s
[13:03:31.157] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:83:0)
[13:03:31.213] Build status: STARTED
[13:03:31.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:84:0) after 8m51s
[13:12:22.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:84:0)
[13:12:22.335] Build status: STARTED
[13:12:22.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:85:0) after 1m33s
[13:13:55.493] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:85:0)
[13:13:55.576] Build status: STARTED
[13:13:55.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:86:0) after 6m15s
[13:20:10.726] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:86:0)
[13:20:10.749] Build status: STARTED
[13:20:10.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:87:0) after 4m10s
[13:24:20.873] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:87:0)
[13:24:20.896] Build status: STARTED
[13:24:20.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:88:0) after 3m53s
[13:28:13.918] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:88:0)
[13:28:13.941] Build status: STARTED
[13:28:13.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:89:0) after 2m2s
[13:30:15.962] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:89:0)
[13:30:16.068] Build status: STARTED
[13:30:16.068] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:90:0) after 6m51s
[13:37:07.090] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:90:0)
[13:37:07.118] Build status: STARTED
[13:37:07.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:91:0) after 4m0s
[13:41:07.186] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:91:0)
[13:41:07.229] Build status: STARTED
[13:41:07.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:92:0) after 9m26s
[13:50:33.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:92:0)
[13:50:33.335] Build status: STARTED
[13:50:33.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:93:0) after 8m39s
[13:59:12.311] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:93:0)
[13:59:12.360] Build status: STARTED
[13:59:12.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:94:0) after 1m54s
[14:01:06.407] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:94:0)
[14:01:06.431] Build status: STARTED
[14:01:06.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:95:0) after 5m44s
[14:06:50.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:95:0)
[14:06:50.554] Build status: STARTED
[14:06:50.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:96:0) after 6m5s
[14:12:55.579] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:96:0)
[14:12:55.626] Build status: STARTED
[14:12:55.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:97:0) after 2m18s
[14:15:13.842] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:97:0)
[14:15:13.917] Build status: STARTED
[14:15:13.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:98:0) after 4m33s
[14:19:47.005] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:98:0)
[14:19:47.027] Build status: STARTED
[14:19:47.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:99:0) after 4m43s
[14:24:30.185] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:99:0)
[14:24:30.209] Build status: STARTED
[14:24:30.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:100:0) after 8m39s
[14:33:09.445] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:100:0)
[14:33:09.497] Build status: STARTED
[14:33:09.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:101:0) after 9m27s
[14:42:36.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:101:0)
[14:42:36.672] Build status: STARTED
[14:42:36.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:102:0) after 2m57s
[14:45:33.804] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:102:0)
[14:45:33.832] Build status: STARTED
[14:45:33.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:103:0) after 7m56s
[14:53:29.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:103:0)
[14:53:29.912] Build status: STARTED
[14:53:29.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:104:0) after 6m8s
[14:59:37.941] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:104:0)
[14:59:37.968] Build status: STARTED
[14:59:37.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:105:0) after 7m7s
[15:06:45.232] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:105:0)
[15:06:45.255] Build status: STARTED
[15:06:45.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:106:0) after 8m3s
[15:14:48.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:106:0)
[15:14:48.319] Build status: STARTED
[15:14:48.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:107:0) after 2m46s
[15:17:34.676] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:107:0)
[15:17:34.698] Build status: STARTED
[15:17:34.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:108:0) after 7m54s
[15:25:28.922] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:108:0)
[15:25:28.965] Build status: STARTED
[15:25:28.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:109:0) after 8m45s
[15:34:14.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:109:0)
[15:34:14.075] Build status: STARTED
[15:34:14.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:110:0) after 3m4s
[15:37:18.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:110:0)
[15:37:18.389] Build status: STARTED
[15:37:18.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:111:0) after 6m40s
[15:43:58.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:111:0)
[15:43:58.434] Build status: STARTED
[15:43:58.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:112:0) after 8m53s
[15:52:51.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:112:0)
[15:52:51.595] Build status: STARTED
[15:52:51.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:113:0) after 6m10s
[15:59:01.712] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:113:0)
[15:59:01.737] Build status: STARTED
[15:59:01.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:114:0) after 2m0s
[16:01:01.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:114:0)
[16:01:01.799] Build status: STARTED
[16:01:01.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:115:0) after 6m53s
[16:07:55.091] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:115:0)
[16:07:55.114] Build status: STARTED
[16:07:55.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:116:0) after 3m1s
[16:10:57.359] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:116:0)
[16:10:57.387] Build status: STARTED
[16:10:57.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:117:0) after 1m46s
[16:12:43.496] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:117:0)
[16:12:43.520] Build status: STARTED
[16:12:43.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:118:0) after 1m40s
[16:14:24.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:118:0)
[16:14:24.561] Build status: STARTED
[16:14:24.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:119:0) after 8m36s
[16:23:00.535] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:119:0)
[16:23:00.630] Build status: STARTED
[16:23:00.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:120:0) after 2m10s
[16:25:10.606] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:120:0)
[16:25:10.689] Build status: STARTED
[16:25:10.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:121:0) after 1m44s
[16:26:54.708] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:121:0)
[16:26:54.729] Build status: STARTED
[16:26:54.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:122:0) after 1m38s
[16:28:32.769] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:122:0)
[16:28:32.794] Build status: STARTED
[16:28:32.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:123:0) after 6m33s
[16:35:05.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:123:0)
[16:35:05.929] Build status: STARTED
[16:35:05.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:124:0) after 6m55s
[16:42:01.029] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:124:0)
[16:42:01.051] Build status: STARTED
[16:42:01.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:125:0) after 3m11s
[16:45:12.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:125:0)
[16:45:12.097] Build status: STARTED
[16:45:12.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:8982363464613026800:126:0) after 4m33s
[16:47:22.805] Received PubSub notification, asking Buildbucket for the build status
[16:47:22.824] Build:
{
  "id": "8816933402638878113",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 26800,
  "createdBy": "project:chromium",
  "createTime": "2022-04-14T05:28:06.646706166Z",
  "startTime": "2022-04-14T05:54:06.923357Z",
  "endTime": "2022-04-14T16:47:22.453517240Z",
  "updateTime": "2022-04-14T16:47:22.453517240Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "4e380580ed5ee7a4267d1ef411b2379f4462869e",
      "ref": "refs/heads/main"
    }
  }
}
[16:47:22.824] Invocation finished in 11h19m17.443537535s with status FAILED