LUCI Scheduler :: chromium :: ToTMacASan

Status: FAILED

Triggered by: -

Duration: 10 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTMacASan"
>

Incoming triggers

b0575a931ba9574711d44965b321d219e8a0433e (4 years ago)
f40512a9ec8d23a945a0f13197752fd3755621ad (4 years ago)
e03bf452cc9889df71db1ba8fb8f1d31e0e5c52e (4 years ago)
f64419ea89a2942128690186a50d673664aece17 (4 years ago)
ffe3e0748f8edc71dcf893856245447213dbc393 (4 years ago)
3127f6839d2c5c407aa4227d56713e3dd316bcd4 (4 years ago)
aab5d0d36f5a1c32f39576e888ad45f36c71c2d8 (4 years ago)
790b5fb4070a7629b544fee83c01d997dff8f666 (4 years ago)
b56c3c93d6511df7fb7dcaadcdf39ea415c9c7a5 (4 years ago)
acaf2f95e9d8d90e92f90a5aa5f8db82ac53e736 (4 years ago)
f26fde5e128e88250ad4e5137535311411ce5e35 (4 years ago)
b07b0a21b9928dc68178e4c4c0446fa508c44896 (4 years ago)
02f1ddc6e016a979844aa5e9b40207b864897fe9 (4 years ago)
e850b0a37661ee42f0edf3f896057c543c38a281 (4 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "e850b0a37661ee42f0edf3f896057c543c38a281"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e850b0a37661ee42f0edf3f896057c543c38a281
gitiles_ref:refs/heads/main

Debug log (UTC)

[14:11:11.149] New invocation is queued and will start shortly
[14:11:12.260] Starting the invocation (attempt 1)
[14:11:12.345] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e850b0a37661ee42f0edf3f896057c543c38a281"
[14:11:12.345] Popped gitiles commit info from properties and tags
[14:11:12.345] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:11:12.345] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:11:12.345] Buildbucket request:
{
  "requestId": "9005523377664679088",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "e850b0a37661ee42f0edf3f896057c543c38a281",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9005523377664679088"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTMacASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[14:11:12.979] Scheduled build:
{
  "id": "8840093315574934256",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25347,
  "createdBy": "project:chromium",
  "createTime": "2021-08-01T14:11:12.509703Z",
  "updateTime": "2021-08-01T14:11:12.918944Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "e850b0a37661ee42f0edf3f896057c543c38a281",
      "ref": "refs/heads/main"
    }
  }
}
[14:11:12.979] Task URL: https://cr-buildbucket.appspot.com/build/8840093315574934256
[14:11:12.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:2:0) after 2m28s
[14:11:30.040] Received PubSub notification, asking Buildbucket for the build status
[14:11:30.069] Build status: STARTED
[14:13:41.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:2:0)
[14:13:41.224] Build status: STARTED
[14:13:41.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:4:0) after 5m19s
[14:19:00.462] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:4:0)
[14:19:00.491] Build status: STARTED
[14:19:00.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:5:0) after 8m31s
[14:27:31.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:5:0)
[14:27:31.783] Build status: STARTED
[14:27:31.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:6:0) after 7m23s
[14:34:55.210] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:6:0)
[14:34:55.240] Build status: STARTED
[14:34:55.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:7:0) after 4m26s
[14:39:21.652] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:7:0)
[14:39:21.690] Build status: STARTED
[14:39:21.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:8:0) after 8m45s
[14:48:06.776] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:8:0)
[14:48:06.821] Build status: STARTED
[14:48:06.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:9:0) after 4m56s
[14:53:03.344] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:9:0)
[14:53:03.385] Build status: STARTED
[14:53:03.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:10:0) after 6m27s
[14:59:30.521] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:10:0)
[14:59:30.655] Build status: STARTED
[14:59:30.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:11:0) after 3m21s
[15:02:52.048] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:11:0)
[15:03:15.142] Build status: STARTED
[15:03:15.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:12:0) after 7m53s
[15:11:08.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:12:0)
[15:11:08.326] Build status: STARTED
[15:11:08.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:13:0) after 1m30s
[15:12:38.545] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:13:0)
[15:12:38.580] Build status: STARTED
[15:12:38.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:14:0) after 9m8s
[15:21:46.598] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:14:0)
[15:21:46.627] Build status: STARTED
[15:21:46.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:15:0) after 5m14s
[15:27:00.938] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:15:0)
[15:27:00.968] Build status: STARTED
[15:27:00.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:16:0) after 3m43s
[15:30:44.170] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:16:0)
[15:30:44.197] Build status: STARTED
[15:30:44.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:17:0) after 8m22s
[15:39:06.228] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:17:0)
[15:39:06.269] Build status: STARTED
[15:39:06.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:18:0) after 8m32s
[15:47:38.287] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:18:0)
[15:47:38.314] Build status: STARTED
[15:47:38.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:19:0) after 1m55s
[15:49:33.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:19:0)
[15:49:33.517] Build status: STARTED
[15:49:33.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:20:0) after 7m24s
[15:56:57.539] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:20:0)
[15:56:57.569] Build status: STARTED
[15:56:57.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:21:0) after 6m28s
[16:03:26.240] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:21:0)
[16:03:26.271] Build status: STARTED
[16:03:26.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:22:0) after 6m9s
[16:09:35.290] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:22:0)
[16:09:35.339] Build status: STARTED
[16:09:35.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:23:0) after 4m44s
[16:14:19.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:23:0)
[16:14:19.587] Build status: STARTED
[16:14:19.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:24:0) after 4m0s
[16:18:20.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:24:0)
[16:18:20.165] Build status: STARTED
[16:18:20.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:25:0) after 4m8s
[16:22:28.270] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:25:0)
[16:22:28.301] Build status: STARTED
[16:22:28.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:26:0) after 4m56s
[16:27:24.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:26:0)
[16:27:24.410] Build status: STARTED
[16:27:24.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:27:0) after 9m17s
[16:36:41.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:27:0)
[16:36:41.822] Build status: STARTED
[16:36:41.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:28:0) after 3m18s
[16:39:59.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:28:0)
[16:40:00.018] Build status: STARTED
[16:40:00.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:29:0) after 7m39s
[16:47:39.037] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:29:0)
[16:47:39.070] Build status: STARTED
[16:47:39.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:30:0) after 8m11s
[16:55:50.110] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:30:0)
[16:55:50.140] Build status: STARTED
[16:55:50.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:31:0) after 1m31s
[16:57:21.296] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:31:0)
[16:57:21.325] Build status: STARTED
[16:57:21.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:32:0) after 9m27s
[17:06:48.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:32:0)
[17:06:48.461] Build status: STARTED
[17:06:48.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:33:0) after 2m8s
[17:08:56.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:33:0)
[17:08:56.516] Build status: STARTED
[17:08:56.516] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:34:0) after 8m51s
[17:17:47.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:34:0)
[17:17:47.823] Build status: STARTED
[17:17:47.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:35:0) after 7m50s
[17:25:37.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:35:0)
[17:25:37.944] Build status: STARTED
[17:25:37.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:36:0) after 6m46s
[17:32:24.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:36:0)
[17:32:24.196] Build status: STARTED
[17:32:24.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:37:0) after 4m27s
[17:36:51.216] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:37:0)
[17:36:51.261] Build status: STARTED
[17:36:51.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:38:0) after 7m0s
[17:43:51.376] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:38:0)
[17:43:51.405] Build status: STARTED
[17:43:51.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:39:0) after 7m41s
[17:51:32.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:39:0)
[17:51:32.458] Build status: STARTED
[17:51:32.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:40:0) after 5m53s
[17:57:25.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:40:0)
[17:57:25.537] Build status: STARTED
[17:57:25.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:41:0) after 3m24s
[18:00:49.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:41:0)
[18:00:49.685] Build status: STARTED
[18:00:49.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:42:0) after 5m27s
[18:06:17.041] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:42:0)
[18:06:17.077] Build status: STARTED
[18:06:17.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:43:0) after 2m4s
[18:08:21.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:43:0)
[18:08:21.126] Build status: STARTED
[18:08:21.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:44:0) after 4m32s
[18:12:53.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:44:0)
[18:12:53.600] Build status: STARTED
[18:12:53.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:45:0) after 1m45s
[18:14:39.114] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:45:0)
[18:14:39.146] Build status: STARTED
[18:14:39.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:46:0) after 7m46s
[18:22:25.373] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:46:0)
[18:22:25.399] Build status: STARTED
[18:22:25.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:47:0) after 1m48s
[18:24:13.467] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:47:0)
[18:24:13.502] Build status: STARTED
[18:24:13.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:48:0) after 3m57s
[18:28:10.523] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:48:0)
[18:28:10.560] Build status: STARTED
[18:28:10.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:49:0) after 7m42s
[18:35:52.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:49:0)
[18:35:52.575] Build status: STARTED
[18:35:52.575] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:50:0) after 2m42s
[18:38:34.794] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:50:0)
[18:38:34.824] Build status: STARTED
[18:38:34.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:51:0) after 9m11s
[18:47:45.843] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:51:0)
[18:47:45.871] Build status: STARTED
[18:47:45.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:52:0) after 8m10s
[18:55:55.893] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:52:0)
[18:55:55.923] Build status: STARTED
[18:55:55.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:53:0) after 8m44s
[19:04:40.733] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:53:0)
[19:04:40.764] Build status: STARTED
[19:04:40.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:54:0) after 1m30s
[19:06:10.785] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:54:0)
[19:06:11.390] Build status: STARTED
[19:06:11.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:55:0) after 7m34s
[19:13:45.415] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:55:0)
[19:13:45.450] Build status: STARTED
[19:13:45.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:56:0) after 7m41s
[19:21:26.469] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:56:0)
[19:21:26.497] Build status: STARTED
[19:21:26.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:57:0) after 2m34s
[19:24:00.864] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:57:0)
[19:24:00.949] Build status: STARTED
[19:24:00.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:58:0) after 3m1s
[19:27:02.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:58:0)
[19:27:02.086] Build status: STARTED
[19:27:02.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:59:0) after 7m57s
[19:34:59.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:59:0)
[19:34:59.144] Build status: STARTED
[19:34:59.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:60:0) after 3m5s
[19:38:04.165] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:60:0)
[19:38:04.195] Build status: STARTED
[19:38:04.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:61:0) after 1m3s
[19:39:07.365] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:61:0)
[19:39:07.398] Build status: STARTED
[19:39:07.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:62:0) after 1m33s
[19:40:40.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:62:0)
[19:40:40.449] Build status: STARTED
[19:40:40.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:63:0) after 3m44s
[19:44:24.605] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:63:0)
[19:44:24.634] Build status: STARTED
[19:44:24.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:64:0) after 5m22s
[19:49:46.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:64:0)
[19:49:46.686] Build status: STARTED
[19:49:46.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:65:0) after 8m41s
[19:58:27.915] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:65:0)
[19:58:27.948] Build status: STARTED
[19:58:27.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:66:0) after 8m34s
[20:07:02.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:66:0)
[20:07:02.193] Build status: STARTED
[20:07:02.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:67:0) after 4m26s
[20:11:28.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:67:0)
[20:11:28.282] Build status: STARTED
[20:11:28.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:68:0) after 8m2s
[20:19:30.734] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:68:0)
[20:19:30.759] Build status: STARTED
[20:19:30.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:69:0) after 9m20s
[20:28:51.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:69:0)
[20:28:51.374] Build status: STARTED
[20:28:51.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:70:0) after 3m59s
[20:32:50.396] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:70:0)
[20:32:50.427] Build status: STARTED
[20:32:50.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:71:0) after 7m23s
[20:40:13.569] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:71:0)
[20:40:13.599] Build status: STARTED
[20:40:13.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:72:0) after 3m16s
[20:43:29.702] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:72:0)
[20:43:29.733] Build status: STARTED
[20:43:29.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:73:0) after 2m2s
[20:45:31.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:73:0)
[20:45:31.773] Build status: STARTED
[20:45:31.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:74:0) after 3m26s
[20:48:57.792] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:74:0)
[20:48:57.826] Build status: STARTED
[20:48:57.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:75:0) after 3m51s
[20:52:49.046] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:75:0)
[20:52:49.089] Build status: STARTED
[20:52:49.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:76:0) after 4m24s
[20:57:13.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:76:0)
[20:57:13.362] Build status: STARTED
[20:57:13.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:77:0) after 6m34s
[21:03:47.380] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:77:0)
[21:03:47.408] Build status: STARTED
[21:03:47.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:78:0) after 7m42s
[21:11:29.429] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:78:0)
[21:11:29.466] Build status: STARTED
[21:11:29.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:79:0) after 5m56s
[21:17:25.645] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:79:0)
[21:17:25.675] Build status: STARTED
[21:17:25.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:80:0) after 6m22s
[21:23:47.706] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:80:0)
[21:23:47.734] Build status: STARTED
[21:23:47.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:81:0) after 5m48s
[21:29:35.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:81:0)
[21:29:35.805] Build status: STARTED
[21:29:35.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:82:0) after 4m20s
[21:33:55.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:82:0)
[21:33:55.853] Build status: STARTED
[21:33:55.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:83:0) after 5m34s
[21:39:30.074] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:83:0)
[21:39:30.100] Build status: STARTED
[21:39:30.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:84:0) after 2m14s
[21:41:44.294] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:84:0)
[21:41:44.472] Build status: STARTED
[21:41:44.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:85:0) after 8m32s
[21:50:16.610] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:85:0)
[21:50:16.645] Build status: STARTED
[21:50:16.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:86:0) after 1m12s
[21:51:28.656] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:86:0)
[21:51:28.683] Build status: STARTED
[21:51:28.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:87:0) after 2m53s
[21:54:21.685] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:87:0)
[21:54:21.721] Build status: STARTED
[21:54:21.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:88:0) after 2m21s
[21:56:42.739] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:88:0)
[21:56:42.767] Build status: STARTED
[21:56:42.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:89:0) after 1m58s
[21:58:40.846] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:89:0)
[21:58:40.873] Build status: STARTED
[21:58:40.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:90:0) after 1m17s
[21:59:58.241] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:90:0)
[21:59:58.266] Build status: STARTED
[21:59:58.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:91:0) after 3m14s
[22:03:12.288] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:91:0)
[22:03:12.319] Build status: STARTED
[22:03:12.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:92:0) after 8m16s
[22:11:28.357] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:92:0)
[22:11:28.397] Build status: STARTED
[22:11:28.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:93:0) after 5m45s
[22:17:13.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:93:0)
[22:17:13.579] Build status: STARTED
[22:17:13.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:94:0) after 4m29s
[22:21:43.028] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:94:0)
[22:21:43.058] Build status: STARTED
[22:21:43.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:95:0) after 8m5s
[22:29:48.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:95:0)
[22:29:48.143] Build status: STARTED
[22:29:48.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:96:0) after 7m57s
[22:37:45.236] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:96:0)
[22:37:45.265] Build status: STARTED
[22:37:45.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:97:0) after 7m14s
[22:44:59.430] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:97:0)
[22:44:59.457] Build status: STARTED
[22:44:59.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:98:0) after 3m25s
[22:48:24.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:98:0)
[22:48:24.506] Build status: STARTED
[22:48:24.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:99:0) after 3m17s
[22:51:41.601] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:99:0)
[22:51:41.630] Build status: STARTED
[22:51:41.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:100:0) after 2m54s
[22:54:35.745] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:100:0)
[22:54:35.768] Build status: STARTED
[22:54:35.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:101:0) after 1m12s
[22:55:48.102] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:101:0)
[22:55:48.125] Build status: STARTED
[22:55:48.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:102:0) after 7m51s
[23:03:39.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:102:0)
[23:03:39.714] Build status: STARTED
[23:03:39.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:103:0) after 6m28s
[23:10:08.318] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:103:0)
[23:10:08.436] Build status: STARTED
[23:10:08.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:104:0) after 9m24s
[23:19:32.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:104:0)
[23:19:32.495] Build status: STARTED
[23:19:32.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:105:0) after 7m2s
[23:26:34.686] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:105:0)
[23:26:34.722] Build status: STARTED
[23:26:34.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:106:0) after 2m32s
[23:29:06.741] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:106:0)
[23:29:06.909] Build status: STARTED
[23:29:06.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:107:0) after 8m40s
[23:37:47.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:107:0)
[23:37:47.274] Build status: STARTED
[23:37:47.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:108:0) after 2m40s
[23:40:27.556] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:108:0)
[23:40:27.589] Build status: STARTED
[23:40:27.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:109:0) after 9m23s
[23:49:50.665] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:109:0)
[23:49:50.692] Build status: STARTED
[23:49:50.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:110:0) after 9m59s
[23:59:50.282] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:110:0)
[23:59:50.320] Build status: STARTED
[23:59:50.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:111:0) after 9m18s
[00:09:08.337] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:111:0)
[00:09:08.359] Build status: STARTED
[00:09:08.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:112:0) after 1m24s
[00:10:32.490] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:112:0)
[00:10:32.521] Build status: STARTED
[00:10:32.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:113:0) after 5m12s
[00:15:44.544] Handling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:113:0)
[00:15:44.573] Build status: STARTED
[00:15:44.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacASan:9005523377664679088:114:0) after 9m50s
[00:20:38.444] Received PubSub notification, asking Buildbucket for the build status
[00:20:38.528] Build:
{
  "id": "8840093315574934256",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTMacASan"
  },
  "number": 25347,
  "createdBy": "project:chromium",
  "createTime": "2021-08-01T14:11:12.509703Z",
  "startTime": "2021-08-01T14:11:29.447418Z",
  "endTime": "2021-08-02T00:20:37.891671052Z",
  "updateTime": "2021-08-02T00:20:37.896189119Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "e850b0a37661ee42f0edf3f896057c543c38a281",
      "ref": "refs/heads/main"
    }
  }
}
[00:20:38.528] Invocation finished in 10h9m27.395779037s with status FAILED