LUCI Scheduler :: chromium :: ToTLinuxASan

Status: FAILED

Triggered by: -

Duration: 9 hours

Actions:

Definition (rev 36bc28844ffd5e030af6e41e2e0e4ddc5c92b699)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "ci"
  builder: "ToTLinuxASan"
>

Incoming triggers

709d3cf2daf1fcdc824114e03cf81c31651fef51 (2 years ago)
3483e5ed29059623dbb49ee1e3b4121c29619a4c (2 years ago)
99db1f9b40f722ee75dfc0f798c3b46b83b831cb (2 years ago)
9a7adeeec8c5b9358c4a736f761989d8e5d4abcd (2 years ago)
d4f0b60f9900591644bec7a96c4c48ac2c6106d8 (2 years ago)
52ede98bfacbb791e0e85139a13cef2ea4d43508 (2 years ago)
f14df6414897dd5e56d1d5da82642fb4ae1bbda0 (2 years ago)
29169bdbfcfab368a4a5d58852e25d148254fb26 (2 years ago)
1d5f5504e6e81c87373a87d1572cd8a2d3c4a841 (2 years ago)
ff9e0432931c07ca8bd696b7d1711d397fd2b5fe (2 years ago)
eb727e3c6923482f955a1a18130b2d90ed074e18 (2 years ago)
d5c52fa7cd45f1f210c9b8a6e095a625949fc5df (2 years ago)
926edaf4532516976d3e8e95fc44371a238fcf56 (2 years ago)
4d960e847dd6f78dc30cf5ce781aaa61b4b476ab (2 years ago)
e316127868fd37c0af035d252836cc0744c915c1 (2 years ago)
3c0df840982222f07b84813456780278a0375c0e (2 years ago)
5331e6baaa6531ff6d4991ed8e319bcae3dbbb8b (2 years ago)
3fcf823a84b1b1e38e56b3faf7f86e7a265a1c56 (2 years ago)
bce9a94e0f15145b9fb39876fc5ca91ef8f25ac0 (2 years ago)
dadf13ed2b51775ef64bc10bf6056870131aa124 (2 years ago)
232c13b3ab61d9fee65b1396fec7bdf3e9e68e37 (2 years ago)
ac7420f277a3d0eee697d1604d9f983138fd7c61 (2 years ago)
dbf842269f3a65a72e37df67bfc151bb4d01f76a (2 years ago)
2611fb29605d9012da26d824c7cf87d0b5d6cfc8 (2 years ago)

Incoming properties

{
  "branch": "refs/heads/main",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "2611fb29605d9012da26d824c7cf87d0b5d6cfc8"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2611fb29605d9012da26d824c7cf87d0b5d6cfc8
gitiles_ref:refs/heads/main

Debug log (UTC)

[15:00:55.730] New invocation is queued and will start shortly
[15:00:56.813] Starting the invocation (attempt 1)
[15:00:56.843] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2611fb29605d9012da26d824c7cf87d0b5d6cfc8"
[15:00:56.843] Popped gitiles commit info from properties and tags
[15:00:56.843] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:00:56.843] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:00:56.844] Buildbucket request:
{
  "requestId": "8951615053089687536",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxASan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "2611fb29605d9012da26d824c7cf87d0b5d6cfc8",
    "ref": "refs/heads/main"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "8951615053089687536"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxASan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[15:00:57.246] Scheduled build:
{
  "id": "8786184991205903473",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxASan"
  },
  "number": 19231,
  "createdBy": "project:chromium",
  "createTime": "2023-03-19T15:00:56.900320138Z",
  "updateTime": "2023-03-19T15:00:56.900320138Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "2611fb29605d9012da26d824c7cf87d0b5d6cfc8",
      "ref": "refs/heads/main"
    }
  }
}
[15:00:57.246] Task URL: https://cr-buildbucket.appspot.com/build/8786184991205903473
[15:00:57.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:2:0) after 5m16s
[15:06:13.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:2:0)
[15:06:13.390] Build status: SCHEDULED
[15:06:13.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:3:0) after 3m8s
[15:08:11.082] Received PubSub notification, asking Buildbucket for the build status
[15:08:11.120] Build status: STARTED
[15:09:21.663] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:3:0)
[15:09:21.682] Build status: STARTED
[15:09:21.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:5:0) after 2m46s
[15:12:07.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:5:0)
[15:12:07.730] Build status: STARTED
[15:12:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:6:0) after 8m18s
[15:20:25.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:6:0)
[15:20:25.778] Build status: STARTED
[15:20:25.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:7:0) after 8m56s
[15:29:21.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:7:0)
[15:29:21.861] Build status: STARTED
[15:29:21.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:8:0) after 9m25s
[15:38:47.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:8:0)
[15:38:47.151] Build status: STARTED
[15:38:47.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:9:0) after 2m25s
[15:41:12.170] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:9:0)
[15:41:12.202] Build status: STARTED
[15:41:12.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:10:0) after 8m1s
[15:49:13.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:10:0)
[15:49:13.250] Build status: STARTED
[15:49:13.250] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:11:0) after 6m29s
[15:55:42.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:11:0)
[15:55:42.331] Build status: STARTED
[15:55:42.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:12:0) after 8m31s
[16:04:13.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:12:0)
[16:04:13.384] Build status: STARTED
[16:04:13.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:13:0) after 2m38s
[16:06:51.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:13:0)
[16:06:51.473] Build status: STARTED
[16:06:51.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:14:0) after 2m3s
[16:08:54.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:14:0)
[16:08:54.725] Build status: STARTED
[16:08:54.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:15:0) after 4m19s
[16:13:13.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:15:0)
[16:13:13.766] Build status: STARTED
[16:13:13.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:16:0) after 3m23s
[16:16:36.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:16:0)
[16:16:37.018] Build status: STARTED
[16:16:37.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:17:0) after 4m47s
[16:21:24.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:17:0)
[16:21:24.141] Build status: STARTED
[16:21:24.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:18:0) after 5m14s
[16:26:38.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:18:0)
[16:26:38.285] Build status: STARTED
[16:26:38.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:19:0) after 6m18s
[16:32:56.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:19:0)
[16:32:56.339] Build status: STARTED
[16:32:56.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:20:0) after 1m15s
[16:34:11.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:20:0)
[16:34:11.443] Build status: STARTED
[16:34:11.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:21:0) after 6m14s
[16:40:25.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:21:0)
[16:40:25.565] Build status: STARTED
[16:40:25.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:22:0) after 4m39s
[16:45:04.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:22:0)
[16:45:04.601] Build status: STARTED
[16:45:04.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:23:0) after 5m28s
[16:50:32.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:23:0)
[16:50:32.831] Build status: STARTED
[16:50:32.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:24:0) after 1m16s
[16:51:48.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:24:0)
[16:51:48.879] Build status: STARTED
[16:51:48.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:25:0) after 2m29s
[16:54:17.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:25:0)
[16:54:17.946] Build status: STARTED
[16:54:17.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:26:0) after 5m44s
[17:00:02.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:26:0)
[17:00:02.151] Build status: STARTED
[17:00:02.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:27:0) after 1m36s
[17:01:38.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:27:0)
[17:01:38.192] Build status: STARTED
[17:01:38.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:28:0) after 5m50s
[17:07:28.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:28:0)
[17:07:28.236] Build status: STARTED
[17:07:28.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:29:0) after 4m6s
[17:11:34.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:29:0)
[17:11:34.563] Build status: STARTED
[17:11:34.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:30:0) after 1m52s
[17:13:26.584] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:30:0)
[17:13:26.606] Build status: STARTED
[17:13:26.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:31:0) after 7m57s
[17:21:24.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:31:0)
[17:21:24.124] Build status: STARTED
[17:21:24.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:32:0) after 9m33s
[17:30:57.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:32:0)
[17:30:57.169] Build status: STARTED
[17:30:57.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:33:0) after 1m55s
[17:32:52.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:33:0)
[17:32:52.330] Build status: STARTED
[17:32:52.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:34:0) after 9m2s
[17:41:54.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:34:0)
[17:41:54.960] Build status: STARTED
[17:41:54.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:35:0) after 3m22s
[17:45:17.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:35:0)
[17:45:17.211] Build status: STARTED
[17:45:17.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:36:0) after 5m48s
[17:51:05.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:36:0)
[17:51:05.369] Build status: STARTED
[17:51:05.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:37:0) after 5m10s
[17:56:15.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:37:0)
[17:56:15.409] Build status: STARTED
[17:56:15.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:38:0) after 9m20s
[18:05:35.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:38:0)
[18:05:35.464] Build status: STARTED
[18:05:35.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:39:0) after 5m37s
[18:11:12.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:39:0)
[18:11:12.931] Build status: STARTED
[18:11:12.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:40:0) after 2m38s
[18:13:51.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:40:0)
[18:13:51.648] Build status: STARTED
[18:13:51.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:41:0) after 3m2s
[18:16:53.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:41:0)
[18:16:53.692] Build status: STARTED
[18:16:53.692] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:42:0) after 2m50s
[18:19:43.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:42:0)
[18:19:43.735] Build status: STARTED
[18:19:43.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:43:0) after 4m44s
[18:24:27.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:43:0)
[18:24:27.869] Build status: STARTED
[18:24:27.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:44:0) after 7m14s
[18:31:42.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:44:0)
[18:31:42.548] Build status: STARTED
[18:31:42.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:45:0) after 8m57s
[18:40:39.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:45:0)
[18:40:39.597] Build status: STARTED
[18:40:39.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:46:0) after 6m43s
[18:47:22.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:46:0)
[18:47:22.640] Build status: STARTED
[18:47:22.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:47:0) after 7m12s
[18:54:34.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:47:0)
[18:54:34.677] Build status: STARTED
[18:54:34.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:48:0) after 6m30s
[19:01:05.027] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:48:0)
[19:01:05.054] Build status: STARTED
[19:01:05.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:49:0) after 7m40s
[19:08:45.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:49:0)
[19:08:45.507] Build status: STARTED
[19:08:45.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:50:0) after 3m27s
[19:12:12.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:50:0)
[19:12:12.925] Build status: STARTED
[19:12:12.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:51:0) after 4m23s
[19:16:36.212] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:51:0)
[19:16:36.317] Build status: STARTED
[19:16:36.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:52:0) after 7m38s
[19:24:14.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:52:0)
[19:24:14.372] Build status: STARTED
[19:24:14.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:53:0) after 1m48s
[19:26:02.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:53:0)
[19:26:02.573] Build status: STARTED
[19:26:02.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:54:0) after 3m57s
[19:30:00.222] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:54:0)
[19:30:00.243] Build status: STARTED
[19:30:00.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:55:0) after 6m19s
[19:36:19.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:55:0)
[19:36:19.293] Build status: STARTED
[19:36:19.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:56:0) after 5m54s
[19:42:13.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:56:0)
[19:42:13.490] Build status: STARTED
[19:42:13.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:57:0) after 3m47s
[19:46:00.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:57:0)
[19:46:00.529] Build status: STARTED
[19:46:00.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:58:0) after 1m59s
[19:47:59.550] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:58:0)
[19:47:59.576] Build status: STARTED
[19:47:59.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:59:0) after 1m45s
[19:49:44.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:59:0)
[19:49:44.736] Build status: STARTED
[19:49:44.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:60:0) after 8m52s
[19:58:36.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:60:0)
[19:58:36.816] Build status: STARTED
[19:58:36.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:61:0) after 9m14s
[20:07:50.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:61:0)
[20:07:50.856] Build status: STARTED
[20:07:50.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:62:0) after 2m50s
[20:10:40.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:62:0)
[20:10:40.907] Build status: STARTED
[20:10:40.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:63:0) after 3m1s
[20:13:41.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:63:0)
[20:13:41.950] Build status: STARTED
[20:13:41.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:64:0) after 7m42s
[20:21:23.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:64:0)
[20:21:24.021] Build status: STARTED
[20:21:24.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:65:0) after 9m24s
[20:30:48.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:65:0)
[20:30:48.081] Build status: STARTED
[20:30:48.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:66:0) after 1m20s
[20:32:08.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:66:0)
[20:32:08.134] Build status: STARTED
[20:32:08.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:67:0) after 4m42s
[20:36:50.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:67:0)
[20:36:50.234] Build status: STARTED
[20:36:50.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:68:0) after 6m13s
[20:43:03.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:68:0)
[20:43:03.319] Build status: STARTED
[20:43:03.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:69:0) after 2m25s
[20:45:28.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:69:0)
[20:45:28.368] Build status: STARTED
[20:45:28.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:70:0) after 4m17s
[20:49:45.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:70:0)
[20:49:45.453] Build status: STARTED
[20:49:45.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:71:0) after 5m49s
[20:55:34.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:71:0)
[20:55:34.564] Build status: STARTED
[20:55:34.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:72:0) after 3m34s
[20:59:08.544] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:72:0)
[20:59:08.566] Build status: STARTED
[20:59:08.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:73:0) after 5m13s
[21:04:21.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:73:0)
[21:04:21.620] Build status: STARTED
[21:04:21.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:74:0) after 2m6s
[21:06:27.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:74:0)
[21:06:27.710] Build status: STARTED
[21:06:27.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:75:0) after 1m28s
[21:07:55.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:75:0)
[21:07:55.759] Build status: STARTED
[21:07:55.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:76:0) after 5m6s
[21:13:01.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:76:0)
[21:13:01.824] Build status: STARTED
[21:13:01.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:77:0) after 5m57s
[21:18:58.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:77:0)
[21:18:58.983] Build status: STARTED
[21:18:58.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:78:0) after 8m24s
[21:27:23.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:78:0)
[21:27:23.032] Build status: STARTED
[21:27:23.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:79:0) after 5m32s
[21:32:55.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:79:0)
[21:32:55.173] Build status: STARTED
[21:32:55.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:80:0) after 5m3s
[21:37:58.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:80:0)
[21:37:58.212] Build status: STARTED
[21:37:58.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:81:0) after 8m48s
[21:46:46.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:81:0)
[21:46:46.261] Build status: STARTED
[21:46:46.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:82:0) after 9m32s
[21:56:18.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:82:0)
[21:56:18.321] Build status: STARTED
[21:56:18.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:83:0) after 3m44s
[22:00:02.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:83:0)
[22:00:02.406] Build status: STARTED
[22:00:02.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:84:0) after 7m17s
[22:07:20.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:84:0)
[22:07:20.346] Build status: STARTED
[22:07:20.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:85:0) after 1m19s
[22:08:39.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:85:0)
[22:08:39.798] Build status: STARTED
[22:08:39.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:86:0) after 4m26s
[22:13:05.820] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:86:0)
[22:13:05.849] Build status: STARTED
[22:13:05.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:87:0) after 7m43s
[22:20:48.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:87:0)
[22:20:49.005] Build status: STARTED
[22:20:49.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:88:0) after 6m24s
[22:27:13.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:88:0)
[22:27:13.081] Build status: STARTED
[22:27:13.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:89:0) after 7m14s
[22:34:27.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:89:0)
[22:34:27.156] Build status: STARTED
[22:34:27.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:90:0) after 9m52s
[22:44:19.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:90:0)
[22:44:19.737] Build status: STARTED
[22:44:19.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:91:0) after 9m56s
[22:54:15.887] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:91:0)
[22:54:15.915] Build status: STARTED
[22:54:15.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:92:0) after 9m33s
[23:03:49.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:92:0)
[23:03:49.302] Build status: STARTED
[23:03:49.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:93:0) after 5m30s
[23:09:19.623] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:93:0)
[23:09:19.649] Build status: STARTED
[23:09:19.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:94:0) after 5m18s
[23:14:38.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:94:0)
[23:14:38.047] Build status: STARTED
[23:14:38.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:95:0) after 5m59s
[23:20:38.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:95:0)
[23:20:38.668] Build status: STARTED
[23:20:38.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:96:0) after 3m33s
[23:24:12.248] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:96:0)
[23:24:12.270] Build status: STARTED
[23:24:12.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:97:0) after 2m58s
[23:27:10.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:97:0)
[23:27:10.343] Build status: STARTED
[23:27:10.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:98:0) after 8m30s
[23:35:40.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:98:0)
[23:35:40.407] Build status: STARTED
[23:35:40.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:99:0) after 6m39s
[23:42:19.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:99:0)
[23:42:19.451] Build status: STARTED
[23:42:19.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:100:0) after 2m44s
[23:45:03.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:100:0)
[23:45:03.548] Build status: STARTED
[23:45:03.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:101:0) after 4m0s
[23:49:03.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:101:0)
[23:49:03.667] Build status: STARTED
[23:49:03.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:102:0) after 1m5s
[23:50:08.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:102:0)
[23:50:08.726] Build status: STARTED
[23:50:08.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:103:0) after 1m26s
[23:51:34.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:103:0)
[23:51:34.722] Build status: STARTED
[23:51:34.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:104:0) after 8m19s
[23:59:53.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:104:0)
[23:59:53.783] Build status: STARTED
[23:59:53.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:105:0) after 4m34s
[00:04:27.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:105:0)
[00:04:27.794] Build status: STARTED
[00:04:27.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:106:0) after 6m45s
[00:11:13.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:106:0)
[00:11:13.093] Build status: STARTED
[00:11:13.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:107:0) after 5m28s
[00:16:41.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:107:0)
[00:16:41.274] Build status: STARTED
[00:16:41.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:108:0) after 4m8s
[00:20:49.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:108:0)
[00:20:49.561] Build status: STARTED
[00:20:49.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:109:0) after 4m29s
[00:25:18.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:109:0)
[00:25:18.628] Build status: STARTED
[00:25:18.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:110:0) after 5m4s
[00:30:22.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:110:0)
[00:30:22.669] Build status: STARTED
[00:30:22.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:111:0) after 8m8s
[00:38:30.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:111:0)
[00:38:30.711] Build status: STARTED
[00:38:30.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:112:0) after 7m15s
[00:45:45.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:112:0)
[00:45:45.753] Build status: STARTED
[00:45:45.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:113:0) after 6m18s
[00:52:03.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:113:0)
[00:52:03.950] Build status: STARTED
[00:52:03.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxASan:8951615053089687536:114:0) after 7m14s
[00:56:11.881] Received PubSub notification, asking Buildbucket for the build status
[00:56:11.903] Build:
{
  "id": "8786184991205903473",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxASan"
  },
  "number": 19231,
  "createdBy": "project:chromium",
  "createTime": "2023-03-19T15:00:56.900320138Z",
  "startTime": "2023-03-19T15:08:10.384574Z",
  "endTime": "2023-03-20T00:56:11.479230060Z",
  "updateTime": "2023-03-20T00:56:11.479230060Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "2611fb29605d9012da26d824c7cf87d0b5d6cfc8",
      "ref": "refs/heads/main"
    }
  }
}
[00:56:11.903] Invocation finished in 9h55m16.182603371s with status FAILED