LUCI Scheduler :: chromium :: ToTLinuxTSan

Status: FAILED

Triggered by: -

Duration: 6 hours

Actions:

Definition (rev 835dd06986af6863f902c628becb4df908d0fc20)

buildbucket: <
  server: "cr-buildbucket.appspot.com"
  bucket: "luci.chromium.ci"
  builder: "ToTLinuxTSan"
>

Incoming triggers

34bc8e9f3d24bde65ee32942c1c7f8fa5c893d15 (5 years ago)
7419e0b0847b8dcfabfe9e00eea4429d558a2744 (5 years ago)
af10043350a250217cfc20eda1ae9043c4212419 (5 years ago)
bd3f2bc359f9a85223674746d5f2ca4568ac9a05 (5 years ago)
6e011ff2b9d8fb42825067666a37c4c1a929a6da (5 years ago)
1594fec8bc1c7ad1c190e459e05f78f331607795 (5 years ago)
7b83d038e19d8716b4deee7bfc0556370599f0c5 (5 years ago)
ff6fe667f86c413a60950f23ab2f929e0973f573 (5 years ago)
5a93deb9fb46350b1334e46850f294f177e16469 (5 years ago)
14f70baa9e0c87244ca66f0e5f1d4b951f40d9e1 (5 years ago)
ec095c485b381d48e13f6a30b0fa7c3bd1dde405 (5 years ago)
a0ac382ba38dbac8018178ee1a3e5568fce3ee38 (5 years ago)
6e2e0faa5350de58c5ea8136765cf5733db61b82 (5 years ago)
3131d45efc6e3b8689015d4c1f587809a53a853b (5 years ago)
7ee2ede8b34262f9f540b01f21f6340f810b4c8f (5 years ago)

Incoming properties

{
  "branch": "refs/heads/master",
  "repository": "https://chromium.googlesource.com/chromium/src",
  "revision": "7ee2ede8b34262f9f540b01f21f6340f810b4c8f"
}

Incoming tags

buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7ee2ede8b34262f9f540b01f21f6340f810b4c8f
gitiles_ref:refs/heads/master

Debug log (UTC)

[18:49:29.033] New invocation is queued and will start shortly
[18:49:30.110] Starting the invocation (attempt 1)
[18:49:30.184] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7ee2ede8b34262f9f540b01f21f6340f810b4c8f"
[18:49:30.184] Popped gitiles commit info from properties and tags
[18:49:30.184] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:49:30.184] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:49:30.184] Buildbucket request:
{
  "requestId": "9015652728899161616",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "properties": {
    },
  "gitilesCommit": {
    "host": "chromium.googlesource.com",
    "project": "chromium/src",
    "id": "7ee2ede8b34262f9f540b01f21f6340f810b4c8f",
    "ref": "refs/heads/master"
  },
  "tags": [
    {
      "key": "scheduler_invocation_id",
      "value": "9015652728899161616"
    },
    {
      "key": "scheduler_job_id",
      "value": "chromium/ToTLinuxTSan"
    },
    {
      "key": "user_agent",
      "value": "luci-scheduler"
    }
  ],
  "notify": {
    "pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
  }
}
[18:49:31.388] Scheduled build:
{
  "id": "8850222666847446304",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 9547,
  "createdBy": "project:chromium",
  "createTime": "2021-04-11T18:49:30.359724Z",
  "updateTime": "2021-04-11T18:49:31.206170Z",
  "status": "SCHEDULED",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "7ee2ede8b34262f9f540b01f21f6340f810b4c8f",
      "ref": "refs/heads/master"
    }
  }
}
[18:49:31.388] Task URL: https://cr-buildbucket.appspot.com/build/8850222666847446304
[18:49:31.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:2:0) after 8m40s
[18:51:04.951] Received PubSub notification, asking Buildbucket for the build status
[18:51:05.002] Build status: STARTED
[18:58:11.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:2:0)
[18:58:11.425] Build status: STARTED
[18:58:11.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:4:0) after 1m28s
[18:59:39.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:4:0)
[18:59:39.484] Build status: STARTED
[18:59:39.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:5:0) after 7m9s
[19:06:48.523] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:5:0)
[19:06:48.550] Build status: STARTED
[19:06:48.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:6:0) after 5m54s
[19:12:42.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:6:0)
[19:12:42.647] Build status: STARTED
[19:12:42.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:7:0) after 2m26s
[19:15:08.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:7:0)
[19:15:08.900] Build status: STARTED
[19:15:08.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:8:0) after 8m22s
[19:23:31.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:8:0)
[19:23:31.394] Build status: STARTED
[19:23:31.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:9:0) after 2m22s
[19:25:53.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:9:0)
[19:25:53.558] Build status: STARTED
[19:25:53.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:10:0) after 6m7s
[19:32:00.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:10:0)
[19:32:00.957] Build status: STARTED
[19:32:00.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:11:0) after 2m45s
[19:34:45.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:11:0)
[19:34:46.021] Build status: STARTED
[19:34:46.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:12:0) after 8m31s
[19:43:17.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:12:0)
[19:43:17.699] Build status: STARTED
[19:43:17.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:13:0) after 1m25s
[19:44:42.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:13:0)
[19:44:42.742] Build status: STARTED
[19:44:42.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:14:0) after 8m25s
[19:53:07.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:14:0)
[19:53:08.022] Build status: STARTED
[19:53:08.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:15:0) after 2m33s
[19:55:41.589] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:15:0)
[19:55:41.624] Build status: STARTED
[19:55:41.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:16:0) after 3m32s
[19:59:13.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:16:0)
[19:59:13.656] Build status: STARTED
[19:59:13.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:17:0) after 2m50s
[20:02:04.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:17:0)
[20:02:04.314] Build status: STARTED
[20:02:04.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:18:0) after 5m9s
[20:07:13.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:18:0)
[20:07:13.414] Build status: STARTED
[20:07:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:19:0) after 4m43s
[20:11:56.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:19:0)
[20:11:56.466] Build status: STARTED
[20:11:56.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:20:0) after 8m1s
[20:19:57.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:20:0)
[20:19:57.545] Build status: STARTED
[20:19:57.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:21:0) after 9m11s
[20:29:08.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:21:0)
[20:29:08.749] Build status: STARTED
[20:29:08.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:22:0) after 7m16s
[20:36:24.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:22:0)
[20:36:24.994] Build status: STARTED
[20:36:24.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:23:0) after 5m54s
[20:42:19.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:23:0)
[20:42:19.087] Build status: STARTED
[20:42:19.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:24:0) after 2m33s
[20:44:52.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:24:0)
[20:44:52.377] Build status: STARTED
[20:44:52.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:25:0) after 8m2s
[20:52:54.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:25:0)
[20:52:54.419] Build status: STARTED
[20:52:54.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:26:0) after 7m58s
[21:00:52.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:26:0)
[21:00:52.668] Build status: STARTED
[21:00:52.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:27:0) after 1m58s
[21:02:50.734] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:27:0)
[21:02:50.772] Build status: STARTED
[21:02:50.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:28:0) after 9m0s
[21:11:50.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:28:0)
[21:11:50.817] Build status: STARTED
[21:11:50.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:29:0) after 1m11s
[21:13:01.934] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:29:0)
[21:13:02.218] Build status: STARTED
[21:13:02.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:30:0) after 4m42s
[21:17:44.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:30:0)
[21:17:44.593] Build status: STARTED
[21:17:44.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:31:0) after 4m48s
[21:22:32.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:31:0)
[21:22:32.852] Build status: STARTED
[21:22:32.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:32:0) after 7m32s
[21:30:04.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:32:0)
[21:30:04.902] Build status: STARTED
[21:30:04.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:33:0) after 9m26s
[21:39:31.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:33:0)
[21:39:31.116] Build status: STARTED
[21:39:31.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:34:0) after 7m15s
[21:46:46.158] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:34:0)
[21:46:46.186] Build status: STARTED
[21:46:46.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:35:0) after 1m18s
[21:48:04.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:35:0)
[21:48:04.317] Build status: STARTED
[21:48:04.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:36:0) after 1m9s
[21:49:13.404] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:36:0)
[21:49:13.432] Build status: STARTED
[21:49:13.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:37:0) after 2m35s
[21:51:48.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:37:0)
[21:51:48.474] Build status: STARTED
[21:51:48.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:38:0) after 4m13s
[21:56:01.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:38:0)
[21:56:01.829] Build status: STARTED
[21:56:01.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:39:0) after 7m36s
[22:03:37.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:39:0)
[22:03:38.034] Build status: STARTED
[22:03:38.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:40:0) after 3m1s
[22:06:39.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:40:0)
[22:06:40.078] Build status: STARTED
[22:06:40.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:41:0) after 5m11s
[22:11:51.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:41:0)
[22:11:51.443] Build status: STARTED
[22:11:51.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:42:0) after 2m16s
[22:14:07.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:42:0)
[22:14:07.489] Build status: STARTED
[22:14:07.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:43:0) after 6m0s
[22:20:07.930] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:43:0)
[22:20:07.963] Build status: STARTED
[22:20:07.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:44:0) after 1m23s
[22:21:31.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:44:0)
[22:21:31.205] Build status: STARTED
[22:21:31.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:45:0) after 8m5s
[22:29:36.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:45:0)
[22:29:36.257] Build status: STARTED
[22:29:36.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:46:0) after 7m27s
[22:37:03.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:46:0)
[22:37:03.306] Build status: STARTED
[22:37:03.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:47:0) after 2m49s
[22:39:52.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:47:0)
[22:39:52.524] Build status: STARTED
[22:39:52.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:48:0) after 3m39s
[22:43:31.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:48:0)
[22:43:31.570] Build status: STARTED
[22:43:31.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:49:0) after 6m25s
[22:49:56.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:49:0)
[22:49:56.797] Build status: STARTED
[22:49:56.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:50:0) after 4m45s
[22:54:41.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:50:0)
[22:54:41.845] Build status: STARTED
[22:54:41.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:51:0) after 9m9s
[23:03:50.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:51:0)
[23:03:50.888] Build status: STARTED
[23:03:50.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:52:0) after 6m33s
[23:10:23.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:52:0)
[23:10:23.940] Build status: STARTED
[23:10:23.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:53:0) after 5m4s
[23:15:27.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:53:0)
[23:15:27.988] Build status: STARTED
[23:15:27.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:54:0) after 3m8s
[23:18:36.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:54:0)
[23:18:36.456] Build status: STARTED
[23:18:36.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:55:0) after 7m33s
[23:26:09.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:55:0)
[23:26:09.577] Build status: STARTED
[23:26:09.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:56:0) after 6m29s
[23:32:38.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:56:0)
[23:32:38.959] Build status: STARTED
[23:32:38.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:57:0) after 4m35s
[23:37:14.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:57:0)
[23:37:14.320] Build status: STARTED
[23:37:14.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:58:0) after 7m30s
[23:44:44.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:58:0)
[23:44:44.386] Build status: STARTED
[23:44:44.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:59:0) after 5m38s
[23:50:22.404] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:59:0)
[23:50:22.429] Build status: STARTED
[23:50:22.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:60:0) after 7m1s
[23:57:23.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:60:0)
[23:57:23.643] Build status: STARTED
[23:57:23.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:61:0) after 9m26s
[00:06:49.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:61:0)
[00:06:49.889] Build status: STARTED
[00:06:49.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:62:0) after 8m8s
[00:14:57.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:62:0)
[00:14:57.944] Build status: STARTED
[00:14:57.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:63:0) after 8m50s
[00:23:48.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:63:0)
[00:23:48.341] Build status: STARTED
[00:23:48.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:64:0) after 6m11s
[00:29:59.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:64:0)
[00:29:59.391] Build status: STARTED
[00:29:59.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:65:0) after 3m41s
[00:33:40.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:65:0)
[00:33:40.525] Build status: STARTED
[00:33:40.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:66:0) after 8m54s
[00:42:34.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:66:0)
[00:42:34.697] Build status: STARTED
[00:42:34.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:67:0) after 5m28s
[00:48:02.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:67:0)
[00:48:02.745] Build status: STARTED
[00:48:02.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:68:0) after 7m20s
[00:55:23.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:68:0)
[00:55:23.402] Build status: STARTED
[00:55:23.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:69:0) after 3m17s
[00:58:40.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:69:0)
[00:58:40.452] Build status: STARTED
[00:58:40.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:70:0) after 1m16s
[00:59:56.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:70:0)
[00:59:56.494] Build status: STARTED
[00:59:56.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:71:0) after 8m8s
[01:08:04.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:71:0)
[01:08:04.601] Build status: STARTED
[01:08:04.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:72:0) after 9m29s
[01:17:33.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:72:0)
[01:17:33.651] Build status: STARTED
[01:17:33.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:73:0) after 5m1s
[01:22:34.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:73:0)
[01:22:34.735] Build status: STARTED
[01:22:34.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:74:0) after 2m49s
[01:25:23.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:74:0)
[01:25:23.755] Build status: STARTED
[01:25:23.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:75:0) after 5m42s
[01:31:05.774] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:75:0)
[01:31:05.799] Build status: STARTED
[01:31:05.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:76:0) after 9m47s
[01:40:52.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:76:0)
[01:40:54.087] Build status: STARTED
[01:40:54.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:77:0) after 1m12s
[01:42:06.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:77:0)
[01:42:06.559] Build status: STARTED
[01:42:06.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:9015652728899161616:78:0) after 4m32s
[01:44:55.591] Received PubSub notification, asking Buildbucket for the build status
[01:44:55.616] Build:
{
  "id": "8850222666847446304",
  "builder": {
    "project": "chromium",
    "bucket": "ci",
    "builder": "ToTLinuxTSan"
  },
  "number": 9547,
  "createdBy": "project:chromium",
  "createTime": "2021-04-11T18:49:30.359724Z",
  "startTime": "2021-04-11T18:50:59.867192Z",
  "endTime": "2021-04-12T01:44:55.352200663Z",
  "updateTime": "2021-04-12T01:44:55.352535763Z",
  "status": "FAILURE",
  "input": {
    "gitilesCommit": {
      "host": "chromium.googlesource.com",
      "project": "chromium/src",
      "id": "7ee2ede8b34262f9f540b01f21f6340f810b4c8f",
      "ref": "refs/heads/master"
    }
  }
}
[01:44:55.616] Invocation finished in 6h55m26.597762817s with status FAILED