[01:44:29.411] New invocation is queued and will start shortly
[01:44:30.493] Starting the invocation (attempt 1)
[01:44:30.535] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a223c02bb3f9dd1f83cf4cc6dfcd415675822b54"
[01:44:30.535] Popped gitiles commit info from properties and tags
[01:44:30.535] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:44:30.535] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:44:30.535] Buildbucket request:
{
"requestId": "8955017248438976800",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a223c02bb3f9dd1f83cf4cc6dfcd415675822b54",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955017248438976800"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:44:31.015] Scheduled build:
{
"id": "8789587186464091969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16077,
"createdBy": "project:chromium",
"createTime": "2023-02-10T01:44:30.663953077Z",
"updateTime": "2023-02-10T01:44:30.663953077Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a223c02bb3f9dd1f83cf4cc6dfcd415675822b54",
"ref": "refs/heads/main"
}
}
}
[01:44:31.015] Task URL: https://cr-buildbucket.appspot.com/build/8789587186464091969
[01:44:31.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:2:0) after 3m24s
[01:45:34.859] Received PubSub notification, asking Buildbucket for the build status
[01:45:34.880] Build status: STARTED
[01:47:55.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:2:0)
[01:47:55.595] Build status: STARTED
[01:47:55.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:4:0) after 9m39s
[01:57:34.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:4:0)
[01:57:34.670] Build status: STARTED
[01:57:34.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:5:0) after 2m33s
[02:00:07.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:5:0)
[02:00:07.988] Build status: STARTED
[02:00:07.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:6:0) after 9m27s
[02:09:35.025] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:6:0)
[02:09:35.053] Build status: STARTED
[02:09:35.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:7:0) after 8m24s
[02:17:59.117] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:7:0)
[02:17:59.138] Build status: STARTED
[02:17:59.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:8:0) after 7m6s
[02:25:05.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:8:0)
[02:25:05.203] Build status: STARTED
[02:25:05.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:9:0) after 1m21s
[02:26:26.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:9:0)
[02:26:26.609] Build status: STARTED
[02:26:26.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:10:0) after 5m32s
[02:31:58.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:10:0)
[02:31:58.765] Build status: STARTED
[02:31:58.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:11:0) after 1m46s
[02:33:45.079] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:11:0)
[02:33:45.103] Build status: STARTED
[02:33:45.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:12:0) after 3m3s
[02:36:48.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:12:0)
[02:36:48.214] Build status: STARTED
[02:36:48.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:13:0) after 5m19s
[02:42:07.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:13:0)
[02:42:07.602] Build status: STARTED
[02:42:07.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:14:0) after 5m20s
[02:47:27.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:14:0)
[02:47:27.647] Build status: STARTED
[02:47:27.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:15:0) after 4m19s
[02:51:46.658] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:15:0)
[02:51:46.684] Build status: STARTED
[02:51:46.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:16:0) after 1m22s
[02:53:08.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:16:0)
[02:53:08.925] Build status: STARTED
[02:53:08.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:17:0) after 2m34s
[02:55:43.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:17:0)
[02:55:43.242] Build status: STARTED
[02:55:43.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:18:0) after 5m15s
[03:00:58.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:18:0)
[03:00:58.509] Build status: STARTED
[03:00:58.509] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:19:0) after 5m12s
[03:06:10.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:19:0)
[03:06:10.649] Build status: STARTED
[03:06:10.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:20:0) after 2m48s
[03:08:58.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:20:0)
[03:08:58.774] Build status: STARTED
[03:08:58.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:21:0) after 2m36s
[03:11:35.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:21:0)
[03:11:35.048] Build status: STARTED
[03:11:35.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:22:0) after 1m56s
[03:13:31.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:22:0)
[03:13:31.123] Build status: STARTED
[03:13:31.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:23:0) after 4m56s
[03:18:27.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:23:0)
[03:18:27.507] Build status: STARTED
[03:18:27.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:24:0) after 4m2s
[03:22:29.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:24:0)
[03:22:29.556] Build status: STARTED
[03:22:29.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:25:0) after 9m48s
[03:32:17.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:25:0)
[03:32:17.718] Build status: STARTED
[03:32:17.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:26:0) after 2m32s
[03:34:49.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:26:0)
[03:34:49.913] Build status: STARTED
[03:34:49.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:27:0) after 1m21s
[03:36:10.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:27:0)
[03:36:10.999] Build status: STARTED
[03:36:10.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:28:0) after 4m2s
[03:40:13.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:28:0)
[03:40:13.067] Build status: STARTED
[03:40:13.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:29:0) after 2m20s
[03:42:33.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:29:0)
[03:42:33.121] Build status: STARTED
[03:42:33.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:30:0) after 9m35s
[03:52:08.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:30:0)
[03:52:08.251] Build status: STARTED
[03:52:08.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:31:0) after 4m30s
[03:56:38.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:31:0)
[03:56:38.422] Build status: STARTED
[03:56:38.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:32:0) after 1m37s
[03:58:15.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:32:0)
[03:58:15.581] Build status: STARTED
[03:58:15.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:33:0) after 1m38s
[03:59:53.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:33:0)
[03:59:53.684] Build status: STARTED
[03:59:53.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:34:0) after 1m12s
[04:01:05.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:34:0)
[04:01:05.771] Build status: STARTED
[04:01:05.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:35:0) after 5m46s
[04:06:51.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:35:0)
[04:06:51.919] Build status: STARTED
[04:06:51.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:36:0) after 3m11s
[04:10:03.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:36:0)
[04:10:03.242] Build status: STARTED
[04:10:03.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:37:0) after 7m0s
[04:17:03.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:37:0)
[04:17:03.290] Build status: STARTED
[04:17:03.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:38:0) after 9m23s
[04:26:26.356] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:38:0)
[04:26:26.383] Build status: STARTED
[04:26:26.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:39:0) after 5m27s
[04:31:53.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:39:0)
[04:31:53.717] Build status: STARTED
[04:31:53.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:40:0) after 2m41s
[04:34:34.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:40:0)
[04:34:34.772] Build status: STARTED
[04:34:34.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:41:0) after 4m44s
[04:39:18.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:41:0)
[04:39:18.833] Build status: STARTED
[04:39:18.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:42:0) after 7m43s
[04:47:01.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:42:0)
[04:47:01.905] Build status: STARTED
[04:47:01.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:43:0) after 5m51s
[04:52:53.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:43:0)
[04:52:53.050] Build status: STARTED
[04:52:53.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:44:0) after 1m18s
[04:54:11.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:44:0)
[04:54:11.101] Build status: STARTED
[04:54:11.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:45:0) after 3m58s
[04:58:09.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:45:0)
[04:58:09.105] Build status: STARTED
[04:58:09.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:46:0) after 2m30s
[05:00:39.171] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:46:0)
[05:00:39.202] Build status: STARTED
[05:00:39.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:47:0) after 4m16s
[05:04:55.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:47:0)
[05:04:55.314] Build status: STARTED
[05:04:55.314] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:48:0) after 1m24s
[05:06:19.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:48:0)
[05:06:19.533] Build status: STARTED
[05:06:19.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:49:0) after 4m40s
[05:10:59.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:49:0)
[05:10:59.762] Build status: STARTED
[05:10:59.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:50:0) after 6m21s
[05:17:20.877] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:50:0)
[05:17:20.895] Build status: STARTED
[05:17:20.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:51:0) after 2m3s
[05:19:23.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:51:0)
[05:19:23.949] Build status: STARTED
[05:19:23.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:52:0) after 1m38s
[05:21:01.980] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:52:0)
[05:21:02.010] Build status: STARTED
[05:21:02.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:53:0) after 4m45s
[05:25:47.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:53:0)
[05:25:47.063] Build status: STARTED
[05:25:47.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:54:0) after 7m50s
[05:33:37.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:54:0)
[05:33:37.434] Build status: STARTED
[05:33:37.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:55:0) after 1m59s
[05:35:36.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:55:0)
[05:35:36.520] Build status: STARTED
[05:35:36.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:56:0) after 3m30s
[05:39:06.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:56:0)
[05:39:06.772] Build status: STARTED
[05:39:06.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:57:0) after 1m28s
[05:40:34.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:57:0)
[05:40:34.841] Build status: STARTED
[05:40:34.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:58:0) after 1m29s
[05:42:03.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:58:0)
[05:42:03.984] Build status: STARTED
[05:42:03.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:59:0) after 4m49s
[05:46:53.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:59:0)
[05:46:53.161] Build status: STARTED
[05:46:53.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:60:0) after 2m3s
[05:48:56.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:60:0)
[05:48:56.321] Build status: STARTED
[05:48:56.321] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:61:0) after 1m42s
[05:50:38.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:61:0)
[05:50:38.402] Build status: STARTED
[05:50:38.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:62:0) after 2m40s
[05:53:18.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:62:0)
[05:53:18.820] Build status: STARTED
[05:53:18.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:63:0) after 8m5s
[06:01:23.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:63:0)
[06:01:23.936] Build status: STARTED
[06:01:23.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:64:0) after 6m37s
[06:08:01.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:64:0)
[06:08:01.280] Build status: STARTED
[06:08:01.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:65:0) after 5m31s
[06:13:32.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:65:0)
[06:13:32.349] Build status: STARTED
[06:13:32.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:66:0) after 1m28s
[06:15:00.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:66:0)
[06:15:00.630] Build status: STARTED
[06:15:00.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:67:0) after 5m14s
[06:20:14.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:67:0)
[06:20:14.789] Build status: STARTED
[06:20:14.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:68:0) after 2m21s
[06:22:35.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:68:0)
[06:22:35.991] Build status: STARTED
[06:22:35.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:69:0) after 1m11s
[06:23:47.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:69:0)
[06:23:47.045] Build status: STARTED
[06:23:47.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:70:0) after 7m48s
[06:31:35.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:70:0)
[06:31:35.090] Build status: STARTED
[06:31:35.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:71:0) after 4m37s
[06:36:12.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:71:0)
[06:36:12.108] Build status: STARTED
[06:36:12.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:72:0) after 4m48s
[06:41:00.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:72:0)
[06:41:00.358] Build status: STARTED
[06:41:00.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:73:0) after 8m2s
[06:49:02.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:73:0)
[06:49:02.498] Build status: STARTED
[06:49:02.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:74:0) after 7m4s
[06:56:06.609] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:74:0)
[06:56:06.639] Build status: STARTED
[06:56:06.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:75:0) after 4m26s
[07:00:32.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:75:0)
[07:00:32.710] Build status: STARTED
[07:00:32.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:76:0) after 8m51s
[07:09:23.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:76:0)
[07:09:23.757] Build status: STARTED
[07:09:23.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:77:0) after 4m12s
[07:13:35.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:77:0)
[07:13:35.818] Build status: STARTED
[07:13:35.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:78:0) after 5m34s
[07:19:09.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:78:0)
[07:19:09.873] Build status: STARTED
[07:19:09.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:79:0) after 5m59s
[07:25:08.948] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:79:0)
[07:25:08.968] Build status: STARTED
[07:25:08.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:80:0) after 6m44s
[07:31:53.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:80:0)
[07:31:53.085] Build status: STARTED
[07:31:53.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:81:0) after 4m59s
[07:36:52.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:81:0)
[07:36:52.163] Build status: STARTED
[07:36:52.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:82:0) after 7m40s
[07:44:32.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:82:0)
[07:44:32.484] Build status: STARTED
[07:44:32.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:83:0) after 2m38s
[07:47:10.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:83:0)
[07:47:10.679] Build status: STARTED
[07:47:10.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:84:0) after 6m11s
[07:53:21.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:84:0)
[07:53:21.738] Build status: STARTED
[07:53:21.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:85:0) after 5m36s
[07:58:57.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:85:0)
[07:58:58.211] Build status: STARTED
[07:58:58.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:86:0) after 2m10s
[08:01:08.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:86:0)
[08:01:08.299] Build status: STARTED
[08:01:08.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:87:0) after 7m7s
[08:08:15.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:87:0)
[08:08:15.429] Build status: STARTED
[08:08:15.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:88:0) after 1m33s
[08:09:48.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:88:0)
[08:09:48.475] Build status: STARTED
[08:09:48.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:89:0) after 9m4s
[08:18:52.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:89:0)
[08:18:52.627] Build status: STARTED
[08:18:52.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:90:0) after 3m2s
[08:21:54.808] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:90:0)
[08:21:54.830] Build status: STARTED
[08:21:54.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:91:0) after 2m21s
[08:24:15.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:91:0)
[08:24:15.882] Build status: STARTED
[08:24:15.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:92:0) after 9m52s
[08:34:08.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:92:0)
[08:34:08.275] Build status: STARTED
[08:34:08.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:93:0) after 1m37s
[08:35:45.301] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:93:0)
[08:35:45.369] Build status: STARTED
[08:35:45.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:94:0) after 6m46s
[08:42:31.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:94:0)
[08:42:31.429] Build status: STARTED
[08:42:31.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:95:0) after 5m38s
[08:48:09.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:95:0)
[08:48:09.505] Build status: STARTED
[08:48:09.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:96:0) after 5m10s
[08:53:19.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:96:0)
[08:53:19.680] Build status: STARTED
[08:53:19.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:97:0) after 8m33s
[09:01:52.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:97:0)
[09:01:52.726] Build status: STARTED
[09:01:52.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:98:0) after 4m29s
[09:06:21.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:98:0)
[09:06:21.841] Build status: STARTED
[09:06:21.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:99:0) after 8m49s
[09:15:10.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:99:0)
[09:15:10.884] Build status: STARTED
[09:15:10.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:100:0) after 9m18s
[09:24:29.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:100:0)
[09:24:29.318] Build status: STARTED
[09:24:29.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:101:0) after 1m58s
[09:26:27.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:101:0)
[09:26:27.514] Build status: STARTED
[09:26:27.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:102:0) after 6m29s
[09:32:56.667] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:102:0)
[09:32:56.697] Build status: STARTED
[09:32:56.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8955017248438976800:103:0) after 1m54s
[09:34:38.771] Received PubSub notification, asking Buildbucket for the build status
[09:34:38.798] Build:
{
"id": "8789587186464091969",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 16077,
"createdBy": "project:chromium",
"createTime": "2023-02-10T01:44:30.663953077Z",
"startTime": "2023-02-10T01:45:34.234180Z",
"endTime": "2023-02-10T09:34:38.449972771Z",
"updateTime": "2023-02-10T09:34:38.449972771Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a223c02bb3f9dd1f83cf4cc6dfcd415675822b54",
"ref": "refs/heads/main"
}
}
}
[09:34:38.798] Invocation finished in 7h50m9.401427401s with status FAILED