[17:31:26.661] New invocation is queued and will start shortly
[17:31:27.727] Starting the invocation (attempt 1)
[17:31:27.754] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ce4fc092f34a50c78a44464d94f114ef8b5f53f8"
[17:31:27.754] Popped gitiles commit info from properties and tags
[17:31:27.754] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:31:27.754] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:31:27.754] Buildbucket request:
{
"requestId": "8874598162029392128",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ce4fc092f34a50c78a44464d94f114ef8b5f53f8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874598162029392128"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:31:28.274] Scheduled build:
{
"id": "8709168100167422369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26193,
"createdBy": "project:chromium",
"createTime": "2025-07-16T17:31:27.813090499Z",
"updateTime": "2025-07-16T17:31:27.813090499Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ce4fc092f34a50c78a44464d94f114ef8b5f53f8",
"ref": "refs/heads/main"
}
}
}
[17:31:28.274] Task URL: https://cr-buildbucket.appspot.com/build/8709168100167422369
[17:31:28.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:2:0) after 9m56s
[17:31:31.356] Received PubSub notification, asking Buildbucket for the build status
[17:31:31.386] Build status: SCHEDULED
[17:31:37.030] Received PubSub notification, asking Buildbucket for the build status
[17:31:37.062] Build status: STARTED
[17:41:24.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:2:0)
[17:41:24.363] Build status: STARTED
[17:41:24.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:5:0) after 8m22s
[17:49:46.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:5:0)
[17:49:46.431] Build status: STARTED
[17:49:46.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:6:0) after 6m14s
[17:56:00.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:6:0)
[17:56:00.497] Build status: STARTED
[17:56:00.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:7:0) after 4m48s
[18:00:48.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:7:0)
[18:00:48.557] Build status: STARTED
[18:00:48.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:8:0) after 7m3s
[18:07:51.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:8:0)
[18:07:51.602] Build status: STARTED
[18:07:51.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:9:0) after 1m7s
[18:08:58.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:9:0)
[18:08:58.640] Build status: STARTED
[18:08:58.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:10:0) after 6m54s
[18:15:52.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:10:0)
[18:15:52.710] Build status: STARTED
[18:15:52.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:11:0) after 5m29s
[18:21:21.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:11:0)
[18:21:21.828] Build status: STARTED
[18:21:21.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:12:0) after 9m50s
[18:31:11.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:12:0)
[18:31:11.904] Build status: STARTED
[18:31:11.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:13:0) after 5m22s
[18:36:33.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:13:0)
[18:36:33.986] Build status: STARTED
[18:36:33.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:14:0) after 5m53s
[18:42:27.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:14:0)
[18:42:27.092] Build status: STARTED
[18:42:27.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:15:0) after 1m53s
[18:44:20.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:15:0)
[18:44:20.238] Build status: STARTED
[18:44:20.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:16:0) after 5m38s
[18:49:58.315] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:16:0)
[18:49:58.368] Build status: STARTED
[18:49:58.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:17:0) after 2m53s
[18:52:51.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:17:0)
[18:52:51.463] Build status: STARTED
[18:52:51.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:18:0) after 5m40s
[18:58:31.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:18:0)
[18:58:31.485] Build status: STARTED
[18:58:31.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:19:0) after 4m24s
[19:02:55.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:19:0)
[19:02:55.564] Build status: STARTED
[19:02:55.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:20:0) after 8m4s
[19:10:59.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:20:0)
[19:10:59.627] Build status: STARTED
[19:10:59.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:21:0) after 4m56s
[19:15:55.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:21:0)
[19:15:55.688] Build status: STARTED
[19:15:55.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:22:0) after 3m30s
[19:19:25.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:22:0)
[19:19:25.819] Build status: STARTED
[19:19:25.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:23:0) after 8m3s
[19:27:28.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:23:0)
[19:27:28.880] Build status: STARTED
[19:27:28.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:24:0) after 5m10s
[19:32:38.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:24:0)
[19:32:38.964] Build status: STARTED
[19:32:38.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:25:0) after 8m29s
[19:41:07.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:25:0)
[19:41:08.028] Build status: STARTED
[19:41:08.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:26:0) after 5m24s
[19:46:32.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:26:0)
[19:46:32.078] Build status: STARTED
[19:46:32.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:27:0) after 8m24s
[19:54:56.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:27:0)
[19:54:56.102] Build status: STARTED
[19:54:56.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:28:0) after 2m9s
[19:57:05.119] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:28:0)
[19:57:05.196] Build status: STARTED
[19:57:05.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:29:0) after 3m53s
[20:00:58.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:29:0)
[20:00:58.274] Build status: STARTED
[20:00:58.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:30:0) after 2m50s
[20:03:48.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:30:0)
[20:03:48.406] Build status: STARTED
[20:03:48.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:31:0) after 8m31s
[20:12:19.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:31:0)
[20:12:19.487] Build status: STARTED
[20:12:19.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:32:0) after 7m49s
[20:20:08.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:32:0)
[20:20:08.573] Build status: STARTED
[20:20:08.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:33:0) after 2m1s
[20:22:09.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:33:0)
[20:22:09.652] Build status: STARTED
[20:22:09.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:34:0) after 3m51s
[20:26:00.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:34:0)
[20:26:00.664] Build status: STARTED
[20:26:00.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:35:0) after 4m8s
[20:30:08.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:35:0)
[20:30:08.717] Build status: STARTED
[20:30:08.717] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:36:0) after 4m27s
[20:34:35.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:36:0)
[20:34:35.764] Build status: STARTED
[20:34:35.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:37:0) after 2m34s
[20:37:10.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:37:0)
[20:37:10.222] Build status: STARTED
[20:37:10.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:38:0) after 4m29s
[20:41:39.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:38:0)
[20:41:39.352] Build status: STARTED
[20:41:39.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:39:0) after 1m34s
[20:43:13.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:39:0)
[20:43:13.485] Build status: STARTED
[20:43:13.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:40:0) after 8m58s
[20:52:11.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:40:0)
[20:52:11.567] Build status: STARTED
[20:52:11.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:41:0) after 2m4s
[20:54:15.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:41:0)
[20:54:15.607] Build status: STARTED
[20:54:15.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:42:0) after 6m54s
[21:01:09.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:42:0)
[21:01:09.890] Build status: STARTED
[21:01:09.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:43:0) after 5m55s
[21:07:05.018] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:43:0)
[21:07:05.042] Build status: STARTED
[21:07:05.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:44:0) after 4m19s
[21:11:24.071] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:44:0)
[21:11:24.089] Build status: STARTED
[21:11:24.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:45:0) after 3m24s
[21:14:48.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:45:0)
[21:14:48.147] Build status: STARTED
[21:14:48.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:46:0) after 3m58s
[21:18:46.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:46:0)
[21:18:46.195] Build status: STARTED
[21:18:46.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:47:0) after 7m44s
[21:26:30.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:47:0)
[21:26:30.247] Build status: STARTED
[21:26:30.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:48:0) after 5m48s
[21:32:18.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:48:0)
[21:32:18.379] Build status: STARTED
[21:32:18.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:49:0) after 9m4s
[21:41:22.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:49:0)
[21:41:22.554] Build status: STARTED
[21:41:22.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:50:0) after 3m17s
[21:44:39.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:50:0)
[21:44:39.616] Build status: STARTED
[21:44:39.616] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:51:0) after 3m12s
[21:47:51.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:51:0)
[21:47:51.681] Build status: STARTED
[21:47:51.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:52:0) after 3m54s
[21:51:45.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:52:0)
[21:51:45.750] Build status: STARTED
[21:51:45.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:53:0) after 7m40s
[21:59:25.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:53:0)
[21:59:25.849] Build status: STARTED
[21:59:25.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:54:0) after 3m30s
[22:02:55.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:54:0)
[22:02:55.907] Build status: STARTED
[22:02:55.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:55:0) after 6m9s
[22:09:04.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:55:0)
[22:09:04.980] Build status: STARTED
[22:09:04.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:56:0) after 4m19s
[22:13:24.020] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:56:0)
[22:13:24.041] Build status: STARTED
[22:13:24.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:57:0) after 2m10s
[22:15:34.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:57:0)
[22:15:34.141] Build status: STARTED
[22:15:34.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:58:0) after 5m5s
[22:20:39.235] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:58:0)
[22:20:39.253] Build status: STARTED
[22:20:39.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:59:0) after 5m9s
[22:25:48.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:59:0)
[22:25:48.379] Build status: STARTED
[22:25:48.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:60:0) after 9m11s
[22:34:59.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:60:0)
[22:34:59.395] Build status: STARTED
[22:34:59.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:61:0) after 6m14s
[22:41:13.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:61:0)
[22:41:13.447] Build status: STARTED
[22:41:13.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:62:0) after 7m2s
[22:48:15.501] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:62:0)
[22:48:15.534] Build status: STARTED
[22:48:15.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:63:0) after 4m39s
[22:52:54.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:63:0)
[22:52:54.936] Build status: STARTED
[22:52:54.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:64:0) after 3m17s
[22:56:12.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:64:0)
[22:56:12.110] Build status: STARTED
[22:56:12.111] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:65:0) after 6m5s
[23:02:17.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:65:0)
[23:02:17.166] Build status: STARTED
[23:02:17.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:66:0) after 1m7s
[23:03:24.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:66:0)
[23:03:24.249] Build status: STARTED
[23:03:24.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:67:0) after 2m16s
[23:05:40.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:67:0)
[23:05:40.300] Build status: STARTED
[23:05:40.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:68:0) after 9m40s
[23:15:20.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:68:0)
[23:15:20.369] Build status: STARTED
[23:15:20.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:69:0) after 7m41s
[23:23:01.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:69:0)
[23:23:01.519] Build status: STARTED
[23:23:01.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:70:0) after 8m41s
[23:31:42.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:70:0)
[23:31:42.607] Build status: STARTED
[23:31:42.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:71:0) after 5m5s
[23:36:47.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:71:0)
[23:36:47.720] Build status: STARTED
[23:36:47.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:72:0) after 1m8s
[23:37:55.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:72:0)
[23:37:55.884] Build status: STARTED
[23:37:55.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:73:0) after 4m22s
[23:42:17.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:73:0)
[23:42:17.941] Build status: STARTED
[23:42:17.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:74:0) after 4m20s
[23:46:37.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:74:0)
[23:46:37.990] Build status: STARTED
[23:46:37.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:75:0) after 9m58s
[23:56:36.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:75:0)
[23:56:36.035] Build status: STARTED
[23:56:36.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:76:0) after 3m6s
[23:59:42.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:76:0)
[23:59:42.081] Build status: STARTED
[23:59:42.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:77:0) after 7m44s
[00:07:26.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:77:0)
[00:07:26.137] Build status: STARTED
[00:07:26.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:78:0) after 9m22s
[00:16:48.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:78:0)
[00:16:48.190] Build status: STARTED
[00:16:48.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:79:0) after 6m56s
[00:23:44.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:79:0)
[00:23:44.296] Build status: STARTED
[00:23:44.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:80:0) after 5m20s
[00:29:04.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:80:0)
[00:29:04.375] Build status: STARTED
[00:29:04.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:81:0) after 2m37s
[00:31:41.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:81:0)
[00:31:41.428] Build status: STARTED
[00:31:41.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:82:0) after 6m2s
[00:37:43.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:82:0)
[00:37:43.501] Build status: STARTED
[00:37:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:83:0) after 4m17s
[00:42:00.539] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:83:0)
[00:42:00.569] Build status: STARTED
[00:42:00.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:84:0) after 3m41s
[00:45:41.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:84:0)
[00:45:41.729] Build status: STARTED
[00:45:41.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:85:0) after 2m30s
[00:48:11.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:85:0)
[00:48:11.863] Build status: STARTED
[00:48:11.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:86:0) after 4m47s
[00:52:58.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:86:0)
[00:52:58.964] Build status: STARTED
[00:52:58.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:87:0) after 3m16s
[00:56:14.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:87:0)
[00:56:15.039] Build status: STARTED
[00:56:15.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:88:0) after 2m27s
[00:58:42.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:88:0)
[00:58:42.083] Build status: STARTED
[00:58:42.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:89:0) after 5m19s
[01:04:01.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:89:0)
[01:04:01.150] Build status: STARTED
[01:04:01.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:90:0) after 6m7s
[01:10:08.210] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:90:0)
[01:10:08.318] Build status: STARTED
[01:10:08.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:91:0) after 9m10s
[01:19:18.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:91:0)
[01:19:18.569] Build status: STARTED
[01:19:18.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:92:0) after 5m57s
[01:25:15.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:92:0)
[01:25:15.621] Build status: STARTED
[01:25:15.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:93:0) after 5m1s
[01:30:16.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:93:0)
[01:30:16.694] Build status: STARTED
[01:30:16.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:94:0) after 9m10s
[01:39:26.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:94:0)
[01:39:26.746] Build status: STARTED
[01:39:26.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:95:0) after 4m47s
[01:44:13.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:95:0)
[01:44:13.766] Build status: STARTED
[01:44:13.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:96:0) after 5m43s
[01:49:56.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:96:0)
[01:49:56.819] Build status: STARTED
[01:49:56.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874598162029392128:97:0) after 8m19s
[01:51:23.384] Received PubSub notification, asking Buildbucket for the build status
[01:51:23.446] Build:
{
"id": "8709168100167422369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26193,
"createdBy": "project:chromium",
"createTime": "2025-07-16T17:31:27.813090499Z",
"startTime": "2025-07-16T17:31:33.078527686Z",
"endTime": "2025-07-17T01:51:23.125486167Z",
"updateTime": "2025-07-17T01:51:23.125486167Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ce4fc092f34a50c78a44464d94f114ef8b5f53f8",
"ref": "refs/heads/main"
}
}
}
[01:51:23.446] Invocation finished in 8h19m56.791305286s with status FAILED