[18:13:39.253] New invocation is queued and will start shortly
[18:13:40.720] Starting the invocation (attempt 1)
[18:13:40.746] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0453bb50fc98c067f56210e782e8dba3b5e66849"
[18:13:40.746] Popped gitiles commit info from properties and tags
[18:13:40.746] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:13:40.746] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:13:40.747] Buildbucket request:
{
"requestId": "8833826871531581072",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0453bb50fc98c067f56210e782e8dba3b5e66849",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833826871531581072"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:13:41.328] Scheduled build:
{
"id": "8668396809231713313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33294,
"createdBy": "project:chromium",
"createTime": "2026-10-09T18:13:40.825871810Z",
"updateTime": "2026-10-09T18:13:40.825871810Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0453bb50fc98c067f56210e782e8dba3b5e66849",
"ref": "refs/heads/main"
}
}
}
[18:13:41.328] Task URL: https://cr-buildbucket.appspot.com/build/8668396809231713313
[18:13:41.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:2:0) after 5m49s
[18:13:43.577] Received PubSub notification, asking Buildbucket for the build status
[18:13:43.631] Build status: SCHEDULED
[18:14:49.972] Received PubSub notification, asking Buildbucket for the build status
[18:14:50.009] Build status: STARTED
[18:19:30.532] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:2:0)
[18:19:30.589] Build status: STARTED
[18:19:30.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:5:0) after 9m14s
[18:28:44.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:5:0)
[18:28:44.848] Build status: STARTED
[18:28:44.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:6:0) after 5m49s
[18:34:34.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:6:0)
[18:34:34.093] Build status: STARTED
[18:34:34.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:7:0) after 5m20s
[18:39:54.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:7:0)
[18:39:54.122] Build status: STARTED
[18:39:54.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:8:0) after 8m20s
[18:48:14.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:8:0)
[18:48:14.227] Build status: STARTED
[18:48:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:9:0) after 4m23s
[18:52:37.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:9:0)
[18:52:37.477] Build status: STARTED
[18:52:37.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:10:0) after 2m24s
[18:55:01.683] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:10:0)
[18:55:01.709] Build status: STARTED
[18:55:01.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:11:0) after 5m19s
[19:00:20.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:11:0)
[19:00:20.816] Build status: STARTED
[19:00:20.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:12:0) after 3m33s
[19:03:53.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:12:0)
[19:03:53.978] Build status: STARTED
[19:03:53.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:13:0) after 2m4s
[19:05:58.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:13:0)
[19:05:58.269] Build status: STARTED
[19:05:58.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:14:0) after 5m8s
[19:11:06.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:14:0)
[19:11:06.529] Build status: STARTED
[19:11:06.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:15:0) after 7m59s
[19:19:05.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:15:0)
[19:19:05.632] Build status: STARTED
[19:19:05.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:16:0) after 1m11s
[19:20:16.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:16:0)
[19:20:16.945] Build status: STARTED
[19:20:16.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:17:0) after 7m36s
[19:27:52.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:17:0)
[19:27:53.027] Build status: STARTED
[19:27:53.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:18:0) after 5m53s
[19:33:46.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:18:0)
[19:33:46.125] Build status: STARTED
[19:33:46.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:19:0) after 3m28s
[19:37:14.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:19:0)
[19:37:14.215] Build status: STARTED
[19:37:14.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:20:0) after 4m14s
[19:41:28.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:20:0)
[19:41:28.386] Build status: STARTED
[19:41:28.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:21:0) after 6m25s
[19:47:53.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:21:0)
[19:47:53.541] Build status: STARTED
[19:47:53.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:22:0) after 1m3s
[19:48:56.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:22:0)
[19:48:56.589] Build status: STARTED
[19:48:56.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:23:0) after 1m47s
[19:50:43.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:23:0)
[19:50:43.880] Build status: STARTED
[19:50:43.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:24:0) after 9m19s
[20:00:02.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:24:0)
[20:00:02.922] Build status: STARTED
[20:00:02.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:25:0) after 9m49s
[20:09:51.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:25:0)
[20:09:52.032] Build status: STARTED
[20:09:52.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:26:0) after 7m6s
[20:16:58.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:26:0)
[20:16:58.164] Build status: STARTED
[20:16:58.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:27:0) after 4m35s
[20:21:33.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:27:0)
[20:21:33.190] Build status: STARTED
[20:21:33.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:28:0) after 4m14s
[20:25:47.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:28:0)
[20:25:47.477] Build status: STARTED
[20:25:47.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:29:0) after 1m11s
[20:26:58.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:29:0)
[20:26:58.727] Build status: STARTED
[20:26:58.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:30:0) after 1m52s
[20:28:50.780] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:30:0)
[20:28:50.800] Build status: STARTED
[20:28:50.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:31:0) after 7m16s
[20:36:06.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:31:0)
[20:36:06.854] Build status: STARTED
[20:36:06.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:32:0) after 9m36s
[20:45:42.905] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:32:0)
[20:45:42.956] Build status: STARTED
[20:45:42.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:33:0) after 1m20s
[20:47:03.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:33:0)
[20:47:03.104] Build status: STARTED
[20:47:03.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:34:0) after 9m0s
[20:56:03.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:34:0)
[20:56:03.299] Build status: STARTED
[20:56:03.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:35:0) after 6m4s
[21:02:07.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:35:0)
[21:02:07.405] Build status: STARTED
[21:02:07.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:36:0) after 9m33s
[21:11:40.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:36:0)
[21:11:40.533] Build status: STARTED
[21:11:40.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:37:0) after 5m2s
[21:16:42.605] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:37:0)
[21:16:42.624] Build status: STARTED
[21:16:42.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:38:0) after 9m34s
[21:26:16.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:38:0)
[21:26:16.679] Build status: STARTED
[21:26:16.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833826871531581072:39:0) after 6m48s
[21:26:39.701] Received PubSub notification, asking Buildbucket for the build status
[21:26:39.725] Build:
{
"id": "8668396809231713313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33294,
"createdBy": "project:chromium",
"createTime": "2026-10-09T18:13:40.825871810Z",
"startTime": "2026-10-09T18:14:49.745057341Z",
"endTime": "2026-10-09T21:26:39.273699790Z",
"updateTime": "2026-10-09T21:26:39.273699790Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0453bb50fc98c067f56210e782e8dba3b5e66849",
"ref": "refs/heads/main"
}
}
}
[21:26:39.725] Invocation finished in 3h13m0.477236649s with status FAILED