[05:46:00.418] New invocation is queued and will start shortly
[05:46:01.551] Starting the invocation (attempt 1)
[05:46:01.585] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/03079b9ea0fd1b43060df524ae8e54d812459645"
[05:46:01.585] Popped gitiles commit info from properties and tags
[05:46:01.585] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:46:01.585] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:46:01.586] Buildbucket request:
{
"requestId": "8833511521567050160",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "03079b9ea0fd1b43060df524ae8e54d812459645",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833511521567050160"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:46:02.215] Scheduled build:
{
"id": "8668081459584802113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33325,
"createdBy": "project:chromium",
"createTime": "2026-10-13T05:46:01.684831439Z",
"updateTime": "2026-10-13T05:46:01.684831439Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "03079b9ea0fd1b43060df524ae8e54d812459645",
"ref": "refs/heads/main"
}
}
}
[05:46:02.215] Task URL: https://cr-buildbucket.appspot.com/build/8668081459584802113
[05:46:02.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:2:0) after 4m43s
[05:46:02.371] Received PubSub notification, asking Buildbucket for the build status
[05:46:02.390] Build status: SCHEDULED
[05:50:45.284] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:2:0)
[05:50:45.305] Build status: SCHEDULED
[05:50:45.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:4:0) after 7m9s
[05:56:25.697] Received PubSub notification, asking Buildbucket for the build status
[05:56:25.717] Build status: STARTED
[05:57:54.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:4:0)
[05:57:54.364] Build status: STARTED
[05:57:54.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:6:0) after 2m57s
[06:00:51.343] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:6:0)
[06:00:51.365] Build status: STARTED
[06:00:51.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:7:0) after 5m6s
[06:05:57.411] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:7:0)
[06:05:57.442] Build status: STARTED
[06:05:57.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:8:0) after 9m43s
[06:15:40.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:8:0)
[06:15:40.439] Build status: STARTED
[06:15:40.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:9:0) after 7m28s
[06:23:08.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:9:0)
[06:23:08.528] Build status: STARTED
[06:23:08.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:10:0) after 2m11s
[06:25:19.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:10:0)
[06:25:19.635] Build status: STARTED
[06:25:19.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:11:0) after 8m0s
[06:33:19.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:11:0)
[06:33:19.796] Build status: STARTED
[06:33:19.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:12:0) after 9m15s
[06:42:34.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:12:0)
[06:42:34.897] Build status: STARTED
[06:42:34.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:13:0) after 4m7s
[06:46:41.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:13:0)
[06:46:41.990] Build status: STARTED
[06:46:41.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:14:0) after 1m58s
[06:48:40.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:14:0)
[06:48:40.083] Build status: STARTED
[06:48:40.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:15:0) after 5m16s
[06:53:56.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:15:0)
[06:53:56.115] Build status: STARTED
[06:53:56.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:16:0) after 1m33s
[06:55:29.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:16:0)
[06:55:29.149] Build status: STARTED
[06:55:29.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:17:0) after 6m56s
[07:02:25.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:17:0)
[07:02:25.186] Build status: STARTED
[07:02:25.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:18:0) after 5m58s
[07:08:23.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:18:0)
[07:08:23.311] Build status: STARTED
[07:08:23.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:19:0) after 6m25s
[07:14:48.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:19:0)
[07:14:48.403] Build status: STARTED
[07:14:48.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:20:0) after 7m15s
[07:22:03.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:20:0)
[07:22:03.478] Build status: STARTED
[07:22:03.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:21:0) after 8m22s
[07:30:25.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:21:0)
[07:30:25.544] Build status: STARTED
[07:30:25.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:22:0) after 6m3s
[07:36:28.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:22:0)
[07:36:28.610] Build status: STARTED
[07:36:28.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:23:0) after 3m47s
[07:40:15.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:23:0)
[07:40:15.667] Build status: STARTED
[07:40:15.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:24:0) after 5m44s
[07:45:59.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:24:0)
[07:45:59.823] Build status: STARTED
[07:45:59.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:25:0) after 1m25s
[07:47:24.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:25:0)
[07:47:24.866] Build status: STARTED
[07:47:24.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:26:0) after 6m23s
[07:53:47.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:26:0)
[07:53:47.944] Build status: STARTED
[07:53:47.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:27:0) after 5m47s
[07:59:35.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:27:0)
[07:59:35.195] Build status: STARTED
[07:59:35.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:28:0) after 8m17s
[08:07:52.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:28:0)
[08:07:52.329] Build status: STARTED
[08:07:52.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:29:0) after 6m12s
[08:14:04.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:29:0)
[08:14:04.386] Build status: STARTED
[08:14:04.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:30:0) after 3m57s
[08:18:01.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:30:0)
[08:18:01.423] Build status: STARTED
[08:18:01.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:31:0) after 5m4s
[08:23:05.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:31:0)
[08:23:05.664] Build status: STARTED
[08:23:05.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:32:0) after 7m40s
[08:30:45.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:32:0)
[08:30:45.774] Build status: STARTED
[08:30:45.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:33:0) after 7m6s
[08:37:51.791] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:33:0)
[08:37:51.810] Build status: STARTED
[08:37:51.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:34:0) after 7m5s
[08:44:56.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:34:0)
[08:44:56.858] Build status: STARTED
[08:44:56.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:35:0) after 7m18s
[08:52:14.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:35:0)
[08:52:14.959] Build status: STARTED
[08:52:14.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:36:0) after 5m37s
[08:57:51.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:36:0)
[08:57:51.982] Build status: STARTED
[08:57:51.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:37:0) after 5m9s
[09:03:01.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:37:0)
[09:03:01.055] Build status: STARTED
[09:03:01.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:38:0) after 5m37s
[09:08:38.058] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:38:0)
[09:08:38.076] Build status: STARTED
[09:08:38.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833511521567050160:39:0) after 4m49s
[09:09:25.268] Received PubSub notification, asking Buildbucket for the build status
[09:09:25.288] Build:
{
"id": "8668081459584802113",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33325,
"createdBy": "project:chromium",
"createTime": "2026-10-13T05:46:01.684831439Z",
"startTime": "2026-10-13T05:56:24.556629581Z",
"endTime": "2026-10-13T09:09:24.772616425Z",
"updateTime": "2026-10-13T09:09:24.772616425Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "03079b9ea0fd1b43060df524ae8e54d812459645",
"ref": "refs/heads/main"
}
}
}
[09:09:25.288] Invocation finished in 3h23m24.877472048s with status FAILED