[21:41:05.339] New invocation is queued and will start shortly
[21:41:06.381] Starting the invocation (attempt 1)
[21:41:06.404] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a37d15a91c13203776ab740b09e8adfb33000010"
[21:41:06.404] Popped gitiles commit info from properties and tags
[21:41:06.405] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:41:06.406] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:41:06.406] Buildbucket request:
{
"requestId": "8833723223898452512",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a37d15a91c13203776ab740b09e8adfb33000010",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833723223898452512"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:41:07.179] Scheduled build:
{
"id": "8668293162027636881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33304,
"createdBy": "project:chromium",
"createTime": "2026-10-10T21:41:06.502166847Z",
"updateTime": "2026-10-10T21:41:06.502166847Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a37d15a91c13203776ab740b09e8adfb33000010",
"ref": "refs/heads/main"
}
}
}
[21:41:07.179] Task URL: https://cr-buildbucket.appspot.com/build/8668293162027636881
[21:41:07.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:2:0) after 8m17s
[21:42:01.325] Received PubSub notification, asking Buildbucket for the build status
[21:42:01.442] Build status: STARTED
[21:42:11.689] Received PubSub notification, asking Buildbucket for the build status
[21:42:11.705] Build status: STARTED
[21:49:24.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:2:0)
[21:49:24.383] Build status: STARTED
[21:49:24.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:5:0) after 6m29s
[21:55:53.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:5:0)
[21:55:53.434] Build status: STARTED
[21:55:53.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:6:0) after 8m4s
[22:03:57.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:6:0)
[22:03:57.462] Build status: STARTED
[22:03:57.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:7:0) after 5m51s
[22:09:48.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:7:0)
[22:09:48.513] Build status: STARTED
[22:09:48.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:8:0) after 2m24s
[22:12:12.669] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:8:0)
[22:12:12.689] Build status: STARTED
[22:12:12.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:9:0) after 7m9s
[22:19:21.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:9:0)
[22:19:21.849] Build status: STARTED
[22:19:21.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:10:0) after 2m36s
[22:21:57.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:10:0)
[22:21:57.917] Build status: STARTED
[22:21:57.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:11:0) after 5m40s
[22:27:37.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:11:0)
[22:27:37.997] Build status: STARTED
[22:27:37.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:12:0) after 7m26s
[22:35:04.134] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:12:0)
[22:35:04.189] Build status: STARTED
[22:35:04.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:13:0) after 3m24s
[22:38:28.303] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:13:0)
[22:38:28.330] Build status: STARTED
[22:38:28.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:14:0) after 3m14s
[22:41:42.461] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:14:0)
[22:41:42.484] Build status: STARTED
[22:41:42.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:15:0) after 1m22s
[22:43:04.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:15:0)
[22:43:04.641] Build status: STARTED
[22:43:04.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:16:0) after 7m59s
[22:51:03.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:16:0)
[22:51:03.667] Build status: STARTED
[22:51:03.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:17:0) after 3m46s
[22:54:49.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:17:0)
[22:54:49.767] Build status: STARTED
[22:54:49.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:18:0) after 1m46s
[22:56:35.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:18:0)
[22:56:35.867] Build status: STARTED
[22:56:35.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:19:0) after 2m22s
[22:58:57.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:19:0)
[22:58:57.959] Build status: STARTED
[22:58:57.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:20:0) after 2m12s
[23:01:09.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:20:0)
[23:01:10.005] Build status: STARTED
[23:01:10.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:21:0) after 6m24s
[23:07:34.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:21:0)
[23:07:34.243] Build status: STARTED
[23:07:34.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:22:0) after 8m18s
[23:15:52.396] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:22:0)
[23:15:52.415] Build status: STARTED
[23:15:52.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:23:0) after 6m4s
[23:21:56.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:23:0)
[23:21:56.587] Build status: STARTED
[23:21:56.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:24:0) after 2m37s
[23:24:33.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:24:0)
[23:24:33.975] Build status: STARTED
[23:24:33.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:25:0) after 7m42s
[23:32:15.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:25:0)
[23:32:16.013] Build status: STARTED
[23:32:16.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:26:0) after 9m38s
[23:41:54.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:26:0)
[23:41:54.073] Build status: STARTED
[23:41:54.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:27:0) after 7m34s
[23:49:28.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:27:0)
[23:49:28.108] Build status: STARTED
[23:49:28.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:28:0) after 2m58s
[23:52:26.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:28:0)
[23:52:26.154] Build status: STARTED
[23:52:26.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:29:0) after 2m27s
[23:54:53.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:29:0)
[23:54:53.208] Build status: STARTED
[23:54:53.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:30:0) after 6m54s
[00:01:47.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:30:0)
[00:01:47.771] Build status: STARTED
[00:01:47.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:31:0) after 8m9s
[00:09:56.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:31:0)
[00:09:56.831] Build status: STARTED
[00:09:56.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:32:0) after 3m8s
[00:13:04.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:32:0)
[00:13:04.868] Build status: STARTED
[00:13:04.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:33:0) after 3m42s
[00:16:46.888] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:33:0)
[00:16:46.908] Build status: STARTED
[00:16:46.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:34:0) after 3m53s
[00:20:40.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:34:0)
[00:20:40.044] Build status: STARTED
[00:20:40.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:35:0) after 8m40s
[00:29:20.099] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:35:0)
[00:29:20.131] Build status: STARTED
[00:29:20.131] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:36:0) after 7m44s
[00:37:04.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:36:0)
[00:37:04.218] Build status: STARTED
[00:37:04.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833723223898452512:37:0) after 7m9s
[00:37:37.283] Received PubSub notification, asking Buildbucket for the build status
[00:37:37.384] Build:
{
"id": "8668293162027636881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33304,
"createdBy": "project:chromium",
"createTime": "2026-10-10T21:41:06.502166847Z",
"startTime": "2026-10-10T21:41:46.989441107Z",
"endTime": "2026-10-11T00:37:36.804284137Z",
"updateTime": "2026-10-11T00:37:36.804284137Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a37d15a91c13203776ab740b09e8adfb33000010",
"ref": "refs/heads/main"
}
}
}
[00:37:37.384] Invocation finished in 2h56m32.049366499s with status FAILED