[16:22:12.879] New invocation is queued and will start shortly
[16:22:14.234] Starting the invocation (attempt 1)
[16:22:14.267] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c65bdf57c4609364f62a3d56bc5b5730fadf075f"
[16:22:14.267] Popped gitiles commit info from properties and tags
[16:22:14.267] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:22:14.268] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:22:14.268] Buildbucket request:
{
"requestId": "8833380897870927472",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c65bdf57c4609364f62a3d56bc5b5730fadf075f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833380897870927472"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:22:14.893] Scheduled build:
{
"id": "8667950835620081313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33339,
"createdBy": "project:chromium",
"createTime": "2026-10-14T16:22:14.405388396Z",
"updateTime": "2026-10-14T16:22:14.405388396Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c65bdf57c4609364f62a3d56bc5b5730fadf075f",
"ref": "refs/heads/main"
}
}
}
[16:22:14.893] Task URL: https://cr-buildbucket.appspot.com/build/8667950835620081313
[16:22:14.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:2:0) after 7m5s
[16:22:15.874] Received PubSub notification, asking Buildbucket for the build status
[16:22:15.930] Build status: SCHEDULED
[16:23:15.044] Received PubSub notification, asking Buildbucket for the build status
[16:23:15.064] Build status: STARTED
[16:29:19.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:2:0)
[16:29:19.945] Build status: STARTED
[16:29:19.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:5:0) after 4m27s
[16:33:47.110] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:5:0)
[16:33:47.130] Build status: STARTED
[16:33:47.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:6:0) after 3m39s
[16:37:26.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:6:0)
[16:37:26.467] Build status: STARTED
[16:37:26.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:7:0) after 8m41s
[16:46:07.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:7:0)
[16:46:07.490] Build status: STARTED
[16:46:07.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:8:0) after 4m54s
[16:51:01.556] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:8:0)
[16:51:01.572] Build status: STARTED
[16:51:01.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:9:0) after 6m8s
[16:57:09.775] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:9:0)
[16:57:09.835] Build status: STARTED
[16:57:09.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:10:0) after 1m17s
[16:58:26.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:10:0)
[16:58:26.875] Build status: STARTED
[16:58:26.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:11:0) after 8m30s
[17:06:56.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:11:0)
[17:06:56.915] Build status: STARTED
[17:06:56.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:12:0) after 8m29s
[17:15:25.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:12:0)
[17:15:26.036] Build status: STARTED
[17:15:26.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:13:0) after 4m38s
[17:20:04.087] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:13:0)
[17:20:04.115] Build status: STARTED
[17:20:04.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:14:0) after 5m0s
[17:25:04.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:14:0)
[17:25:04.147] Build status: STARTED
[17:25:04.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:15:0) after 3m0s
[17:28:04.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:15:0)
[17:28:04.205] Build status: STARTED
[17:28:04.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:16:0) after 6m12s
[17:34:16.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:16:0)
[17:34:16.285] Build status: STARTED
[17:34:16.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:17:0) after 9m3s
[17:43:19.355] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:17:0)
[17:43:19.433] Build status: STARTED
[17:43:19.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:18:0) after 4m58s
[17:48:17.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:18:0)
[17:48:17.576] Build status: STARTED
[17:48:17.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:19:0) after 3m58s
[17:52:15.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:19:0)
[17:52:15.621] Build status: STARTED
[17:52:15.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:20:0) after 3m14s
[17:55:29.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:20:0)
[17:55:29.665] Build status: STARTED
[17:55:29.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:21:0) after 7m16s
[18:02:45.802] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:21:0)
[18:02:45.827] Build status: STARTED
[18:02:45.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:22:0) after 8m57s
[18:11:43.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:22:0)
[18:11:43.129] Build status: STARTED
[18:11:43.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:23:0) after 6m38s
[18:18:21.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:23:0)
[18:18:21.194] Build status: STARTED
[18:18:21.194] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:24:0) after 8m18s
[18:26:39.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:24:0)
[18:26:39.473] Build status: STARTED
[18:26:39.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:25:0) after 5m53s
[18:32:32.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:25:0)
[18:32:32.768] Build status: STARTED
[18:32:32.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:26:0) after 6m31s
[18:39:03.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:26:0)
[18:39:03.819] Build status: STARTED
[18:39:03.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:27:0) after 7m51s
[18:46:54.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:27:0)
[18:46:54.935] Build status: STARTED
[18:46:54.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833380897870927472:28:0) after 5m36s
[18:50:38.191] Received PubSub notification, asking Buildbucket for the build status
[18:50:38.216] Build:
{
"id": "8667950835620081313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33339,
"createdBy": "project:chromium",
"createTime": "2026-10-14T16:22:14.405388396Z",
"startTime": "2026-10-14T16:23:14.833181887Z",
"endTime": "2026-10-14T18:50:37.880626330Z",
"updateTime": "2026-10-14T18:50:37.880626330Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c65bdf57c4609364f62a3d56bc5b5730fadf075f",
"ref": "refs/heads/main"
}
}
}
[18:50:38.216] Invocation finished in 2h28m25.342063404s with status FAILED