[01:48:27.260] New invocation is queued and will start shortly
[01:48:28.404] Starting the invocation (attempt 1)
[01:48:28.435] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8f2ff06635bed55edde647baecc835f8fc8b061f"
[01:48:28.435] Popped gitiles commit info from properties and tags
[01:48:28.435] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:48:28.435] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:48:28.435] Buildbucket request:
{
"requestId": "8835338406415133408",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f2ff06635bed55edde647baecc835f8fc8b061f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835338406415133408"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:48:28.996] Scheduled build:
{
"id": "8669908344446785777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32753,
"createdBy": "project:chromium",
"createTime": "2026-09-23T01:48:28.512309806Z",
"updateTime": "2026-09-23T01:48:28.512309806Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f2ff06635bed55edde647baecc835f8fc8b061f",
"ref": "refs/heads/main"
}
}
}
[01:48:28.996] Task URL: https://cr-buildbucket.appspot.com/build/8669908344446785777
[01:48:28.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:2:0) after 1m17s
[01:48:29.160] Received PubSub notification, asking Buildbucket for the build status
[01:48:29.271] Build status: SCHEDULED
[01:49:46.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:2:0)
[01:49:46.171] Build status: SCHEDULED
[01:49:46.171] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:4:0) after 1m56s
[01:51:42.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:4:0)
[01:51:42.213] Build status: SCHEDULED
[01:51:42.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:5:0) after 2m18s
[01:54:00.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:5:0)
[01:54:00.298] Build status: SCHEDULED
[01:54:00.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:6:0) after 3m40s
[01:57:40.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:6:0)
[01:57:40.326] Build status: SCHEDULED
[01:57:40.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:7:0) after 7m18s
[02:04:35.370] Received PubSub notification, asking Buildbucket for the build status
[02:04:35.389] Build status: STARTED
[02:04:58.403] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:7:0)
[02:04:58.422] Build status: STARTED
[02:04:58.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:9:0) after 9m36s
[02:14:34.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:9:0)
[02:14:34.693] Build status: STARTED
[02:14:34.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:10:0) after 3m21s
[02:17:55.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:10:0)
[02:17:55.969] Build status: STARTED
[02:17:55.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:11:0) after 3m21s
[02:21:16.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:11:0)
[02:21:17.002] Build status: STARTED
[02:21:17.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:12:0) after 5m48s
[02:27:04.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:12:0)
[02:27:05.015] Build status: STARTED
[02:27:05.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:13:0) after 4m20s
[02:31:24.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:13:0)
[02:31:25.090] Build status: STARTED
[02:31:25.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:14:0) after 3m51s
[02:35:16.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:14:0)
[02:35:16.240] Build status: STARTED
[02:35:16.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:15:0) after 2m40s
[02:37:56.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:15:0)
[02:37:56.225] Build status: STARTED
[02:37:56.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:16:0) after 3m48s
[02:41:44.288] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:16:0)
[02:41:44.311] Build status: STARTED
[02:41:44.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:17:0) after 2m38s
[02:44:22.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:17:0)
[02:44:22.347] Build status: STARTED
[02:44:22.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:18:0) after 1m42s
[02:46:04.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:18:0)
[02:46:04.414] Build status: STARTED
[02:46:04.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:19:0) after 3m37s
[02:49:41.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:19:0)
[02:49:41.572] Build status: STARTED
[02:49:41.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:20:0) after 5m15s
[02:54:56.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:20:0)
[02:54:56.669] Build status: STARTED
[02:54:56.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:21:0) after 2m26s
[02:57:22.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:21:0)
[02:57:22.834] Build status: STARTED
[02:57:22.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:22:0) after 1m15s
[02:58:37.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:22:0)
[02:58:37.881] Build status: STARTED
[02:58:37.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:23:0) after 4m6s
[03:02:43.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:23:0)
[03:02:43.926] Build status: STARTED
[03:02:43.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:24:0) after 7m28s
[03:10:11.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:24:0)
[03:10:11.969] Build status: STARTED
[03:10:11.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:25:0) after 1m6s
[03:11:18.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:25:0)
[03:11:18.055] Build status: STARTED
[03:11:18.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:26:0) after 3m29s
[03:14:47.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:26:0)
[03:14:47.115] Build status: STARTED
[03:14:47.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:27:0) after 7m51s
[03:22:38.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:27:0)
[03:22:38.181] Build status: STARTED
[03:22:38.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:28:0) after 5m28s
[03:28:06.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:28:0)
[03:28:06.255] Build status: STARTED
[03:28:06.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:29:0) after 1m9s
[03:29:15.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:29:0)
[03:29:15.294] Build status: STARTED
[03:29:15.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:30:0) after 3m34s
[03:32:49.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:30:0)
[03:32:49.329] Build status: STARTED
[03:32:49.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:31:0) after 2m4s
[03:34:53.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:31:0)
[03:34:53.360] Build status: STARTED
[03:34:53.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:32:0) after 6m54s
[03:41:47.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:32:0)
[03:41:47.456] Build status: STARTED
[03:41:47.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835338406415133408:33:0) after 9m17s
[03:44:03.798] Received PubSub notification, asking Buildbucket for the build status
[03:44:03.835] Build:
{
"id": "8669908344446785777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32753,
"createdBy": "project:chromium",
"createTime": "2026-09-23T01:48:28.512309806Z",
"startTime": "2026-09-23T02:04:35.188457876Z",
"endTime": "2026-09-23T03:44:03.453245311Z",
"updateTime": "2026-09-23T03:44:03.453245311Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f2ff06635bed55edde647baecc835f8fc8b061f",
"ref": "refs/heads/main"
}
}
}
[03:44:03.835] Invocation finished in 1h55m36.582290904s with status FAILED