[15:26:46.387] New invocation is queued and will start shortly
[15:26:47.612] Starting the invocation (attempt 1)
[15:26:47.641] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c8b11373ab0df8bdf749555993a2944af801c2ca"
[15:26:47.642] Popped gitiles commit info from properties and tags
[15:26:47.642] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:26:47.642] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:26:47.642] Buildbucket request:
{
"requestId": "8835286922245688288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8b11373ab0df8bdf749555993a2944af801c2ca",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835286922245688288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:26:48.229] Scheduled build:
{
"id": "8669856860190669489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32759,
"createdBy": "project:chromium",
"createTime": "2026-09-23T15:26:47.725058712Z",
"updateTime": "2026-09-23T15:26:47.725058712Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8b11373ab0df8bdf749555993a2944af801c2ca",
"ref": "refs/heads/main"
}
}
}
[15:26:48.229] Task URL: https://cr-buildbucket.appspot.com/build/8669856860190669489
[15:26:48.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:2:0) after 4m35s
[15:26:49.164] Received PubSub notification, asking Buildbucket for the build status
[15:26:49.188] Build status: SCHEDULED
[15:31:23.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:2:0)
[15:31:23.276] Build status: SCHEDULED
[15:31:23.276] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:4:0) after 1m17s
[15:32:40.293] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:4:0)
[15:32:40.315] Build status: SCHEDULED
[15:32:40.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:5:0) after 8m30s
[15:41:10.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:5:0)
[15:41:10.371] Build status: SCHEDULED
[15:41:10.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:6:0) after 9m21s
[15:48:32.233] Received PubSub notification, asking Buildbucket for the build status
[15:48:32.253] Build status: STARTED
[15:50:31.679] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:6:0)
[15:50:31.843] Build status: STARTED
[15:50:31.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:8:0) after 2m46s
[15:53:17.861] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:8:0)
[15:53:17.884] Build status: STARTED
[15:53:17.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:9:0) after 3m6s
[15:56:24.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:9:0)
[15:56:24.074] Build status: STARTED
[15:56:24.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:10:0) after 9m3s
[16:05:27.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:10:0)
[16:05:27.145] Build status: STARTED
[16:05:27.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:11:0) after 2m17s
[16:07:44.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:11:0)
[16:07:44.208] Build status: STARTED
[16:07:44.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:12:0) after 2m1s
[16:09:45.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:12:0)
[16:09:45.309] Build status: STARTED
[16:09:45.309] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:13:0) after 5m14s
[16:14:59.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:13:0)
[16:14:59.595] Build status: STARTED
[16:14:59.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:14:0) after 3m27s
[16:18:26.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:14:0)
[16:18:26.590] Build status: STARTED
[16:18:26.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:15:0) after 4m14s
[16:22:40.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:15:0)
[16:22:40.780] Build status: STARTED
[16:22:40.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:16:0) after 8m43s
[16:31:23.981] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:16:0)
[16:31:24.021] Build status: STARTED
[16:31:24.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:17:0) after 6m2s
[16:37:26.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:17:0)
[16:37:26.116] Build status: STARTED
[16:37:26.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:18:0) after 1m36s
[16:39:02.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:18:0)
[16:39:02.172] Build status: STARTED
[16:39:02.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:19:0) after 9m0s
[16:48:02.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:19:0)
[16:48:02.259] Build status: STARTED
[16:48:02.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:20:0) after 9m9s
[16:57:11.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:20:0)
[16:57:11.617] Build status: STARTED
[16:57:11.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:21:0) after 5m59s
[17:03:10.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:21:0)
[17:03:10.664] Build status: STARTED
[17:03:10.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:22:0) after 8m6s
[17:11:16.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:22:0)
[17:11:16.790] Build status: STARTED
[17:11:16.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:23:0) after 9m52s
[17:21:08.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:23:0)
[17:21:08.863] Build status: STARTED
[17:21:08.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:24:0) after 4m16s
[17:25:24.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:24:0)
[17:25:24.953] Build status: STARTED
[17:25:24.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:25:0) after 6m38s
[17:32:02.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:25:0)
[17:32:02.994] Build status: STARTED
[17:32:02.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:26:0) after 9m26s
[17:41:29.014] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:26:0)
[17:41:29.031] Build status: STARTED
[17:41:29.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:27:0) after 8m24s
[17:49:53.245] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:27:0)
[17:49:53.338] Build status: STARTED
[17:49:53.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:28:0) after 5m25s
[17:55:18.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:28:0)
[17:55:18.383] Build status: STARTED
[17:55:18.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:29:0) after 1m3s
[17:56:21.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:29:0)
[17:56:21.422] Build status: STARTED
[17:56:21.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:30:0) after 5m22s
[18:01:43.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:30:0)
[18:01:43.476] Build status: STARTED
[18:01:43.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:31:0) after 5m40s
[18:07:23.481] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:31:0)
[18:07:23.499] Build status: STARTED
[18:07:23.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:32:0) after 6m58s
[18:14:21.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:32:0)
[18:14:21.596] Build status: STARTED
[18:14:21.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:33:0) after 1m24s
[18:15:45.622] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:33:0)
[18:15:45.666] Build status: STARTED
[18:15:45.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:34:0) after 6m13s
[18:21:58.688] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:34:0)
[18:21:58.708] Build status: STARTED
[18:21:58.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:35:0) after 8m28s
[18:30:26.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:35:0)
[18:30:26.777] Build status: STARTED
[18:30:26.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835286922245688288:36:0) after 1m43s
[18:30:57.697] Received PubSub notification, asking Buildbucket for the build status
[18:30:57.721] Build:
{
"id": "8669856860190669489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32759,
"createdBy": "project:chromium",
"createTime": "2026-09-23T15:26:47.725058712Z",
"startTime": "2026-09-23T15:48:32.063461756Z",
"endTime": "2026-09-23T18:30:56.688335573Z",
"updateTime": "2026-09-23T18:30:56.688335573Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8b11373ab0df8bdf749555993a2944af801c2ca",
"ref": "refs/heads/main"
}
}
}
[18:30:57.721] Invocation finished in 3h4m11.338817114s with status FAILED