[22:37:50.554] New invocation is queued and will start shortly
[22:37:51.643] Starting the invocation (attempt 1)
[22:37:51.672] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d37ec9096b7ff383fb5f97b3b293ddf025a5994a"
[22:37:51.672] Popped gitiles commit info from properties and tags
[22:37:51.672] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:37:51.672] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:37:51.672] Buildbucket request:
{
"requestId": "8857546655443621024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d37ec9096b7ff383fb5f97b3b293ddf025a5994a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857546655443621024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:37:52.147] Scheduled build:
{
"id": "8692116593558891441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 28972,
"createdBy": "project:chromium",
"createTime": "2026-01-20T22:37:51.722826183Z",
"updateTime": "2026-01-20T22:37:51.722826183Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d37ec9096b7ff383fb5f97b3b293ddf025a5994a",
"ref": "refs/heads/main"
}
}
}
[22:37:52.147] Task URL: https://cr-buildbucket.appspot.com/build/8692116593558891441
[22:37:52.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:2:0) after 2m28s
[22:37:52.302] Received PubSub notification, asking Buildbucket for the build status
[22:37:52.325] Build status: SCHEDULED
[22:38:53.621] Received PubSub notification, asking Buildbucket for the build status
[22:38:53.644] Build status: STARTED
[22:40:20.267] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:2:0)
[22:40:20.282] Build status: STARTED
[22:40:20.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:5:0) after 2m7s
[22:42:27.326] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:5:0)
[22:42:27.337] Build status: STARTED
[22:42:27.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:6:0) after 6m56s
[22:49:23.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:6:0)
[22:49:23.375] Build status: STARTED
[22:49:23.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:7:0) after 9m9s
[22:58:32.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:7:0)
[22:58:32.525] Build status: STARTED
[22:58:32.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:8:0) after 5m56s
[23:04:28.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:8:0)
[23:04:28.724] Build status: STARTED
[23:04:28.724] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:9:0) after 8m51s
[23:13:19.752] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:9:0)
[23:13:19.776] Build status: STARTED
[23:13:19.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:10:0) after 1m25s
[23:14:44.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:10:0)
[23:14:44.809] Build status: STARTED
[23:14:44.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:11:0) after 2m48s
[23:17:32.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:11:0)
[23:17:32.904] Build status: STARTED
[23:17:32.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:12:0) after 3m54s
[23:21:26.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:12:0)
[23:21:26.956] Build status: STARTED
[23:21:26.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:13:0) after 6m20s
[23:27:46.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:13:0)
[23:27:46.996] Build status: STARTED
[23:27:46.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:14:0) after 3m24s
[23:31:11.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:14:0)
[23:31:11.085] Build status: STARTED
[23:31:11.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:15:0) after 4m47s
[23:35:58.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:15:0)
[23:35:58.252] Build status: STARTED
[23:35:58.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:16:0) after 8m12s
[23:44:10.272] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:16:0)
[23:44:10.299] Build status: STARTED
[23:44:10.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:17:0) after 8m17s
[23:52:27.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:17:0)
[23:52:27.341] Build status: STARTED
[23:52:27.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:18:0) after 7m53s
[00:00:20.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:18:0)
[00:00:20.382] Build status: STARTED
[00:00:20.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:19:0) after 5m23s
[00:05:43.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:19:0)
[00:05:43.481] Build status: STARTED
[00:05:43.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:20:0) after 7m14s
[00:12:57.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:20:0)
[00:12:57.520] Build status: STARTED
[00:12:57.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:21:0) after 4m46s
[00:17:43.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:21:0)
[00:17:43.660] Build status: STARTED
[00:17:43.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:22:0) after 6m21s
[00:24:04.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:22:0)
[00:24:04.832] Build status: STARTED
[00:24:04.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:23:0) after 5m24s
[00:29:28.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:23:0)
[00:29:28.871] Build status: STARTED
[00:29:28.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:24:0) after 9m20s
[00:38:48.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:24:0)
[00:38:48.873] Build status: STARTED
[00:38:48.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:25:0) after 9m7s
[00:47:55.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:25:0)
[00:47:55.940] Build status: STARTED
[00:47:55.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:26:0) after 5m5s
[00:53:00.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:26:0)
[00:53:00.986] Build status: STARTED
[00:53:00.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:27:0) after 7m40s
[01:00:41.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:27:0)
[01:00:41.101] Build status: STARTED
[01:00:41.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:28:0) after 8m5s
[01:08:46.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:28:0)
[01:08:46.192] Build status: STARTED
[01:08:46.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:29:0) after 5m1s
[01:13:47.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:29:0)
[01:13:47.274] Build status: STARTED
[01:13:47.274] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:30:0) after 3m12s
[01:16:59.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:30:0)
[01:16:59.376] Build status: STARTED
[01:16:59.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:31:0) after 3m35s
[01:20:34.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:31:0)
[01:20:34.532] Build status: STARTED
[01:20:34.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:32:0) after 6m45s
[01:27:19.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:32:0)
[01:27:19.549] Build status: STARTED
[01:27:19.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:33:0) after 4m20s
[01:31:39.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:33:0)
[01:31:39.597] Build status: STARTED
[01:31:39.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:34:0) after 2m57s
[01:34:36.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:34:0)
[01:34:36.733] Build status: STARTED
[01:34:36.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:35:0) after 7m14s
[01:41:50.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:35:0)
[01:41:50.804] Build status: STARTED
[01:41:50.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:36:0) after 7m30s
[01:49:20.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:36:0)
[01:49:20.885] Build status: STARTED
[01:49:20.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:37:0) after 6m4s
[01:55:24.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:37:0)
[01:55:24.922] Build status: STARTED
[01:55:24.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:38:0) after 5m55s
[02:01:19.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:38:0)
[02:01:19.962] Build status: STARTED
[02:01:19.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857546655443621024:39:0) after 1m21s
[02:01:40.484] Received PubSub notification, asking Buildbucket for the build status
[02:01:40.507] Build:
{
"id": "8692116593558891441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 28972,
"createdBy": "project:chromium",
"createTime": "2026-01-20T22:37:51.722826183Z",
"startTime": "2026-01-20T22:38:53.457754307Z",
"endTime": "2026-01-21T02:01:40.194556818Z",
"updateTime": "2026-01-21T02:01:40.194556818Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d37ec9096b7ff383fb5f97b3b293ddf025a5994a",
"ref": "refs/heads/main"
}
}
}
[02:01:40.507] Invocation finished in 3h23m49.966042843s with status FAILED