[13:19:40.847] New invocation is queued and will start shortly
[13:19:41.979] Starting the invocation (attempt 1)
[13:19:42.022] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fca2d133eaa58d770958613367c7b168106a5b0c"
[13:19:42.022] Popped gitiles commit info from properties and tags
[13:19:42.022] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:19:42.022] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:19:42.022] Buildbucket request:
{
"requestId": "8855769832611669216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fca2d133eaa58d770958613367c7b168106a5b0c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8855769832611669216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:19:42.537] Scheduled build:
{
"id": "8690339770674402305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29168,
"createdBy": "project:chromium",
"createTime": "2026-02-09T13:19:42.072565283Z",
"updateTime": "2026-02-09T13:19:42.072565283Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fca2d133eaa58d770958613367c7b168106a5b0c",
"ref": "refs/heads/main"
}
}
}
[13:19:42.537] Task URL: https://cr-buildbucket.appspot.com/build/8690339770674402305
[13:19:42.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:2:0) after 7m37s
[13:19:42.949] Received PubSub notification, asking Buildbucket for the build status
[13:19:42.963] Build status: SCHEDULED
[13:19:50.378] Received PubSub notification, asking Buildbucket for the build status
[13:19:50.488] Build status: STARTED
[13:27:19.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:2:0)
[13:27:19.578] Build status: STARTED
[13:27:19.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:5:0) after 4m34s
[13:31:53.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:5:0)
[13:31:53.676] Build status: STARTED
[13:31:53.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:6:0) after 7m57s
[13:39:50.656] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:6:0)
[13:39:50.702] Build status: STARTED
[13:39:50.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:7:0) after 4m56s
[13:44:46.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:7:0)
[13:44:46.765] Build status: STARTED
[13:44:46.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:8:0) after 8m37s
[13:53:23.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:8:0)
[13:53:23.800] Build status: STARTED
[13:53:23.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:9:0) after 1m59s
[13:55:22.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:9:0)
[13:55:22.830] Build status: STARTED
[13:55:22.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:10:0) after 9m16s
[14:04:38.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:10:0)
[14:04:38.876] Build status: STARTED
[14:04:38.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:11:0) after 2m1s
[14:06:39.913] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:11:0)
[14:06:39.944] Build status: STARTED
[14:06:39.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:12:0) after 5m54s
[14:12:33.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:12:0)
[14:12:33.974] Build status: STARTED
[14:12:33.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:13:0) after 6m39s
[14:19:13.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:13:0)
[14:19:13.037] Build status: STARTED
[14:19:13.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:14:0) after 6m56s
[14:26:09.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:14:0)
[14:26:09.112] Build status: STARTED
[14:26:09.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:15:0) after 4m56s
[14:31:05.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:15:0)
[14:31:05.206] Build status: STARTED
[14:31:05.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:16:0) after 4m46s
[14:35:51.312] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:16:0)
[14:35:51.393] Build status: STARTED
[14:35:51.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:17:0) after 6m18s
[14:42:09.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:17:0)
[14:42:09.492] Build status: STARTED
[14:42:09.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:18:0) after 1m42s
[14:43:51.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:18:0)
[14:43:51.559] Build status: STARTED
[14:43:51.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:19:0) after 7m58s
[14:51:49.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:19:0)
[14:51:49.749] Build status: STARTED
[14:51:49.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:20:0) after 5m24s
[14:57:13.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:20:0)
[14:57:13.825] Build status: STARTED
[14:57:13.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:21:0) after 7m18s
[15:04:31.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:21:0)
[15:04:31.901] Build status: STARTED
[15:04:31.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:22:0) after 2m46s
[15:07:17.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:22:0)
[15:07:17.898] Build status: STARTED
[15:07:17.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:23:0) after 8m2s
[15:15:19.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:23:0)
[15:15:19.984] Build status: STARTED
[15:15:19.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:24:0) after 7m52s
[15:23:12.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:24:0)
[15:23:12.058] Build status: STARTED
[15:23:12.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:25:0) after 7m34s
[15:30:46.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:25:0)
[15:30:46.089] Build status: STARTED
[15:30:46.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:26:0) after 3m29s
[15:34:15.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:26:0)
[15:34:15.149] Build status: STARTED
[15:34:15.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:27:0) after 1m2s
[15:35:17.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:27:0)
[15:35:17.234] Build status: STARTED
[15:35:17.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:28:0) after 9m10s
[15:44:27.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:28:0)
[15:44:27.291] Build status: STARTED
[15:44:27.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:29:0) after 2m24s
[15:46:51.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:29:0)
[15:46:51.429] Build status: STARTED
[15:46:51.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:30:0) after 9m58s
[15:56:49.449] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:30:0)
[15:56:49.472] Build status: STARTED
[15:56:49.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:31:0) after 7m40s
[16:04:29.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:31:0)
[16:04:29.565] Build status: STARTED
[16:04:29.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:32:0) after 1m50s
[16:06:19.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:32:0)
[16:06:19.946] Build status: STARTED
[16:06:19.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:33:0) after 7m28s
[16:13:47.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:33:0)
[16:13:47.995] Build status: STARTED
[16:13:47.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:34:0) after 9m12s
[16:23:00.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:34:0)
[16:23:00.084] Build status: STARTED
[16:23:00.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:35:0) after 3m56s
[16:26:56.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:35:0)
[16:26:56.311] Build status: STARTED
[16:26:56.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:36:0) after 2m22s
[16:29:18.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:36:0)
[16:29:18.438] Build status: STARTED
[16:29:18.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:37:0) after 6m17s
[16:35:35.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:37:0)
[16:35:35.471] Build status: STARTED
[16:35:35.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:38:0) after 3m52s
[16:39:27.563] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:38:0)
[16:39:27.581] Build status: STARTED
[16:39:27.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8855769832611669216:39:0) after 5m54s
[16:43:43.417] Received PubSub notification, asking Buildbucket for the build status
[16:43:43.432] Build:
{
"id": "8690339770674402305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29168,
"createdBy": "project:chromium",
"createTime": "2026-02-09T13:19:42.072565283Z",
"startTime": "2026-02-09T13:19:49.192387638Z",
"endTime": "2026-02-09T16:43:41.057096889Z",
"updateTime": "2026-02-09T16:43:41.057096889Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fca2d133eaa58d770958613367c7b168106a5b0c",
"ref": "refs/heads/main"
}
}
}
[16:43:43.432] Invocation finished in 3h24m2.592202058s with status FAILED