[03:52:57.760] New invocation is queued and will start shortly
[03:52:59.793] Starting the invocation (attempt 1)
[03:52:59.820] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5425ce420b9e7391b92df0127146b9183634eb96"
[03:52:59.820] Popped gitiles commit info from properties and tags
[03:52:59.820] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:52:59.821] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:52:59.821] Buildbucket request:
{
"requestId": "8833609230662342528",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5425ce420b9e7391b92df0127146b9183634eb96",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833609230662342528"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:53:00.302] Scheduled build:
{
"id": "8668179167784511921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33314,
"createdBy": "project:chromium",
"createTime": "2026-10-12T03:52:59.884755039Z",
"updateTime": "2026-10-12T03:52:59.884755039Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5425ce420b9e7391b92df0127146b9183634eb96",
"ref": "refs/heads/main"
}
}
}
[03:53:00.302] Task URL: https://cr-buildbucket.appspot.com/build/8668179167784511921
[03:53:00.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:2:0) after 3m47s
[03:53:01.272] Received PubSub notification, asking Buildbucket for the build status
[03:53:01.297] Build status: SCHEDULED
[03:54:14.966] Received PubSub notification, asking Buildbucket for the build status
[03:54:14.985] Build status: STARTED
[03:56:47.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:2:0)
[03:56:47.612] Build status: STARTED
[03:56:47.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:5:0) after 9m16s
[04:06:03.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:5:0)
[04:06:03.714] Build status: STARTED
[04:06:03.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:6:0) after 7m44s
[04:13:47.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:6:0)
[04:13:47.745] Build status: STARTED
[04:13:47.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:7:0) after 9m39s
[04:23:26.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:7:0)
[04:23:26.904] Build status: STARTED
[04:23:26.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:8:0) after 5m44s
[04:29:10.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:8:0)
[04:29:10.943] Build status: STARTED
[04:29:10.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:9:0) after 1m40s
[04:30:51.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:9:0)
[04:30:51.258] Build status: STARTED
[04:30:51.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:10:0) after 7m42s
[04:38:33.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:10:0)
[04:38:33.301] Build status: STARTED
[04:38:33.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:11:0) after 4m38s
[04:43:11.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:11:0)
[04:43:11.335] Build status: STARTED
[04:43:11.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:12:0) after 1m42s
[04:44:53.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:12:0)
[04:44:53.523] Build status: STARTED
[04:44:53.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:13:0) after 4m46s
[04:49:39.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:13:0)
[04:49:39.858] Build status: STARTED
[04:49:39.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:14:0) after 7m48s
[04:57:27.873] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:14:0)
[04:57:27.910] Build status: STARTED
[04:57:27.911] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:15:0) after 7m29s
[05:04:56.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:15:0)
[05:04:56.980] Build status: STARTED
[05:04:56.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:16:0) after 2m30s
[05:07:27.088] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:16:0)
[05:07:27.105] Build status: STARTED
[05:07:27.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:17:0) after 1m16s
[05:08:43.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:17:0)
[05:08:43.152] Build status: STARTED
[05:08:43.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:18:0) after 2m54s
[05:11:37.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:18:0)
[05:11:37.359] Build status: STARTED
[05:11:37.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:19:0) after 8m15s
[05:19:52.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:19:0)
[05:19:52.404] Build status: STARTED
[05:19:52.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:20:0) after 6m19s
[05:26:11.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:20:0)
[05:26:11.539] Build status: STARTED
[05:26:11.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:21:0) after 9m32s
[05:35:43.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:21:0)
[05:35:43.664] Build status: STARTED
[05:35:43.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:22:0) after 2m44s
[05:38:27.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:22:0)
[05:38:27.816] Build status: STARTED
[05:38:27.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:23:0) after 5m56s
[05:44:23.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:23:0)
[05:44:24.161] Build status: STARTED
[05:44:24.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:24:0) after 6m25s
[05:50:49.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:24:0)
[05:50:49.198] Build status: STARTED
[05:50:49.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:25:0) after 6m9s
[05:56:58.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:25:0)
[05:56:58.272] Build status: STARTED
[05:56:58.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:26:0) after 1m10s
[05:58:08.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:26:0)
[05:58:08.345] Build status: STARTED
[05:58:08.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:27:0) after 2m49s
[06:00:57.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:27:0)
[06:00:58.488] Build status: STARTED
[06:00:58.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:28:0) after 1m36s
[06:02:34.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:28:0)
[06:02:34.524] Build status: STARTED
[06:02:34.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:29:0) after 4m13s
[06:06:47.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:29:0)
[06:06:47.597] Build status: STARTED
[06:06:47.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:30:0) after 9m14s
[06:16:01.632] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:30:0)
[06:16:01.654] Build status: STARTED
[06:16:01.654] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:31:0) after 5m39s
[06:21:40.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:31:0)
[06:21:40.744] Build status: STARTED
[06:21:40.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:32:0) after 7m34s
[06:29:14.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:32:0)
[06:29:14.852] Build status: STARTED
[06:29:14.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:33:0) after 1m5s
[06:30:19.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:33:0)
[06:30:20.034] Build status: STARTED
[06:30:20.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:34:0) after 8m16s
[06:38:36.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:34:0)
[06:38:36.169] Build status: STARTED
[06:38:36.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:35:0) after 1m11s
[06:39:47.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:35:0)
[06:39:47.203] Build status: STARTED
[06:39:47.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:36:0) after 4m19s
[06:44:06.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:36:0)
[06:44:06.298] Build status: STARTED
[06:44:06.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:37:0) after 8m12s
[06:52:18.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:37:0)
[06:52:18.367] Build status: STARTED
[06:52:18.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833609230662342528:38:0) after 3m39s
[06:52:53.014] Received PubSub notification, asking Buildbucket for the build status
[06:52:53.032] Build:
{
"id": "8668179167784511921",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33314,
"createdBy": "project:chromium",
"createTime": "2026-10-12T03:52:59.884755039Z",
"startTime": "2026-10-12T03:54:14.339738967Z",
"endTime": "2026-10-12T06:52:52.614684107Z",
"updateTime": "2026-10-12T06:52:52.614684107Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5425ce420b9e7391b92df0127146b9183634eb96",
"ref": "refs/heads/main"
}
}
}
[06:52:53.032] Invocation finished in 2h59m55.275780169s with status FAILED