[15:52:56.963] New invocation is queued and will start shortly
[15:52:58.108] Starting the invocation (attempt 1)
[15:52:58.154] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5e5279ddf0f9ab0540ecae3b4d3692b328c5eed2"
[15:52:58.154] Popped gitiles commit info from properties and tags
[15:52:58.154] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:52:58.155] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:52:58.155] Buildbucket request:
{
"requestId": "8856575562489492064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e5279ddf0f9ab0540ecae3b4d3692b328c5eed2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856575562489492064"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:52:58.751] Scheduled build:
{
"id": "8691145500519899185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29098,
"createdBy": "project:chromium",
"createTime": "2026-01-31T15:52:58.212778445Z",
"updateTime": "2026-01-31T15:52:58.212778445Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e5279ddf0f9ab0540ecae3b4d3692b328c5eed2",
"ref": "refs/heads/main"
}
}
}
[15:52:58.751] Task URL: https://cr-buildbucket.appspot.com/build/8691145500519899185
[15:52:58.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:2:0) after 4m36s
[15:52:59.638] Received PubSub notification, asking Buildbucket for the build status
[15:52:59.653] Build status: SCHEDULED
[15:54:02.441] Received PubSub notification, asking Buildbucket for the build status
[15:54:02.461] Build status: STARTED
[15:57:34.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:2:0)
[15:57:34.947] Build status: STARTED
[15:57:34.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:5:0) after 7m11s
[16:04:45.988] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:5:0)
[16:04:46.010] Build status: STARTED
[16:04:46.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:6:0) after 1m15s
[16:06:01.152] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:6:0)
[16:06:01.165] Build status: STARTED
[16:06:01.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:7:0) after 3m43s
[16:09:44.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:7:0)
[16:09:44.368] Build status: STARTED
[16:09:44.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:8:0) after 9m5s
[16:18:49.381] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:8:0)
[16:18:49.405] Build status: STARTED
[16:18:49.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:9:0) after 4m47s
[16:23:36.380] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:9:0)
[16:23:36.410] Build status: STARTED
[16:23:36.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:10:0) after 5m46s
[16:29:22.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:10:0)
[16:29:22.544] Build status: STARTED
[16:29:22.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:11:0) after 8m45s
[16:38:07.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:11:0)
[16:38:07.580] Build status: STARTED
[16:38:07.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:12:0) after 4m58s
[16:43:05.693] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:12:0)
[16:43:05.719] Build status: STARTED
[16:43:05.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:13:0) after 8m53s
[16:51:58.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:13:0)
[16:51:58.837] Build status: STARTED
[16:51:58.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:14:0) after 2m4s
[16:54:02.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:14:0)
[16:54:03.005] Build status: STARTED
[16:54:03.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:15:0) after 1m24s
[16:55:27.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:15:0)
[16:55:27.080] Build status: STARTED
[16:55:27.080] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:16:0) after 4m46s
[17:00:13.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:16:0)
[17:00:13.222] Build status: STARTED
[17:00:13.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:17:0) after 8m51s
[17:09:04.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:17:0)
[17:09:04.355] Build status: STARTED
[17:09:04.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:18:0) after 4m49s
[17:13:53.662] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:18:0)
[17:13:53.676] Build status: STARTED
[17:13:53.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:19:0) after 1m54s
[17:15:47.689] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:19:0)
[17:15:47.713] Build status: STARTED
[17:15:47.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:20:0) after 5m55s
[17:21:42.735] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:20:0)
[17:21:42.757] Build status: STARTED
[17:21:42.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:21:0) after 9m46s
[17:31:28.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:21:0)
[17:31:28.845] Build status: STARTED
[17:31:28.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:22:0) after 8m46s
[17:40:14.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:22:0)
[17:40:14.880] Build status: STARTED
[17:40:14.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:23:0) after 9m2s
[17:49:17.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:23:0)
[17:49:17.500] Build status: STARTED
[17:49:17.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:24:0) after 6m14s
[17:55:31.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:24:0)
[17:55:31.535] Build status: STARTED
[17:55:31.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:25:0) after 1m27s
[17:56:58.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:25:0)
[17:56:58.643] Build status: STARTED
[17:56:58.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:26:0) after 9m56s
[18:06:54.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:26:0)
[18:06:54.668] Build status: STARTED
[18:06:54.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:27:0) after 7m44s
[18:14:38.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:27:0)
[18:14:38.702] Build status: STARTED
[18:14:38.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:28:0) after 3m26s
[18:18:04.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:28:0)
[18:18:04.848] Build status: STARTED
[18:18:04.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:29:0) after 3m40s
[18:21:45.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:29:0)
[18:21:45.142] Build status: STARTED
[18:21:45.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:30:0) after 8m39s
[18:30:24.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:30:0)
[18:30:24.181] Build status: STARTED
[18:30:24.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:31:0) after 4m5s
[18:34:29.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:31:0)
[18:34:29.349] Build status: STARTED
[18:34:29.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:32:0) after 9m47s
[18:44:16.362] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:32:0)
[18:44:16.402] Build status: STARTED
[18:44:16.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:33:0) after 8m7s
[18:52:23.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:33:0)
[18:52:23.447] Build status: STARTED
[18:52:23.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:34:0) after 1m5s
[18:53:28.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:34:0)
[18:53:28.735] Build status: STARTED
[18:53:28.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:35:0) after 7m25s
[19:00:53.777] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:35:0)
[19:00:53.797] Build status: STARTED
[19:00:53.797] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856575562489492064:36:0) after 9m13s
[19:05:31.173] Received PubSub notification, asking Buildbucket for the build status
[19:05:31.230] Build:
{
"id": "8691145500519899185",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29098,
"createdBy": "project:chromium",
"createTime": "2026-01-31T15:52:58.212778445Z",
"startTime": "2026-01-31T15:54:02.218891758Z",
"endTime": "2026-01-31T19:05:30.662573494Z",
"updateTime": "2026-01-31T19:05:30.662573494Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5e5279ddf0f9ab0540ecae3b4d3692b328c5eed2",
"ref": "refs/heads/main"
}
}
}
[19:05:31.230] Invocation finished in 3h12m34.280008968s with status FAILED