[19:05:32.863] New invocation is queued and will start shortly
[19:05:33.919] Starting the invocation (attempt 1)
[19:05:33.949] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6c589c3c268b2ccb532f91a91df42d567d382038"
[19:05:33.949] Popped gitiles commit info from properties and tags
[19:05:33.949] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:05:33.949] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:05:33.949] Buildbucket request:
{
"requestId": "8856563445245777440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6c589c3c268b2ccb532f91a91df42d567d382038",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856563445245777440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:05:34.492] Scheduled build:
{
"id": "8691133383368236945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29099,
"createdBy": "project:chromium",
"createTime": "2026-01-31T19:05:34.028163038Z",
"updateTime": "2026-01-31T19:05:34.028163038Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6c589c3c268b2ccb532f91a91df42d567d382038",
"ref": "refs/heads/main"
}
}
}
[19:05:34.492] Task URL: https://cr-buildbucket.appspot.com/build/8691133383368236945
[19:05:34.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:2:0) after 8m50s
[19:05:35.595] Received PubSub notification, asking Buildbucket for the build status
[19:05:35.620] Build status: SCHEDULED
[19:06:38.467] Received PubSub notification, asking Buildbucket for the build status
[19:06:38.485] Build status: STARTED
[19:14:24.704] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:2:0)
[19:14:24.807] Build status: STARTED
[19:14:24.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:5:0) after 3m33s
[19:17:58.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:5:0)
[19:17:58.246] Build status: STARTED
[19:17:58.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:6:0) after 7m8s
[19:25:06.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:6:0)
[19:25:06.287] Build status: STARTED
[19:25:06.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:7:0) after 8m2s
[19:33:08.377] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:7:0)
[19:33:08.402] Build status: STARTED
[19:33:08.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:8:0) after 7m39s
[19:40:47.420] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:8:0)
[19:40:47.438] Build status: STARTED
[19:40:47.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:9:0) after 9m4s
[19:49:51.527] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:9:0)
[19:49:51.543] Build status: STARTED
[19:49:51.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:10:0) after 7m55s
[19:57:46.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:10:0)
[19:57:46.703] Build status: STARTED
[19:57:46.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:11:0) after 8m13s
[20:05:59.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:11:0)
[20:05:59.937] Build status: STARTED
[20:05:59.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:12:0) after 9m10s
[20:15:09.949] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:12:0)
[20:15:09.967] Build status: STARTED
[20:15:09.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:13:0) after 7m9s
[20:22:19.317] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:13:0)
[20:22:19.349] Build status: STARTED
[20:22:19.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:14:0) after 4m35s
[20:26:54.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:14:0)
[20:26:54.415] Build status: STARTED
[20:26:54.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:15:0) after 6m20s
[20:33:14.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:15:0)
[20:33:14.703] Build status: STARTED
[20:33:14.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:16:0) after 2m29s
[20:35:43.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:16:0)
[20:35:44.001] Build status: STARTED
[20:35:44.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:17:0) after 1m20s
[20:37:04.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:17:0)
[20:37:04.471] Build status: STARTED
[20:37:04.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:18:0) after 3m13s
[20:40:17.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:18:0)
[20:40:17.648] Build status: STARTED
[20:40:17.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:19:0) after 2m33s
[20:42:50.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:19:0)
[20:42:50.821] Build status: STARTED
[20:42:50.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:20:0) after 2m50s
[20:45:40.836] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:20:0)
[20:45:40.879] Build status: STARTED
[20:45:40.879] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:21:0) after 3m35s
[20:49:15.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:21:0)
[20:49:15.906] Build status: STARTED
[20:49:15.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:22:0) after 9m30s
[20:58:46.023] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:22:0)
[20:58:46.082] Build status: STARTED
[20:58:46.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:23:0) after 8m35s
[21:07:21.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:23:0)
[21:07:21.112] Build status: STARTED
[21:07:21.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:24:0) after 8m10s
[21:15:31.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:24:0)
[21:15:31.203] Build status: STARTED
[21:15:31.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:25:0) after 8m51s
[21:24:22.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:25:0)
[21:24:22.232] Build status: STARTED
[21:24:22.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:26:0) after 8m33s
[21:32:55.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:26:0)
[21:32:55.278] Build status: STARTED
[21:32:55.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:27:0) after 5m34s
[21:38:29.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:27:0)
[21:38:29.482] Build status: STARTED
[21:38:29.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:28:0) after 9m11s
[21:47:40.601] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:28:0)
[21:47:40.618] Build status: STARTED
[21:47:40.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:29:0) after 7m10s
[21:54:50.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:29:0)
[21:54:50.710] Build status: STARTED
[21:54:50.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:30:0) after 6m1s
[22:00:51.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:30:0)
[22:00:51.828] Build status: STARTED
[22:00:51.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:31:0) after 7m28s
[22:08:19.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:31:0)
[22:08:19.997] Build status: STARTED
[22:08:19.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:32:0) after 1m26s
[22:09:46.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:32:0)
[22:09:46.054] Build status: STARTED
[22:09:46.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856563445245777440:33:0) after 5m50s
[22:11:30.494] Received PubSub notification, asking Buildbucket for the build status
[22:11:30.529] Build:
{
"id": "8691133383368236945",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29099,
"createdBy": "project:chromium",
"createTime": "2026-01-31T19:05:34.028163038Z",
"startTime": "2026-01-31T19:06:37.911523602Z",
"endTime": "2026-01-31T22:11:30.227463939Z",
"updateTime": "2026-01-31T22:11:30.227463939Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6c589c3c268b2ccb532f91a91df42d567d382038",
"ref": "refs/heads/main"
}
}
}
[22:11:30.529] Invocation finished in 3h5m57.675076557s with status FAILED