[12:40:28.343] New invocation is queued and will start shortly
[12:40:29.481] Starting the invocation (attempt 1)
[12:40:29.504] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2185bb7d3e8d30fb500c24aab1e47118a6acc0b8"
[12:40:29.504] Popped gitiles commit info from properties and tags
[12:40:29.504] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:40:29.504] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:40:29.504] Buildbucket request:
{
"requestId": "8856587672097225328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2185bb7d3e8d30fb500c24aab1e47118a6acc0b8",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856587672097225328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:40:29.969] Scheduled build:
{
"id": "8691157610145095137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29097,
"createdBy": "project:chromium",
"createTime": "2026-01-31T12:40:29.573450768Z",
"updateTime": "2026-01-31T12:40:29.573450768Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2185bb7d3e8d30fb500c24aab1e47118a6acc0b8",
"ref": "refs/heads/main"
}
}
}
[12:40:29.969] Task URL: https://cr-buildbucket.appspot.com/build/8691157610145095137
[12:40:29.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:2:0) after 5m42s
[12:40:30.944] Received PubSub notification, asking Buildbucket for the build status
[12:40:30.964] Build status: SCHEDULED
[12:41:36.548] Received PubSub notification, asking Buildbucket for the build status
[12:41:36.569] Build status: STARTED
[12:46:12.517] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:2:0)
[12:46:12.541] Build status: STARTED
[12:46:12.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:5:0) after 6m34s
[12:52:46.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:5:0)
[12:52:46.635] Build status: STARTED
[12:52:46.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:6:0) after 7m52s
[13:00:39.123] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:6:0)
[13:00:39.145] Build status: STARTED
[13:00:39.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:7:0) after 4m50s
[13:05:29.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:7:0)
[13:05:29.135] Build status: STARTED
[13:05:29.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:8:0) after 2m30s
[13:07:59.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:8:0)
[13:07:59.443] Build status: STARTED
[13:07:59.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:9:0) after 3m31s
[13:11:30.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:9:0)
[13:11:30.474] Build status: STARTED
[13:11:30.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:10:0) after 3m32s
[13:15:02.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:10:0)
[13:15:02.508] Build status: STARTED
[13:15:02.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:11:0) after 4m31s
[13:19:33.572] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:11:0)
[13:19:33.608] Build status: STARTED
[13:19:33.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:12:0) after 1m31s
[13:21:04.621] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:12:0)
[13:21:04.638] Build status: STARTED
[13:21:04.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:13:0) after 2m22s
[13:23:26.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:13:0)
[13:23:26.757] Build status: STARTED
[13:23:26.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:14:0) after 4m47s
[13:28:13.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:14:0)
[13:28:13.972] Build status: STARTED
[13:28:13.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:15:0) after 1m39s
[13:29:53.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:15:0)
[13:29:53.102] Build status: STARTED
[13:29:53.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:16:0) after 6m59s
[13:36:52.336] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:16:0)
[13:36:52.400] Build status: STARTED
[13:36:52.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:17:0) after 4m42s
[13:41:34.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:17:0)
[13:41:34.659] Build status: STARTED
[13:41:34.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:18:0) after 7m40s
[13:49:15.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:18:0)
[13:49:15.062] Build status: STARTED
[13:49:15.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:19:0) after 9m44s
[13:58:59.078] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:19:0)
[13:58:59.156] Build status: STARTED
[13:58:59.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:20:0) after 4m9s
[14:03:08.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:20:0)
[14:03:08.484] Build status: STARTED
[14:03:08.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:21:0) after 6m56s
[14:10:04.499] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:21:0)
[14:10:04.517] Build status: STARTED
[14:10:04.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:22:0) after 6m9s
[14:16:13.537] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:22:0)
[14:16:13.560] Build status: STARTED
[14:16:13.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:23:0) after 9m10s
[14:25:23.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:23:0)
[14:25:23.823] Build status: STARTED
[14:25:23.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:24:0) after 8m49s
[14:34:12.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:24:0)
[14:34:12.885] Build status: STARTED
[14:34:12.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:25:0) after 9m27s
[14:43:40.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:25:0)
[14:43:40.156] Build status: STARTED
[14:43:40.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:26:0) after 2m20s
[14:46:00.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:26:0)
[14:46:00.208] Build status: STARTED
[14:46:00.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:27:0) after 3m59s
[14:49:59.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:27:0)
[14:49:59.842] Build status: STARTED
[14:49:59.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:28:0) after 6m41s
[14:56:40.886] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:28:0)
[14:56:40.902] Build status: STARTED
[14:56:40.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:29:0) after 8m1s
[15:04:42.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:29:0)
[15:04:42.040] Build status: STARTED
[15:04:42.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:30:0) after 3m56s
[15:08:38.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:30:0)
[15:08:38.257] Build status: STARTED
[15:08:38.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:31:0) after 3m27s
[15:12:05.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:31:0)
[15:12:05.286] Build status: STARTED
[15:12:05.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:32:0) after 9m31s
[15:21:36.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:32:0)
[15:21:36.395] Build status: STARTED
[15:21:36.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:33:0) after 6m30s
[15:28:06.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:33:0)
[15:28:06.469] Build status: STARTED
[15:28:06.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:34:0) after 4m26s
[15:32:32.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:34:0)
[15:32:32.508] Build status: STARTED
[15:32:32.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:35:0) after 7m22s
[15:39:54.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:35:0)
[15:39:54.543] Build status: STARTED
[15:39:54.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:36:0) after 8m37s
[15:48:31.813] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:36:0)
[15:48:31.835] Build status: STARTED
[15:48:31.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:37:0) after 2m32s
[15:51:03.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:37:0)
[15:51:03.880] Build status: STARTED
[15:51:03.880] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856587672097225328:38:0) after 3m14s
[15:52:55.212] Received PubSub notification, asking Buildbucket for the build status
[15:52:55.245] Build:
{
"id": "8691157610145095137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29097,
"createdBy": "project:chromium",
"createTime": "2026-01-31T12:40:29.573450768Z",
"startTime": "2026-01-31T12:41:34.593044277Z",
"endTime": "2026-01-31T15:52:53.611248748Z",
"updateTime": "2026-01-31T15:52:53.611248748Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2185bb7d3e8d30fb500c24aab1e47118a6acc0b8",
"ref": "refs/heads/main"
}
}
}
[15:52:55.245] Invocation finished in 3h12m26.917336937s with status FAILED