[11:51:20.580] New invocation is queued and will start shortly
[11:51:21.644] Starting the invocation (attempt 1)
[11:51:21.673] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/77820b7023a3bfb68c47b4ea2f83f82ae1c88878"
[11:51:21.673] Popped gitiles commit info from properties and tags
[11:51:21.673] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:51:21.673] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:51:21.674] Buildbucket request:
{
"requestId": "8843001218081312144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "77820b7023a3bfb68c47b4ea2f83f82ae1c88878",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843001218081312144"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:51:22.206] Scheduled build:
{
"id": "8677571156196419217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 31192,
"createdBy": "project:chromium",
"createTime": "2026-06-30T11:51:21.755277175Z",
"updateTime": "2026-06-30T11:51:21.755277175Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "77820b7023a3bfb68c47b4ea2f83f82ae1c88878",
"ref": "refs/heads/main"
}
}
}
[11:51:22.206] Task URL: https://cr-buildbucket.appspot.com/build/8677571156196419217
[11:51:22.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:2:0) after 6m16s
[11:51:23.137] Received PubSub notification, asking Buildbucket for the build status
[11:51:23.165] Build status: SCHEDULED
[11:52:21.390] Received PubSub notification, asking Buildbucket for the build status
[11:52:21.422] Build status: STARTED
[11:57:38.220] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:2:0)
[11:57:38.247] Build status: STARTED
[11:57:38.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:5:0) after 4m43s
[12:02:21.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:5:0)
[12:02:21.288] Build status: STARTED
[12:02:21.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:6:0) after 9m12s
[12:11:33.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:6:0)
[12:11:33.346] Build status: STARTED
[12:11:33.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:7:0) after 4m9s
[12:15:42.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:7:0)
[12:15:42.417] Build status: STARTED
[12:15:42.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:8:0) after 6m37s
[12:22:19.423] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:8:0)
[12:22:19.518] Build status: STARTED
[12:22:19.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:9:0) after 2m24s
[12:24:43.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:9:0)
[12:24:43.553] Build status: STARTED
[12:24:43.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:10:0) after 7m24s
[12:32:07.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:10:0)
[12:32:07.625] Build status: STARTED
[12:32:07.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:11:0) after 6m31s
[12:38:38.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:11:0)
[12:38:38.663] Build status: STARTED
[12:38:38.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:12:0) after 3m13s
[12:41:51.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:12:0)
[12:41:51.760] Build status: STARTED
[12:41:51.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:13:0) after 8m42s
[12:50:34.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:13:0)
[12:50:34.247] Build status: STARTED
[12:50:34.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:14:0) after 4m26s
[12:55:00.260] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:14:0)
[12:55:00.327] Build status: STARTED
[12:55:00.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:15:0) after 8m41s
[13:03:41.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:15:0)
[13:03:41.511] Build status: STARTED
[13:03:41.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:16:0) after 8m50s
[13:12:31.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:16:0)
[13:12:31.743] Build status: STARTED
[13:12:31.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:17:0) after 5m27s
[13:17:58.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:17:0)
[13:17:58.789] Build status: STARTED
[13:17:58.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:18:0) after 3m7s
[13:21:05.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:18:0)
[13:21:05.842] Build status: STARTED
[13:21:05.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:19:0) after 1m48s
[13:22:53.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:19:0)
[13:22:53.849] Build status: STARTED
[13:22:53.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:20:0) after 3m44s
[13:26:37.924] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:20:0)
[13:26:37.972] Build status: STARTED
[13:26:37.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:21:0) after 2m29s
[13:29:07.090] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:21:0)
[13:29:07.128] Build status: STARTED
[13:29:07.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:22:0) after 8m31s
[13:37:38.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:22:0)
[13:37:38.220] Build status: STARTED
[13:37:38.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:23:0) after 5m46s
[13:43:24.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:23:0)
[13:43:24.253] Build status: STARTED
[13:43:24.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:24:0) after 4m14s
[13:47:38.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:24:0)
[13:47:38.289] Build status: STARTED
[13:47:38.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:25:0) after 7m53s
[13:55:31.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:25:0)
[13:55:31.415] Build status: STARTED
[13:55:31.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:26:0) after 7m35s
[14:03:06.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:26:0)
[14:03:06.752] Build status: STARTED
[14:03:06.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:27:0) after 6m41s
[14:09:47.862] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:27:0)
[14:09:47.881] Build status: STARTED
[14:09:47.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:28:0) after 8m42s
[14:18:29.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:28:0)
[14:18:30.017] Build status: STARTED
[14:18:30.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:29:0) after 6m12s
[14:24:42.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:29:0)
[14:24:42.103] Build status: STARTED
[14:24:42.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:30:0) after 4m1s
[14:28:43.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:30:0)
[14:28:43.141] Build status: STARTED
[14:28:43.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:31:0) after 3m18s
[14:32:01.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:31:0)
[14:32:01.175] Build status: STARTED
[14:32:01.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:32:0) after 7m44s
[14:39:45.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:32:0)
[14:39:45.243] Build status: STARTED
[14:39:45.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:33:0) after 8m27s
[14:48:12.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:33:0)
[14:48:12.287] Build status: STARTED
[14:48:12.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:34:0) after 3m40s
[14:51:52.352] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:34:0)
[14:51:52.398] Build status: STARTED
[14:51:52.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:35:0) after 4m5s
[14:55:57.412] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:35:0)
[14:55:57.433] Build status: STARTED
[14:55:57.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:36:0) after 5m41s
[15:01:38.454] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:36:0)
[15:01:38.471] Build status: STARTED
[15:01:38.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843001218081312144:37:0) after 5m6s
[15:04:58.402] Received PubSub notification, asking Buildbucket for the build status
[15:04:58.437] Build:
{
"id": "8677571156196419217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 31192,
"createdBy": "project:chromium",
"createTime": "2026-06-30T11:51:21.755277175Z",
"startTime": "2026-06-30T11:52:21.194580100Z",
"endTime": "2026-06-30T15:04:58.095274262Z",
"updateTime": "2026-06-30T15:04:58.095274262Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "77820b7023a3bfb68c47b4ea2f83f82ae1c88878",
"ref": "refs/heads/main"
}
}
}
[15:04:58.437] Invocation finished in 3h13m37.862563771s with status FAILED