[15:46:51.175] New invocation is queued and will start shortly
[15:46:52.293] Starting the invocation (attempt 1)
[15:46:52.315] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4fc7483166d7152acf2a98c00f70c85614558422"
[15:46:52.315] Popped gitiles commit info from properties and tags
[15:46:52.315] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:46:52.315] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:46:52.315] Buildbucket request:
{
"requestId": "8833654913538038448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fc7483166d7152acf2a98c00f70c85614558422",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833654913538038448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:46:53.631] Scheduled build:
{
"id": "8668224851632652529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33310,
"createdBy": "project:chromium",
"createTime": "2026-10-11T15:46:52.371881010Z",
"updateTime": "2026-10-11T15:46:52.371881010Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fc7483166d7152acf2a98c00f70c85614558422",
"ref": "refs/heads/main"
}
}
}
[15:46:53.631] Task URL: https://cr-buildbucket.appspot.com/build/8668224851632652529
[15:46:53.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:2:0) after 5m47s
[15:47:10.980] Received PubSub notification, asking Buildbucket for the build status
[15:47:11.175] Build status: SCHEDULED
[15:49:02.033] Received PubSub notification, asking Buildbucket for the build status
[15:49:02.057] Build status: STARTED
[15:52:40.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:2:0)
[15:52:40.722] Build status: STARTED
[15:52:40.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:5:0) after 3m22s
[15:56:02.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:5:0)
[15:56:02.772] Build status: STARTED
[15:56:02.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:6:0) after 7m5s
[16:03:07.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:6:0)
[16:03:07.819] Build status: STARTED
[16:03:07.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:7:0) after 5m18s
[16:08:25.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:7:0)
[16:08:25.853] Build status: STARTED
[16:08:25.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:8:0) after 9m51s
[16:18:16.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:8:0)
[16:18:16.906] Build status: STARTED
[16:18:16.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:9:0) after 9m45s
[16:28:01.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:9:0)
[16:28:01.981] Build status: STARTED
[16:28:01.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:10:0) after 4m40s
[16:32:41.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:10:0)
[16:32:42.018] Build status: STARTED
[16:32:42.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:11:0) after 3m16s
[16:35:58.371] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:11:0)
[16:35:58.390] Build status: STARTED
[16:35:58.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:12:0) after 8m47s
[16:44:45.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:12:0)
[16:44:45.671] Build status: STARTED
[16:44:45.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:13:0) after 8m46s
[16:53:31.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:13:0)
[16:53:31.770] Build status: STARTED
[16:53:31.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:14:0) after 9m2s
[17:02:33.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:14:0)
[17:02:33.813] Build status: STARTED
[17:02:33.813] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:15:0) after 1m3s
[17:03:36.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:15:0)
[17:03:37.176] Build status: STARTED
[17:03:37.176] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:16:0) after 7m3s
[17:10:40.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:16:0)
[17:10:40.343] Build status: STARTED
[17:10:40.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:17:0) after 6m17s
[17:16:57.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:17:0)
[17:16:57.538] Build status: STARTED
[17:16:57.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:18:0) after 3m49s
[17:20:46.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:18:0)
[17:20:46.656] Build status: STARTED
[17:20:46.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:19:0) after 1m16s
[17:22:02.863] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:19:0)
[17:22:02.892] Build status: STARTED
[17:22:02.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:20:0) after 5m31s
[17:27:33.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:20:0)
[17:27:33.933] Build status: STARTED
[17:27:33.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:21:0) after 1m5s
[17:28:39.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:21:0)
[17:28:39.085] Build status: STARTED
[17:28:39.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:22:0) after 6m51s
[17:35:30.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:22:0)
[17:35:30.200] Build status: STARTED
[17:35:30.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:23:0) after 1m46s
[17:37:16.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:23:0)
[17:37:16.280] Build status: STARTED
[17:37:16.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:24:0) after 3m34s
[17:40:50.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:24:0)
[17:40:50.423] Build status: STARTED
[17:40:50.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:25:0) after 6m3s
[17:46:53.438] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:25:0)
[17:46:53.475] Build status: STARTED
[17:46:53.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:26:0) after 9m33s
[17:56:26.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:26:0)
[17:56:26.510] Build status: STARTED
[17:56:26.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:27:0) after 5m28s
[18:01:54.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:27:0)
[18:01:54.564] Build status: STARTED
[18:01:54.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:28:0) after 6m51s
[18:08:45.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:28:0)
[18:08:45.750] Build status: STARTED
[18:08:45.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:29:0) after 1m15s
[18:10:00.771] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:29:0)
[18:10:00.805] Build status: STARTED
[18:10:00.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:30:0) after 9m35s
[18:19:35.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:30:0)
[18:19:35.853] Build status: STARTED
[18:19:35.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:31:0) after 7m15s
[18:26:50.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:31:0)
[18:26:50.976] Build status: STARTED
[18:26:50.976] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:32:0) after 1m5s
[18:27:56.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:32:0)
[18:27:56.116] Build status: STARTED
[18:27:56.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:33:0) after 3m44s
[18:31:40.198] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:33:0)
[18:31:40.221] Build status: STARTED
[18:31:40.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:34:0) after 5m42s
[18:37:22.202] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:34:0)
[18:37:22.217] Build status: STARTED
[18:37:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:35:0) after 6m34s
[18:43:56.231] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:35:0)
[18:43:56.266] Build status: STARTED
[18:43:56.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:36:0) after 1m57s
[18:45:53.287] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:36:0)
[18:45:53.331] Build status: STARTED
[18:45:53.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833654913538038448:37:0) after 8m4s
[18:52:33.982] Received PubSub notification, asking Buildbucket for the build status
[18:52:34.000] Build:
{
"id": "8668224851632652529",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33310,
"createdBy": "project:chromium",
"createTime": "2026-10-11T15:46:52.371881010Z",
"startTime": "2026-10-11T15:48:13.999762435Z",
"endTime": "2026-10-11T18:52:08.634404307Z",
"updateTime": "2026-10-11T18:52:08.634404307Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4fc7483166d7152acf2a98c00f70c85614558422",
"ref": "refs/heads/main"
}
}
}
[18:52:34.000] Invocation finished in 3h5m42.829504375s with status FAILED