[02:51:52.669] New invocation is queued and will start shortly
[02:51:53.700] Starting the invocation (attempt 1)
[02:51:53.723] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/14d10e901224eb61f5c4e804c62a8e38e5d1f1b5"
[02:51:53.723] Popped gitiles commit info from properties and tags
[02:51:53.723] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:51:53.723] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:51:53.724] Buildbucket request:
{
"requestId": "8850826497404185904",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "14d10e901224eb61f5c4e804c62a8e38e5d1f1b5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850826497404185904"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:51:54.339] Scheduled build:
{
"id": "8685396435573145345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29994,
"createdBy": "project:chromium",
"createTime": "2026-04-05T02:51:53.795799133Z",
"updateTime": "2026-04-05T02:51:53.795799133Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "14d10e901224eb61f5c4e804c62a8e38e5d1f1b5",
"ref": "refs/heads/main"
}
}
}
[02:51:54.339] Task URL: https://cr-buildbucket.appspot.com/build/8685396435573145345
[02:51:54.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:2:0) after 3m9s
[02:51:55.274] Received PubSub notification, asking Buildbucket for the build status
[02:51:55.310] Build status: SCHEDULED
[02:52:54.739] Received PubSub notification, asking Buildbucket for the build status
[02:52:54.757] Build status: STARTED
[02:55:03.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:2:0)
[02:55:03.378] Build status: STARTED
[02:55:03.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:5:0) after 4m10s
[02:59:13.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:5:0)
[02:59:13.370] Build status: STARTED
[02:59:13.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:6:0) after 4m42s
[03:03:55.578] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:6:0)
[03:03:55.597] Build status: STARTED
[03:03:55.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:7:0) after 2m47s
[03:06:42.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:7:0)
[03:06:42.709] Build status: STARTED
[03:06:42.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:8:0) after 1m54s
[03:08:37.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:8:0)
[03:08:37.383] Build status: STARTED
[03:08:37.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:9:0) after 2m47s
[03:11:24.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:9:0)
[03:11:24.767] Build status: STARTED
[03:11:24.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:10:0) after 4m48s
[03:16:12.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:10:0)
[03:16:12.924] Build status: STARTED
[03:16:12.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:11:0) after 7m41s
[03:23:53.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:11:0)
[03:23:53.994] Build status: STARTED
[03:23:53.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:12:0) after 1m41s
[03:25:35.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:12:0)
[03:25:35.252] Build status: STARTED
[03:25:35.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:13:0) after 9m17s
[03:34:52.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:13:0)
[03:34:52.280] Build status: STARTED
[03:34:52.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:14:0) after 9m50s
[03:44:42.503] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:14:0)
[03:44:42.572] Build status: STARTED
[03:44:42.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:15:0) after 6m13s
[03:50:55.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:15:0)
[03:50:55.721] Build status: STARTED
[03:50:55.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:16:0) after 8m35s
[03:59:30.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:16:0)
[03:59:30.966] Build status: STARTED
[03:59:30.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:17:0) after 8m34s
[04:08:05.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:17:0)
[04:08:05.449] Build status: STARTED
[04:08:05.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:18:0) after 9m21s
[04:17:26.460] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:18:0)
[04:17:26.476] Build status: STARTED
[04:17:26.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:19:0) after 8m52s
[04:26:18.624] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:19:0)
[04:26:18.641] Build status: STARTED
[04:26:18.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:20:0) after 2m28s
[04:28:46.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:20:0)
[04:28:46.860] Build status: STARTED
[04:28:46.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:21:0) after 9m4s
[04:37:50.875] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:21:0)
[04:37:50.900] Build status: STARTED
[04:37:50.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:22:0) after 7m0s
[04:44:50.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:22:0)
[04:44:50.935] Build status: STARTED
[04:44:50.935] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:23:0) after 9m27s
[04:54:18.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:23:0)
[04:54:18.058] Build status: STARTED
[04:54:18.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:24:0) after 2m42s
[04:57:00.069] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:24:0)
[04:57:00.088] Build status: STARTED
[04:57:00.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:25:0) after 9m30s
[05:06:30.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:25:0)
[05:06:30.584] Build status: STARTED
[05:06:30.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:26:0) after 6m51s
[05:13:21.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:26:0)
[05:13:21.587] Build status: STARTED
[05:13:21.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:27:0) after 3m24s
[05:16:45.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:27:0)
[05:16:45.621] Build status: STARTED
[05:16:45.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:28:0) after 2m50s
[05:19:35.633] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:28:0)
[05:19:35.715] Build status: STARTED
[05:19:35.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:29:0) after 1m20s
[05:20:55.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:29:0)
[05:20:55.747] Build status: STARTED
[05:20:55.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:30:0) after 5m5s
[05:26:00.805] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:30:0)
[05:26:00.829] Build status: STARTED
[05:26:00.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:31:0) after 3m16s
[05:29:16.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:31:0)
[05:29:16.964] Build status: STARTED
[05:29:16.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:32:0) after 4m1s
[05:33:18.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:32:0)
[05:33:18.074] Build status: STARTED
[05:33:18.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:33:0) after 4m52s
[05:38:10.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:33:0)
[05:38:10.193] Build status: STARTED
[05:38:10.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:34:0) after 3m5s
[05:41:15.328] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:34:0)
[05:41:15.368] Build status: STARTED
[05:41:15.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850826497404185904:35:0) after 9m32s
[05:42:10.953] Received PubSub notification, asking Buildbucket for the build status
[05:42:10.968] Build:
{
"id": "8685396435573145345",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29994,
"createdBy": "project:chromium",
"createTime": "2026-04-05T02:51:53.795799133Z",
"startTime": "2026-04-05T02:52:54.381194836Z",
"endTime": "2026-04-05T05:42:10.531124427Z",
"updateTime": "2026-04-05T05:42:10.531124427Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "14d10e901224eb61f5c4e804c62a8e38e5d1f1b5",
"ref": "refs/heads/main"
}
}
}
[05:42:10.968] Invocation finished in 2h50m18.303072511s with status FAILED