[00:26:11.329] New invocation is queued and will start shortly
[00:26:12.403] Starting the invocation (attempt 1)
[00:26:12.426] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5a63e24fd24ba4405ebc5bd30472c4bcaffc5b0c"
[00:26:12.426] Popped gitiles commit info from properties and tags
[00:26:12.426] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:26:12.426] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:26:12.426] Buildbucket request:
{
"requestId": "8850563872468957216",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a63e24fd24ba4405ebc5bd30472c4bcaffc5b0c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850563872468957216"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:26:13.164] Scheduled build:
{
"id": "8685133810544183265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30025,
"createdBy": "project:chromium",
"createTime": "2026-04-08T00:26:12.540579210Z",
"updateTime": "2026-04-08T00:26:12.540579210Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a63e24fd24ba4405ebc5bd30472c4bcaffc5b0c",
"ref": "refs/heads/main"
}
}
}
[00:26:13.164] Task URL: https://cr-buildbucket.appspot.com/build/8685133810544183265
[00:26:13.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:2:0) after 1m53s
[00:28:06.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:2:0)
[00:28:06.281] Build status: SCHEDULED
[00:28:06.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:3:0) after 4m17s
[00:29:33.345] Received PubSub notification, asking Buildbucket for the build status
[00:29:33.367] Build status: SCHEDULED
[00:32:23.290] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:3:0)
[00:32:23.320] Build status: SCHEDULED
[00:32:23.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:5:0) after 1m54s
[00:34:17.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:5:0)
[00:34:17.601] Build status: STARTED
[00:34:17.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:6:0) after 7m8s
[00:34:49.455] Received PubSub notification, asking Buildbucket for the build status
[00:34:49.475] Build status: STARTED
[00:41:25.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:6:0)
[00:41:25.745] Build status: STARTED
[00:41:25.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:8:0) after 4m41s
[00:46:06.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:8:0)
[00:46:06.845] Build status: STARTED
[00:46:06.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:9:0) after 7m15s
[00:53:21.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:9:0)
[00:53:21.928] Build status: STARTED
[00:53:21.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:10:0) after 1m14s
[00:54:35.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:10:0)
[00:54:35.970] Build status: STARTED
[00:54:35.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:11:0) after 7m13s
[01:01:49.045] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:11:0)
[01:01:49.148] Build status: STARTED
[01:01:49.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:12:0) after 6m45s
[01:08:34.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:12:0)
[01:08:34.187] Build status: STARTED
[01:08:34.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:13:0) after 2m39s
[01:11:13.239] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:13:0)
[01:11:13.260] Build status: STARTED
[01:11:13.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:14:0) after 3m39s
[01:14:52.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:14:0)
[01:14:52.291] Build status: STARTED
[01:14:52.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:15:0) after 8m39s
[01:23:31.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:15:0)
[01:23:31.343] Build status: STARTED
[01:23:31.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:16:0) after 1m34s
[01:25:05.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:16:0)
[01:25:05.468] Build status: STARTED
[01:25:05.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:17:0) after 1m45s
[01:26:50.456] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:17:0)
[01:26:50.478] Build status: STARTED
[01:26:50.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:18:0) after 5m9s
[01:31:59.666] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:18:0)
[01:31:59.682] Build status: STARTED
[01:31:59.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:19:0) after 6m44s
[01:38:43.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:19:0)
[01:38:43.854] Build status: STARTED
[01:38:43.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:20:0) after 9m16s
[01:47:59.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:20:0)
[01:47:59.885] Build status: STARTED
[01:47:59.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:21:0) after 6m45s
[01:54:44.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:21:0)
[01:54:44.884] Build status: STARTED
[01:54:44.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:22:0) after 4m0s
[01:58:44.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:22:0)
[01:58:44.961] Build status: STARTED
[01:58:44.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:23:0) after 3m40s
[02:02:25.038] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:23:0)
[02:02:25.099] Build status: STARTED
[02:02:25.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:24:0) after 3m44s
[02:06:09.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:24:0)
[02:06:09.226] Build status: STARTED
[02:06:09.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:25:0) after 1m46s
[02:07:55.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:25:0)
[02:07:55.322] Build status: STARTED
[02:07:55.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:26:0) after 6m36s
[02:14:31.546] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:26:0)
[02:14:31.586] Build status: STARTED
[02:14:31.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:27:0) after 6m4s
[02:20:35.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:27:0)
[02:20:35.694] Build status: STARTED
[02:20:35.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:28:0) after 5m20s
[02:25:55.804] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:28:0)
[02:25:55.823] Build status: STARTED
[02:25:55.823] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:29:0) after 1m51s
[02:27:46.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:29:0)
[02:27:46.858] Build status: STARTED
[02:27:46.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:30:0) after 7m58s
[02:35:44.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:30:0)
[02:35:44.990] Build status: STARTED
[02:35:44.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:31:0) after 7m36s
[02:43:21.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:31:0)
[02:43:21.037] Build status: STARTED
[02:43:21.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:32:0) after 2m27s
[02:45:48.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:32:0)
[02:45:48.310] Build status: STARTED
[02:45:48.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:33:0) after 3m17s
[02:49:05.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:33:0)
[02:49:05.488] Build status: STARTED
[02:49:05.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:34:0) after 2m41s
[02:51:46.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:34:0)
[02:51:46.550] Build status: STARTED
[02:51:46.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:35:0) after 1m54s
[02:53:40.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:35:0)
[02:53:40.620] Build status: STARTED
[02:53:40.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:36:0) after 7m9s
[03:00:49.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:36:0)
[03:00:49.636] Build status: STARTED
[03:00:49.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:37:0) after 2m39s
[03:03:28.682] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:37:0)
[03:03:28.698] Build status: STARTED
[03:03:28.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:38:0) after 5m10s
[03:08:38.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:38:0)
[03:08:38.814] Build status: STARTED
[03:08:38.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:39:0) after 6m22s
[03:15:00.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:39:0)
[03:15:00.891] Build status: STARTED
[03:15:00.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:40:0) after 7m4s
[03:22:04.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:40:0)
[03:22:05.012] Build status: STARTED
[03:22:05.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:41:0) after 4m22s
[03:26:27.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:41:0)
[03:26:27.168] Build status: STARTED
[03:26:27.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:42:0) after 1m9s
[03:27:36.197] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:42:0)
[03:27:36.221] Build status: STARTED
[03:27:36.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:43:0) after 7m32s
[03:35:08.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:43:0)
[03:35:08.425] Build status: STARTED
[03:35:08.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:44:0) after 9m13s
[03:44:21.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:44:0)
[03:44:21.492] Build status: STARTED
[03:44:21.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:45:0) after 1m56s
[03:46:17.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:45:0)
[03:46:17.535] Build status: STARTED
[03:46:17.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:46:0) after 1m14s
[03:47:31.541] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:46:0)
[03:47:31.595] Build status: STARTED
[03:47:31.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850563872468957216:47:0) after 4m29s
[03:48:27.348] Received PubSub notification, asking Buildbucket for the build status
[03:48:27.365] Build:
{
"id": "8685133810544183265",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30025,
"createdBy": "project:chromium",
"createTime": "2026-04-08T00:26:12.540579210Z",
"startTime": "2026-04-08T00:32:46.300100549Z",
"endTime": "2026-04-08T03:48:26.970377978Z",
"updateTime": "2026-04-08T03:48:26.970377978Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5a63e24fd24ba4405ebc5bd30472c4bcaffc5b0c",
"ref": "refs/heads/main"
}
}
}
[03:48:27.365] Invocation finished in 3h22m16.044745024s with status FAILED