[17:10:00.670] New invocation is queued and will start shortly
[17:10:01.801] Starting the invocation (attempt 1)
[17:10:01.821] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7e0e0d999e4539f31c80bf4435370bc3ac1e63ef"
[17:10:01.821] Popped gitiles commit info from properties and tags
[17:10:01.821] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:10:01.822] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:10:01.822] Buildbucket request:
{
"requestId": "8848960568996336240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e0e0d999e4539f31c80bf4435370bc3ac1e63ef",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848960568996336240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:10:02.395] Scheduled build:
{
"id": "8683530507078975729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30284,
"createdBy": "project:chromium",
"createTime": "2026-04-25T17:10:01.876364522Z",
"updateTime": "2026-04-25T17:10:01.876364522Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e0e0d999e4539f31c80bf4435370bc3ac1e63ef",
"ref": "refs/heads/main"
}
}
}
[17:10:02.395] Task URL: https://cr-buildbucket.appspot.com/build/8683530507078975729
[17:10:02.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:2:0) after 1m56s
[17:10:03.392] Received PubSub notification, asking Buildbucket for the build status
[17:10:03.410] Build status: SCHEDULED
[17:11:07.417] Received PubSub notification, asking Buildbucket for the build status
[17:11:07.440] Build status: STARTED
[17:11:58.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:2:0)
[17:11:58.870] Build status: STARTED
[17:11:58.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:5:0) after 9m55s
[17:21:53.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:5:0)
[17:21:54.008] Build status: STARTED
[17:21:54.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:6:0) after 6m47s
[17:28:41.169] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:6:0)
[17:28:41.187] Build status: STARTED
[17:28:41.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:7:0) after 1m9s
[17:29:50.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:7:0)
[17:29:50.372] Build status: STARTED
[17:29:50.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:8:0) after 3m53s
[17:33:43.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:8:0)
[17:33:43.408] Build status: STARTED
[17:33:43.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:9:0) after 6m25s
[17:40:08.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:9:0)
[17:40:08.450] Build status: STARTED
[17:40:08.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:10:0) after 1m57s
[17:42:05.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:10:0)
[17:42:05.545] Build status: STARTED
[17:42:05.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:11:0) after 3m46s
[17:45:51.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:11:0)
[17:45:51.841] Build status: STARTED
[17:45:51.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:12:0) after 5m0s
[17:50:51.954] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:12:0)
[17:50:51.968] Build status: STARTED
[17:50:51.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:13:0) after 4m50s
[17:55:42.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:13:0)
[17:55:42.394] Build status: STARTED
[17:55:42.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:14:0) after 6m43s
[18:02:25.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:14:0)
[18:02:25.647] Build status: STARTED
[18:02:25.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:15:0) after 7m25s
[18:09:50.855] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:15:0)
[18:09:50.888] Build status: STARTED
[18:09:50.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:16:0) after 3m23s
[18:13:13.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:16:0)
[18:13:13.938] Build status: STARTED
[18:13:13.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:17:0) after 7m23s
[18:20:37.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:17:0)
[18:20:37.220] Build status: STARTED
[18:20:37.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:18:0) after 3m6s
[18:23:43.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:18:0)
[18:23:43.348] Build status: STARTED
[18:23:43.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:19:0) after 1m9s
[18:24:52.486] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:19:0)
[18:24:52.503] Build status: STARTED
[18:24:52.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:20:0) after 4m18s
[18:29:10.518] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:20:0)
[18:29:10.537] Build status: STARTED
[18:29:10.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:21:0) after 6m11s
[18:35:21.603] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:21:0)
[18:35:21.620] Build status: STARTED
[18:35:21.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:22:0) after 2m31s
[18:37:52.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:22:0)
[18:37:52.706] Build status: STARTED
[18:37:52.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:23:0) after 5m48s
[18:43:40.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:23:0)
[18:43:40.997] Build status: STARTED
[18:43:40.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:24:0) after 2m12s
[18:45:53.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:24:0)
[18:45:53.029] Build status: STARTED
[18:45:53.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:25:0) after 2m47s
[18:48:40.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:25:0)
[18:48:40.126] Build status: STARTED
[18:48:40.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:26:0) after 1m23s
[18:50:03.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:26:0)
[18:50:03.226] Build status: STARTED
[18:50:03.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:27:0) after 6m42s
[18:56:45.369] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:27:0)
[18:56:45.388] Build status: STARTED
[18:56:45.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:28:0) after 4m18s
[19:01:03.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:28:0)
[19:01:03.563] Build status: STARTED
[19:01:03.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:29:0) after 9m13s
[19:10:16.618] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:29:0)
[19:10:16.668] Build status: STARTED
[19:10:16.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:30:0) after 7m39s
[19:17:55.859] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:30:0)
[19:17:55.873] Build status: STARTED
[19:17:55.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:31:0) after 5m38s
[19:23:34.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:31:0)
[19:23:34.164] Build status: STARTED
[19:23:34.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:32:0) after 9m46s
[19:33:20.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:32:0)
[19:33:20.199] Build status: STARTED
[19:33:20.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:33:0) after 3m5s
[19:36:25.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:33:0)
[19:36:25.527] Build status: STARTED
[19:36:25.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:34:0) after 1m49s
[19:38:14.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:34:0)
[19:38:14.668] Build status: STARTED
[19:38:14.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:35:0) after 9m19s
[19:47:33.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:35:0)
[19:47:33.905] Build status: STARTED
[19:47:33.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:36:0) after 7m35s
[19:55:09.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:36:0)
[19:55:09.110] Build status: STARTED
[19:55:09.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:37:0) after 3m45s
[19:58:54.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:37:0)
[19:58:54.365] Build status: STARTED
[19:58:54.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848960568996336240:38:0) after 2m49s
[20:00:43.356] Received PubSub notification, asking Buildbucket for the build status
[20:00:43.377] Build:
{
"id": "8683530507078975729",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30284,
"createdBy": "project:chromium",
"createTime": "2026-04-25T17:10:01.876364522Z",
"startTime": "2026-04-25T17:11:07.034474341Z",
"endTime": "2026-04-25T20:00:40.919098841Z",
"updateTime": "2026-04-25T20:00:40.919098841Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7e0e0d999e4539f31c80bf4435370bc3ac1e63ef",
"ref": "refs/heads/main"
}
}
}
[20:00:43.377] Invocation finished in 2h50m42.713294076s with status FAILED