[14:26:41.539] New invocation is queued and will start shortly
[14:26:42.596] Starting the invocation (attempt 1)
[14:26:42.619] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/16acb83380cd6ae22ccbe1a6db7c712459d64ac6"
[14:26:42.619] Popped gitiles commit info from properties and tags
[14:26:42.619] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:26:42.619] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:26:42.619] Buildbucket request:
{
"requestId": "8848970844128597856",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "16acb83380cd6ae22ccbe1a6db7c712459d64ac6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848970844128597856"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:26:43.077] Scheduled build:
{
"id": "8683540782285081073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30283,
"createdBy": "project:chromium",
"createTime": "2026-04-25T14:26:42.676354153Z",
"updateTime": "2026-04-25T14:26:42.676354153Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "16acb83380cd6ae22ccbe1a6db7c712459d64ac6",
"ref": "refs/heads/main"
}
}
}
[14:26:43.077] Task URL: https://cr-buildbucket.appspot.com/build/8683540782285081073
[14:26:43.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:2:0) after 2m34s
[14:26:44.012] Received PubSub notification, asking Buildbucket for the build status
[14:26:44.028] Build status: SCHEDULED
[14:27:47.555] Received PubSub notification, asking Buildbucket for the build status
[14:27:47.573] Build status: STARTED
[14:29:17.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:2:0)
[14:29:17.167] Build status: STARTED
[14:29:17.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:5:0) after 2m14s
[14:31:31.228] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:5:0)
[14:31:31.244] Build status: STARTED
[14:31:31.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:6:0) after 6m16s
[14:37:47.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:6:0)
[14:37:47.379] Build status: STARTED
[14:37:47.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:7:0) after 8m44s
[14:46:31.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:7:0)
[14:46:31.597] Build status: STARTED
[14:46:31.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:8:0) after 7m4s
[14:53:35.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:8:0)
[14:53:35.632] Build status: STARTED
[14:53:35.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:9:0) after 2m39s
[14:56:14.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:9:0)
[14:56:14.666] Build status: STARTED
[14:56:14.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:10:0) after 2m20s
[14:58:34.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:10:0)
[14:58:34.671] Build status: STARTED
[14:58:34.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:11:0) after 6m56s
[15:05:30.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:11:0)
[15:05:30.775] Build status: STARTED
[15:05:30.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:12:0) after 4m6s
[15:09:36.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:12:0)
[15:09:36.806] Build status: STARTED
[15:09:36.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:13:0) after 7m11s
[15:16:47.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:13:0)
[15:16:47.866] Build status: STARTED
[15:16:47.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:14:0) after 9m50s
[15:26:37.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:14:0)
[15:26:37.938] Build status: STARTED
[15:26:37.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:15:0) after 6m20s
[15:32:57.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:15:0)
[15:32:58.018] Build status: STARTED
[15:32:58.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:16:0) after 7m42s
[15:40:40.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:16:0)
[15:40:40.545] Build status: STARTED
[15:40:40.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:17:0) after 5m20s
[15:46:00.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:17:0)
[15:46:00.895] Build status: STARTED
[15:46:00.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:18:0) after 8m31s
[15:54:31.911] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:18:0)
[15:54:31.926] Build status: STARTED
[15:54:31.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:19:0) after 3m41s
[15:58:12.937] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:19:0)
[15:58:12.955] Build status: STARTED
[15:58:12.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:20:0) after 4m13s
[16:02:25.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:20:0)
[16:02:25.978] Build status: STARTED
[16:02:25.978] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:21:0) after 1m31s
[16:03:57.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:21:0)
[16:03:57.132] Build status: STARTED
[16:03:57.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:22:0) after 3m54s
[16:07:51.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:22:0)
[16:07:51.164] Build status: STARTED
[16:07:51.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:23:0) after 8m57s
[16:16:48.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:23:0)
[16:16:48.317] Build status: STARTED
[16:16:48.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:24:0) after 9m34s
[16:26:22.331] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:24:0)
[16:26:22.350] Build status: STARTED
[16:26:22.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:25:0) after 4m53s
[16:31:15.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:25:0)
[16:31:15.384] Build status: STARTED
[16:31:15.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:26:0) after 4m18s
[16:35:34.200] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:26:0)
[16:35:34.256] Build status: STARTED
[16:35:34.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:27:0) after 6m13s
[16:41:47.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:27:0)
[16:41:47.608] Build status: STARTED
[16:41:47.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:28:0) after 3m27s
[16:45:14.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:28:0)
[16:45:14.887] Build status: STARTED
[16:45:14.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:29:0) after 8m6s
[16:53:20.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:29:0)
[16:53:20.989] Build status: STARTED
[16:53:20.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:30:0) after 2m26s
[16:55:47.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:30:0)
[16:55:47.027] Build status: STARTED
[16:55:47.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:31:0) after 9m5s
[17:04:52.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:31:0)
[17:04:52.117] Build status: STARTED
[17:04:52.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:32:0) after 5m1s
[17:09:53.132] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:32:0)
[17:09:53.150] Build status: STARTED
[17:09:53.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848970844128597856:33:0) after 4m18s
[17:09:58.661] Received PubSub notification, asking Buildbucket for the build status
[17:09:58.678] Build:
{
"id": "8683540782285081073",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30283,
"createdBy": "project:chromium",
"createTime": "2026-04-25T14:26:42.676354153Z",
"startTime": "2026-04-25T14:27:47.332210824Z",
"endTime": "2026-04-25T17:09:58.240036908Z",
"updateTime": "2026-04-25T17:09:58.240036908Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "16acb83380cd6ae22ccbe1a6db7c712459d64ac6",
"ref": "refs/heads/main"
}
}
}
[17:09:58.678] Invocation finished in 2h43m17.144221725s with status FAILED