[02:01:42.591] New invocation is queued and will start shortly
[02:01:43.811] Starting the invocation (attempt 1)
[02:01:43.836] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/85440f793ac1fd5b08cb6d196d0ca43e39c6f27d"
[02:01:43.837] Popped gitiles commit info from properties and tags
[02:01:43.837] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:01:43.837] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:01:43.837] Buildbucket request:
{
"requestId": "8857533829242003408",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "85440f793ac1fd5b08cb6d196d0ca43e39c6f27d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857533829242003408"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:01:44.400] Scheduled build:
{
"id": "8692103767198201681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 28973,
"createdBy": "project:chromium",
"createTime": "2026-01-21T02:01:43.893269615Z",
"updateTime": "2026-01-21T02:01:43.893269615Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "85440f793ac1fd5b08cb6d196d0ca43e39c6f27d",
"ref": "refs/heads/main"
}
}
}
[02:01:44.400] Task URL: https://cr-buildbucket.appspot.com/build/8692103767198201681
[02:01:44.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:2:0) after 8m45s
[02:01:44.671] Received PubSub notification, asking Buildbucket for the build status
[02:01:44.726] Build status: SCHEDULED
[02:02:43.793] Received PubSub notification, asking Buildbucket for the build status
[02:02:43.864] Build status: STARTED
[02:10:29.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:2:0)
[02:10:29.785] Build status: STARTED
[02:10:29.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:5:0) after 3m51s
[02:14:20.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:5:0)
[02:14:20.884] Build status: STARTED
[02:14:20.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:6:0) after 1m24s
[02:15:44.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:6:0)
[02:15:44.926] Build status: STARTED
[02:15:44.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:7:0) after 5m24s
[02:21:09.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:7:0)
[02:21:09.150] Build status: STARTED
[02:21:09.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:8:0) after 9m57s
[02:31:06.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:8:0)
[02:31:06.244] Build status: STARTED
[02:31:06.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:9:0) after 1m46s
[02:32:52.373] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:9:0)
[02:32:52.397] Build status: STARTED
[02:32:52.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:10:0) after 1m20s
[02:34:12.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:10:0)
[02:34:12.475] Build status: STARTED
[02:34:12.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:11:0) after 3m8s
[02:37:20.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:11:0)
[02:37:20.558] Build status: STARTED
[02:37:20.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:12:0) after 3m2s
[02:40:22.637] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:12:0)
[02:40:22.651] Build status: STARTED
[02:40:22.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:13:0) after 5m19s
[02:45:41.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:13:0)
[02:45:41.757] Build status: STARTED
[02:45:41.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:14:0) after 7m0s
[02:52:41.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:14:0)
[02:52:41.793] Build status: STARTED
[02:52:41.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:15:0) after 6m11s
[02:58:52.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:15:0)
[02:58:52.863] Build status: STARTED
[02:58:52.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:16:0) after 5m23s
[03:04:15.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:16:0)
[03:04:15.899] Build status: STARTED
[03:04:15.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:17:0) after 5m26s
[03:09:42.062] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:17:0)
[03:09:42.124] Build status: STARTED
[03:09:42.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:18:0) after 1m14s
[03:10:56.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:18:0)
[03:10:56.206] Build status: STARTED
[03:10:56.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:19:0) after 7m11s
[03:18:07.265] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:19:0)
[03:18:07.281] Build status: STARTED
[03:18:07.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:20:0) after 8m12s
[03:26:19.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:20:0)
[03:26:19.335] Build status: STARTED
[03:26:19.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:21:0) after 5m28s
[03:31:47.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:21:0)
[03:31:47.953] Build status: STARTED
[03:31:47.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:22:0) after 8m6s
[03:39:54.001] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:22:0)
[03:39:54.021] Build status: STARTED
[03:39:54.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:23:0) after 5m52s
[03:45:46.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:23:0)
[03:45:46.057] Build status: STARTED
[03:45:46.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:24:0) after 1m27s
[03:47:13.096] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:24:0)
[03:47:13.113] Build status: STARTED
[03:47:13.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:25:0) after 3m32s
[03:50:45.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:25:0)
[03:50:45.251] Build status: STARTED
[03:50:45.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:26:0) after 6m18s
[03:57:03.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:26:0)
[03:57:03.404] Build status: STARTED
[03:57:03.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:27:0) after 4m45s
[04:01:48.419] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:27:0)
[04:01:48.441] Build status: STARTED
[04:01:48.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:28:0) after 4m31s
[04:06:19.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:28:0)
[04:06:19.488] Build status: STARTED
[04:06:19.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:29:0) after 9m36s
[04:15:55.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:29:0)
[04:15:55.551] Build status: STARTED
[04:15:55.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:30:0) after 4m49s
[04:20:45.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:30:0)
[04:20:45.277] Build status: STARTED
[04:20:45.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:31:0) after 3m46s
[04:24:31.502] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:31:0)
[04:24:31.520] Build status: STARTED
[04:24:31.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:32:0) after 1m54s
[04:26:26.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:32:0)
[04:26:26.318] Build status: STARTED
[04:26:26.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:33:0) after 7m28s
[04:33:54.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:33:0)
[04:33:54.348] Build status: STARTED
[04:33:54.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:34:0) after 9m34s
[04:43:28.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:34:0)
[04:43:28.431] Build status: STARTED
[04:43:28.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:35:0) after 8m21s
[04:51:49.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:35:0)
[04:51:49.456] Build status: STARTED
[04:51:49.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:36:0) after 8m20s
[05:00:09.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:36:0)
[05:00:09.457] Build status: STARTED
[05:00:09.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:37:0) after 6m10s
[05:06:19.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:37:0)
[05:06:19.495] Build status: STARTED
[05:06:19.495] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8857533829242003408:38:0) after 7m49s
[05:10:57.730] Received PubSub notification, asking Buildbucket for the build status
[05:10:57.757] Build:
{
"id": "8692103767198201681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 28973,
"createdBy": "project:chromium",
"createTime": "2026-01-21T02:01:43.893269615Z",
"startTime": "2026-01-21T02:02:43.497816599Z",
"endTime": "2026-01-21T05:10:57.437207816Z",
"updateTime": "2026-01-21T05:10:57.437207816Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "85440f793ac1fd5b08cb6d196d0ca43e39c6f27d",
"ref": "refs/heads/main"
}
}
}
[05:10:57.757] Invocation finished in 3h9m15.197315068s with status FAILED