[02:58:48.795] New invocation is queued and will start shortly
[02:58:49.848] Starting the invocation (attempt 1)
[02:58:49.885] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/28e88ed2eb2cb2e2ccd6a61eb9a88fff5455d260"
[02:58:49.885] Popped gitiles commit info from properties and tags
[02:58:49.885] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:58:49.885] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:58:49.885] Buildbucket request:
{
"requestId": "8848832927803808928",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "28e88ed2eb2cb2e2ccd6a61eb9a88fff5455d260",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848832927803808928"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:58:50.313] Scheduled build:
{
"id": "8683402865960360321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30298,
"createdBy": "project:chromium",
"createTime": "2026-04-27T02:58:49.933153529Z",
"updateTime": "2026-04-27T02:58:49.933153529Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "28e88ed2eb2cb2e2ccd6a61eb9a88fff5455d260",
"ref": "refs/heads/main"
}
}
}
[02:58:50.313] Task URL: https://cr-buildbucket.appspot.com/build/8683402865960360321
[02:58:50.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:2:0) after 6m55s
[02:58:51.270] Received PubSub notification, asking Buildbucket for the build status
[02:58:51.349] Build status: SCHEDULED
[02:58:54.975] Received PubSub notification, asking Buildbucket for the build status
[02:58:54.997] Build status: STARTED
[03:05:45.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:2:0)
[03:05:45.385] Build status: STARTED
[03:05:45.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:5:0) after 6m1s
[03:11:46.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:5:0)
[03:11:46.487] Build status: STARTED
[03:11:46.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:6:0) after 9m13s
[03:20:59.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:6:0)
[03:20:59.536] Build status: STARTED
[03:20:59.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:7:0) after 9m56s
[03:30:55.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:7:0)
[03:30:55.587] Build status: STARTED
[03:30:55.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:8:0) after 6m36s
[03:37:31.600] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:8:0)
[03:37:31.621] Build status: STARTED
[03:37:31.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:9:0) after 7m22s
[03:44:53.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:9:0)
[03:44:53.767] Build status: STARTED
[03:44:53.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:10:0) after 6m39s
[03:51:32.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:10:0)
[03:51:32.816] Build status: STARTED
[03:51:32.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:11:0) after 3m38s
[03:55:10.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:11:0)
[03:55:10.960] Build status: STARTED
[03:55:10.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:12:0) after 5m35s
[04:00:45.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:12:0)
[04:00:46.079] Build status: STARTED
[04:00:46.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:13:0) after 7m36s
[04:08:22.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:13:0)
[04:08:22.172] Build status: STARTED
[04:08:22.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:14:0) after 6m11s
[04:14:33.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:14:0)
[04:14:33.233] Build status: STARTED
[04:14:33.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:15:0) after 4m5s
[04:18:38.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:15:0)
[04:18:38.501] Build status: STARTED
[04:18:38.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:16:0) after 9m33s
[04:28:11.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:16:0)
[04:28:11.759] Build status: STARTED
[04:28:11.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:17:0) after 7m21s
[04:35:32.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:17:0)
[04:35:32.807] Build status: STARTED
[04:35:32.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:18:0) after 3m12s
[04:38:45.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:18:0)
[04:38:45.200] Build status: STARTED
[04:38:45.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:19:0) after 3m11s
[04:41:56.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:19:0)
[04:41:56.409] Build status: STARTED
[04:41:56.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:20:0) after 6m8s
[04:48:04.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:20:0)
[04:48:04.693] Build status: STARTED
[04:48:04.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:21:0) after 4m42s
[04:52:46.764] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:21:0)
[04:52:46.779] Build status: STARTED
[04:52:46.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:22:0) after 9m46s
[05:02:33.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:22:0)
[05:02:33.117] Build status: STARTED
[05:02:33.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:23:0) after 2m47s
[05:05:20.128] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:23:0)
[05:05:20.220] Build status: STARTED
[05:05:20.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:24:0) after 9m24s
[05:14:44.269] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:24:0)
[05:14:44.299] Build status: STARTED
[05:14:44.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:25:0) after 8m8s
[05:22:52.314] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:25:0)
[05:22:52.330] Build status: STARTED
[05:22:52.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:26:0) after 2m22s
[05:25:14.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:26:0)
[05:25:14.374] Build status: STARTED
[05:25:14.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:27:0) after 8m17s
[05:33:31.385] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:27:0)
[05:33:31.402] Build status: STARTED
[05:33:31.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:28:0) after 7m39s
[05:41:10.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:28:0)
[05:41:10.436] Build status: STARTED
[05:41:10.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:29:0) after 2m34s
[05:43:44.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:29:0)
[05:43:44.468] Build status: STARTED
[05:43:44.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:30:0) after 5m28s
[05:49:12.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:30:0)
[05:49:12.501] Build status: STARTED
[05:49:12.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848832927803808928:31:0) after 6m55s
[05:49:52.204] Received PubSub notification, asking Buildbucket for the build status
[05:49:52.220] Build:
{
"id": "8683402865960360321",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30298,
"createdBy": "project:chromium",
"createTime": "2026-04-27T02:58:49.933153529Z",
"startTime": "2026-04-27T02:58:54.747282536Z",
"endTime": "2026-04-27T05:49:49.926629237Z",
"updateTime": "2026-04-27T05:49:49.926629237Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "28e88ed2eb2cb2e2ccd6a61eb9a88fff5455d260",
"ref": "refs/heads/main"
}
}
}
[05:49:52.220] Invocation finished in 2h51m3.428710431s with status FAILED