[05:22:29.454] New invocation is queued and will start shortly
[05:22:30.510] Starting the invocation (attempt 1)
[05:22:30.532] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9ef1190c33a108be2bc86d0f43d56f23fd138ffe"
[05:22:30.532] Popped gitiles commit info from properties and tags
[05:22:30.532] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:22:30.532] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:22:30.532] Buildbucket request:
{
"requestId": "8850635827715329168",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ef1190c33a108be2bc86d0f43d56f23fd138ffe",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850635827715329168"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:22:31.396] Scheduled build:
{
"id": "8685205765850375553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30020,
"createdBy": "project:chromium",
"createTime": "2026-04-07T05:22:30.613145796Z",
"updateTime": "2026-04-07T05:22:30.613145796Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ef1190c33a108be2bc86d0f43d56f23fd138ffe",
"ref": "refs/heads/main"
}
}
}
[05:22:31.396] Task URL: https://cr-buildbucket.appspot.com/build/8685205765850375553
[05:22:31.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:2:0) after 7m15s
[05:22:31.976] Received PubSub notification, asking Buildbucket for the build status
[05:22:32.000] Build status: SCHEDULED
[05:23:36.636] Received PubSub notification, asking Buildbucket for the build status
[05:23:36.657] Build status: STARTED
[05:29:46.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:2:0)
[05:29:46.399] Build status: STARTED
[05:29:46.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:5:0) after 4m8s
[05:33:54.444] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:5:0)
[05:33:54.470] Build status: STARTED
[05:33:54.470] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:6:0) after 1m12s
[05:35:06.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:6:0)
[05:35:06.493] Build status: STARTED
[05:35:06.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:7:0) after 5m39s
[05:40:45.510] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:7:0)
[05:40:45.526] Build status: STARTED
[05:40:45.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:8:0) after 2m48s
[05:43:33.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:8:0)
[05:43:33.587] Build status: STARTED
[05:43:33.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:9:0) after 1m31s
[05:45:04.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:9:0)
[05:45:04.594] Build status: STARTED
[05:45:04.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:10:0) after 6m19s
[05:51:23.641] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:10:0)
[05:51:23.673] Build status: STARTED
[05:51:23.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:11:0) after 4m27s
[05:55:50.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:11:0)
[05:55:50.734] Build status: STARTED
[05:55:50.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:12:0) after 9m4s
[06:04:54.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:12:0)
[06:04:54.770] Build status: STARTED
[06:04:54.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:13:0) after 9m8s
[06:14:02.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:13:0)
[06:14:02.896] Build status: STARTED
[06:14:02.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:14:0) after 4m43s
[06:18:45.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:14:0)
[06:18:45.915] Build status: STARTED
[06:18:45.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:15:0) after 9m55s
[06:28:41.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:15:0)
[06:28:41.027] Build status: STARTED
[06:28:41.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:16:0) after 8m18s
[06:36:59.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:16:0)
[06:36:59.109] Build status: STARTED
[06:36:59.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:17:0) after 8m10s
[06:45:09.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:17:0)
[06:45:09.240] Build status: STARTED
[06:45:09.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:18:0) after 9m22s
[06:54:31.473] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:18:0)
[06:54:31.504] Build status: STARTED
[06:54:31.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:19:0) after 7m30s
[07:02:01.471] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:19:0)
[07:02:01.525] Build status: STARTED
[07:02:01.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:20:0) after 9m16s
[07:12:17.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:20:0)
[07:12:17.624] Build status: STARTED
[07:12:17.624] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:21:0) after 9m49s
[07:22:06.645] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:21:0)
[07:22:06.674] Build status: STARTED
[07:22:06.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:22:0) after 7m20s
[07:29:26.695] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:22:0)
[07:29:26.709] Build status: STARTED
[07:29:26.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:23:0) after 4m28s
[07:33:54.684] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:23:0)
[07:33:54.702] Build status: STARTED
[07:33:54.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:24:0) after 9m42s
[07:43:36.720] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:24:0)
[07:43:36.738] Build status: STARTED
[07:43:36.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:25:0) after 6m58s
[07:50:34.732] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:25:0)
[07:50:34.755] Build status: STARTED
[07:50:34.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:26:0) after 9m7s
[07:59:41.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:26:0)
[07:59:41.800] Build status: STARTED
[07:59:41.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:27:0) after 1m56s
[08:01:37.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:27:0)
[08:01:37.916] Build status: STARTED
[08:01:37.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:28:0) after 9m6s
[08:10:43.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:28:0)
[08:10:43.983] Build status: STARTED
[08:10:43.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850635827715329168:29:0) after 6m27s
[08:13:46.307] Received PubSub notification, asking Buildbucket for the build status
[08:13:46.327] Build:
{
"id": "8685205765850375553",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30020,
"createdBy": "project:chromium",
"createTime": "2026-04-07T05:22:30.613145796Z",
"startTime": "2026-04-07T05:23:36.298285492Z",
"endTime": "2026-04-07T08:13:46.044557879Z",
"updateTime": "2026-04-07T08:13:46.044557879Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9ef1190c33a108be2bc86d0f43d56f23fd138ffe",
"ref": "refs/heads/main"
}
}
}
[08:13:46.327] Invocation finished in 2h51m16.87663884s with status FAILED