[15:28:29.968] New invocation is queued and will start shortly
[15:28:31.069] Starting the invocation (attempt 1)
[15:28:31.090] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5bced80d3398c4c9739058630a162b85adf7d94d"
[15:28:31.090] Popped gitiles commit info from properties and tags
[15:28:31.090] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:28:31.090] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:28:31.090] Buildbucket request:
{
"requestId": "8850869491863631184",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5bced80d3398c4c9739058630a162b85adf7d94d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850869491863631184"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:28:31.611] Scheduled build:
{
"id": "8685439429967913505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29990,
"createdBy": "project:chromium",
"createTime": "2026-04-04T15:28:31.145790080Z",
"updateTime": "2026-04-04T15:28:31.145790080Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5bced80d3398c4c9739058630a162b85adf7d94d",
"ref": "refs/heads/main"
}
}
}
[15:28:31.611] Task URL: https://cr-buildbucket.appspot.com/build/8685439429967913505
[15:28:31.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:2:0) after 8m45s
[15:28:50.005] Received PubSub notification, asking Buildbucket for the build status
[15:28:50.029] Build status: SCHEDULED
[15:28:58.150] Received PubSub notification, asking Buildbucket for the build status
[15:28:58.167] Build status: STARTED
[15:37:16.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:2:0)
[15:37:16.741] Build status: STARTED
[15:37:16.741] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:5:0) after 3m52s
[15:41:08.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:5:0)
[15:41:08.770] Build status: STARTED
[15:41:08.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:6:0) after 8m26s
[15:49:34.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:6:0)
[15:49:34.874] Build status: STARTED
[15:49:34.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:7:0) after 9m9s
[15:58:43.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:7:0)
[15:58:43.926] Build status: STARTED
[15:58:43.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:8:0) after 4m2s
[16:02:45.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:8:0)
[16:02:46.043] Build status: STARTED
[16:02:46.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:9:0) after 3m18s
[16:06:04.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:9:0)
[16:06:04.075] Build status: STARTED
[16:06:04.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:10:0) after 4m16s
[16:10:20.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:10:0)
[16:10:20.179] Build status: STARTED
[16:10:20.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:11:0) after 9m5s
[16:19:25.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:11:0)
[16:19:25.239] Build status: STARTED
[16:19:25.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:12:0) after 7m1s
[16:26:26.402] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:12:0)
[16:26:26.432] Build status: STARTED
[16:26:26.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:13:0) after 2m7s
[16:28:33.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:13:0)
[16:28:33.579] Build status: STARTED
[16:28:33.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:14:0) after 4m34s
[16:33:07.685] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:14:0)
[16:33:07.704] Build status: STARTED
[16:33:07.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:15:0) after 8m50s
[16:41:58.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:15:0)
[16:41:58.083] Build status: STARTED
[16:41:58.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:16:0) after 6m59s
[16:48:57.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:16:0)
[16:48:57.124] Build status: STARTED
[16:48:57.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:17:0) after 1m29s
[16:50:26.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:17:0)
[16:50:26.162] Build status: STARTED
[16:50:26.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:18:0) after 6m8s
[16:56:34.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:18:0)
[16:56:34.240] Build status: STARTED
[16:56:34.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:19:0) after 8m24s
[17:04:58.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:19:0)
[17:04:58.447] Build status: STARTED
[17:04:58.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:20:0) after 2m48s
[17:07:46.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:20:0)
[17:07:46.520] Build status: STARTED
[17:07:46.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:21:0) after 7m52s
[17:15:38.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:21:0)
[17:15:38.581] Build status: STARTED
[17:15:38.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:22:0) after 6m52s
[17:22:30.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:22:0)
[17:22:30.666] Build status: STARTED
[17:22:30.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:23:0) after 9m3s
[17:31:33.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:23:0)
[17:31:33.698] Build status: STARTED
[17:31:33.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:24:0) after 4m35s
[17:36:08.865] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:24:0)
[17:36:08.884] Build status: STARTED
[17:36:08.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:25:0) after 7m7s
[17:43:15.917] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:25:0)
[17:43:15.933] Build status: STARTED
[17:43:15.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:26:0) after 9m39s
[17:52:55.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:26:0)
[17:52:55.853] Build status: STARTED
[17:52:55.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:27:0) after 9m12s
[18:02:07.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:27:0)
[18:02:07.986] Build status: STARTED
[18:02:07.986] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:28:0) after 6m56s
[18:09:04.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:28:0)
[18:09:04.043] Build status: STARTED
[18:09:04.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850869491863631184:29:0) after 8m36s
[18:16:19.835] Received PubSub notification, asking Buildbucket for the build status
[18:16:19.853] Build:
{
"id": "8685439429967913505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29990,
"createdBy": "project:chromium",
"createTime": "2026-04-04T15:28:31.145790080Z",
"startTime": "2026-04-04T15:28:56.673778671Z",
"endTime": "2026-04-04T18:16:19.475609107Z",
"updateTime": "2026-04-04T18:16:19.475609107Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5bced80d3398c4c9739058630a162b85adf7d94d",
"ref": "refs/heads/main"
}
}
}
[18:16:19.853] Invocation finished in 2h47m49.89835815s with status FAILED