[01:00:04.921] New invocation is queued and will start shortly
[01:00:06.389] Starting the invocation (attempt 1)
[01:00:06.416] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e4f496dd4c98075c03322665d98ee21e00ae33f6"
[01:00:06.416] Popped gitiles commit info from properties and tags
[01:00:06.416] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:00:06.416] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:00:06.417] Buildbucket request:
{
"requestId": "8848478009862178208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4f496dd4c98075c03322665d98ee21e00ae33f6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848478009862178208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:00:06.980] Scheduled build:
{
"id": "8683047947519127217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30363,
"createdBy": "project:chromium",
"createTime": "2026-05-01T01:00:06.535803060Z",
"updateTime": "2026-05-01T01:00:06.535803060Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4f496dd4c98075c03322665d98ee21e00ae33f6",
"ref": "refs/heads/main"
}
}
}
[01:00:06.980] Task URL: https://cr-buildbucket.appspot.com/build/8683047947519127217
[01:00:06.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:2:0) after 2m17s
[01:00:07.038] Received PubSub notification, asking Buildbucket for the build status
[01:00:07.058] Build status: SCHEDULED
[01:01:05.844] Received PubSub notification, asking Buildbucket for the build status
[01:01:05.865] Build status: STARTED
[01:02:23.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:2:0)
[01:02:24.087] Build status: STARTED
[01:02:24.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:5:0) after 8m5s
[01:10:29.223] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:5:0)
[01:10:29.240] Build status: STARTED
[01:10:29.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:6:0) after 1m33s
[01:12:02.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:6:0)
[01:12:02.286] Build status: STARTED
[01:12:02.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:7:0) after 4m7s
[01:16:09.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:7:0)
[01:16:09.338] Build status: STARTED
[01:16:09.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:8:0) after 7m36s
[01:23:45.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:8:0)
[01:23:45.351] Build status: STARTED
[01:23:45.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:9:0) after 8m56s
[01:32:41.706] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:9:0)
[01:32:41.766] Build status: STARTED
[01:32:41.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:10:0) after 7m54s
[01:40:35.952] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:10:0)
[01:40:35.988] Build status: STARTED
[01:40:35.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:11:0) after 7m32s
[01:48:08.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:11:0)
[01:48:08.121] Build status: STARTED
[01:48:08.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:12:0) after 2m19s
[01:50:27.244] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:12:0)
[01:50:27.266] Build status: STARTED
[01:50:27.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:13:0) after 9m0s
[01:59:27.334] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:13:0)
[01:59:27.366] Build status: STARTED
[01:59:27.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:14:0) after 5m8s
[02:04:35.342] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:14:0)
[02:04:35.362] Build status: STARTED
[02:04:35.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:15:0) after 9m22s
[02:13:57.457] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:15:0)
[02:13:57.492] Build status: STARTED
[02:13:57.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:16:0) after 5m36s
[02:19:33.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:16:0)
[02:19:33.531] Build status: STARTED
[02:19:33.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:17:0) after 5m32s
[02:25:05.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:17:0)
[02:25:05.803] Build status: STARTED
[02:25:05.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:18:0) after 2m48s
[02:27:53.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:18:0)
[02:27:53.891] Build status: STARTED
[02:27:53.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:19:0) after 4m45s
[02:32:38.904] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:19:0)
[02:32:38.923] Build status: STARTED
[02:32:38.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:20:0) after 9m0s
[02:41:38.955] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:20:0)
[02:41:38.974] Build status: STARTED
[02:41:38.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:21:0) after 6m47s
[02:48:26.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:21:0)
[02:48:26.203] Build status: STARTED
[02:48:26.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:22:0) after 3m36s
[02:52:02.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:22:0)
[02:52:02.272] Build status: STARTED
[02:52:02.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:23:0) after 9m17s
[03:01:19.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:23:0)
[03:01:19.414] Build status: STARTED
[03:01:19.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:24:0) after 7m17s
[03:08:36.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:24:0)
[03:08:36.564] Build status: STARTED
[03:08:36.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:25:0) after 6m37s
[03:15:13.585] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:25:0)
[03:15:13.604] Build status: STARTED
[03:15:13.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:26:0) after 4m14s
[03:19:27.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:26:0)
[03:19:27.696] Build status: STARTED
[03:19:27.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:27:0) after 8m13s
[03:27:40.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:27:0)
[03:27:40.728] Build status: STARTED
[03:27:40.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:28:0) after 3m22s
[03:31:02.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:28:0)
[03:31:02.843] Build status: STARTED
[03:31:02.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:29:0) after 5m14s
[03:36:16.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:29:0)
[03:36:17.015] Build status: STARTED
[03:36:17.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:30:0) after 3m47s
[03:40:04.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:30:0)
[03:40:04.202] Build status: STARTED
[03:40:04.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:31:0) after 4m35s
[03:44:39.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:31:0)
[03:44:39.277] Build status: STARTED
[03:44:39.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:32:0) after 2m22s
[03:47:01.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:32:0)
[03:47:01.398] Build status: STARTED
[03:47:01.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:33:0) after 4m26s
[03:51:27.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:33:0)
[03:51:27.419] Build status: STARTED
[03:51:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:34:0) after 6m59s
[03:58:26.474] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:34:0)
[03:58:26.508] Build status: STARTED
[03:58:26.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:35:0) after 6m14s
[04:04:40.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:35:0)
[04:04:40.562] Build status: STARTED
[04:04:40.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8848478009862178208:36:0) after 8m0s
[04:07:32.311] Received PubSub notification, asking Buildbucket for the build status
[04:07:32.330] Build:
{
"id": "8683047947519127217",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30363,
"createdBy": "project:chromium",
"createTime": "2026-05-01T01:00:06.535803060Z",
"startTime": "2026-05-01T01:01:05.619957430Z",
"endTime": "2026-05-01T04:07:31.105615515Z",
"updateTime": "2026-05-01T04:07:31.105615515Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e4f496dd4c98075c03322665d98ee21e00ae33f6",
"ref": "refs/heads/main"
}
}
}
[04:07:32.330] Invocation finished in 3h7m27.413954828s with status FAILED