[04:45:42.922] New invocation is queued and will start shortly
[04:45:44.209] Starting the invocation (attempt 1)
[04:45:44.241] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b7c18f0a34caeda9fb0257c9fb858f9e8893576f"
[04:45:44.241] Popped gitiles commit info from properties and tags
[04:45:44.241] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:45:44.241] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:45:44.241] Buildbucket request:
{
"requestId": "8843027996257276912",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c18f0a34caeda9fb0257c9fb858f9e8893576f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8843027996257276912"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:45:44.834] Scheduled build:
{
"id": "8677597934096934465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 31190,
"createdBy": "project:chromium",
"createTime": "2026-06-30T04:45:44.359175101Z",
"updateTime": "2026-06-30T04:45:44.359175101Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c18f0a34caeda9fb0257c9fb858f9e8893576f",
"ref": "refs/heads/main"
}
}
}
[04:45:44.834] Task URL: https://cr-buildbucket.appspot.com/build/8677597934096934465
[04:45:44.834] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:2:0) after 5m6s
[04:46:05.222] Received PubSub notification, asking Buildbucket for the build status
[04:46:05.251] Build status: SCHEDULED
[04:46:45.930] Received PubSub notification, asking Buildbucket for the build status
[04:46:46.040] Build status: STARTED
[04:50:50.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:2:0)
[04:50:51.002] Build status: STARTED
[04:50:51.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:5:0) after 4m39s
[04:55:30.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:5:0)
[04:55:30.034] Build status: STARTED
[04:55:30.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:6:0) after 2m37s
[04:58:07.148] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:6:0)
[04:58:07.234] Build status: STARTED
[04:58:07.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:7:0) after 7m6s
[05:05:13.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:7:0)
[05:05:13.318] Build status: STARTED
[05:05:13.318] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:8:0) after 8m40s
[05:13:53.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:8:0)
[05:13:53.357] Build status: STARTED
[05:13:53.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:9:0) after 7m36s
[05:21:29.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:9:0)
[05:21:29.444] Build status: STARTED
[05:21:29.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:10:0) after 9m8s
[05:30:37.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:10:0)
[05:30:37.627] Build status: STARTED
[05:30:37.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:11:0) after 4m3s
[05:34:40.681] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:11:0)
[05:34:40.700] Build status: STARTED
[05:34:40.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:12:0) after 9m52s
[05:44:32.768] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:12:0)
[05:44:32.793] Build status: STARTED
[05:44:32.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:13:0) after 4m2s
[05:48:34.860] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:13:0)
[05:48:34.876] Build status: STARTED
[05:48:34.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:14:0) after 6m26s
[05:55:00.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:14:0)
[05:55:00.959] Build status: STARTED
[05:55:00.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:15:0) after 1m40s
[05:56:40.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:15:0)
[05:56:41.014] Build status: STARTED
[05:56:41.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:16:0) after 1m4s
[05:57:45.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:16:0)
[05:57:45.048] Build status: STARTED
[05:57:45.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:17:0) after 2m33s
[06:00:18.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:17:0)
[06:00:18.092] Build status: STARTED
[06:00:18.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:18:0) after 8m7s
[06:08:25.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:18:0)
[06:08:25.185] Build status: STARTED
[06:08:25.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:19:0) after 3m40s
[06:12:05.187] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:19:0)
[06:12:05.207] Build status: STARTED
[06:12:05.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:20:0) after 2m56s
[06:15:01.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:20:0)
[06:15:01.282] Build status: STARTED
[06:15:01.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:21:0) after 6m14s
[06:21:15.406] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:21:0)
[06:21:15.423] Build status: STARTED
[06:21:15.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:22:0) after 6m56s
[06:28:11.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:22:0)
[06:28:11.463] Build status: STARTED
[06:28:11.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:23:0) after 6m36s
[06:34:47.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:23:0)
[06:34:47.498] Build status: STARTED
[06:34:47.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:24:0) after 7m52s
[06:42:39.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:24:0)
[06:42:39.535] Build status: STARTED
[06:42:39.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:25:0) after 8m1s
[06:50:40.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:25:0)
[06:50:40.682] Build status: STARTED
[06:50:40.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:26:0) after 7m11s
[06:57:51.726] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:26:0)
[06:57:51.747] Build status: STARTED
[06:57:51.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:27:0) after 1m34s
[06:59:25.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:27:0)
[06:59:25.815] Build status: STARTED
[06:59:25.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:28:0) after 7m52s
[07:07:17.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:28:0)
[07:07:17.891] Build status: STARTED
[07:07:17.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:29:0) after 5m36s
[07:12:53.902] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:29:0)
[07:12:54.020] Build status: STARTED
[07:12:54.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:30:0) after 7m22s
[07:20:16.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:30:0)
[07:20:16.127] Build status: STARTED
[07:20:16.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:31:0) after 7m6s
[07:27:22.182] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:31:0)
[07:27:22.202] Build status: STARTED
[07:27:22.202] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:32:0) after 1m47s
[07:29:09.296] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:32:0)
[07:29:09.327] Build status: STARTED
[07:29:09.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:33:0) after 6m27s
[07:35:36.393] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:33:0)
[07:35:36.409] Build status: STARTED
[07:35:36.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:34:0) after 8m27s
[07:44:03.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:34:0)
[07:44:03.442] Build status: STARTED
[07:44:03.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:35:0) after 3m52s
[07:47:55.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:35:0)
[07:47:55.431] Build status: STARTED
[07:47:55.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:36:0) after 1m41s
[07:49:36.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:36:0)
[07:49:36.465] Build status: STARTED
[07:49:36.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:37:0) after 5m13s
[07:54:49.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:37:0)
[07:54:49.513] Build status: STARTED
[07:54:49.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:38:0) after 8m22s
[08:03:11.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:38:0)
[08:03:11.587] Build status: STARTED
[08:03:11.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:39:0) after 3m50s
[08:07:01.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:39:0)
[08:07:01.614] Build status: STARTED
[08:07:01.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:40:0) after 6m6s
[08:13:07.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:40:0)
[08:13:07.749] Build status: STARTED
[08:13:07.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:41:0) after 1m26s
[08:14:33.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:41:0)
[08:14:33.767] Build status: STARTED
[08:14:33.767] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8843027996257276912:42:0) after 2m25s
[08:16:44.956] Received PubSub notification, asking Buildbucket for the build status
[08:16:44.977] Build:
{
"id": "8677597934096934465",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 31190,
"createdBy": "project:chromium",
"createTime": "2026-06-30T04:45:44.359175101Z",
"startTime": "2026-06-30T04:46:29.363035623Z",
"endTime": "2026-06-30T08:16:44.684426399Z",
"updateTime": "2026-06-30T08:16:44.684426399Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b7c18f0a34caeda9fb0257c9fb858f9e8893576f",
"ref": "refs/heads/main"
}
}
}
[08:16:44.977] Invocation finished in 3h31m2.061119646s with status FAILED