[02:58:58.207] New invocation is queued and will start shortly
[02:58:59.237] Starting the invocation (attempt 1)
[02:58:59.263] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d25fa88bb9fdf7893f428167b6207e25a2b511a5"
[02:58:59.263] Popped gitiles commit info from properties and tags
[02:58:59.263] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:58:59.264] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:58:59.264] Buildbucket request:
{
"requestId": "8850735454227619712",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d25fa88bb9fdf7893f428167b6207e25a2b511a5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850735454227619712"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:58:59.926] Scheduled build:
{
"id": "8685305392409121361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30007,
"createdBy": "project:chromium",
"createTime": "2026-04-06T02:58:59.322033967Z",
"updateTime": "2026-04-06T02:58:59.322033967Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d25fa88bb9fdf7893f428167b6207e25a2b511a5",
"ref": "refs/heads/main"
}
}
}
[02:58:59.926] Task URL: https://cr-buildbucket.appspot.com/build/8685305392409121361
[02:58:59.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:2:0) after 5m45s
[02:59:00.192] Received PubSub notification, asking Buildbucket for the build status
[02:59:00.207] Build status: SCHEDULED
[03:00:08.633] Received PubSub notification, asking Buildbucket for the build status
[03:00:08.659] Build status: STARTED
[03:04:45.040] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:2:0)
[03:04:45.061] Build status: STARTED
[03:04:45.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:5:0) after 7m55s
[03:12:40.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:5:0)
[03:12:40.093] Build status: STARTED
[03:12:40.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:6:0) after 9m23s
[03:22:03.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:6:0)
[03:22:03.135] Build status: STARTED
[03:22:03.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:7:0) after 5m53s
[03:27:56.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:7:0)
[03:27:56.369] Build status: STARTED
[03:27:56.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:8:0) after 4m26s
[03:32:22.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:8:0)
[03:32:22.799] Build status: STARTED
[03:32:22.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:9:0) after 6m19s
[03:38:41.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:9:0)
[03:38:41.837] Build status: STARTED
[03:38:41.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:10:0) after 1m7s
[03:39:49.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:10:0)
[03:39:49.157] Build status: STARTED
[03:39:49.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:11:0) after 7m44s
[03:47:33.468] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:11:0)
[03:47:33.491] Build status: STARTED
[03:47:33.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:12:0) after 8m22s
[03:55:55.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:12:0)
[03:55:55.627] Build status: STARTED
[03:55:55.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:13:0) after 2m47s
[03:58:42.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:13:0)
[03:58:42.709] Build status: STARTED
[03:58:42.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:14:0) after 9m11s
[04:07:53.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:14:0)
[04:07:53.899] Build status: STARTED
[04:07:53.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:15:0) after 5m5s
[04:12:58.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:15:0)
[04:12:58.987] Build status: STARTED
[04:12:58.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:16:0) after 6m55s
[04:19:54.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:16:0)
[04:19:54.032] Build status: STARTED
[04:19:54.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:17:0) after 5m55s
[04:25:49.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:17:0)
[04:25:49.083] Build status: STARTED
[04:25:49.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:18:0) after 1m20s
[04:27:09.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:18:0)
[04:27:09.165] Build status: STARTED
[04:27:09.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:19:0) after 7m54s
[04:35:03.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:19:0)
[04:35:03.257] Build status: STARTED
[04:35:03.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:20:0) after 3m39s
[04:38:42.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:20:0)
[04:38:42.417] Build status: STARTED
[04:38:42.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:21:0) after 5m41s
[04:44:23.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:21:0)
[04:44:23.450] Build status: STARTED
[04:44:23.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:22:0) after 3m0s
[04:47:23.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:22:0)
[04:47:23.595] Build status: STARTED
[04:47:23.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:23:0) after 3m19s
[04:50:42.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:23:0)
[04:50:42.578] Build status: STARTED
[04:50:42.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:24:0) after 4m34s
[04:55:16.748] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:24:0)
[04:55:16.772] Build status: STARTED
[04:55:16.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:25:0) after 6m33s
[05:01:49.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:25:0)
[05:01:49.829] Build status: STARTED
[05:01:49.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:26:0) after 8m39s
[05:10:28.910] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:26:0)
[05:10:28.937] Build status: STARTED
[05:10:28.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:27:0) after 1m5s
[05:11:34.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:27:0)
[05:11:34.165] Build status: STARTED
[05:11:34.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:28:0) after 3m13s
[05:14:47.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:28:0)
[05:14:47.365] Build status: STARTED
[05:14:47.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:29:0) after 4m40s
[05:19:27.522] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:29:0)
[05:19:27.545] Build status: STARTED
[05:19:27.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:30:0) after 9m48s
[05:29:15.567] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:30:0)
[05:29:15.598] Build status: STARTED
[05:29:15.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:31:0) after 2m53s
[05:32:08.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:31:0)
[05:32:08.647] Build status: STARTED
[05:32:08.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:32:0) after 7m57s
[05:40:05.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:32:0)
[05:40:05.852] Build status: STARTED
[05:40:05.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8850735454227619712:33:0) after 9m46s
[05:48:09.051] Received PubSub notification, asking Buildbucket for the build status
[05:48:09.068] Build:
{
"id": "8685305392409121361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 30007,
"createdBy": "project:chromium",
"createTime": "2026-04-06T02:58:59.322033967Z",
"startTime": "2026-04-06T03:00:06.792409190Z",
"endTime": "2026-04-06T05:47:40.976049973Z",
"updateTime": "2026-04-06T05:47:40.976049973Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d25fa88bb9fdf7893f428167b6207e25a2b511a5",
"ref": "refs/heads/main"
}
}
}
[05:48:09.068] Invocation finished in 2h49m10.863869394s with status FAILED