[04:32:55.414] New invocation is queued and will start shortly
[04:32:56.472] Starting the invocation (attempt 1)
[04:32:56.495] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc09501ef856d1b3318a0891727bd845f0217938"
[04:32:56.495] Popped gitiles commit info from properties and tags
[04:32:56.495] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:32:56.495] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:32:56.495] Buildbucket request:
{
"requestId": "8856527749048303584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc09501ef856d1b3318a0891727bd845f0217938",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8856527749048303584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:32:56.962] Scheduled build:
{
"id": "8691097687197643489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29102,
"createdBy": "project:chromium",
"createTime": "2026-02-01T04:32:56.549153707Z",
"updateTime": "2026-02-01T04:32:56.549153707Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc09501ef856d1b3318a0891727bd845f0217938",
"ref": "refs/heads/main"
}
}
}
[04:32:56.962] Task URL: https://cr-buildbucket.appspot.com/build/8691097687197643489
[04:32:56.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:2:0) after 7m7s
[04:33:04.632] Received PubSub notification, asking Buildbucket for the build status
[04:33:04.648] Build status: SCHEDULED
[04:33:50.468] Received PubSub notification, asking Buildbucket for the build status
[04:33:50.563] Build status: STARTED
[04:40:03.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:2:0)
[04:40:04.006] Build status: STARTED
[04:40:04.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:5:0) after 3m7s
[04:43:11.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:5:0)
[04:43:11.208] Build status: STARTED
[04:43:11.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:6:0) after 1m35s
[04:44:46.330] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:6:0)
[04:44:46.363] Build status: STARTED
[04:44:46.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:7:0) after 5m43s
[04:50:29.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:7:0)
[04:50:29.629] Build status: STARTED
[04:50:29.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:8:0) after 9m28s
[04:59:57.833] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:8:0)
[04:59:57.862] Build status: STARTED
[04:59:57.862] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:9:0) after 4m9s
[05:04:07.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:9:0)
[05:04:07.792] Build status: STARTED
[05:04:07.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:10:0) after 7m47s
[05:11:54.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:10:0)
[05:11:54.820] Build status: STARTED
[05:11:54.820] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:11:0) after 4m14s
[05:16:09.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:11:0)
[05:16:09.487] Build status: STARTED
[05:16:09.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:12:0) after 9m43s
[05:25:52.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:12:0)
[05:25:52.639] Build status: STARTED
[05:25:52.639] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:13:0) after 8m44s
[05:34:36.722] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:13:0)
[05:34:36.737] Build status: STARTED
[05:34:36.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:14:0) after 9m58s
[05:44:35.008] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:14:0)
[05:44:35.040] Build status: STARTED
[05:44:35.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:15:0) after 1m3s
[05:45:38.126] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:15:0)
[05:45:38.148] Build status: STARTED
[05:45:38.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:16:0) after 3m24s
[05:49:02.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:16:0)
[05:49:02.573] Build status: STARTED
[05:49:02.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:17:0) after 1m33s
[05:50:35.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:17:0)
[05:50:35.718] Build status: STARTED
[05:50:35.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:18:0) after 1m5s
[05:51:40.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:18:0)
[05:51:40.952] Build status: STARTED
[05:51:40.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:19:0) after 2m33s
[05:54:13.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:19:0)
[05:54:13.993] Build status: STARTED
[05:54:13.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:20:0) after 1m0s
[05:55:14.006] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:20:0)
[05:55:14.029] Build status: STARTED
[05:55:14.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:21:0) after 3m55s
[05:59:09.043] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:21:0)
[05:59:09.063] Build status: STARTED
[05:59:09.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:22:0) after 4m19s
[06:03:28.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:22:0)
[06:03:28.351] Build status: STARTED
[06:03:28.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:23:0) after 7m2s
[06:10:30.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:23:0)
[06:10:30.374] Build status: STARTED
[06:10:30.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:24:0) after 3m35s
[06:14:05.390] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:24:0)
[06:14:05.403] Build status: STARTED
[06:14:05.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:25:0) after 7m13s
[06:21:18.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:25:0)
[06:21:18.618] Build status: STARTED
[06:21:18.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:26:0) after 1m17s
[06:22:35.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:26:0)
[06:22:36.042] Build status: STARTED
[06:22:36.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:27:0) after 7m19s
[06:29:55.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:27:0)
[06:29:55.157] Build status: STARTED
[06:29:55.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:28:0) after 2m19s
[06:32:14.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:28:0)
[06:32:14.670] Build status: STARTED
[06:32:14.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:29:0) after 8m19s
[06:40:33.795] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:29:0)
[06:40:33.815] Build status: STARTED
[06:40:33.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:30:0) after 4m17s
[06:44:50.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:30:0)
[06:44:50.947] Build status: STARTED
[06:44:50.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:31:0) after 1m57s
[06:46:48.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:31:0)
[06:46:48.023] Build status: STARTED
[06:46:48.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:32:0) after 6m12s
[06:53:00.095] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:32:0)
[06:53:00.120] Build status: STARTED
[06:53:00.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:33:0) after 3m50s
[06:56:50.135] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:33:0)
[06:56:50.160] Build status: STARTED
[06:56:50.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:34:0) after 8m28s
[07:05:18.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:34:0)
[07:05:18.456] Build status: STARTED
[07:05:18.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:35:0) after 2m37s
[07:07:55.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:35:0)
[07:07:55.515] Build status: STARTED
[07:07:55.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:36:0) after 2m15s
[07:10:10.731] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:36:0)
[07:10:10.747] Build status: STARTED
[07:10:10.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:37:0) after 4m27s
[07:14:37.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:37:0)
[07:14:37.987] Build status: STARTED
[07:14:37.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:38:0) after 6m47s
[07:21:25.151] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:38:0)
[07:21:25.204] Build status: STARTED
[07:21:25.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:39:0) after 4m21s
[07:25:46.350] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:39:0)
[07:25:46.363] Build status: STARTED
[07:25:46.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:40:0) after 6m18s
[07:32:04.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:40:0)
[07:32:04.396] Build status: STARTED
[07:32:04.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:41:0) after 1m38s
[07:33:42.513] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:41:0)
[07:33:42.551] Build status: STARTED
[07:33:42.551] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:42:0) after 3m3s
[07:36:45.758] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:42:0)
[07:36:45.776] Build status: STARTED
[07:36:45.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8856527749048303584:43:0) after 6m21s
[07:40:55.930] Received PubSub notification, asking Buildbucket for the build status
[07:40:55.945] Build:
{
"id": "8691097687197643489",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29102,
"createdBy": "project:chromium",
"createTime": "2026-02-01T04:32:56.549153707Z",
"startTime": "2026-02-01T04:33:50.336428918Z",
"endTime": "2026-02-01T07:40:55.577889Z",
"updateTime": "2026-02-01T07:40:55.577889Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc09501ef856d1b3318a0891727bd845f0217938",
"ref": "refs/heads/main"
}
}
}
[07:40:55.945] Invocation finished in 3h8m0.544374337s with status FAILED