[13:53:46.536] New invocation is queued and will start shortly
[13:53:49.064] Starting the invocation (attempt 1)
[13:53:49.092] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e26b7e3b541430f6f6cc603c23e29cc5c7134c82"
[13:53:49.092] Popped gitiles commit info from properties and tags
[13:53:49.092] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:53:49.093] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:53:49.093] Buildbucket request:
{
"requestId": "8842268739554920816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e26b7e3b541430f6f6cc603c23e29cc5c7134c82",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842268739554920816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:53:49.590] Scheduled build:
{
"id": "8676838676150872881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 31338,
"createdBy": "project:chromium",
"createTime": "2026-07-08T13:53:49.162028210Z",
"updateTime": "2026-07-08T13:53:49.162028210Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e26b7e3b541430f6f6cc603c23e29cc5c7134c82",
"ref": "refs/heads/main"
}
}
}
[13:53:49.590] Task URL: https://cr-buildbucket.appspot.com/build/8676838676150872881
[13:53:49.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:2:0) after 4m25s
[13:53:52.450] Received PubSub notification, asking Buildbucket for the build status
[13:53:52.465] Build status: SCHEDULED
[13:54:02.999] Received PubSub notification, asking Buildbucket for the build status
[13:54:03.027] Build status: STARTED
[13:58:14.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:2:0)
[13:58:14.645] Build status: STARTED
[13:58:14.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:5:0) after 9m36s
[14:07:50.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:5:0)
[14:07:50.690] Build status: STARTED
[14:07:50.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:6:0) after 7m7s
[14:14:57.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:6:0)
[14:14:57.807] Build status: STARTED
[14:14:57.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:7:0) after 7m30s
[14:22:27.967] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:7:0)
[14:22:27.993] Build status: STARTED
[14:22:27.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:8:0) after 2m23s
[14:24:51.007] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:8:0)
[14:24:51.024] Build status: STARTED
[14:24:51.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:9:0) after 1m29s
[14:26:20.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:9:0)
[14:26:20.096] Build status: STARTED
[14:26:20.096] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:10:0) after 1m49s
[14:28:09.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:10:0)
[14:28:09.241] Build status: STARTED
[14:28:09.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:11:0) after 1m47s
[14:29:56.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:11:0)
[14:29:56.337] Build status: STARTED
[14:29:56.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:12:0) after 9m51s
[14:39:47.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:12:0)
[14:39:47.588] Build status: STARTED
[14:39:47.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:13:0) after 3m56s
[14:43:43.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:13:0)
[14:43:43.636] Build status: STARTED
[14:43:43.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:14:0) after 7m23s
[14:51:06.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:14:0)
[14:51:06.752] Build status: STARTED
[14:51:06.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:15:0) after 5m51s
[14:56:57.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:15:0)
[14:56:57.790] Build status: STARTED
[14:56:57.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:16:0) after 8m40s
[15:05:38.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:16:0)
[15:05:38.116] Build status: STARTED
[15:05:38.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:17:0) after 8m1s
[15:13:39.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:17:0)
[15:13:39.151] Build status: STARTED
[15:13:39.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:18:0) after 7m20s
[15:20:59.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:18:0)
[15:20:59.218] Build status: STARTED
[15:20:59.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:19:0) after 7m15s
[15:28:14.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:19:0)
[15:28:14.547] Build status: STARTED
[15:28:14.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:20:0) after 1m13s
[15:29:27.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:20:0)
[15:29:27.725] Build status: STARTED
[15:29:27.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:21:0) after 2m23s
[15:31:50.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:21:0)
[15:31:50.963] Build status: STARTED
[15:31:50.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:22:0) after 8m7s
[15:39:57.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:22:0)
[15:39:58.003] Build status: STARTED
[15:39:58.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:23:0) after 8m46s
[15:48:44.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:23:0)
[15:48:44.088] Build status: STARTED
[15:48:44.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:24:0) after 8m7s
[15:56:51.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:24:0)
[15:56:51.378] Build status: STARTED
[15:56:51.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:25:0) after 8m55s
[16:05:46.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:25:0)
[16:05:46.459] Build status: STARTED
[16:05:46.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:26:0) after 5m25s
[16:11:11.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:26:0)
[16:11:11.493] Build status: STARTED
[16:11:11.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:27:0) after 2m35s
[16:13:46.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:27:0)
[16:13:46.705] Build status: STARTED
[16:13:46.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:28:0) after 5m29s
[16:19:15.686] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:28:0)
[16:19:15.766] Build status: STARTED
[16:19:15.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:29:0) after 1m40s
[16:20:55.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:29:0)
[16:20:55.793] Build status: STARTED
[16:20:55.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:30:0) after 6m41s
[16:27:36.809] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:30:0)
[16:27:36.836] Build status: STARTED
[16:27:36.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:31:0) after 9m40s
[16:37:16.856] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:31:0)
[16:37:16.876] Build status: STARTED
[16:37:16.876] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:32:0) after 8m23s
[16:45:39.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:32:0)
[16:45:39.914] Build status: STARTED
[16:45:39.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:33:0) after 3m34s
[16:49:13.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:33:0)
[16:49:14.007] Build status: STARTED
[16:49:14.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:34:0) after 2m50s
[16:52:04.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:34:0)
[16:52:04.053] Build status: STARTED
[16:52:04.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:35:0) after 4m5s
[16:56:09.074] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:35:0)
[16:56:09.146] Build status: STARTED
[16:56:09.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:36:0) after 1m11s
[16:57:20.190] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:36:0)
[16:57:20.209] Build status: STARTED
[16:57:20.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:37:0) after 8m50s
[17:06:10.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:37:0)
[17:06:10.244] Build status: STARTED
[17:06:10.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8842268739554920816:38:0) after 8m18s
[17:09:12.796] Received PubSub notification, asking Buildbucket for the build status
[17:09:12.816] Build:
{
"id": "8676838676150872881",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 31338,
"createdBy": "project:chromium",
"createTime": "2026-07-08T13:53:49.162028210Z",
"startTime": "2026-07-08T13:53:59.078033210Z",
"endTime": "2026-07-08T17:09:12.541221877Z",
"updateTime": "2026-07-08T17:09:12.541221877Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e26b7e3b541430f6f6cc603c23e29cc5c7134c82",
"ref": "refs/heads/main"
}
}
}
[17:09:12.816] Invocation finished in 3h15m26.284124843s with status FAILED