[09:41:36.055] New invocation is queued and will start shortly
[09:41:38.041] Starting the invocation (attempt 1)
[09:41:38.063] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ef98b4c65cef5a7e8fbaeb13d58d39f313c93873"
[09:41:38.063] Popped gitiles commit info from properties and tags
[09:41:38.063] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:41:38.064] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:41:38.064] Buildbucket request:
{
"requestId": "8833406102307620320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ef98b4c65cef5a7e8fbaeb13d58d39f313c93873",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833406102307620320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:41:38.715] Scheduled build:
{
"id": "8667976039430626785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33336,
"createdBy": "project:chromium",
"createTime": "2026-10-14T09:41:38.178715915Z",
"updateTime": "2026-10-14T09:41:38.178715915Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ef98b4c65cef5a7e8fbaeb13d58d39f313c93873",
"ref": "refs/heads/main"
}
}
}
[09:41:38.715] Task URL: https://cr-buildbucket.appspot.com/build/8667976039430626785
[09:41:38.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:2:0) after 4m59s
[09:41:39.658] Received PubSub notification, asking Buildbucket for the build status
[09:41:39.710] Build status: SCHEDULED
[09:42:35.190] Received PubSub notification, asking Buildbucket for the build status
[09:42:35.207] Build status: STARTED
[09:46:37.756] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:2:0)
[09:46:37.824] Build status: STARTED
[09:46:37.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:5:0) after 2m31s
[09:49:08.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:5:0)
[09:49:08.842] Build status: STARTED
[09:49:08.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:6:0) after 4m29s
[09:53:37.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:6:0)
[09:53:37.992] Build status: STARTED
[09:53:37.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:7:0) after 2m50s
[09:56:28.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:7:0)
[09:56:28.024] Build status: STARTED
[09:56:28.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:8:0) after 3m9s
[09:59:37.070] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:8:0)
[09:59:37.090] Build status: STARTED
[09:59:37.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:9:0) after 2m31s
[10:02:08.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:9:0)
[10:02:08.125] Build status: STARTED
[10:02:08.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:10:0) after 7m55s
[10:10:03.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:10:0)
[10:10:03.189] Build status: STARTED
[10:10:03.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:11:0) after 4m22s
[10:14:25.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:11:0)
[10:14:25.224] Build status: STARTED
[10:14:25.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:12:0) after 7m4s
[10:21:29.278] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:12:0)
[10:21:29.300] Build status: STARTED
[10:21:29.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:13:0) after 6m34s
[10:28:03.409] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:13:0)
[10:28:03.477] Build status: STARTED
[10:28:03.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:14:0) after 8m34s
[10:36:37.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:14:0)
[10:36:37.592] Build status: STARTED
[10:36:37.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:15:0) after 5m7s
[10:41:44.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:15:0)
[10:41:44.671] Build status: STARTED
[10:41:44.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:16:0) after 1m33s
[10:43:17.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:16:0)
[10:43:17.710] Build status: STARTED
[10:43:17.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:17:0) after 6m3s
[10:49:20.690] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:17:0)
[10:49:20.785] Build status: STARTED
[10:49:20.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:18:0) after 4m19s
[10:53:39.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:18:0)
[10:53:39.851] Build status: STARTED
[10:53:39.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:19:0) after 2m41s
[10:56:20.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:19:0)
[10:56:20.899] Build status: STARTED
[10:56:20.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:20:0) after 6m50s
[11:03:10.969] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:20:0)
[11:03:10.987] Build status: STARTED
[11:03:10.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:21:0) after 3m21s
[11:06:32.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:21:0)
[11:06:32.105] Build status: STARTED
[11:06:32.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:22:0) after 3m49s
[11:10:21.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:22:0)
[11:10:21.369] Build status: STARTED
[11:10:21.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:23:0) after 1m34s
[11:11:55.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:23:0)
[11:11:55.408] Build status: STARTED
[11:11:55.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:24:0) after 7m13s
[11:19:08.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:24:0)
[11:19:08.508] Build status: STARTED
[11:19:08.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:25:0) after 7m6s
[11:26:14.580] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:25:0)
[11:26:14.601] Build status: STARTED
[11:26:14.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:26:0) after 9m30s
[11:35:44.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:26:0)
[11:35:44.670] Build status: STARTED
[11:35:44.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:27:0) after 5m9s
[11:40:53.787] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:27:0)
[11:40:53.805] Build status: STARTED
[11:40:53.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:28:0) after 1m27s
[11:42:20.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:28:0)
[11:42:20.846] Build status: STARTED
[11:42:20.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833406102307620320:29:0) after 7m43s
[11:49:18.182] Received PubSub notification, asking Buildbucket for the build status
[11:49:18.257] Build:
{
"id": "8667976039430626785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33336,
"createdBy": "project:chromium",
"createTime": "2026-10-14T09:41:38.178715915Z",
"startTime": "2026-10-14T09:42:34.988283009Z",
"endTime": "2026-10-14T11:48:52.626937991Z",
"updateTime": "2026-10-14T11:48:52.626937991Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ef98b4c65cef5a7e8fbaeb13d58d39f313c93873",
"ref": "refs/heads/main"
}
}
}
[11:49:18.257] Invocation finished in 2h7m42.207414123s with status FAILED