[11:49:20.331] New invocation is queued and will start shortly
[11:49:21.449] Starting the invocation (attempt 1)
[11:49:21.473] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2e1a8d44627cd0afbf71d6df54c855cc2ea1bd87"
[11:49:21.473] Popped gitiles commit info from properties and tags
[11:49:21.473] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:49:21.473] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:49:21.473] Buildbucket request:
{
"requestId": "8833398065734898016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2e1a8d44627cd0afbf71d6df54c855cc2ea1bd87",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833398065734898016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:49:22.248] Scheduled build:
{
"id": "8667968003763857377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33337,
"createdBy": "project:chromium",
"createTime": "2026-10-14T11:49:21.587304529Z",
"updateTime": "2026-10-14T11:49:21.587304529Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2e1a8d44627cd0afbf71d6df54c855cc2ea1bd87",
"ref": "refs/heads/main"
}
},
"canary": true
}
[11:49:22.249] Task URL: https://cr-buildbucket.appspot.com/build/8667968003763857377
[11:49:22.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:2:0) after 1m50s
[11:49:25.260] Received PubSub notification, asking Buildbucket for the build status
[11:49:25.301] Build status: SCHEDULED
[11:50:01.045] Received PubSub notification, asking Buildbucket for the build status
[11:50:01.070] Build status: STARTED
[11:51:12.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:2:0)
[11:51:12.462] Build status: STARTED
[11:51:12.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:5:0) after 3m35s
[11:54:47.478] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:5:0)
[11:54:47.522] Build status: STARTED
[11:54:47.522] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:6:0) after 9m58s
[12:04:45.554] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:6:0)
[12:04:45.599] Build status: STARTED
[12:04:45.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:7:0) after 2m55s
[12:07:40.671] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:7:0)
[12:07:40.693] Build status: STARTED
[12:07:40.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:8:0) after 1m31s
[12:09:11.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:8:0)
[12:09:11.763] Build status: STARTED
[12:09:11.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:9:0) after 4m25s
[12:13:36.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:9:0)
[12:13:36.861] Build status: STARTED
[12:13:36.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:10:0) after 7m10s
[12:20:47.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:10:0)
[12:20:47.043] Build status: STARTED
[12:20:47.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:11:0) after 8m49s
[12:29:36.060] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:11:0)
[12:29:36.158] Build status: STARTED
[12:29:36.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:12:0) after 4m8s
[12:33:44.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:12:0)
[12:33:44.177] Build status: STARTED
[12:33:44.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:13:0) after 7m44s
[12:41:28.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:13:0)
[12:41:28.281] Build status: STARTED
[12:41:28.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:14:0) after 6m24s
[12:47:52.292] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:14:0)
[12:47:52.320] Build status: STARTED
[12:47:52.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:15:0) after 9m0s
[12:56:52.339] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:15:0)
[12:56:52.358] Build status: STARTED
[12:56:52.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:16:0) after 5m18s
[13:02:10.413] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:16:0)
[13:02:10.452] Build status: STARTED
[13:02:10.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:17:0) after 3m10s
[13:05:20.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:17:0)
[13:05:20.488] Build status: STARTED
[13:05:20.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:18:0) after 1m11s
[13:06:31.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:18:0)
[13:06:31.530] Build status: STARTED
[13:06:31.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:19:0) after 7m7s
[13:13:38.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:19:0)
[13:13:38.604] Build status: STARTED
[13:13:38.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:20:0) after 1m12s
[13:14:50.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:20:0)
[13:14:50.825] Build status: STARTED
[13:14:50.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:21:0) after 1m56s
[13:16:46.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:21:0)
[13:16:46.872] Build status: STARTED
[13:16:46.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:22:0) after 2m27s
[13:19:13.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:22:0)
[13:19:14.035] Build status: STARTED
[13:19:14.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:23:0) after 3m49s
[13:23:03.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:23:0)
[13:23:03.183] Build status: STARTED
[13:23:03.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:24:0) after 5m22s
[13:28:25.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:24:0)
[13:28:25.285] Build status: STARTED
[13:28:25.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:25:0) after 8m45s
[13:37:10.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:25:0)
[13:37:10.369] Build status: STARTED
[13:37:10.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:26:0) after 1m54s
[13:39:04.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:26:0)
[13:39:04.484] Build status: STARTED
[13:39:04.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:27:0) after 6m30s
[13:45:34.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:27:0)
[13:45:34.477] Build status: STARTED
[13:45:34.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:28:0) after 5m37s
[13:51:11.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:28:0)
[13:51:11.557] Build status: STARTED
[13:51:11.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:29:0) after 2m20s
[13:53:31.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:29:0)
[13:53:31.669] Build status: STARTED
[13:53:31.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:30:0) after 5m26s
[13:58:57.747] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:30:0)
[13:58:57.771] Build status: STARTED
[13:58:57.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8833398065734898016:31:0) after 7m15s
[14:00:21.647] Received PubSub notification, asking Buildbucket for the build status
[14:00:21.680] Build:
{
"id": "8667968003763857377",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 33337,
"createdBy": "project:chromium",
"createTime": "2026-10-14T11:49:21.587304529Z",
"startTime": "2026-10-14T11:49:57.959417644Z",
"endTime": "2026-10-14T14:00:06.276174817Z",
"updateTime": "2026-10-14T14:00:06.276174817Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2e1a8d44627cd0afbf71d6df54c855cc2ea1bd87",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:00:21.680] Invocation finished in 2h11m1.356849411s with status FAILED