[02:39:32.107] New invocation is queued and will start shortly
[02:39:33.263] Starting the invocation (attempt 1)
[02:39:33.284] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/47862bf7dd580ad622a27640177909292c21d904"
[02:39:33.284] Popped gitiles commit info from properties and tags
[02:39:33.284] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:39:33.285] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:39:33.286] Buildbucket request:
{
"requestId": "8852186228440733632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "47862bf7dd580ad622a27640177909292c21d904",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852186228440733632"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:39:33.795] Scheduled build:
{
"id": "8686756166502011169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29834,
"createdBy": "project:chromium",
"createTime": "2026-03-21T02:39:33.331014194Z",
"updateTime": "2026-03-21T02:39:33.331014194Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "47862bf7dd580ad622a27640177909292c21d904",
"ref": "refs/heads/main"
}
}
}
[02:39:33.795] Task URL: https://cr-buildbucket.appspot.com/build/8686756166502011169
[02:39:33.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:2:0) after 8m54s
[02:39:34.760] Received PubSub notification, asking Buildbucket for the build status
[02:39:34.837] Build status: SCHEDULED
[02:40:35.398] Received PubSub notification, asking Buildbucket for the build status
[02:40:35.506] Build status: STARTED
[02:48:27.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:2:0)
[02:48:27.786] Build status: STARTED
[02:48:27.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:5:0) after 1m46s
[02:50:13.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:5:0)
[02:50:13.917] Build status: STARTED
[02:50:13.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:6:0) after 5m13s
[02:55:27.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:6:0)
[02:55:27.088] Build status: STARTED
[02:55:27.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:7:0) after 2m3s
[02:57:30.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:7:0)
[02:57:30.086] Build status: STARTED
[02:57:30.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:8:0) after 7m9s
[03:04:39.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:8:0)
[03:04:39.102] Build status: STARTED
[03:04:39.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:9:0) after 5m20s
[03:09:59.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:9:0)
[03:09:59.222] Build status: STARTED
[03:09:59.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:10:0) after 6m17s
[03:16:16.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:10:0)
[03:16:16.265] Build status: STARTED
[03:16:16.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:11:0) after 1m13s
[03:17:29.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:11:0)
[03:17:29.303] Build status: STARTED
[03:17:29.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:12:0) after 2m6s
[03:19:35.354] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:12:0)
[03:19:35.371] Build status: STARTED
[03:19:35.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:13:0) after 2m22s
[03:21:57.429] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:13:0)
[03:21:57.448] Build status: STARTED
[03:21:57.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:14:0) after 1m14s
[03:23:11.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:14:0)
[03:23:11.502] Build status: STARTED
[03:23:11.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:15:0) after 3m39s
[03:26:50.568] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:15:0)
[03:26:50.624] Build status: STARTED
[03:26:50.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:16:0) after 7m2s
[03:33:52.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:16:0)
[03:33:52.716] Build status: STARTED
[03:33:52.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:17:0) after 8m53s
[03:42:45.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:17:0)
[03:42:45.705] Build status: STARTED
[03:42:45.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:18:0) after 2m25s
[03:45:10.770] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:18:0)
[03:45:10.801] Build status: STARTED
[03:45:10.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:19:0) after 2m30s
[03:47:40.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:19:0)
[03:47:40.927] Build status: STARTED
[03:47:40.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:20:0) after 6m13s
[03:53:53.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:20:0)
[03:53:54.004] Build status: STARTED
[03:53:54.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:21:0) after 7m31s
[04:01:25.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:21:0)
[04:01:25.086] Build status: STARTED
[04:01:25.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:22:0) after 8m48s
[04:10:13.101] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:22:0)
[04:10:13.243] Build status: STARTED
[04:10:13.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:23:0) after 2m21s
[04:12:34.257] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:23:0)
[04:12:34.320] Build status: STARTED
[04:12:34.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:24:0) after 8m40s
[04:21:14.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:24:0)
[04:21:14.408] Build status: STARTED
[04:21:14.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:25:0) after 9m1s
[04:30:15.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:25:0)
[04:30:15.417] Build status: STARTED
[04:30:15.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852186228440733632:26:0) after 8m12s
[04:32:05.391] Received PubSub notification, asking Buildbucket for the build status
[04:32:05.416] Build:
{
"id": "8686756166502011169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29834,
"createdBy": "project:chromium",
"createTime": "2026-03-21T02:39:33.331014194Z",
"startTime": "2026-03-21T02:40:35.143710500Z",
"endTime": "2026-03-21T04:32:05.117260422Z",
"updateTime": "2026-03-21T04:32:05.117260422Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "47862bf7dd580ad622a27640177909292c21d904",
"ref": "refs/heads/main"
}
}
}
[04:32:05.416] Invocation finished in 1h52m33.317392427s with status FAILED