[21:53:37.142] New invocation is queued and will start shortly
[21:53:38.281] Starting the invocation (attempt 1)
[21:53:38.315] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f44d0d33cf4e5d33e8ea81a49585fd159cadb362"
[21:53:38.315] Popped gitiles commit info from properties and tags
[21:53:38.315] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:53:38.316] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:53:38.316] Buildbucket request:
{
"requestId": "8852204216719920272",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f44d0d33cf4e5d33e8ea81a49585fd159cadb362",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852204216719920272"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:53:38.837] Scheduled build:
{
"id": "8686774154793322593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29832,
"createdBy": "project:chromium",
"createTime": "2026-03-20T21:53:38.359885037Z",
"updateTime": "2026-03-20T21:53:38.359885037Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f44d0d33cf4e5d33e8ea81a49585fd159cadb362",
"ref": "refs/heads/main"
}
}
}
[21:53:38.837] Task URL: https://cr-buildbucket.appspot.com/build/8686774154793322593
[21:53:38.838] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:2:0) after 7m41s
[21:53:39.846] Received PubSub notification, asking Buildbucket for the build status
[21:53:39.864] Build status: SCHEDULED
[21:54:44.186] Received PubSub notification, asking Buildbucket for the build status
[21:54:44.205] Build status: STARTED
[22:01:19.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:2:0)
[22:01:19.892] Build status: STARTED
[22:01:19.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:5:0) after 4m14s
[22:05:33.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:5:0)
[22:05:34.052] Build status: STARTED
[22:05:34.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:6:0) after 1m33s
[22:07:07.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:6:0)
[22:07:07.073] Build status: STARTED
[22:07:07.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:7:0) after 3m15s
[22:10:22.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:7:0)
[22:10:22.324] Build status: STARTED
[22:10:22.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:8:0) after 4m9s
[22:14:31.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:8:0)
[22:14:31.361] Build status: STARTED
[22:14:31.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:9:0) after 2m18s
[22:16:49.430] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:9:0)
[22:16:49.453] Build status: STARTED
[22:16:49.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:10:0) after 7m56s
[22:24:45.470] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:10:0)
[22:24:45.485] Build status: STARTED
[22:24:45.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:11:0) after 4m58s
[22:29:43.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:11:0)
[22:29:43.527] Build status: STARTED
[22:29:43.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:12:0) after 8m8s
[22:37:51.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:12:0)
[22:37:51.668] Build status: STARTED
[22:37:51.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:13:0) after 3m23s
[22:41:14.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:13:0)
[22:41:14.679] Build status: STARTED
[22:41:14.679] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:14:0) after 9m23s
[22:50:37.665] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:14:0)
[22:50:37.683] Build status: STARTED
[22:50:37.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:15:0) after 8m49s
[22:59:26.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:15:0)
[22:59:26.718] Build status: STARTED
[22:59:26.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:16:0) after 4m31s
[23:03:57.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:16:0)
[23:03:57.733] Build status: STARTED
[23:03:57.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:17:0) after 5m30s
[23:09:27.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:17:0)
[23:09:27.840] Build status: STARTED
[23:09:27.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:18:0) after 9m50s
[23:19:17.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:18:0)
[23:19:18.056] Build status: STARTED
[23:19:18.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:19:0) after 8m16s
[23:27:34.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:19:0)
[23:27:34.192] Build status: STARTED
[23:27:34.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:20:0) after 3m3s
[23:30:37.207] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:20:0)
[23:30:37.269] Build status: STARTED
[23:30:37.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:21:0) after 8m19s
[23:38:56.526] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:21:0)
[23:38:56.621] Build status: STARTED
[23:38:56.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:22:0) after 4m55s
[23:43:51.830] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:22:0)
[23:43:51.863] Build status: STARTED
[23:43:51.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:23:0) after 3m55s
[23:47:47.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:23:0)
[23:47:47.248] Build status: STARTED
[23:47:47.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:24:0) after 3m27s
[23:51:14.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:24:0)
[23:51:14.425] Build status: STARTED
[23:51:14.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:25:0) after 6m8s
[23:57:22.484] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:25:0)
[23:57:22.518] Build status: STARTED
[23:57:22.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:26:0) after 9m33s
[00:06:55.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:26:0)
[00:06:55.636] Build status: STARTED
[00:06:55.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:27:0) after 5m57s
[00:12:52.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:27:0)
[00:12:52.816] Build status: STARTED
[00:12:52.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:28:0) after 7m11s
[00:20:03.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:28:0)
[00:20:03.916] Build status: STARTED
[00:20:03.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:29:0) after 3m33s
[00:23:36.936] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:29:0)
[00:23:36.951] Build status: STARTED
[00:23:36.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:30:0) after 1m38s
[00:25:15.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:30:0)
[00:25:15.076] Build status: STARTED
[00:25:15.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:31:0) after 7m26s
[00:32:41.250] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:31:0)
[00:32:41.269] Build status: STARTED
[00:32:41.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:32:0) after 2m18s
[00:34:59.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:32:0)
[00:34:59.315] Build status: STARTED
[00:34:59.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:33:0) after 1m22s
[00:36:21.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:33:0)
[00:36:21.411] Build status: STARTED
[00:36:21.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8852204216719920272:34:0) after 8m13s
[00:44:21.288] Received PubSub notification, asking Buildbucket for the build status
[00:44:21.305] Build:
{
"id": "8686774154793322593",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 29832,
"createdBy": "project:chromium",
"createTime": "2026-03-20T21:53:38.359885037Z",
"startTime": "2026-03-20T21:54:43.958047418Z",
"endTime": "2026-03-21T00:44:12.118206940Z",
"updateTime": "2026-03-21T00:44:12.118206940Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f44d0d33cf4e5d33e8ea81a49585fd159cadb362",
"ref": "refs/heads/main"
}
}
}
[00:44:21.305] Invocation finished in 2h50m44.165910118s with status FAILED