[07:23:26.950] New invocation is queued and will start shortly
[07:23:28.221] Starting the invocation (attempt 1)
[07:23:28.247] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/66473335b57ceabadf95e59a52ae0868dc9a4d87"
[07:23:28.247] Popped gitiles commit info from properties and tags
[07:23:28.247] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:23:28.247] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:23:28.247] Buildbucket request:
{
"requestId": "8835226733392797168",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "66473335b57ceabadf95e59a52ae0868dc9a4d87",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835226733392797168"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:23:28.967] Scheduled build:
{
"id": "8669796671312932161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32765,
"createdBy": "project:chromium",
"createTime": "2026-09-24T07:23:28.312675300Z",
"updateTime": "2026-09-24T07:23:28.312675300Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "66473335b57ceabadf95e59a52ae0868dc9a4d87",
"ref": "refs/heads/main"
}
}
}
[07:23:28.967] Task URL: https://cr-buildbucket.appspot.com/build/8669796671312932161
[07:23:28.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:2:0) after 1m45s
[07:23:29.178] Received PubSub notification, asking Buildbucket for the build status
[07:23:29.199] Build status: SCHEDULED
[07:25:13.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:2:0)
[07:25:13.956] Build status: SCHEDULED
[07:25:13.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:4:0) after 1m22s
[07:26:35.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:4:0)
[07:26:35.990] Build status: SCHEDULED
[07:26:35.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:5:0) after 4m33s
[07:31:09.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:5:0)
[07:31:09.140] Build status: SCHEDULED
[07:31:09.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:6:0) after 6m41s
[07:37:50.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:6:0)
[07:37:50.180] Build status: SCHEDULED
[07:37:50.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:7:0) after 3m51s
[07:41:41.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:7:0)
[07:41:41.220] Build status: SCHEDULED
[07:41:41.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:8:0) after 9m34s
[07:51:15.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:8:0)
[07:51:15.378] Build status: SCHEDULED
[07:51:15.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:9:0) after 1m28s
[07:52:43.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:9:0)
[07:52:43.507] Build status: SCHEDULED
[07:52:43.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:10:0) after 8m19s
[08:01:02.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:10:0)
[08:01:02.844] Build status: SCHEDULED
[08:01:02.874] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:11:0) after 8m25s
[08:09:27.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:11:0)
[08:09:27.942] Build status: SCHEDULED
[08:09:27.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:12:0) after 1m15s
[08:10:42.997] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:12:0)
[08:10:43.015] Build status: SCHEDULED
[08:10:43.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:13:0) after 4m5s
[08:14:48.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:13:0)
[08:14:48.094] Build status: SCHEDULED
[08:14:48.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:14:0) after 8m19s
[08:15:53.622] Received PubSub notification, asking Buildbucket for the build status
[08:15:53.696] Build status: STARTED
[08:23:07.112] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:14:0)
[08:23:07.230] Build status: STARTED
[08:23:07.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:16:0) after 4m32s
[08:27:39.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:16:0)
[08:27:39.261] Build status: STARTED
[08:27:39.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:17:0) after 4m9s
[08:31:48.280] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:17:0)
[08:31:48.545] Build status: STARTED
[08:31:48.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:18:0) after 7m40s
[08:39:28.634] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:18:0)
[08:39:28.656] Build status: STARTED
[08:39:28.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:19:0) after 3m49s
[08:43:17.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:19:0)
[08:43:17.700] Build status: STARTED
[08:43:17.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:20:0) after 5m19s
[08:48:36.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:20:0)
[08:48:36.861] Build status: STARTED
[08:48:36.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:21:0) after 2m45s
[08:51:21.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:21:0)
[08:51:21.916] Build status: STARTED
[08:51:21.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:22:0) after 9m27s
[09:00:48.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:22:0)
[09:00:48.961] Build status: STARTED
[09:00:48.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:23:0) after 7m15s
[09:08:04.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:23:0)
[09:08:04.093] Build status: STARTED
[09:08:04.093] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:24:0) after 8m41s
[09:16:45.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:24:0)
[09:16:45.311] Build status: STARTED
[09:16:45.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:25:0) after 5m33s
[09:22:18.428] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:25:0)
[09:22:18.449] Build status: STARTED
[09:22:18.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:26:0) after 1m45s
[09:24:03.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:26:0)
[09:24:03.494] Build status: STARTED
[09:24:03.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:27:0) after 9m4s
[09:33:07.511] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:27:0)
[09:33:07.529] Build status: STARTED
[09:33:07.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:28:0) after 9m4s
[09:42:11.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:28:0)
[09:42:11.629] Build status: STARTED
[09:42:11.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:29:0) after 6m10s
[09:48:21.702] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:29:0)
[09:48:21.733] Build status: STARTED
[09:48:21.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:30:0) after 8m42s
[09:57:03.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:30:0)
[09:57:03.814] Build status: STARTED
[09:57:03.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:31:0) after 3m49s
[10:00:52.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:31:0)
[10:00:52.938] Build status: STARTED
[10:00:52.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:32:0) after 4m49s
[10:05:42.295] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:32:0)
[10:05:42.375] Build status: STARTED
[10:05:42.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:33:0) after 4m42s
[10:10:24.477] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:33:0)
[10:10:24.496] Build status: STARTED
[10:10:24.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:34:0) after 6m23s
[10:16:47.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:34:0)
[10:16:47.539] Build status: STARTED
[10:16:47.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:35:0) after 4m35s
[10:21:22.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:35:0)
[10:21:22.640] Build status: STARTED
[10:21:22.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835226733392797168:36:0) after 8m49s
[10:28:30.277] Received PubSub notification, asking Buildbucket for the build status
[10:28:30.334] Build:
{
"id": "8669796671312932161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32765,
"createdBy": "project:chromium",
"createTime": "2026-09-24T07:23:28.312675300Z",
"startTime": "2026-09-24T08:15:53.441844590Z",
"endTime": "2026-09-24T10:28:29.963242951Z",
"updateTime": "2026-09-24T10:28:29.963242951Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "66473335b57ceabadf95e59a52ae0868dc9a4d87",
"ref": "refs/heads/main"
}
}
}
[10:28:30.334] Invocation finished in 3h5m3.389317516s with status FAILED