[18:31:01.241] New invocation is queued and will start shortly
[18:31:03.375] Starting the invocation (attempt 1)
[18:31:03.403] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/570ff167ff50df45925d79c2faeb64b27d9acd92"
[18:31:03.403] Popped gitiles commit info from properties and tags
[18:31:03.403] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:31:03.403] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:31:03.403] Buildbucket request:
{
"requestId": "8835275330392611648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "570ff167ff50df45925d79c2faeb64b27d9acd92",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835275330392611648"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:31:04.614] Scheduled build:
{
"id": "8669845267121533409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32760,
"createdBy": "project:chromium",
"createTime": "2026-09-23T18:31:03.737990220Z",
"updateTime": "2026-09-23T18:31:03.737990220Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "570ff167ff50df45925d79c2faeb64b27d9acd92",
"ref": "refs/heads/main"
}
}
}
[18:31:04.614] Task URL: https://cr-buildbucket.appspot.com/build/8669845267121533409
[18:31:04.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:2:0) after 5m47s
[18:31:05.478] Received PubSub notification, asking Buildbucket for the build status
[18:31:05.513] Build status: SCHEDULED
[18:36:51.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:2:0)
[18:36:51.803] Build status: SCHEDULED
[18:36:51.803] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:4:0) after 9m2s
[18:45:53.945] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:4:0)
[18:45:53.970] Build status: SCHEDULED
[18:45:53.970] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:5:0) after 6m4s
[18:51:57.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:5:0)
[18:51:58.014] Build status: SCHEDULED
[18:51:58.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:6:0) after 4m12s
[18:56:10.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:6:0)
[18:56:10.082] Build status: SCHEDULED
[18:56:10.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:7:0) after 4m37s
[19:00:47.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:7:0)
[19:00:47.169] Build status: SCHEDULED
[19:00:47.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:8:0) after 2m54s
[19:03:41.233] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:8:0)
[19:03:41.256] Build status: SCHEDULED
[19:03:41.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:9:0) after 3m41s
[19:07:22.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:9:0)
[19:07:22.305] Build status: SCHEDULED
[19:07:22.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:10:0) after 9m38s
[19:17:00.337] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:10:0)
[19:17:00.410] Build status: SCHEDULED
[19:17:00.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:11:0) after 5m47s
[19:17:17.913] Received PubSub notification, asking Buildbucket for the build status
[19:17:17.934] Build status: STARTED
[19:22:47.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:11:0)
[19:22:47.453] Build status: STARTED
[19:22:47.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:13:0) after 5m28s
[19:28:15.482] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:13:0)
[19:28:15.504] Build status: STARTED
[19:28:15.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:14:0) after 8m56s
[19:37:11.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:14:0)
[19:37:11.567] Build status: STARTED
[19:37:11.567] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:15:0) after 4m0s
[19:41:11.620] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:15:0)
[19:41:11.647] Build status: STARTED
[19:41:11.647] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:16:0) after 3m45s
[19:44:56.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:16:0)
[19:44:56.687] Build status: STARTED
[19:44:56.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:17:0) after 8m17s
[19:53:13.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:17:0)
[19:53:13.722] Build status: STARTED
[19:53:13.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:18:0) after 7m32s
[20:00:46.059] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:18:0)
[20:00:46.091] Build status: STARTED
[20:00:46.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:19:0) after 1m27s
[20:02:13.133] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:19:0)
[20:02:13.192] Build status: STARTED
[20:02:13.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:20:0) after 4m39s
[20:06:52.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:20:0)
[20:06:52.381] Build status: STARTED
[20:06:52.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:21:0) after 8m20s
[20:15:12.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:21:0)
[20:15:12.427] Build status: STARTED
[20:15:12.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:22:0) after 9m44s
[20:24:56.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:22:0)
[20:24:56.505] Build status: STARTED
[20:24:56.506] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:23:0) after 3m12s
[20:28:08.558] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:23:0)
[20:28:08.714] Build status: STARTED
[20:28:08.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:24:0) after 2m27s
[20:30:35.736] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:24:0)
[20:30:35.787] Build status: STARTED
[20:30:35.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:25:0) after 3m10s
[20:33:45.982] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:25:0)
[20:33:46.058] Build status: STARTED
[20:33:46.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:26:0) after 2m50s
[20:36:36.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:26:0)
[20:36:36.125] Build status: STARTED
[20:36:36.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:27:0) after 8m18s
[20:44:54.143] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:27:0)
[20:44:54.257] Build status: STARTED
[20:44:54.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:28:0) after 3m57s
[20:48:51.398] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:28:0)
[20:48:51.421] Build status: STARTED
[20:48:51.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:29:0) after 1m9s
[20:50:00.441] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:29:0)
[20:50:00.460] Build status: STARTED
[20:50:00.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:30:0) after 6m8s
[20:56:08.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:30:0)
[20:56:08.573] Build status: STARTED
[20:56:08.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:31:0) after 7m37s
[21:03:45.772] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:31:0)
[21:03:45.941] Build status: STARTED
[21:03:45.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:32:0) after 3m34s
[21:07:19.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:32:0)
[21:07:19.990] Build status: STARTED
[21:07:19.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8835275330392611648:33:0) after 5m42s
[21:12:43.584] Received PubSub notification, asking Buildbucket for the build status
[21:12:43.603] Build:
{
"id": "8669845267121533409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32760,
"createdBy": "project:chromium",
"createTime": "2026-09-23T18:31:03.737990220Z",
"startTime": "2026-09-23T19:17:17.742681452Z",
"endTime": "2026-09-23T21:12:43.050981309Z",
"updateTime": "2026-09-23T21:12:43.050981309Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "570ff167ff50df45925d79c2faeb64b27d9acd92",
"ref": "refs/heads/main"
}
}
}
[21:12:43.603] Invocation finished in 2h41m42.368865329s with status FAILED