[22:45:50.662] New invocation is queued and will start shortly
[22:45:51.736] Starting the invocation (attempt 1)
[22:45:51.768] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f004e4a02b0ac1998398ed361d6aa133702b8c61"
[22:45:51.768] Popped gitiles commit info from properties and tags
[22:45:51.768] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:45:51.768] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:45:51.769] Buildbucket request:
{
"requestId": "8838339595133931616",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f004e4a02b0ac1998398ed361d6aa133702b8c61",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8838339595133931616"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:45:52.510] Scheduled build:
{
"id": "8672909533135288033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32467,
"createdBy": "project:chromium",
"createTime": "2026-08-20T22:45:51.941966288Z",
"updateTime": "2026-08-20T22:45:51.941966288Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f004e4a02b0ac1998398ed361d6aa133702b8c61",
"ref": "refs/heads/main"
}
}
}
[22:45:52.510] Task URL: https://cr-buildbucket.appspot.com/build/8672909533135288033
[22:45:52.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:2:0) after 5m15s
[22:46:01.707] Received PubSub notification, asking Buildbucket for the build status
[22:46:01.731] Build status: SCHEDULED
[22:46:50.222] Received PubSub notification, asking Buildbucket for the build status
[22:46:50.244] Build status: STARTED
[22:51:07.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:2:0)
[22:51:07.774] Build status: STARTED
[22:51:07.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:5:0) after 2m50s
[22:53:57.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:5:0)
[22:53:57.868] Build status: STARTED
[22:53:57.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:6:0) after 3m19s
[22:57:16.900] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:6:0)
[22:57:16.972] Build status: STARTED
[22:57:16.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:7:0) after 4m46s
[23:02:02.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:7:0)
[23:02:03.016] Build status: STARTED
[23:02:03.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:8:0) after 5m3s
[23:07:06.092] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:8:0)
[23:07:06.153] Build status: STARTED
[23:07:06.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:9:0) after 8m29s
[23:15:35.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:9:0)
[23:15:35.281] Build status: STARTED
[23:15:35.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:10:0) after 8m21s
[23:23:56.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:10:0)
[23:23:56.326] Build status: STARTED
[23:23:56.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:11:0) after 8m5s
[23:32:01.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:11:0)
[23:32:01.416] Build status: STARTED
[23:32:01.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:12:0) after 3m7s
[23:35:08.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:12:0)
[23:35:08.510] Build status: STARTED
[23:35:08.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:13:0) after 1m33s
[23:36:41.530] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:13:0)
[23:36:41.683] Build status: STARTED
[23:36:41.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:14:0) after 7m22s
[23:44:03.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:14:0)
[23:44:03.860] Build status: STARTED
[23:44:03.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:15:0) after 3m29s
[23:47:32.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:15:0)
[23:47:32.907] Build status: STARTED
[23:47:32.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:16:0) after 6m51s
[23:54:24.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:16:0)
[23:54:24.105] Build status: STARTED
[23:54:24.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:17:0) after 1m44s
[23:56:08.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:17:0)
[23:56:08.143] Build status: STARTED
[23:56:08.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:18:0) after 8m56s
[00:05:04.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:18:0)
[00:05:04.249] Build status: STARTED
[00:05:04.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:19:0) after 5m25s
[00:10:29.273] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:19:0)
[00:10:29.298] Build status: STARTED
[00:10:29.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:20:0) after 3m19s
[00:13:48.327] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:20:0)
[00:13:48.345] Build status: STARTED
[00:13:48.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:21:0) after 4m43s
[00:18:31.397] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:21:0)
[00:18:31.415] Build status: STARTED
[00:18:31.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:22:0) after 3m28s
[00:21:59.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:22:0)
[00:21:59.506] Build status: STARTED
[00:21:59.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:23:0) after 9m35s
[00:31:34.529] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:23:0)
[00:31:34.549] Build status: STARTED
[00:31:34.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:24:0) after 2m9s
[00:33:43.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:24:0)
[00:33:43.606] Build status: STARTED
[00:33:43.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:25:0) after 5m59s
[00:39:42.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:25:0)
[00:39:42.643] Build status: STARTED
[00:39:42.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:26:0) after 1m10s
[00:40:52.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:26:0)
[00:40:52.693] Build status: STARTED
[00:40:52.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:27:0) after 7m51s
[00:48:43.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:27:0)
[00:48:43.836] Build status: STARTED
[00:48:43.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:28:0) after 3m58s
[00:52:41.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:28:0)
[00:52:41.966] Build status: STARTED
[00:52:41.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:29:0) after 4m15s
[00:56:56.989] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:29:0)
[00:56:57.037] Build status: STARTED
[00:56:57.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:30:0) after 1m31s
[00:58:28.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:30:0)
[00:58:28.216] Build status: STARTED
[00:58:28.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:31:0) after 8m13s
[01:06:41.268] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:31:0)
[01:06:41.300] Build status: STARTED
[01:06:41.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:32:0) after 5m16s
[01:11:57.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:32:0)
[01:11:57.391] Build status: STARTED
[01:11:57.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:33:0) after 6m34s
[01:18:31.538] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:33:0)
[01:18:31.560] Build status: STARTED
[01:18:31.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:34:0) after 2m16s
[01:20:47.615] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:34:0)
[01:20:47.642] Build status: STARTED
[01:20:47.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:35:0) after 2m13s
[01:23:00.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:35:0)
[01:23:00.792] Build status: STARTED
[01:23:00.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:36:0) after 8m55s
[01:31:55.842] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:36:0)
[01:31:55.864] Build status: STARTED
[01:31:55.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:37:0) after 4m16s
[01:36:12.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:37:0)
[01:36:12.088] Build status: STARTED
[01:36:12.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:38:0) after 7m29s
[01:43:41.122] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:38:0)
[01:43:41.141] Build status: STARTED
[01:43:41.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:39:0) after 9m54s
[01:53:35.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:39:0)
[01:53:35.176] Build status: STARTED
[01:53:35.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:40:0) after 5m59s
[01:59:34.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:40:0)
[01:59:34.490] Build status: STARTED
[01:59:34.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:41:0) after 9m53s
[02:09:27.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:41:0)
[02:09:27.586] Build status: STARTED
[02:09:27.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:42:0) after 2m25s
[02:11:52.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:42:0)
[02:11:52.627] Build status: STARTED
[02:11:52.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:43:0) after 1m33s
[02:13:25.651] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:43:0)
[02:13:25.675] Build status: STARTED
[02:13:25.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:44:0) after 9m3s
[02:22:28.832] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:44:0)
[02:22:28.850] Build status: STARTED
[02:22:28.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:45:0) after 1m59s
[02:24:27.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:45:0)
[02:24:27.912] Build status: STARTED
[02:24:27.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:46:0) after 4m33s
[02:29:00.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:46:0)
[02:29:01.004] Build status: STARTED
[02:29:01.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:47:0) after 7m30s
[02:36:31.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:47:0)
[02:36:31.050] Build status: STARTED
[02:36:31.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:48:0) after 1m39s
[02:38:10.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:48:0)
[02:38:10.184] Build status: STARTED
[02:38:10.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:49:0) after 6m43s
[02:44:53.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:49:0)
[02:44:53.226] Build status: STARTED
[02:44:53.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:50:0) after 9m7s
[02:54:00.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:50:0)
[02:54:00.324] Build status: STARTED
[02:54:00.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:51:0) after 4m47s
[02:58:47.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:51:0)
[02:58:47.395] Build status: STARTED
[02:58:47.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:52:0) after 4m30s
[03:03:17.367] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:52:0)
[03:03:17.391] Build status: STARTED
[03:03:17.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:53:0) after 3m28s
[03:06:45.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:53:0)
[03:06:45.434] Build status: STARTED
[03:06:45.434] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:54:0) after 2m27s
[03:09:12.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:54:0)
[03:09:12.515] Build status: STARTED
[03:09:12.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:55:0) after 4m16s
[03:13:28.614] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:55:0)
[03:13:28.637] Build status: STARTED
[03:13:28.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:56:0) after 7m53s
[03:21:21.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:56:0)
[03:21:21.827] Build status: STARTED
[03:21:21.827] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:57:0) after 7m58s
[03:29:19.927] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:57:0)
[03:29:19.946] Build status: STARTED
[03:29:19.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:58:0) after 3m37s
[03:32:56.992] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:58:0)
[03:32:57.121] Build status: STARTED
[03:32:57.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:59:0) after 3m54s
[03:36:51.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:59:0)
[03:36:51.326] Build status: STARTED
[03:36:51.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:60:0) after 2m50s
[03:39:41.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:60:0)
[03:39:41.535] Build status: STARTED
[03:39:41.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:61:0) after 8m46s
[03:48:27.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:61:0)
[03:48:27.573] Build status: STARTED
[03:48:27.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:62:0) after 6m18s
[03:54:45.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:62:0)
[03:54:45.619] Build status: STARTED
[03:54:45.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8838339595133931616:63:0) after 6m37s
[03:57:29.559] Received PubSub notification, asking Buildbucket for the build status
[03:57:29.575] Build:
{
"id": "8672909533135288033",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 32467,
"createdBy": "project:chromium",
"createTime": "2026-08-20T22:45:51.941966288Z",
"startTime": "2026-08-20T22:46:45.621949413Z",
"endTime": "2026-08-21T03:57:28.676526600Z",
"updateTime": "2026-08-21T03:57:28.676526600Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f004e4a02b0ac1998398ed361d6aa133702b8c61",
"ref": "refs/heads/main"
}
}
}
[03:57:29.575] Invocation finished in 5h11m38.92346485s with status SUCCEEDED