[01:51:24.521] New invocation is queued and will start shortly
[01:51:25.744] Starting the invocation (attempt 1)
[01:51:25.776] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0647d0d2f45bab689c71d7e148ab35f867a9edf4"
[01:51:25.776] Popped gitiles commit info from properties and tags
[01:51:25.776] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:51:25.776] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:51:25.777] Buildbucket request:
{
"requestId": "8874566707001060624",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0647d0d2f45bab689c71d7e148ab35f867a9edf4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874566707001060624"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:51:26.325] Scheduled build:
{
"id": "8709136644951272609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26194,
"createdBy": "project:chromium",
"createTime": "2025-07-17T01:51:25.845035771Z",
"updateTime": "2025-07-17T01:51:25.845035771Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0647d0d2f45bab689c71d7e148ab35f867a9edf4",
"ref": "refs/heads/main"
}
}
}
[01:51:26.325] Task URL: https://cr-buildbucket.appspot.com/build/8709136644951272609
[01:51:26.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:2:0) after 6m20s
[01:51:27.322] Received PubSub notification, asking Buildbucket for the build status
[01:51:27.374] Build status: SCHEDULED
[01:52:37.167] Received PubSub notification, asking Buildbucket for the build status
[01:52:37.204] Build status: STARTED
[01:57:46.353] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:2:0)
[01:57:46.411] Build status: STARTED
[01:57:46.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:5:0) after 3m0s
[02:00:46.583] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:5:0)
[02:00:46.610] Build status: STARTED
[02:00:46.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:6:0) after 6m18s
[02:07:04.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:6:0)
[02:07:04.729] Build status: STARTED
[02:07:04.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:7:0) after 4m33s
[02:11:37.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:7:0)
[02:11:37.786] Build status: STARTED
[02:11:37.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:8:0) after 9m31s
[02:21:08.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:8:0)
[02:21:08.884] Build status: STARTED
[02:21:08.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:9:0) after 7m26s
[02:28:34.909] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:9:0)
[02:28:34.930] Build status: STARTED
[02:28:34.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:10:0) after 8m36s
[02:37:11.003] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:10:0)
[02:37:11.048] Build status: STARTED
[02:37:11.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:11:0) after 9m37s
[02:46:48.076] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:11:0)
[02:46:48.095] Build status: STARTED
[02:46:48.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:12:0) after 8m3s
[02:54:51.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:12:0)
[02:54:51.141] Build status: STARTED
[02:54:51.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:13:0) after 9m12s
[03:04:03.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:13:0)
[03:04:03.181] Build status: STARTED
[03:04:03.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:14:0) after 6m29s
[03:10:32.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:14:0)
[03:10:32.285] Build status: STARTED
[03:10:32.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:15:0) after 5m51s
[03:16:23.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:15:0)
[03:16:23.371] Build status: STARTED
[03:16:23.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:16:0) after 5m55s
[03:22:18.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:16:0)
[03:22:18.409] Build status: STARTED
[03:22:18.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:17:0) after 4m30s
[03:26:48.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:17:0)
[03:26:48.432] Build status: STARTED
[03:26:48.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:18:0) after 7m33s
[03:34:21.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:18:0)
[03:34:21.543] Build status: STARTED
[03:34:21.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:19:0) after 1m4s
[03:35:25.561] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:19:0)
[03:35:25.584] Build status: STARTED
[03:35:25.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:20:0) after 9m23s
[03:44:48.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:20:0)
[03:44:48.630] Build status: STARTED
[03:44:48.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:21:0) after 8m7s
[03:52:55.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:21:0)
[03:52:55.714] Build status: STARTED
[03:52:55.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:22:0) after 7m38s
[04:00:33.739] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:22:0)
[04:00:33.758] Build status: STARTED
[04:00:33.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:23:0) after 5m27s
[04:06:00.781] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:23:0)
[04:06:00.824] Build status: STARTED
[04:06:00.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:24:0) after 7m17s
[04:13:17.895] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:24:0)
[04:13:17.916] Build status: STARTED
[04:13:17.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:25:0) after 3m3s
[04:16:21.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:25:0)
[04:16:21.461] Build status: STARTED
[04:16:21.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:26:0) after 1m33s
[04:17:55.091] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:26:0)
[04:17:55.164] Build status: STARTED
[04:17:55.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:27:0) after 3m2s
[04:20:57.476] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:27:0)
[04:20:57.542] Build status: STARTED
[04:20:57.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:28:0) after 1m14s
[04:22:11.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:28:0)
[04:22:11.815] Build status: STARTED
[04:22:11.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:29:0) after 6m19s
[04:28:30.846] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:29:0)
[04:28:30.859] Build status: STARTED
[04:28:30.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:30:0) after 2m41s
[04:31:11.925] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:30:0)
[04:31:11.945] Build status: STARTED
[04:31:11.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:31:0) after 2m7s
[04:33:18.975] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:31:0)
[04:33:18.998] Build status: STARTED
[04:33:18.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:32:0) after 6m23s
[04:39:42.024] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:32:0)
[04:39:42.041] Build status: STARTED
[04:39:42.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:33:0) after 6m43s
[04:46:25.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:33:0)
[04:46:25.078] Build status: STARTED
[04:46:25.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:34:0) after 5m54s
[04:52:19.102] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:34:0)
[04:52:19.181] Build status: STARTED
[04:52:19.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:35:0) after 4m42s
[04:57:01.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:35:0)
[04:57:01.298] Build status: STARTED
[04:57:01.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:36:0) after 2m11s
[04:59:12.559] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:36:0)
[04:59:12.596] Build status: STARTED
[04:59:12.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:37:0) after 6m54s
[05:06:06.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:37:0)
[05:06:06.675] Build status: STARTED
[05:06:06.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:38:0) after 1m53s
[05:07:59.755] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:38:0)
[05:07:59.776] Build status: STARTED
[05:07:59.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:39:0) after 2m44s
[05:10:43.792] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:39:0)
[05:10:43.850] Build status: STARTED
[05:10:43.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:40:0) after 2m34s
[05:13:18.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:40:0)
[05:13:18.275] Build status: STARTED
[05:13:18.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:41:0) after 2m41s
[05:15:59.307] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:41:0)
[05:15:59.371] Build status: STARTED
[05:15:59.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:42:0) after 2m19s
[05:18:18.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:42:0)
[05:18:18.684] Build status: STARTED
[05:18:18.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:43:0) after 9m29s
[05:27:48.103] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:43:0)
[05:27:48.121] Build status: STARTED
[05:27:48.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:44:0) after 5m51s
[05:33:39.593] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:44:0)
[05:33:39.613] Build status: STARTED
[05:33:39.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:45:0) after 3m10s
[05:36:49.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:45:0)
[05:36:49.663] Build status: STARTED
[05:36:49.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:46:0) after 5m40s
[05:42:30.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:46:0)
[05:42:30.074] Build status: STARTED
[05:42:30.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:47:0) after 4m11s
[05:46:41.175] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:47:0)
[05:46:41.199] Build status: STARTED
[05:46:41.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:48:0) after 5m19s
[05:52:00.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:48:0)
[05:52:00.396] Build status: STARTED
[05:52:00.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:49:0) after 8m28s
[06:00:28.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:49:0)
[06:00:28.478] Build status: STARTED
[06:00:28.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:50:0) after 1m9s
[06:01:37.528] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:50:0)
[06:01:37.559] Build status: STARTED
[06:01:37.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:51:0) after 9m57s
[06:11:34.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:51:0)
[06:11:34.671] Build status: STARTED
[06:11:34.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:52:0) after 4m59s
[06:16:33.730] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:52:0)
[06:16:33.755] Build status: STARTED
[06:16:33.755] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:53:0) after 4m22s
[06:20:55.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:53:0)
[06:20:55.854] Build status: STARTED
[06:20:55.854] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:54:0) after 3m54s
[06:24:50.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:54:0)
[06:24:50.140] Build status: STARTED
[06:24:50.140] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:55:0) after 5m31s
[06:30:21.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:55:0)
[06:30:21.478] Build status: STARTED
[06:30:21.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:56:0) after 1m51s
[06:32:12.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:56:0)
[06:32:12.598] Build status: STARTED
[06:32:12.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:57:0) after 1m23s
[06:33:35.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:57:0)
[06:33:35.747] Build status: STARTED
[06:33:35.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:58:0) after 6m42s
[06:40:17.899] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:58:0)
[06:40:17.920] Build status: STARTED
[06:40:17.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:59:0) after 9m31s
[06:49:48.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:59:0)
[06:49:48.967] Build status: STARTED
[06:49:48.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:60:0) after 6m57s
[06:56:46.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:60:0)
[06:56:46.240] Build status: STARTED
[06:56:46.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:61:0) after 5m30s
[07:02:16.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:61:0)
[07:02:16.329] Build status: STARTED
[07:02:16.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:62:0) after 6m46s
[07:09:02.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:62:0)
[07:09:02.379] Build status: STARTED
[07:09:02.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:63:0) after 3m23s
[07:12:25.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:63:0)
[07:12:25.464] Build status: STARTED
[07:12:25.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:64:0) after 4m35s
[07:17:00.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:64:0)
[07:17:00.668] Build status: STARTED
[07:17:00.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:65:0) after 2m12s
[07:19:12.740] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:65:0)
[07:19:12.763] Build status: STARTED
[07:19:12.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:66:0) after 1m34s
[07:20:46.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:66:0)
[07:20:46.875] Build status: STARTED
[07:20:46.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:67:0) after 1m8s
[07:21:55.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:67:0)
[07:21:55.062] Build status: STARTED
[07:21:55.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:68:0) after 4m1s
[07:25:56.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:68:0)
[07:25:56.368] Build status: STARTED
[07:25:56.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:69:0) after 6m18s
[07:32:14.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:69:0)
[07:32:14.809] Build status: STARTED
[07:32:14.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:70:0) after 5m5s
[07:37:19.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:70:0)
[07:37:19.907] Build status: STARTED
[07:37:19.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:71:0) after 5m34s
[07:42:54.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:71:0)
[07:42:54.065] Build status: STARTED
[07:42:54.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:72:0) after 8m17s
[07:51:11.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:72:0)
[07:51:11.199] Build status: STARTED
[07:51:11.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:73:0) after 4m52s
[07:56:03.432] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:73:0)
[07:56:03.453] Build status: STARTED
[07:56:03.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:74:0) after 1m16s
[07:57:19.485] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:74:0)
[07:57:19.512] Build status: STARTED
[07:57:19.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:75:0) after 8m42s
[08:06:01.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:75:0)
[08:06:01.682] Build status: STARTED
[08:06:01.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:76:0) after 3m17s
[08:09:18.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:76:0)
[08:09:18.783] Build status: STARTED
[08:09:18.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:77:0) after 3m57s
[08:13:15.793] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:77:0)
[08:13:15.815] Build status: STARTED
[08:13:15.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:78:0) after 8m22s
[08:21:37.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:78:0)
[08:21:37.865] Build status: STARTED
[08:21:37.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:79:0) after 9m15s
[08:30:52.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:79:0)
[08:30:53.032] Build status: STARTED
[08:30:53.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:80:0) after 1m2s
[08:31:55.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:80:0)
[08:31:55.114] Build status: STARTED
[08:31:55.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:81:0) after 6m2s
[08:37:57.213] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:81:0)
[08:37:57.271] Build status: STARTED
[08:37:57.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:82:0) after 3m5s
[08:41:02.346] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:82:0)
[08:41:02.362] Build status: STARTED
[08:41:02.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:83:0) after 7m49s
[08:48:51.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:83:0)
[08:48:51.402] Build status: STARTED
[08:48:51.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:84:0) after 8m25s
[08:57:16.493] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:84:0)
[08:57:16.521] Build status: STARTED
[08:57:16.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:85:0) after 5m11s
[09:02:27.591] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:85:0)
[09:02:27.614] Build status: STARTED
[09:02:27.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:86:0) after 3m35s
[09:06:02.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:86:0)
[09:06:02.894] Build status: STARTED
[09:06:02.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:87:0) after 6m39s
[09:12:41.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:87:0)
[09:12:41.942] Build status: STARTED
[09:12:41.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:88:0) after 2m0s
[09:14:41.940] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:88:0)
[09:14:41.959] Build status: STARTED
[09:14:41.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:89:0) after 4m0s
[09:18:42.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:89:0)
[09:18:42.044] Build status: STARTED
[09:18:42.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:90:0) after 9m15s
[09:27:57.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:90:0)
[09:27:57.092] Build status: STARTED
[09:27:57.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:91:0) after 1m29s
[09:29:26.347] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:91:0)
[09:29:26.393] Build status: STARTED
[09:29:26.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:92:0) after 6m33s
[09:35:59.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:92:0)
[09:35:59.443] Build status: STARTED
[09:35:59.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:93:0) after 9m30s
[09:45:29.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:93:0)
[09:45:29.498] Build status: STARTED
[09:45:29.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:94:0) after 9m37s
[09:55:06.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:94:0)
[09:55:06.599] Build status: STARTED
[09:55:06.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874566707001060624:95:0) after 8m38s
[09:57:42.405] Received PubSub notification, asking Buildbucket for the build status
[09:57:42.520] Build:
{
"id": "8709136644951272609",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26194,
"createdBy": "project:chromium",
"createTime": "2025-07-17T01:51:25.845035771Z",
"startTime": "2025-07-17T01:52:36.958863582Z",
"endTime": "2025-07-17T09:57:41.991046091Z",
"updateTime": "2025-07-17T09:57:41.991046091Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0647d0d2f45bab689c71d7e148ab35f867a9edf4",
"ref": "refs/heads/main"
}
}
}
[09:57:42.520] Invocation finished in 8h6m18.013284986s with status FAILED