[10:53:58.075] New invocation is queued and will start shortly
[10:53:59.161] Starting the invocation (attempt 1)
[10:53:59.195] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bc4cdfd8b867cfc07204680c9abbd15fd7885526"
[10:53:59.195] Popped gitiles commit info from properties and tags
[10:53:59.195] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:53:59.195] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:53:59.196] Buildbucket request:
{
"requestId": "8876525705382900688",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc4cdfd8b867cfc07204680c9abbd15fd7885526",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8876525705382900688"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:53:59.706] Scheduled build:
{
"id": "8711095643447254401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26109,
"createdBy": "project:chromium",
"createTime": "2025-06-25T10:53:59.293579863Z",
"updateTime": "2025-06-25T10:53:59.293579863Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc4cdfd8b867cfc07204680c9abbd15fd7885526",
"ref": "refs/heads/main"
}
}
}
[10:53:59.706] Task URL: https://cr-buildbucket.appspot.com/build/8711095643447254401
[10:53:59.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:2:0) after 6m1s
[10:54:00.756] Received PubSub notification, asking Buildbucket for the build status
[10:54:00.775] Build status: SCHEDULED
[10:54:58.456] Received PubSub notification, asking Buildbucket for the build status
[10:54:58.480] Build status: STARTED
[11:00:00.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:2:0)
[11:00:00.757] Build status: STARTED
[11:00:00.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:5:0) after 1m57s
[11:01:58.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:5:0)
[11:01:58.076] Build status: STARTED
[11:01:58.076] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:6:0) after 6m25s
[11:08:23.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:6:0)
[11:08:23.569] Build status: STARTED
[11:08:23.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:7:0) after 9m38s
[11:18:01.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:7:0)
[11:18:01.626] Build status: STARTED
[11:18:01.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:8:0) after 9m12s
[11:27:13.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:8:0)
[11:27:13.666] Build status: STARTED
[11:27:13.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:9:0) after 5m28s
[11:32:42.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:9:0)
[11:32:42.073] Build status: STARTED
[11:32:42.073] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:10:0) after 3m44s
[11:36:26.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:10:0)
[11:36:26.437] Build status: STARTED
[11:36:26.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:11:0) after 3m26s
[11:39:52.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:11:0)
[11:39:52.486] Build status: STARTED
[11:39:52.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:12:0) after 4m5s
[11:43:57.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:12:0)
[11:43:57.878] Build status: STARTED
[11:43:57.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:13:0) after 5m35s
[11:49:33.173] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:13:0)
[11:49:33.190] Build status: STARTED
[11:49:33.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:14:0) after 4m59s
[11:54:32.221] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:14:0)
[11:54:32.245] Build status: STARTED
[11:54:32.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:15:0) after 2m24s
[11:56:56.391] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:15:0)
[11:56:56.423] Build status: STARTED
[11:56:56.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:16:0) after 8m49s
[12:05:45.570] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:16:0)
[12:05:45.588] Build status: STARTED
[12:05:45.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:17:0) after 3m16s
[12:09:01.848] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:17:0)
[12:09:01.867] Build status: STARTED
[12:09:01.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:18:0) after 5m27s
[12:14:28.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:18:0)
[12:14:29.010] Build status: STARTED
[12:14:29.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:19:0) after 4m9s
[12:18:38.047] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:19:0)
[12:18:38.116] Build status: STARTED
[12:18:38.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:20:0) after 2m0s
[12:20:38.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:20:0)
[12:20:38.263] Build status: STARTED
[12:20:38.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:21:0) after 4m27s
[12:25:05.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:21:0)
[12:25:05.344] Build status: STARTED
[12:25:05.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:22:0) after 6m54s
[12:31:59.371] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:22:0)
[12:31:59.402] Build status: STARTED
[12:31:59.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:23:0) after 2m27s
[12:34:26.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:23:0)
[12:34:26.452] Build status: STARTED
[12:34:26.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:24:0) after 4m29s
[12:38:55.497] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:24:0)
[12:38:55.521] Build status: STARTED
[12:38:55.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:25:0) after 3m52s
[12:42:47.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:25:0)
[12:42:47.631] Build status: STARTED
[12:42:47.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:26:0) after 3m10s
[12:45:57.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:26:0)
[12:45:57.745] Build status: STARTED
[12:45:57.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:27:0) after 1m26s
[12:47:23.838] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:27:0)
[12:47:23.859] Build status: STARTED
[12:47:23.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:28:0) after 2m40s
[12:50:03.892] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:28:0)
[12:50:03.955] Build status: STARTED
[12:50:03.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:29:0) after 8m36s
[12:58:39.935] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:29:0)
[12:58:39.952] Build status: STARTED
[12:58:39.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:30:0) after 1m59s
[13:00:38.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:30:0)
[13:00:38.989] Build status: STARTED
[13:00:38.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:31:0) after 6m46s
[13:07:25.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:31:0)
[13:07:25.030] Build status: STARTED
[13:07:25.030] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:32:0) after 2m30s
[13:09:55.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:32:0)
[13:09:55.154] Build status: STARTED
[13:09:55.154] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:33:0) after 9m58s
[13:19:53.178] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:33:0)
[13:19:53.204] Build status: STARTED
[13:19:53.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:34:0) after 7m50s
[13:27:43.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:34:0)
[13:27:43.258] Build status: STARTED
[13:27:43.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:35:0) after 5m33s
[13:33:16.283] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:35:0)
[13:33:16.307] Build status: STARTED
[13:33:16.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:36:0) after 1m45s
[13:35:01.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:36:0)
[13:35:01.399] Build status: STARTED
[13:35:01.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:37:0) after 7m52s
[13:42:53.498] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:37:0)
[13:42:53.513] Build status: STARTED
[13:42:53.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:38:0) after 5m38s
[13:48:31.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:38:0)
[13:48:31.561] Build status: STARTED
[13:48:31.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:39:0) after 1m32s
[13:50:03.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:39:0)
[13:50:03.615] Build status: STARTED
[13:50:03.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:40:0) after 3m58s
[13:54:01.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:40:0)
[13:54:01.655] Build status: STARTED
[13:54:01.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:41:0) after 7m47s
[14:01:48.721] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:41:0)
[14:01:48.738] Build status: STARTED
[14:01:48.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:42:0) after 4m55s
[14:06:43.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:42:0)
[14:06:43.806] Build status: STARTED
[14:06:43.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:43:0) after 1m30s
[14:08:13.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:43:0)
[14:08:13.795] Build status: STARTED
[14:08:13.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:44:0) after 5m36s
[14:13:49.818] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:44:0)
[14:13:49.941] Build status: STARTED
[14:13:49.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:45:0) after 2m55s
[14:16:44.958] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:45:0)
[14:16:44.980] Build status: STARTED
[14:16:44.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:46:0) after 6m12s
[14:22:57.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:46:0)
[14:22:57.071] Build status: STARTED
[14:22:57.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:47:0) after 7m49s
[14:30:46.167] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:47:0)
[14:30:46.182] Build status: STARTED
[14:30:46.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:48:0) after 2m0s
[14:32:46.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:48:0)
[14:32:46.212] Build status: STARTED
[14:32:46.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:49:0) after 8m30s
[14:41:16.199] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:49:0)
[14:41:16.263] Build status: STARTED
[14:41:16.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:50:0) after 6m55s
[14:48:11.335] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:50:0)
[14:48:11.361] Build status: STARTED
[14:48:11.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:51:0) after 5m44s
[14:53:55.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:51:0)
[14:53:55.395] Build status: STARTED
[14:53:55.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:52:0) after 2m11s
[14:56:06.437] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:52:0)
[14:56:06.463] Build status: STARTED
[14:56:06.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:53:0) after 2m43s
[14:58:49.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:53:0)
[14:58:49.568] Build status: STARTED
[14:58:49.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:54:0) after 4m32s
[15:03:21.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:54:0)
[15:03:21.610] Build status: STARTED
[15:03:21.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:55:0) after 9m36s
[15:12:57.648] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:55:0)
[15:12:57.664] Build status: STARTED
[15:12:57.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:56:0) after 9m24s
[15:22:21.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:56:0)
[15:22:21.667] Build status: STARTED
[15:22:21.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:57:0) after 5m30s
[15:27:51.757] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:57:0)
[15:27:51.778] Build status: STARTED
[15:27:51.778] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:58:0) after 2m51s
[15:30:42.769] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:58:0)
[15:30:42.801] Build status: STARTED
[15:30:42.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:59:0) after 5m57s
[15:36:39.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:59:0)
[15:36:39.948] Build status: STARTED
[15:36:39.948] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:60:0) after 8m55s
[15:45:35.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:60:0)
[15:45:35.078] Build status: STARTED
[15:45:35.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:61:0) after 8m5s
[15:53:40.108] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:61:0)
[15:53:40.133] Build status: STARTED
[15:53:40.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:62:0) after 3m10s
[15:56:50.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:62:0)
[15:56:50.195] Build status: STARTED
[15:56:50.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:63:0) after 9m38s
[16:06:28.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:63:0)
[16:06:28.336] Build status: STARTED
[16:06:28.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:64:0) after 9m16s
[16:15:44.365] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:64:0)
[16:15:44.384] Build status: STARTED
[16:15:44.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:65:0) after 4m0s
[16:19:44.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:65:0)
[16:19:44.442] Build status: STARTED
[16:19:44.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:66:0) after 2m26s
[16:22:10.467] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:66:0)
[16:22:10.486] Build status: STARTED
[16:22:10.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:67:0) after 2m53s
[16:25:03.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:67:0)
[16:25:03.884] Build status: STARTED
[16:25:03.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:68:0) after 1m23s
[16:26:26.916] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:68:0)
[16:26:26.937] Build status: STARTED
[16:26:26.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:69:0) after 8m34s
[16:35:01.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:69:0)
[16:35:01.040] Build status: STARTED
[16:35:01.040] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:70:0) after 1m8s
[16:36:09.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:70:0)
[16:36:09.145] Build status: STARTED
[16:36:09.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:71:0) after 1m7s
[16:37:16.179] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:71:0)
[16:37:16.196] Build status: STARTED
[16:37:16.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:72:0) after 4m39s
[16:41:55.216] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:72:0)
[16:41:55.240] Build status: STARTED
[16:41:55.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:73:0) after 6m39s
[16:48:34.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:73:0)
[16:48:34.332] Build status: STARTED
[16:48:34.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:74:0) after 2m25s
[16:50:59.351] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:74:0)
[16:50:59.372] Build status: STARTED
[16:50:59.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:75:0) after 2m48s
[16:53:47.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:75:0)
[16:53:47.408] Build status: STARTED
[16:53:47.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:76:0) after 7m11s
[17:00:58.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:76:0)
[17:00:58.466] Build status: STARTED
[17:00:58.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:77:0) after 8m59s
[17:09:57.491] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:77:0)
[17:09:57.520] Build status: STARTED
[17:09:57.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:78:0) after 2m3s
[17:12:00.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:78:0)
[17:12:00.572] Build status: STARTED
[17:12:00.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:79:0) after 2m53s
[17:14:53.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:79:0)
[17:14:53.653] Build status: STARTED
[17:14:53.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:80:0) after 6m4s
[17:20:57.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:80:0)
[17:20:57.828] Build status: STARTED
[17:20:57.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:81:0) after 3m17s
[17:24:14.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:81:0)
[17:24:14.867] Build status: STARTED
[17:24:14.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:82:0) after 2m0s
[17:26:14.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:82:0)
[17:26:14.933] Build status: STARTED
[17:26:14.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:83:0) after 3m57s
[17:30:11.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:83:0)
[17:30:12.023] Build status: STARTED
[17:30:12.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:84:0) after 3m7s
[17:33:19.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:84:0)
[17:33:19.180] Build status: STARTED
[17:33:19.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:85:0) after 7m42s
[17:41:01.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:85:0)
[17:41:01.344] Build status: STARTED
[17:41:01.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:86:0) after 6m52s
[17:47:53.341] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:86:0)
[17:47:53.359] Build status: STARTED
[17:47:53.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:87:0) after 3m15s
[17:51:08.388] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:87:0)
[17:51:08.404] Build status: STARTED
[17:51:08.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:88:0) after 7m56s
[17:59:04.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:88:0)
[17:59:04.729] Build status: STARTED
[17:59:04.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:89:0) after 2m55s
[18:01:59.807] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:89:0)
[18:01:59.856] Build status: STARTED
[18:01:59.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:90:0) after 9m15s
[18:11:14.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:90:0)
[18:11:14.898] Build status: STARTED
[18:11:14.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:91:0) after 4m18s
[18:15:32.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:91:0)
[18:15:32.947] Build status: STARTED
[18:15:32.947] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:92:0) after 1m36s
[18:17:08.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:92:0)
[18:17:08.995] Build status: STARTED
[18:17:08.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:93:0) after 3m7s
[18:20:16.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:93:0)
[18:20:16.055] Build status: STARTED
[18:20:16.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:94:0) after 2m29s
[18:22:45.229] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:94:0)
[18:22:45.255] Build status: STARTED
[18:22:45.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:95:0) after 3m11s
[18:25:56.375] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:95:0)
[18:25:56.393] Build status: STARTED
[18:25:56.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:96:0) after 9m41s
[18:35:37.431] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:96:0)
[18:35:37.452] Build status: STARTED
[18:35:37.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:97:0) after 7m28s
[18:43:05.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:97:0)
[18:43:05.492] Build status: STARTED
[18:43:05.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:98:0) after 3m39s
[18:46:44.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:98:0)
[18:46:44.623] Build status: STARTED
[18:46:44.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:99:0) after 1m36s
[18:48:20.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:99:0)
[18:48:20.762] Build status: STARTED
[18:48:20.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:100:0) after 9m1s
[18:57:21.898] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:100:0)
[18:57:21.941] Build status: STARTED
[18:57:21.941] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:101:0) after 1m43s
[18:59:05.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:101:0)
[18:59:05.074] Build status: STARTED
[18:59:05.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:102:0) after 6m46s
[19:05:51.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:102:0)
[19:05:51.121] Build status: STARTED
[19:05:51.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:103:0) after 9m38s
[19:15:29.157] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:103:0)
[19:15:29.183] Build status: STARTED
[19:15:29.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8876525705382900688:104:0) after 5m5s
[19:19:20.261] Received PubSub notification, asking Buildbucket for the build status
[19:19:20.278] Build:
{
"id": "8711095643447254401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26109,
"createdBy": "project:chromium",
"createTime": "2025-06-25T10:53:59.293579863Z",
"startTime": "2025-06-25T10:54:58.221685747Z",
"endTime": "2025-06-25T19:19:19.848756149Z",
"updateTime": "2025-06-25T19:19:19.848756149Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bc4cdfd8b867cfc07204680c9abbd15fd7885526",
"ref": "refs/heads/main"
}
}
}
[19:19:20.278] Invocation finished in 8h25m22.214404306s with status FAILED