[18:51:01.394] New invocation is queued and will start shortly
[18:51:02.687] Starting the invocation (attempt 1)
[18:51:02.742] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/74622567e31a327016d406af1c50a849a6db4609"
[18:51:02.742] Popped gitiles commit info from properties and tags
[18:51:02.742] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:51:02.743] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:51:02.743] Buildbucket request:
{
"requestId": "8871512858518487328",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "74622567e31a327016d406af1c50a849a6db4609",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8871512858518487328"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:51:03.291] Scheduled build:
{
"id": "8706082796337479297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26880,
"createdBy": "project:chromium",
"createTime": "2025-08-19T18:51:02.834460278Z",
"updateTime": "2025-08-19T18:51:02.834460278Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "74622567e31a327016d406af1c50a849a6db4609",
"ref": "refs/heads/main"
}
}
}
[18:51:03.291] Task URL: https://cr-buildbucket.appspot.com/build/8706082796337479297
[18:51:03.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:2:0) after 6m3s
[18:51:04.405] Received PubSub notification, asking Buildbucket for the build status
[18:51:04.423] Build status: SCHEDULED
[18:52:14.655] Received PubSub notification, asking Buildbucket for the build status
[18:52:14.684] Build status: STARTED
[18:57:06.445] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:2:0)
[18:57:06.461] Build status: STARTED
[18:57:06.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:5:0) after 8m36s
[19:05:42.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:5:0)
[19:05:42.549] Build status: STARTED
[19:05:42.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:6:0) after 5m49s
[19:11:31.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:6:0)
[19:11:31.674] Build status: STARTED
[19:11:31.674] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:7:0) after 5m17s
[19:16:48.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:7:0)
[19:16:48.729] Build status: STARTED
[19:16:48.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:8:0) after 1m9s
[19:17:57.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:8:0)
[19:17:57.799] Build status: STARTED
[19:17:57.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:9:0) after 3m22s
[19:21:19.871] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:9:0)
[19:21:19.894] Build status: STARTED
[19:21:19.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:10:0) after 1m24s
[19:22:43.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:10:0)
[19:22:43.934] Build status: STARTED
[19:22:43.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:11:0) after 1m56s
[19:24:39.959] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:11:0)
[19:24:39.975] Build status: STARTED
[19:24:39.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:12:0) after 2m59s
[19:27:39.084] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:12:0)
[19:27:39.184] Build status: STARTED
[19:27:39.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:13:0) after 4m13s
[19:31:52.230] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:13:0)
[19:31:52.248] Build status: STARTED
[19:31:52.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:14:0) after 1m12s
[19:33:04.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:14:0)
[19:33:04.385] Build status: STARTED
[19:33:04.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:15:0) after 5m45s
[19:38:49.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:15:0)
[19:38:49.436] Build status: STARTED
[19:38:49.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:16:0) after 1m38s
[19:40:27.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:16:0)
[19:40:27.472] Build status: STARTED
[19:40:27.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:17:0) after 4m40s
[19:45:07.575] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:17:0)
[19:45:07.709] Build status: STARTED
[19:45:07.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:18:0) after 2m55s
[19:48:02.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:18:0)
[19:48:02.829] Build status: STARTED
[19:48:02.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:19:0) after 2m0s
[19:50:03.073] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:19:0)
[19:50:03.114] Build status: STARTED
[19:50:03.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:20:0) after 3m8s
[19:53:11.155] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:20:0)
[19:53:11.244] Build status: STARTED
[19:53:11.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:21:0) after 1m37s
[19:54:48.275] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:21:0)
[19:54:48.298] Build status: STARTED
[19:54:48.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:22:0) after 6m18s
[20:01:06.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:22:0)
[20:01:06.373] Build status: STARTED
[20:01:06.373] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:23:0) after 5m27s
[20:06:33.415] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:23:0)
[20:06:33.435] Build status: STARTED
[20:06:33.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:24:0) after 1m48s
[20:08:21.576] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:24:0)
[20:08:21.592] Build status: STARTED
[20:08:21.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:25:0) after 1m34s
[20:09:55.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:25:0)
[20:09:55.631] Build status: STARTED
[20:09:55.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:26:0) after 9m16s
[20:19:11.657] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:26:0)
[20:19:11.683] Build status: STARTED
[20:19:11.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:27:0) after 5m48s
[20:24:59.850] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:27:0)
[20:24:59.867] Build status: STARTED
[20:24:59.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:28:0) after 8m40s
[20:33:39.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:28:0)
[20:33:40.017] Build status: STARTED
[20:33:40.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:29:0) after 2m18s
[20:35:58.064] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:29:0)
[20:35:58.082] Build status: STARTED
[20:35:58.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:30:0) after 2m37s
[20:38:35.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:30:0)
[20:38:35.135] Build status: STARTED
[20:38:35.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:31:0) after 6m24s
[20:44:59.206] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:31:0)
[20:44:59.235] Build status: STARTED
[20:44:59.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:32:0) after 1m54s
[20:46:53.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:32:0)
[20:46:53.374] Build status: STARTED
[20:46:53.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:33:0) after 5m27s
[20:52:20.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:33:0)
[20:52:20.448] Build status: STARTED
[20:52:20.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:34:0) after 9m6s
[21:01:26.519] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:34:0)
[21:01:26.545] Build status: STARTED
[21:01:26.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:35:0) after 4m15s
[21:05:41.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:35:0)
[21:05:41.665] Build status: STARTED
[21:05:41.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:36:0) after 9m6s
[21:14:47.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:36:0)
[21:14:47.781] Build status: STARTED
[21:14:47.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:37:0) after 3m34s
[21:18:21.964] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:37:0)
[21:18:21.982] Build status: STARTED
[21:18:21.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:38:0) after 3m18s
[21:21:40.051] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:38:0)
[21:21:40.078] Build status: STARTED
[21:21:40.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:39:0) after 3m29s
[21:25:09.106] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:39:0)
[21:25:09.127] Build status: STARTED
[21:25:09.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:40:0) after 8m9s
[21:33:18.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:40:0)
[21:33:18.179] Build status: STARTED
[21:33:18.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:41:0) after 4m46s
[21:38:04.271] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:41:0)
[21:38:04.288] Build status: STARTED
[21:38:04.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:42:0) after 3m7s
[21:41:11.309] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:42:0)
[21:41:11.759] Build status: STARTED
[21:41:11.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:43:0) after 6m50s
[21:48:01.831] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:43:0)
[21:48:01.849] Build status: STARTED
[21:48:01.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:44:0) after 1m5s
[21:49:06.972] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:44:0)
[21:49:06.996] Build status: STARTED
[21:49:06.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:45:0) after 3m36s
[21:52:43.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:45:0)
[21:52:43.061] Build status: STARTED
[21:52:43.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:46:0) after 3m27s
[21:56:10.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:46:0)
[21:56:10.178] Build status: STARTED
[21:56:10.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:47:0) after 6m10s
[22:02:20.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:47:0)
[22:02:20.285] Build status: STARTED
[22:02:20.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:48:0) after 5m37s
[22:07:57.310] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:48:0)
[22:07:57.333] Build status: STARTED
[22:07:57.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:49:0) after 9m59s
[22:17:56.366] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:49:0)
[22:17:56.384] Build status: STARTED
[22:17:56.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:50:0) after 5m53s
[22:23:49.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:50:0)
[22:23:49.481] Build status: STARTED
[22:23:49.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:51:0) after 4m14s
[22:28:03.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:51:0)
[22:28:03.592] Build status: STARTED
[22:28:03.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:52:0) after 5m18s
[22:33:21.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:52:0)
[22:33:21.685] Build status: STARTED
[22:33:21.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:53:0) after 2m17s
[22:35:38.718] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:53:0)
[22:35:38.739] Build status: STARTED
[22:35:38.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:54:0) after 4m10s
[22:39:48.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:54:0)
[22:39:48.818] Build status: STARTED
[22:39:48.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:55:0) after 9m53s
[22:49:41.858] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:55:0)
[22:49:41.883] Build status: STARTED
[22:49:41.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:56:0) after 8m39s
[22:58:20.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:56:0)
[22:58:20.926] Build status: STARTED
[22:58:20.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:57:0) after 3m19s
[23:01:39.979] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:57:0)
[23:01:40.001] Build status: STARTED
[23:01:40.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:58:0) after 8m32s
[23:10:12.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:58:0)
[23:10:12.097] Build status: STARTED
[23:10:12.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:59:0) after 2m41s
[23:12:53.240] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:59:0)
[23:12:53.259] Build status: STARTED
[23:12:53.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:60:0) after 2m32s
[23:15:25.270] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:60:0)
[23:15:25.287] Build status: STARTED
[23:15:25.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:61:0) after 6m35s
[23:22:00.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:61:0)
[23:22:00.340] Build status: STARTED
[23:22:00.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:62:0) after 9m55s
[23:31:55.492] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:62:0)
[23:31:55.511] Build status: STARTED
[23:31:55.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:63:0) after 2m18s
[23:34:13.542] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:63:0)
[23:34:13.648] Build status: STARTED
[23:34:13.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:64:0) after 8m8s
[23:42:21.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:64:0)
[23:42:21.766] Build status: STARTED
[23:42:21.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:65:0) after 7m11s
[23:49:32.821] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:65:0)
[23:49:32.842] Build status: STARTED
[23:49:32.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:66:0) after 7m57s
[23:57:29.908] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:66:0)
[23:57:29.924] Build status: STARTED
[23:57:29.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:67:0) after 2m4s
[23:59:33.946] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:67:0)
[23:59:33.969] Build status: STARTED
[23:59:33.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:68:0) after 3m22s
[00:02:55.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:68:0)
[00:02:56.014] Build status: STARTED
[00:02:56.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:69:0) after 7m11s
[00:10:07.085] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:69:0)
[00:10:07.102] Build status: STARTED
[00:10:07.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:70:0) after 5m54s
[00:16:01.236] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:70:0)
[00:16:01.251] Build status: STARTED
[00:16:01.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:71:0) after 6m33s
[00:22:34.263] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:71:0)
[00:22:34.284] Build status: STARTED
[00:22:34.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:72:0) after 9m10s
[00:31:44.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:72:0)
[00:31:44.389] Build status: STARTED
[00:31:44.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:73:0) after 1m0s
[00:32:44.421] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:73:0)
[00:32:44.552] Build status: STARTED
[00:32:44.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:74:0) after 2m11s
[00:34:55.599] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:74:0)
[00:34:55.683] Build status: STARTED
[00:34:55.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:75:0) after 7m0s
[00:41:55.779] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:75:0)
[00:41:55.800] Build status: STARTED
[00:41:55.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:76:0) after 9m27s
[00:51:22.878] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:76:0)
[00:51:22.902] Build status: STARTED
[00:51:22.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:77:0) after 3m10s
[00:54:33.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:77:0)
[00:54:33.047] Build status: STARTED
[00:54:33.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:78:0) after 5m37s
[01:00:10.080] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:78:0)
[01:00:10.102] Build status: STARTED
[01:00:10.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:79:0) after 6m14s
[01:06:24.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:79:0)
[01:06:24.124] Build status: STARTED
[01:06:24.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:80:0) after 9m46s
[01:16:10.153] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:80:0)
[01:16:10.249] Build status: STARTED
[01:16:10.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:81:0) after 4m18s
[01:20:28.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:81:0)
[01:20:28.299] Build status: STARTED
[01:20:28.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:82:0) after 2m15s
[01:22:43.427] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:82:0)
[01:22:43.444] Build status: STARTED
[01:22:43.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:83:0) after 1m2s
[01:23:45.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:83:0)
[01:23:45.687] Build status: STARTED
[01:23:45.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:84:0) after 7m53s
[01:31:38.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:84:0)
[01:31:38.762] Build status: STARTED
[01:31:38.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:85:0) after 6m59s
[01:38:37.788] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:85:0)
[01:38:37.806] Build status: STARTED
[01:38:37.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:86:0) after 1m6s
[01:39:43.806] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:86:0)
[01:39:43.892] Build status: STARTED
[01:39:43.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:87:0) after 1m24s
[01:41:07.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:87:0)
[01:41:07.980] Build status: STARTED
[01:41:07.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:88:0) after 4m54s
[01:46:02.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:88:0)
[01:46:02.102] Build status: STARTED
[01:46:02.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:89:0) after 9m35s
[01:55:37.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:89:0)
[01:55:37.158] Build status: STARTED
[01:55:37.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:90:0) after 5m47s
[02:01:24.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:90:0)
[02:01:24.227] Build status: STARTED
[02:01:24.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:91:0) after 4m12s
[02:05:36.311] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:91:0)
[02:05:36.359] Build status: STARTED
[02:05:36.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:92:0) after 1m3s
[02:06:39.376] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:92:0)
[02:06:39.405] Build status: STARTED
[02:06:39.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8871512858518487328:93:0) after 9m58s
[02:10:06.882] Received PubSub notification, asking Buildbucket for the build status
[02:10:06.915] Build:
{
"id": "8706082796337479297",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26880,
"createdBy": "project:chromium",
"createTime": "2025-08-19T18:51:02.834460278Z",
"startTime": "2025-08-19T18:52:14.311536064Z",
"endTime": "2025-08-20T02:10:06.466162365Z",
"updateTime": "2025-08-20T02:10:06.466162365Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "74622567e31a327016d406af1c50a849a6db4609",
"ref": "refs/heads/main"
}
}
}
[02:10:06.915] Invocation finished in 7h19m5.544345938s with status FAILED