[17:55:30.061] New invocation is queued and will start shortly
[17:55:31.204] Starting the invocation (attempt 1)
[17:55:31.239] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/18d42d6bd1ec2734bbfa8ba883b85da632f08707"
[17:55:31.239] Popped gitiles commit info from properties and tags
[17:55:31.239] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:55:31.240] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:55:31.240] Buildbucket request:
{
"requestId": "8874506051550010016",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "18d42d6bd1ec2734bbfa8ba883b85da632f08707",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874506051550010016"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxTSan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:55:31.901] Scheduled build:
{
"id": "8709075989581764929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26196,
"createdBy": "project:chromium",
"createTime": "2025-07-17T17:55:31.313402831Z",
"updateTime": "2025-07-17T17:55:31.313402831Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "18d42d6bd1ec2734bbfa8ba883b85da632f08707",
"ref": "refs/heads/main"
}
}
}
[17:55:31.901] Task URL: https://cr-buildbucket.appspot.com/build/8709075989581764929
[17:55:31.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:2:0) after 7m1s
[17:55:32.144] Received PubSub notification, asking Buildbucket for the build status
[17:55:32.172] Build status: SCHEDULED
[17:56:33.976] Received PubSub notification, asking Buildbucket for the build status
[17:56:34.007] Build status: STARTED
[18:02:32.957] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:2:0)
[18:02:33.015] Build status: STARTED
[18:02:33.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:5:0) after 4m56s
[18:07:29.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:5:0)
[18:07:29.109] Build status: STARTED
[18:07:29.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:6:0) after 3m2s
[18:10:31.194] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:6:0)
[18:10:31.224] Build status: STARTED
[18:10:31.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:7:0) after 4m47s
[18:15:18.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:7:0)
[18:15:18.244] Build status: STARTED
[18:15:18.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:8:0) after 9m4s
[18:24:22.422] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:8:0)
[18:24:22.482] Build status: STARTED
[18:24:22.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:9:0) after 8m17s
[18:32:39.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:9:0)
[18:32:39.595] Build status: STARTED
[18:32:39.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:10:0) after 9m34s
[18:42:13.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:10:0)
[18:42:13.646] Build status: STARTED
[18:42:13.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:11:0) after 5m42s
[18:47:55.762] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:11:0)
[18:47:55.781] Build status: STARTED
[18:47:55.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:12:0) after 5m55s
[18:53:50.854] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:12:0)
[18:53:50.883] Build status: STARTED
[18:53:50.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:13:0) after 8m43s
[19:02:34.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:13:0)
[19:02:34.105] Build status: STARTED
[19:02:34.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:14:0) after 5m10s
[19:07:44.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:14:0)
[19:07:44.169] Build status: STARTED
[19:07:44.169] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:15:0) after 5m14s
[19:12:58.259] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:15:0)
[19:12:58.282] Build status: STARTED
[19:12:58.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:16:0) after 3m2s
[19:16:00.387] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:16:0)
[19:16:00.405] Build status: STARTED
[19:16:00.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:17:0) after 2m47s
[19:18:47.483] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:17:0)
[19:18:47.505] Build status: STARTED
[19:18:47.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:18:0) after 4m11s
[19:22:58.535] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:18:0)
[19:22:58.553] Build status: STARTED
[19:22:58.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:19:0) after 5m27s
[19:28:25.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:19:0)
[19:28:25.628] Build status: STARTED
[19:28:25.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:20:0) after 8m4s
[19:36:29.698] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:20:0)
[19:36:29.715] Build status: STARTED
[19:36:29.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:21:0) after 7m25s
[19:43:54.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:21:0)
[19:43:54.822] Build status: STARTED
[19:43:54.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:22:0) after 9m41s
[19:53:35.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:22:0)
[19:53:35.869] Build status: STARTED
[19:53:35.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:23:0) after 8m37s
[20:02:12.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:23:0)
[20:02:12.933] Build status: STARTED
[20:02:12.933] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:24:0) after 5m13s
[20:07:25.968] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:24:0)
[20:07:25.988] Build status: STARTED
[20:07:25.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:25:0) after 8m7s
[20:15:33.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:25:0)
[20:15:33.122] Build status: STARTED
[20:15:33.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:26:0) after 3m55s
[20:19:28.145] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:26:0)
[20:19:28.182] Build status: STARTED
[20:19:28.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:27:0) after 6m36s
[20:26:04.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:27:0)
[20:26:04.232] Build status: STARTED
[20:26:04.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:28:0) after 9m28s
[20:35:32.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:28:0)
[20:35:32.328] Build status: STARTED
[20:35:32.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:29:0) after 8m11s
[20:43:43.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:29:0)
[20:43:43.542] Build status: STARTED
[20:43:43.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:30:0) after 8m41s
[20:52:24.588] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:30:0)
[20:52:24.633] Build status: STARTED
[20:52:24.633] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:31:0) after 3m11s
[20:55:35.625] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:31:0)
[20:55:35.641] Build status: STARTED
[20:55:35.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:32:0) after 3m9s
[20:58:44.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:32:0)
[20:58:44.646] Build status: STARTED
[20:58:44.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:33:0) after 4m53s
[21:03:37.828] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:33:0)
[21:03:37.849] Build status: STARTED
[21:03:37.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:34:0) after 9m35s
[21:13:12.897] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:34:0)
[21:13:12.916] Build status: STARTED
[21:13:12.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:35:0) after 2m36s
[21:15:48.947] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:35:0)
[21:15:48.969] Build status: STARTED
[21:15:48.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:36:0) after 7m41s
[21:23:30.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:36:0)
[21:23:30.061] Build status: STARTED
[21:23:30.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:37:0) after 6m57s
[21:30:27.098] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:37:0)
[21:30:27.120] Build status: STARTED
[21:30:27.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:38:0) after 9m33s
[21:40:00.147] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:38:0)
[21:40:00.199] Build status: STARTED
[21:40:00.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:39:0) after 6m32s
[21:46:32.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:39:0)
[21:46:32.341] Build status: STARTED
[21:46:32.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:40:0) after 4m32s
[21:51:04.466] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:40:0)
[21:51:04.483] Build status: STARTED
[21:51:04.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:41:0) after 5m30s
[21:56:34.480] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:41:0)
[21:56:34.499] Build status: STARTED
[21:56:34.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:42:0) after 1m28s
[21:58:02.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:42:0)
[21:58:02.670] Build status: STARTED
[21:58:02.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:43:0) after 7m35s
[22:05:37.760] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:43:0)
[22:05:37.781] Build status: STARTED
[22:05:37.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:44:0) after 6m57s
[22:12:34.823] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:44:0)
[22:12:34.843] Build status: STARTED
[22:12:34.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:45:0) after 9m8s
[22:21:42.884] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:45:0)
[22:21:42.906] Build status: STARTED
[22:21:42.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:46:0) after 3m12s
[22:24:54.986] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:46:0)
[22:24:55.000] Build status: STARTED
[22:24:55.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:47:0) after 8m43s
[22:33:38.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:47:0)
[22:33:38.059] Build status: STARTED
[22:33:38.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:48:0) after 1m6s
[22:34:44.097] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:48:0)
[22:34:44.112] Build status: STARTED
[22:34:44.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:49:0) after 1m19s
[22:36:03.188] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:49:0)
[22:36:03.229] Build status: STARTED
[22:36:03.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:50:0) after 8m10s
[22:44:13.297] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:50:0)
[22:44:13.316] Build status: STARTED
[22:44:13.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:51:0) after 3m30s
[22:47:43.394] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:51:0)
[22:47:43.430] Build status: STARTED
[22:47:43.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:52:0) after 4m35s
[22:52:18.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:52:0)
[22:52:18.562] Build status: STARTED
[22:52:18.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:53:0) after 7m17s
[22:59:35.587] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:53:0)
[22:59:35.604] Build status: STARTED
[22:59:35.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:54:0) after 2m57s
[23:02:32.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:54:0)
[23:02:32.798] Build status: STARTED
[23:02:32.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:55:0) after 2m43s
[23:05:15.837] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:55:0)
[23:05:15.857] Build status: STARTED
[23:05:15.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:56:0) after 9m8s
[23:14:24.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:56:0)
[23:14:24.093] Build status: STARTED
[23:14:24.094] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:57:0) after 2m34s
[23:16:58.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:57:0)
[23:16:58.144] Build status: STARTED
[23:16:58.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:58:0) after 7m48s
[23:24:46.150] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:58:0)
[23:24:46.170] Build status: STARTED
[23:24:46.170] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:59:0) after 1m7s
[23:25:53.208] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:59:0)
[23:25:53.228] Build status: STARTED
[23:25:53.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:60:0) after 3m37s
[23:29:30.255] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:60:0)
[23:29:30.270] Build status: STARTED
[23:29:30.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:61:0) after 3m49s
[23:33:19.305] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:61:0)
[23:33:19.322] Build status: STARTED
[23:33:19.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:62:0) after 1m27s
[23:34:46.405] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:62:0)
[23:34:46.423] Build status: STARTED
[23:34:46.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:63:0) after 1m3s
[23:35:49.451] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:63:0)
[23:35:49.471] Build status: STARTED
[23:35:49.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:64:0) after 9m40s
[23:45:29.555] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:64:0)
[23:45:29.587] Build status: STARTED
[23:45:29.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:65:0) after 7m23s
[23:52:52.655] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:65:0)
[23:52:52.671] Build status: STARTED
[23:52:52.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:66:0) after 5m6s
[23:57:58.705] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:66:0)
[23:57:58.725] Build status: STARTED
[23:57:58.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:67:0) after 6m47s
[00:04:45.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:67:0)
[00:04:45.773] Build status: STARTED
[00:04:45.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:68:0) after 8m49s
[00:13:34.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:68:0)
[00:13:34.779] Build status: STARTED
[00:13:34.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:69:0) after 9m25s
[00:22:59.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:69:0)
[00:22:59.875] Build status: STARTED
[00:22:59.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:70:0) after 7m33s
[00:30:32.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:70:0)
[00:30:32.980] Build status: STARTED
[00:30:32.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:71:0) after 4m5s
[00:34:38.012] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:71:0)
[00:34:38.034] Build status: STARTED
[00:34:38.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:72:0) after 1m46s
[00:36:24.093] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:72:0)
[00:36:24.115] Build status: STARTED
[00:36:24.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:73:0) after 8m12s
[00:44:36.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:73:0)
[00:44:36.164] Build status: STARTED
[00:44:36.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:74:0) after 4m46s
[00:49:22.195] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:74:0)
[00:49:22.215] Build status: STARTED
[00:49:22.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:75:0) after 2m25s
[00:51:47.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:75:0)
[00:51:47.209] Build status: STARTED
[00:51:47.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:76:0) after 8m5s
[00:59:52.304] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:76:0)
[00:59:52.338] Build status: STARTED
[00:59:52.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:77:0) after 3m28s
[01:03:20.416] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:77:0)
[01:03:20.437] Build status: STARTED
[01:03:20.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:78:0) after 1m45s
[01:05:05.459] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:78:0)
[01:05:05.484] Build status: STARTED
[01:05:05.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:79:0) after 6m42s
[01:11:47.574] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:79:0)
[01:11:47.597] Build status: STARTED
[01:11:47.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:80:0) after 1m17s
[01:13:04.627] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:80:0)
[01:13:04.643] Build status: STARTED
[01:13:04.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:81:0) after 3m0s
[01:16:04.687] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:81:0)
[01:16:04.709] Build status: STARTED
[01:16:04.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:82:0) after 9m33s
[01:25:38.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:82:0)
[01:25:38.099] Build status: STARTED
[01:25:38.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:83:0) after 4m29s
[01:30:07.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:83:0)
[01:30:07.218] Build status: STARTED
[01:30:07.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:84:0) after 5m58s
[01:36:05.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:84:0)
[01:36:05.465] Build status: STARTED
[01:36:05.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:85:0) after 5m35s
[01:41:40.701] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:85:0)
[01:41:40.720] Build status: STARTED
[01:41:40.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:86:0) after 2m10s
[01:43:51.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:86:0)
[01:43:51.513] Build status: STARTED
[01:43:51.513] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:87:0) after 9m18s
[01:53:09.540] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:87:0)
[01:53:09.560] Build status: STARTED
[01:53:09.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:88:0) after 1m43s
[01:54:52.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:88:0)
[01:54:52.609] Build status: STARTED
[01:54:52.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxTSan:8874506051550010016:89:0) after 7m47s
[01:59:17.927] Received PubSub notification, asking Buildbucket for the build status
[01:59:17.946] Build:
{
"id": "8709075989581764929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxTSan"
},
"number": 26196,
"createdBy": "project:chromium",
"createTime": "2025-07-17T17:55:31.313402831Z",
"startTime": "2025-07-17T17:56:33.668454119Z",
"endTime": "2025-07-18T01:59:17.514335026Z",
"updateTime": "2025-07-18T01:59:17.514335026Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "18d42d6bd1ec2734bbfa8ba883b85da632f08707",
"ref": "refs/heads/main"
}
}
}
[01:59:17.946] Invocation finished in 8h3m47.893885318s with status FAILED