[02:19:20.886] New invocation is queued and will start shortly
[02:19:22.001] Starting the invocation (attempt 1)
[02:19:22.033] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/165b0ad128b0f4eda4cc1d38787b32afc32b74e7"
[02:19:22.033] Popped gitiles commit info from properties and tags
[02:19:22.034] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:19:22.034] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:19:22.034] Buildbucket request:
{
"requestId": "8867407788857303376",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "165b0ad128b0f4eda4cc1d38787b32afc32b74e7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867407788857303376"
},
{
"key": "scheduler_job_id",
"value": "chromium/CrWinAsan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:19:22.490] Scheduled build:
{
"id": "8701977726926895121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19594,
"createdBy": "project:chromium",
"createTime": "2025-10-04T02:19:22.098376348Z",
"updateTime": "2025-10-04T02:19:22.098376348Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "165b0ad128b0f4eda4cc1d38787b32afc32b74e7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:19:22.490] Task URL: https://cr-buildbucket.appspot.com/build/8701977726926895121
[02:19:22.490] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:2:0) after 5m20s
[02:19:23.473] Received PubSub notification, asking Buildbucket for the build status
[02:19:23.495] Build status: SCHEDULED
[02:24:42.504] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:2:0)
[02:24:42.519] Build status: SCHEDULED
[02:24:42.519] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:4:0) after 4m22s
[02:29:04.633] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:4:0)
[02:29:04.650] Build status: SCHEDULED
[02:29:04.650] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:5:0) after 3m2s
[02:32:06.663] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:5:0)
[02:32:06.681] Build status: SCHEDULED
[02:32:06.681] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:6:0) after 1m0s
[02:33:06.697] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:6:0)
[02:33:06.720] Build status: SCHEDULED
[02:33:06.720] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:7:0) after 4m53s
[02:37:59.788] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:7:0)
[02:37:59.812] Build status: SCHEDULED
[02:37:59.812] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:8:0) after 5m18s
[02:43:17.960] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:8:0)
[02:43:17.973] Build status: SCHEDULED
[02:43:17.973] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:9:0) after 1m46s
[02:45:04.032] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:9:0)
[02:45:04.051] Build status: SCHEDULED
[02:45:04.051] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:10:0) after 1m11s
[02:46:15.133] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:10:0)
[02:46:15.158] Build status: SCHEDULED
[02:46:15.158] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:11:0) after 4m38s
[02:50:53.322] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:11:0)
[02:50:53.345] Build status: SCHEDULED
[02:50:53.345] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:12:0) after 1m45s
[02:52:38.417] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:12:0)
[02:52:38.433] Build status: SCHEDULED
[02:52:38.433] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:13:0) after 2m35s
[02:55:13.465] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:13:0)
[02:55:13.482] Build status: SCHEDULED
[02:55:13.482] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:14:0) after 8m7s
[03:03:20.540] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:14:0)
[03:03:20.561] Build status: SCHEDULED
[03:03:20.561] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:15:0) after 5m17s
[03:08:37.595] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:15:0)
[03:08:37.610] Build status: SCHEDULED
[03:08:37.610] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:16:0) after 5m33s
[03:14:10.654] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:16:0)
[03:14:10.671] Build status: SCHEDULED
[03:14:10.671] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:17:0) after 2m24s
[03:14:59.768] Received PubSub notification, asking Buildbucket for the build status
[03:14:59.783] Build status: STARTED
[03:16:34.686] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:17:0)
[03:16:34.719] Build status: STARTED
[03:16:34.719] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:19:0) after 6m54s
[03:23:28.740] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:19:0)
[03:23:28.763] Build status: STARTED
[03:23:28.764] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:20:0) after 6m24s
[03:29:52.779] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:20:0)
[03:29:52.800] Build status: STARTED
[03:29:52.800] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:21:0) after 4m7s
[03:33:59.817] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:21:0)
[03:33:59.839] Build status: STARTED
[03:33:59.839] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:22:0) after 5m9s
[03:39:08.857] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:22:0)
[03:39:08.880] Build status: STARTED
[03:39:08.880] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:23:0) after 8m40s
[03:47:48.980] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:23:0)
[03:47:49.031] Build status: STARTED
[03:47:49.031] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:24:0) after 1m22s
[03:49:11.055] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:24:0)
[03:49:11.073] Build status: STARTED
[03:49:11.073] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:25:0) after 3m5s
[03:52:16.314] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:25:0)
[03:52:16.327] Build status: STARTED
[03:52:16.327] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:26:0) after 5m31s
[03:57:47.339] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:26:0)
[03:57:47.354] Build status: STARTED
[03:57:47.354] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:27:0) after 3m28s
[04:01:15.613] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:27:0)
[04:01:15.646] Build status: STARTED
[04:01:15.646] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:28:0) after 9m31s
[04:10:46.748] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:28:0)
[04:10:46.762] Build status: STARTED
[04:10:46.762] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:29:0) after 6m22s
[04:17:08.780] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:29:0)
[04:17:08.797] Build status: STARTED
[04:17:08.797] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:30:0) after 3m21s
[04:20:29.983] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:30:0)
[04:20:30.046] Build status: STARTED
[04:20:30.046] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:31:0) after 6m42s
[04:27:12.148] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:31:0)
[04:27:12.163] Build status: STARTED
[04:27:12.163] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:32:0) after 9m35s
[04:36:47.180] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:32:0)
[04:36:47.212] Build status: STARTED
[04:36:47.212] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:33:0) after 2m28s
[04:39:15.311] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:33:0)
[04:39:15.326] Build status: STARTED
[04:39:15.326] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:34:0) after 6m1s
[04:45:16.404] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:34:0)
[04:45:16.420] Build status: STARTED
[04:45:16.420] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:35:0) after 5m22s
[04:50:38.429] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:35:0)
[04:50:38.442] Build status: STARTED
[04:50:38.442] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:36:0) after 2m5s
[04:52:43.463] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:36:0)
[04:52:43.478] Build status: STARTED
[04:52:43.478] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:37:0) after 7m14s
[04:59:57.592] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:37:0)
[04:59:57.614] Build status: STARTED
[04:59:57.614] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:38:0) after 7m1s
[05:06:58.773] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:38:0)
[05:06:58.788] Build status: STARTED
[05:06:58.788] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:39:0) after 5m35s
[05:12:33.802] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:39:0)
[05:12:33.816] Build status: STARTED
[05:12:33.816] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:40:0) after 6m33s
[05:19:06.877] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:40:0)
[05:19:06.923] Build status: STARTED
[05:19:06.923] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:41:0) after 1m54s
[05:21:00.973] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:41:0)
[05:21:00.997] Build status: STARTED
[05:21:00.997] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:42:0) after 9m14s
[05:30:15.351] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:42:0)
[05:30:15.380] Build status: STARTED
[05:30:15.380] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:43:0) after 2m42s
[05:32:57.763] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:43:0)
[05:32:57.797] Build status: STARTED
[05:32:57.797] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:44:0) after 3m19s
[05:36:16.825] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:44:0)
[05:36:16.841] Build status: STARTED
[05:36:16.841] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:45:0) after 3m23s
[05:39:39.854] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:45:0)
[05:39:39.873] Build status: STARTED
[05:39:39.873] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:46:0) after 9m8s
[05:48:48.075] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:46:0)
[05:48:48.106] Build status: STARTED
[05:48:48.106] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:47:0) after 5m29s
[05:54:17.462] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:47:0)
[05:54:17.539] Build status: STARTED
[05:54:17.539] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:48:0) after 9m49s
[06:04:06.687] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:48:0)
[06:04:06.709] Build status: STARTED
[06:04:06.709] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:49:0) after 2m7s
[06:06:13.732] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:49:0)
[06:06:13.748] Build status: STARTED
[06:06:13.748] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:50:0) after 1m41s
[06:07:55.031] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:50:0)
[06:07:55.053] Build status: STARTED
[06:07:55.053] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:51:0) after 6m47s
[06:14:42.076] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:51:0)
[06:14:42.188] Build status: STARTED
[06:14:42.188] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:52:0) after 1m59s
[06:16:41.471] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:52:0)
[06:16:41.504] Build status: STARTED
[06:16:41.504] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:53:0) after 3m44s
[06:20:25.774] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:53:0)
[06:20:25.788] Build status: STARTED
[06:20:25.788] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:54:0) after 7m52s
[06:28:17.903] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:54:0)
[06:28:18.020] Build status: STARTED
[06:28:18.020] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:55:0) after 3m56s
[06:32:14.036] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:55:0)
[06:32:14.070] Build status: STARTED
[06:32:14.070] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:56:0) after 3m57s
[06:36:11.089] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:56:0)
[06:36:11.242] Build status: STARTED
[06:36:11.242] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:57:0) after 7m30s
[06:43:41.258] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:57:0)
[06:43:41.271] Build status: STARTED
[06:43:41.271] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:58:0) after 5m15s
[06:48:56.277] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:58:0)
[06:48:56.290] Build status: STARTED
[06:48:56.290] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:59:0) after 7m47s
[06:56:43.358] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:59:0)
[06:56:43.372] Build status: STARTED
[06:56:43.372] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:60:0) after 7m29s
[07:04:12.390] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:60:0)
[07:04:12.403] Build status: STARTED
[07:04:12.403] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:61:0) after 5m37s
[07:09:49.423] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:61:0)
[07:09:49.522] Build status: STARTED
[07:09:49.522] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:62:0) after 9m10s
[07:18:59.735] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:62:0)
[07:18:59.752] Build status: STARTED
[07:18:59.753] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:63:0) after 8m53s
[07:27:53.066] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:63:0)
[07:27:53.119] Build status: STARTED
[07:27:53.119] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:64:0) after 4m51s
[07:32:44.163] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:64:0)
[07:32:44.388] Build status: STARTED
[07:32:44.388] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:65:0) after 9m10s
[07:41:54.492] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:65:0)
[07:41:54.511] Build status: STARTED
[07:41:54.511] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:66:0) after 7m17s
[07:49:11.509] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:66:0)
[07:49:11.527] Build status: STARTED
[07:49:11.527] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:67:0) after 1m43s
[07:50:54.644] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:67:0)
[07:50:54.661] Build status: STARTED
[07:50:54.661] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:68:0) after 4m57s
[07:55:52.288] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:68:0)
[07:55:52.307] Build status: STARTED
[07:55:52.307] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:69:0) after 7m36s
[08:03:28.447] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:69:0)
[08:03:28.466] Build status: STARTED
[08:03:28.466] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:70:0) after 6m11s
[08:09:39.838] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:70:0)
[08:09:39.851] Build status: STARTED
[08:09:39.851] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:71:0) after 3m5s
[08:12:44.962] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:71:0)
[08:12:44.975] Build status: STARTED
[08:12:44.975] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:72:0) after 7m12s
[08:19:57.090] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:72:0)
[08:19:57.130] Build status: STARTED
[08:19:57.130] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:73:0) after 8m37s
[08:28:34.417] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:73:0)
[08:28:34.495] Build status: STARTED
[08:28:34.495] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:74:0) after 8m23s
[08:36:57.690] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:74:0)
[08:36:57.709] Build status: STARTED
[08:36:57.709] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:75:0) after 6m6s
[08:43:03.754] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:75:0)
[08:43:03.785] Build status: STARTED
[08:43:03.785] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:76:0) after 6m49s
[08:49:52.809] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:76:0)
[08:49:52.826] Build status: STARTED
[08:49:52.826] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:77:0) after 9m21s
[08:59:13.890] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:77:0)
[08:59:13.911] Build status: STARTED
[08:59:13.911] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:78:0) after 6m25s
[09:05:38.951] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:78:0)
[09:05:38.967] Build status: STARTED
[09:05:38.967] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:79:0) after 8m23s
[09:14:02.100] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:79:0)
[09:14:02.210] Build status: STARTED
[09:14:02.210] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:80:0) after 6m0s
[09:20:02.277] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:80:0)
[09:20:02.292] Build status: STARTED
[09:20:02.292] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:81:0) after 9m32s
[09:29:34.309] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:81:0)
[09:29:34.324] Build status: STARTED
[09:29:34.325] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:82:0) after 4m44s
[09:34:18.527] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:82:0)
[09:34:18.542] Build status: STARTED
[09:34:18.542] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:83:0) after 8m5s
[09:42:23.558] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:83:0)
[09:42:23.609] Build status: STARTED
[09:42:23.609] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:84:0) after 8m11s
[09:50:34.633] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:84:0)
[09:50:34.656] Build status: STARTED
[09:50:34.656] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:85:0) after 9m25s
[10:00:00.105] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:85:0)
[10:00:00.138] Build status: STARTED
[10:00:00.138] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:86:0) after 8m13s
[10:08:13.154] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:86:0)
[10:08:13.179] Build status: STARTED
[10:08:13.179] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:87:0) after 9m6s
[10:17:19.197] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:87:0)
[10:17:19.234] Build status: STARTED
[10:17:19.234] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:88:0) after 9m22s
[10:26:41.253] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:88:0)
[10:26:41.274] Build status: STARTED
[10:26:41.274] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:89:0) after 9m46s
[10:36:27.289] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:89:0)
[10:36:27.305] Build status: STARTED
[10:36:27.305] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:90:0) after 7m21s
[10:43:48.530] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:90:0)
[10:43:48.551] Build status: STARTED
[10:43:48.551] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:91:0) after 8m23s
[10:52:11.905] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:91:0)
[10:52:11.928] Build status: STARTED
[10:52:11.928] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:92:0) after 9m47s
[11:01:59.050] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:92:0)
[11:01:59.066] Build status: STARTED
[11:01:59.066] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:93:0) after 8m18s
[11:10:17.307] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:93:0)
[11:10:17.327] Build status: STARTED
[11:10:17.327] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:94:0) after 8m43s
[11:19:00.355] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:94:0)
[11:19:00.375] Build status: STARTED
[11:19:00.375] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:95:0) after 9m58s
[11:28:58.510] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:95:0)
[11:28:58.532] Build status: STARTED
[11:28:58.532] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:96:0) after 4m45s
[11:33:43.587] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:96:0)
[11:33:43.614] Build status: STARTED
[11:33:43.614] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:97:0) after 6m21s
[11:40:04.630] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:97:0)
[11:40:04.653] Build status: STARTED
[11:40:04.653] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:98:0) after 2m21s
[11:42:25.718] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:98:0)
[11:42:25.735] Build status: STARTED
[11:42:25.735] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:99:0) after 8m46s
[11:51:11.761] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:99:0)
[11:51:11.781] Build status: STARTED
[11:51:11.781] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:100:0) after 6m15s
[11:57:26.806] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:100:0)
[11:57:26.821] Build status: STARTED
[11:57:26.821] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:101:0) after 6m23s
[12:03:49.867] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:101:0)
[12:03:49.883] Build status: STARTED
[12:03:49.883] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:102:0) after 7m9s
[12:10:58.898] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:102:0)
[12:10:58.959] Build status: STARTED
[12:10:58.959] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:103:0) after 2m51s
[12:13:50.056] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:103:0)
[12:13:50.067] Build status: STARTED
[12:13:50.067] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:104:0) after 7m44s
[12:21:34.376] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:104:0)
[12:21:34.410] Build status: STARTED
[12:21:34.410] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:105:0) after 3m42s
[12:25:16.489] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:105:0)
[12:25:16.512] Build status: STARTED
[12:25:16.512] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:106:0) after 6m45s
[12:32:01.715] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:106:0)
[12:32:01.789] Build status: STARTED
[12:32:01.789] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:107:0) after 6m59s
[12:39:00.811] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:107:0)
[12:39:00.829] Build status: STARTED
[12:39:00.829] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:108:0) after 8m50s
[12:47:51.110] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:108:0)
[12:47:51.127] Build status: STARTED
[12:47:51.128] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:109:0) after 6m25s
[12:54:16.148] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:109:0)
[12:54:16.179] Build status: STARTED
[12:54:16.179] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:110:0) after 9m46s
[13:04:02.248] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:110:0)
[13:04:02.270] Build status: STARTED
[13:04:02.270] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:111:0) after 5m14s
[13:09:16.342] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:111:0)
[13:09:16.355] Build status: STARTED
[13:09:16.355] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:112:0) after 5m37s
[13:14:53.411] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:112:0)
[13:14:53.429] Build status: STARTED
[13:14:53.429] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:113:0) after 9m27s
[13:24:20.481] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:113:0)
[13:24:20.504] Build status: STARTED
[13:24:20.504] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:114:0) after 6m23s
[13:30:43.656] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:114:0)
[13:30:43.675] Build status: STARTED
[13:30:43.675] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:115:0) after 5m11s
[13:35:54.694] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:115:0)
[13:35:54.715] Build status: STARTED
[13:35:54.715] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:116:0) after 1m40s
[13:37:34.812] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:116:0)
[13:37:34.830] Build status: STARTED
[13:37:34.830] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:117:0) after 3m28s
[13:41:02.849] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:117:0)
[13:41:02.882] Build status: STARTED
[13:41:02.882] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:118:0) after 5m0s
[13:46:02.901] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:118:0)
[13:46:02.919] Build status: STARTED
[13:46:02.919] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:119:0) after 3m37s
[13:49:39.926] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:119:0)
[13:49:39.940] Build status: STARTED
[13:49:39.940] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:120:0) after 7m21s
[13:57:01.252] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:120:0)
[13:57:01.268] Build status: STARTED
[13:57:01.268] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:121:0) after 6m17s
[14:03:18.641] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:121:0)
[14:03:18.659] Build status: STARTED
[14:03:18.659] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:122:0) after 1m15s
[14:04:33.832] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:122:0)
[14:04:33.846] Build status: STARTED
[14:04:33.847] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:123:0) after 1m56s
[14:06:30.214] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:123:0)
[14:06:30.266] Build status: STARTED
[14:06:30.266] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:124:0) after 3m51s
[14:10:21.367] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:124:0)
[14:10:21.406] Build status: STARTED
[14:10:21.407] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:125:0) after 2m14s
[14:12:35.953] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:125:0)
[14:12:35.968] Build status: STARTED
[14:12:35.968] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:126:0) after 4m41s
[14:17:17.084] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:126:0)
[14:17:17.102] Build status: STARTED
[14:17:17.102] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:127:0) after 6m2s
[14:23:19.131] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:127:0)
[14:23:19.148] Build status: STARTED
[14:23:19.148] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:128:0) after 7m43s
[14:31:02.143] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:128:0)
[14:31:02.160] Build status: STARTED
[14:31:02.160] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:129:0) after 7m54s
[14:38:56.178] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:129:0)
[14:38:56.193] Build status: STARTED
[14:38:56.193] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:130:0) after 4m30s
[14:43:26.309] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:130:0)
[14:43:26.327] Build status: STARTED
[14:43:26.327] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:131:0) after 6m4s
[14:49:30.354] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:131:0)
[14:49:30.369] Build status: STARTED
[14:49:30.369] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:132:0) after 5m12s
[14:54:42.502] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:132:0)
[14:54:42.517] Build status: STARTED
[14:54:42.517] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:133:0) after 3m43s
[14:58:25.536] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:133:0)
[14:58:25.552] Build status: STARTED
[14:58:25.553] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:134:0) after 3m1s
[15:01:26.737] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:134:0)
[15:01:26.761] Build status: STARTED
[15:01:26.761] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:135:0) after 9m45s
[15:11:12.039] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:135:0)
[15:11:12.057] Build status: STARTED
[15:11:12.057] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:136:0) after 4m20s
[15:15:32.138] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:136:0)
[15:15:32.150] Build status: STARTED
[15:15:32.150] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:137:0) after 4m25s
[15:19:57.273] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:137:0)
[15:19:57.291] Build status: STARTED
[15:19:57.291] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:138:0) after 1m44s
[15:21:41.412] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:138:0)
[15:21:41.431] Build status: STARTED
[15:21:41.431] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:139:0) after 1m1s
[15:22:42.712] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:139:0)
[15:22:42.729] Build status: STARTED
[15:22:42.729] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:140:0) after 6m11s
[15:28:53.853] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:140:0)
[15:28:53.871] Build status: STARTED
[15:28:53.871] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:141:0) after 5m19s
[15:34:13.197] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:141:0)
[15:34:13.214] Build status: STARTED
[15:34:13.214] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:142:0) after 4m30s
[15:38:43.393] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:142:0)
[15:38:43.416] Build status: STARTED
[15:38:43.416] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:143:0) after 8m1s
[15:46:44.482] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:143:0)
[15:46:44.495] Build status: STARTED
[15:46:44.495] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:144:0) after 5m55s
[15:52:39.850] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:144:0)
[15:52:39.872] Build status: STARTED
[15:52:39.872] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:145:0) after 8m3s
[16:00:43.037] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:145:0)
[16:00:43.059] Build status: STARTED
[16:00:43.059] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:146:0) after 9m33s
[16:10:16.149] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:146:0)
[16:10:16.168] Build status: STARTED
[16:10:16.168] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8867407788857303376:147:0) after 8m22s
[16:13:41.322] Received PubSub notification, asking Buildbucket for the build status
[16:13:41.338] Build:
{
"id": "8701977726926895121",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19594,
"createdBy": "project:chromium",
"createTime": "2025-10-04T02:19:22.098376348Z",
"startTime": "2025-10-04T03:14:56.531245706Z",
"endTime": "2025-10-04T16:13:41.060448924Z",
"updateTime": "2025-10-04T16:13:41.060448924Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "165b0ad128b0f4eda4cc1d38787b32afc32b74e7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:13:41.338] Invocation finished in 13h54m20.464106182s with status FAILED