[22:16:35.462] New invocation is queued and will start shortly
[22:16:36.598] Starting the invocation (attempt 1)
[22:16:36.628] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/bb3145db720169a8f728399c6ba2d775944e027d"
[22:16:36.628] Popped gitiles commit info from properties and tags
[22:16:36.628] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:16:36.628] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:16:36.629] Buildbucket request:
{
"requestId": "8878113503845163680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb3145db720169a8f728399c6ba2d775944e027d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878113503845163680"
},
{
"key": "scheduler_job_id",
"value": "chromium/CrWinAsan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:16:37.341] Scheduled build:
{
"id": "8712683441902033041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19002,
"createdBy": "project:chromium",
"createTime": "2025-06-07T22:16:36.688261111Z",
"updateTime": "2025-06-07T22:16:36.688261111Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb3145db720169a8f728399c6ba2d775944e027d",
"ref": "refs/heads/main"
}
}
}
[22:16:37.341] Task URL: https://cr-buildbucket.appspot.com/build/8712683441902033041
[22:16:37.341] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:2:0) after 6m44s
[22:16:38.211] Received PubSub notification, asking Buildbucket for the build status
[22:16:38.232] Build status: SCHEDULED
[22:23:21.788] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:2:0)
[22:23:21.807] Build status: SCHEDULED
[22:23:21.807] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:4:0) after 2m49s
[22:26:10.832] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:4:0)
[22:26:10.853] Build status: SCHEDULED
[22:26:10.854] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:5:0) after 1m12s
[22:27:22.986] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:5:0)
[22:27:23.020] Build status: SCHEDULED
[22:27:23.020] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:6:0) after 9m12s
[22:36:35.264] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:6:0)
[22:36:35.297] Build status: SCHEDULED
[22:36:35.297] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:7:0) after 3m34s
[22:40:09.317] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:7:0)
[22:40:09.349] Build status: SCHEDULED
[22:40:09.349] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:8:0) after 7m25s
[22:47:34.503] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:8:0)
[22:47:34.547] Build status: SCHEDULED
[22:47:34.547] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:9:0) after 8m34s
[22:56:08.672] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:9:0)
[22:56:08.698] Build status: SCHEDULED
[22:56:08.698] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:10:0) after 9m25s
[23:05:33.733] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:10:0)
[23:05:33.763] Build status: SCHEDULED
[23:05:33.763] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:11:0) after 4m53s
[23:10:26.806] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:11:0)
[23:10:26.831] Build status: SCHEDULED
[23:10:26.831] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:12:0) after 1m57s
[23:12:23.894] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:12:0)
[23:12:23.915] Build status: SCHEDULED
[23:12:23.915] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:13:0) after 9m21s
[23:21:44.935] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:13:0)
[23:21:44.962] Build status: SCHEDULED
[23:21:44.962] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:14:0) after 5m56s
[23:27:40.971] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:14:0)
[23:27:40.992] Build status: SCHEDULED
[23:27:40.992] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:15:0) after 1m44s
[23:29:25.585] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:15:0)
[23:29:25.607] Build status: SCHEDULED
[23:29:25.607] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:16:0) after 1m25s
[23:30:51.268] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:16:0)
[23:30:51.293] Build status: SCHEDULED
[23:30:51.293] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:17:0) after 8m17s
[23:39:08.381] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:17:0)
[23:39:08.404] Build status: SCHEDULED
[23:39:08.404] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:18:0) after 6m53s
[23:46:01.423] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:18:0)
[23:46:01.457] Build status: SCHEDULED
[23:46:01.457] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:19:0) after 1m56s
[23:46:27.316] Received PubSub notification, asking Buildbucket for the build status
[23:46:27.332] Build status: STARTED
[23:47:57.578] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:19:0)
[23:47:57.636] Build status: STARTED
[23:47:57.636] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:21:0) after 9m3s
[23:57:00.658] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:21:0)
[23:57:00.680] Build status: STARTED
[23:57:00.680] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:22:0) after 3m2s
[00:00:02.688] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:22:0)
[00:00:02.731] Build status: STARTED
[00:00:02.731] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:23:0) after 8m12s
[00:08:14.755] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:23:0)
[00:08:14.825] Build status: STARTED
[00:08:14.825] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:24:0) after 2m37s
[00:10:52.019] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:24:0)
[00:10:52.060] Build status: STARTED
[00:10:52.060] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:25:0) after 4m35s
[00:15:27.140] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:25:0)
[00:15:27.161] Build status: STARTED
[00:15:27.161] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:26:0) after 3m48s
[00:19:15.176] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:26:0)
[00:19:15.194] Build status: STARTED
[00:19:15.194] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:27:0) after 7m57s
[00:27:12.216] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:27:0)
[00:27:12.269] Build status: STARTED
[00:27:12.269] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:28:0) after 7m25s
[00:34:37.297] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:28:0)
[00:34:37.329] Build status: STARTED
[00:34:37.329] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:29:0) after 8m1s
[00:42:38.351] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:29:0)
[00:42:38.367] Build status: STARTED
[00:42:38.367] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:30:0) after 6m49s
[00:49:27.388] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:30:0)
[00:49:27.515] Build status: STARTED
[00:49:27.515] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:31:0) after 3m59s
[00:53:26.692] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:31:0)
[00:53:26.718] Build status: STARTED
[00:53:26.718] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:32:0) after 6m2s
[00:59:28.834] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:32:0)
[00:59:28.903] Build status: STARTED
[00:59:28.903] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:33:0) after 8m0s
[01:07:28.935] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:33:0)
[01:07:28.952] Build status: STARTED
[01:07:28.952] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:34:0) after 8m16s
[01:15:45.175] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:34:0)
[01:15:45.198] Build status: STARTED
[01:15:45.198] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:35:0) after 3m16s
[01:19:01.442] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:35:0)
[01:19:01.463] Build status: STARTED
[01:19:01.463] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:36:0) after 6m23s
[01:25:24.506] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:36:0)
[01:25:24.548] Build status: STARTED
[01:25:24.548] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:37:0) after 3m22s
[01:28:46.912] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:37:0)
[01:28:46.927] Build status: STARTED
[01:28:46.927] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:38:0) after 8m42s
[01:37:29.143] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:38:0)
[01:37:29.160] Build status: STARTED
[01:37:29.160] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:39:0) after 2m9s
[01:39:38.366] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:39:0)
[01:39:38.389] Build status: STARTED
[01:39:38.389] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:40:0) after 4m29s
[01:44:07.692] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:40:0)
[01:44:07.711] Build status: STARTED
[01:44:07.711] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:41:0) after 3m7s
[01:47:14.730] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:41:0)
[01:47:14.757] Build status: STARTED
[01:47:14.757] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:42:0) after 4m46s
[01:52:00.811] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:42:0)
[01:52:00.835] Build status: STARTED
[01:52:00.835] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:43:0) after 9m13s
[02:01:13.908] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:43:0)
[02:01:13.941] Build status: STARTED
[02:01:13.941] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:44:0) after 2m26s
[02:03:40.042] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:44:0)
[02:03:40.058] Build status: STARTED
[02:03:40.058] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:45:0) after 8m20s
[02:12:00.189] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:45:0)
[02:12:00.206] Build status: STARTED
[02:12:00.206] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:46:0) after 7m21s
[02:19:21.283] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:46:0)
[02:19:21.355] Build status: STARTED
[02:19:21.355] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:47:0) after 1m26s
[02:20:47.775] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:47:0)
[02:20:47.868] Build status: STARTED
[02:20:47.868] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:48:0) after 5m26s
[02:26:14.338] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:48:0)
[02:26:14.387] Build status: STARTED
[02:26:14.388] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:49:0) after 1m28s
[02:27:42.428] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:49:0)
[02:27:42.446] Build status: STARTED
[02:27:42.446] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:50:0) after 1m18s
[02:29:00.503] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:50:0)
[02:29:00.525] Build status: STARTED
[02:29:00.525] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:51:0) after 9m51s
[02:38:51.624] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:51:0)
[02:38:51.640] Build status: STARTED
[02:38:51.640] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:52:0) after 3m26s
[02:42:17.663] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:52:0)
[02:42:17.679] Build status: STARTED
[02:42:17.679] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:53:0) after 2m43s
[02:45:00.941] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:53:0)
[02:45:00.958] Build status: STARTED
[02:45:00.958] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:54:0) after 3m54s
[02:48:55.033] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:54:0)
[02:48:55.067] Build status: STARTED
[02:48:55.067] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:55:0) after 8m42s
[02:57:37.057] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:55:0)
[02:57:37.082] Build status: STARTED
[02:57:37.082] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:56:0) after 4m19s
[03:01:56.242] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:56:0)
[03:01:56.263] Build status: STARTED
[03:01:56.263] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:57:0) after 1m7s
[03:03:03.276] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:57:0)
[03:03:03.548] Build status: STARTED
[03:03:03.548] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:58:0) after 2m14s
[03:05:17.565] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:58:0)
[03:05:17.604] Build status: STARTED
[03:05:17.604] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:59:0) after 3m26s
[03:08:43.728] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:59:0)
[03:08:43.752] Build status: STARTED
[03:08:43.752] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:60:0) after 7m39s
[03:16:23.024] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:60:0)
[03:16:23.044] Build status: STARTED
[03:16:23.044] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:61:0) after 3m39s
[03:20:02.267] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:61:0)
[03:20:02.286] Build status: STARTED
[03:20:02.286] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:62:0) after 2m52s
[03:22:54.562] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:62:0)
[03:22:54.580] Build status: STARTED
[03:22:54.580] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:63:0) after 2m55s
[03:25:49.607] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:63:0)
[03:25:49.626] Build status: STARTED
[03:25:49.626] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:64:0) after 7m13s
[03:33:03.099] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:64:0)
[03:33:03.121] Build status: STARTED
[03:33:03.121] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:65:0) after 2m14s
[03:35:17.147] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:65:0)
[03:35:17.227] Build status: STARTED
[03:35:17.227] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:66:0) after 9m25s
[03:44:42.269] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:66:0)
[03:44:42.287] Build status: STARTED
[03:44:42.287] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:67:0) after 1m40s
[03:46:22.309] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:67:0)
[03:46:22.339] Build status: STARTED
[03:46:22.339] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:68:0) after 9m58s
[03:56:20.397] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:68:0)
[03:56:20.437] Build status: STARTED
[03:56:20.437] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:69:0) after 2m11s
[03:58:31.536] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:69:0)
[03:58:31.576] Build status: STARTED
[03:58:31.576] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8878113503845163680:70:0) after 7m50s
[04:05:50.674] Received PubSub notification, asking Buildbucket for the build status
[04:05:50.697] Build:
{
"id": "8712683441902033041",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 19002,
"createdBy": "project:chromium",
"createTime": "2025-06-07T22:16:36.688261111Z",
"startTime": "2025-06-07T23:46:27.148122696Z",
"endTime": "2025-06-08T04:05:50.333141791Z",
"updateTime": "2025-06-08T04:05:50.333141791Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "bb3145db720169a8f728399c6ba2d775944e027d",
"ref": "refs/heads/main"
}
}
}
[04:05:50.697] Invocation finished in 5h49m15.245440252s with status FAILED