[23:15:19.399] New invocation is queued and will start shortly
[23:15:20.851] Starting the invocation (attempt 1)
[23:15:20.886] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d5a0efe79b57a7d1d5d6c3f8de297b7c225da3fe"
[23:15:20.886] Popped gitiles commit info from properties and tags
[23:15:20.886] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:15:20.886] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:15:20.886] Buildbucket request:
{
"requestId": "8892877114256243200",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5a0efe79b57a7d1d5d6c3f8de297b7c225da3fe",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8892877114256243200"
},
{
"key": "scheduler_job_id",
"value": "chromium/CrWinAsan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:15:21.457] Scheduled build:
{
"id": "8727447051905447681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 17950,
"createdBy": "project:chromium",
"createTime": "2024-12-26T23:15:21.010988816Z",
"updateTime": "2024-12-26T23:15:21.010988816Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5a0efe79b57a7d1d5d6c3f8de297b7c225da3fe",
"ref": "refs/heads/main"
}
}
}
[23:15:21.457] Task URL: https://cr-buildbucket.appspot.com/build/8727447051905447681
[23:15:21.457] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:2:0) after 9m44s
[23:15:22.510] Received PubSub notification, asking Buildbucket for the build status
[23:15:22.535] Build status: SCHEDULED
[23:25:06.144] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:2:0)
[23:25:06.244] Build status: SCHEDULED
[23:25:06.244] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:4:0) after 9m9s
[23:34:15.236] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:4:0)
[23:34:15.260] Build status: SCHEDULED
[23:34:15.261] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:5:0) after 4m45s
[23:39:00.283] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:5:0)
[23:39:00.307] Build status: SCHEDULED
[23:39:00.307] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:6:0) after 5m40s
[23:44:40.308] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:6:0)
[23:44:40.332] Build status: SCHEDULED
[23:44:40.332] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:7:0) after 3m49s
[23:48:29.573] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:7:0)
[23:48:29.590] Build status: SCHEDULED
[23:48:29.590] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:8:0) after 2m49s
[23:51:18.862] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:8:0)
[23:51:18.888] Build status: SCHEDULED
[23:51:18.888] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:9:0) after 6m44s
[23:58:02.929] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:9:0)
[23:58:02.962] Build status: SCHEDULED
[23:58:02.962] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:10:0) after 2m20s
[00:00:23.301] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:10:0)
[00:00:23.325] Build status: SCHEDULED
[00:00:23.325] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:11:0) after 6m28s
[00:06:51.349] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:11:0)
[00:06:51.377] Build status: SCHEDULED
[00:06:51.377] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:12:0) after 1m1s
[00:07:52.503] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:12:0)
[00:07:52.530] Build status: SCHEDULED
[00:07:52.530] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:13:0) after 8m3s
[00:15:55.555] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:13:0)
[00:15:55.626] Build status: SCHEDULED
[00:15:55.626] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:14:0) after 2m27s
[00:18:22.737] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:14:0)
[00:18:22.767] Build status: SCHEDULED
[00:18:22.767] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:15:0) after 3m26s
[00:21:48.794] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:15:0)
[00:21:48.811] Build status: SCHEDULED
[00:21:48.811] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:16:0) after 1m28s
[00:23:16.901] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:16:0)
[00:23:16.967] Build status: SCHEDULED
[00:23:16.967] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:17:0) after 2m36s
[00:25:53.022] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:17:0)
[00:25:53.044] Build status: SCHEDULED
[00:25:53.044] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:18:0) after 6m44s
[00:32:37.088] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:18:0)
[00:32:37.104] Build status: SCHEDULED
[00:32:37.104] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:19:0) after 9m52s
[00:42:29.122] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:19:0)
[00:42:29.146] Build status: SCHEDULED
[00:42:29.146] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:20:0) after 6m44s
[00:49:13.578] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:20:0)
[00:49:13.596] Build status: SCHEDULED
[00:49:13.596] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:21:0) after 9m53s
[00:59:06.621] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:21:0)
[00:59:06.639] Build status: SCHEDULED
[00:59:06.640] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:22:0) after 7m37s
[01:06:44.355] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:22:0)
[01:06:44.372] Build status: SCHEDULED
[01:06:44.372] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:23:0) after 7m34s
[01:14:18.608] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:23:0)
[01:14:18.629] Build status: SCHEDULED
[01:14:18.629] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:24:0) after 5m24s
[01:19:42.873] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:24:0)
[01:19:42.897] Build status: SCHEDULED
[01:19:42.897] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:25:0) after 3m12s
[01:22:55.095] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:25:0)
[01:22:55.113] Build status: SCHEDULED
[01:22:55.113] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:26:0) after 3m46s
[01:26:41.132] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:26:0)
[01:26:41.148] Build status: SCHEDULED
[01:26:41.148] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:27:0) after 9m22s
[01:36:03.214] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:27:0)
[01:36:03.239] Build status: SCHEDULED
[01:36:03.239] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:28:0) after 9m42s
[01:45:45.425] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:28:0)
[01:45:45.441] Build status: SCHEDULED
[01:45:45.441] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:29:0) after 4m44s
[01:50:29.486] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:29:0)
[01:50:29.503] Build status: SCHEDULED
[01:50:29.503] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:30:0) after 8m5s
[01:58:34.585] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:30:0)
[01:58:34.688] Build status: SCHEDULED
[01:58:34.688] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:31:0) after 9m13s
[02:07:47.707] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:31:0)
[02:07:47.734] Build status: SCHEDULED
[02:07:47.734] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:32:0) after 5m40s
[02:13:28.005] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:32:0)
[02:13:28.022] Build status: SCHEDULED
[02:13:28.022] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:33:0) after 5m53s
[02:19:21.087] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:33:0)
[02:19:21.102] Build status: SCHEDULED
[02:19:21.102] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:34:0) after 4m24s
[02:23:45.228] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:34:0)
[02:23:45.246] Build status: SCHEDULED
[02:23:45.246] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:35:0) after 5m37s
[02:29:22.361] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:35:0)
[02:29:22.380] Build status: SCHEDULED
[02:29:22.380] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:36:0) after 1m8s
[02:30:30.408] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:36:0)
[02:30:30.423] Build status: SCHEDULED
[02:30:30.423] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:37:0) after 1m31s
[02:32:01.444] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:37:0)
[02:32:01.465] Build status: SCHEDULED
[02:32:01.465] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:38:0) after 3m44s
[02:35:45.544] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:38:0)
[02:35:45.564] Build status: SCHEDULED
[02:35:45.564] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:39:0) after 6m0s
[02:41:45.671] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:39:0)
[02:41:45.687] Build status: SCHEDULED
[02:41:45.687] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:40:0) after 8m43s
[02:50:29.143] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:40:0)
[02:50:29.173] Build status: SCHEDULED
[02:50:29.173] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:41:0) after 9m43s
[03:00:12.224] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:41:0)
[03:00:12.253] Build status: SCHEDULED
[03:00:12.253] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:42:0) after 3m58s
[03:04:10.403] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:42:0)
[03:04:10.426] Build status: SCHEDULED
[03:04:10.426] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:43:0) after 9m41s
[03:13:51.912] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:43:0)
[03:13:51.925] Build status: SCHEDULED
[03:13:51.925] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:44:0) after 4m13s
[03:18:04.968] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:44:0)
[03:18:04.997] Build status: SCHEDULED
[03:18:04.997] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:45:0) after 5m48s
[03:23:53.127] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:45:0)
[03:23:53.145] Build status: SCHEDULED
[03:23:53.145] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:46:0) after 2m19s
[03:26:12.147] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:46:0)
[03:26:12.167] Build status: SCHEDULED
[03:26:12.167] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:47:0) after 4m4s
[03:30:16.337] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:47:0)
[03:30:16.352] Build status: SCHEDULED
[03:30:16.352] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:48:0) after 8m24s
[03:38:40.547] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:48:0)
[03:38:40.564] Build status: SCHEDULED
[03:38:40.564] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:49:0) after 5m34s
[03:44:14.741] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:49:0)
[03:44:14.762] Build status: SCHEDULED
[03:44:14.762] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:50:0) after 9m13s
[03:53:27.784] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:50:0)
[03:53:27.824] Build status: SCHEDULED
[03:53:27.824] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:51:0) after 6m54s
[04:00:22.243] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:51:0)
[04:00:22.260] Build status: SCHEDULED
[04:00:22.260] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:52:0) after 9m15s
[04:09:37.428] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:52:0)
[04:09:37.451] Build status: SCHEDULED
[04:09:37.451] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:53:0) after 8m18s
[04:17:55.493] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:53:0)
[04:17:55.512] Build status: SCHEDULED
[04:17:55.512] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:54:0) after 8m12s
[04:26:07.538] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:54:0)
[04:26:07.737] Build status: SCHEDULED
[04:26:07.737] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:55:0) after 5m6s
[04:31:13.988] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:55:0)
[04:31:14.033] Build status: SCHEDULED
[04:31:14.033] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:56:0) after 5m1s
[04:36:15.115] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:56:0)
[04:36:15.134] Build status: SCHEDULED
[04:36:15.134] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:57:0) after 3m18s
[04:39:33.204] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:57:0)
[04:39:33.221] Build status: SCHEDULED
[04:39:33.221] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:58:0) after 6m39s
[04:46:12.388] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:58:0)
[04:46:12.407] Build status: SCHEDULED
[04:46:12.407] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:59:0) after 4m21s
[04:50:33.545] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:59:0)
[04:50:33.561] Build status: SCHEDULED
[04:50:33.561] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:60:0) after 2m36s
[04:53:09.586] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:60:0)
[04:53:09.611] Build status: SCHEDULED
[04:53:09.611] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:61:0) after 3m5s
[04:56:14.781] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:61:0)
[04:56:14.797] Build status: SCHEDULED
[04:56:14.797] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:62:0) after 4m33s
[05:00:47.824] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:62:0)
[05:00:47.840] Build status: SCHEDULED
[05:00:47.840] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:63:0) after 5m13s
[05:06:00.950] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:63:0)
[05:06:00.988] Build status: SCHEDULED
[05:06:00.988] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:64:0) after 5m42s
[05:11:43.028] Handling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:64:0)
[05:11:43.051] Build status: SCHEDULED
[05:11:43.051] Scheduling timer "check-buildbucket-build-status" (chromium/CrWinAsan:8892877114256243200:65:0) after 4m20s
[05:15:22.570] Received PubSub notification, asking Buildbucket for the build status
[05:15:22.602] Build:
{
"id": "8727447051905447681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "CrWinAsan"
},
"number": 17950,
"createdBy": "project:chromium",
"createTime": "2024-12-26T23:15:21.010988816Z",
"endTime": "2024-12-27T05:15:22.306388570Z",
"updateTime": "2024-12-27T05:15:22.306388570Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d5a0efe79b57a7d1d5d6c3f8de297b7c225da3fe",
"ref": "refs/heads/main"
}
}
}
[05:15:22.602] Invocation finished in 6h0m3.217975957s with status FAILED