[13:37:12.445] New invocation is queued and will start shortly
[13:37:13.604] Starting the invocation (attempt 1)
[13:37:13.631] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e69eae296b0c5472684150ced50b3b2fe64f7c7f"
[13:37:13.631] Popped gitiles commit info from properties and tags
[13:37:13.631] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:37:13.632] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:37:13.632] Buildbucket request:
{
"requestId": "8934769284635176592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e69eae296b0c5472684150ced50b3b2fe64f7c7f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8934769284635176592"
},
{
"key": "scheduler_job_id",
"value": "chromium/win-asan"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:37:14.852] Scheduled build:
{
"id": "8769339222482387633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"number": 28155,
"createdBy": "project:chromium",
"createTime": "2023-09-21T13:37:13.872454189Z",
"updateTime": "2023-09-21T13:37:13.872454189Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e69eae296b0c5472684150ced50b3b2fe64f7c7f",
"ref": "refs/heads/main"
}
}
}
[13:37:14.852] Task URL: https://cr-buildbucket.appspot.com/build/8769339222482387633
[13:37:14.852] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:2:0) after 3m56s
[13:37:23.351] Received PubSub notification, asking Buildbucket for the build status
[13:37:23.370] Build status: SCHEDULED
[13:41:10.872] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:2:0)
[13:41:11.022] Build status: SCHEDULED
[13:41:11.022] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:4:0) after 4m32s
[13:42:11.965] Received PubSub notification, asking Buildbucket for the build status
[13:42:11.983] Build status: STARTED
[13:45:43.470] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:4:0)
[13:45:43.530] Build status: STARTED
[13:45:43.530] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:6:0) after 6m49s
[13:52:32.551] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:6:0)
[13:52:32.575] Build status: STARTED
[13:52:32.575] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:7:0) after 7m50s
[14:00:22.706] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:7:0)
[14:00:22.747] Build status: STARTED
[14:00:22.747] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:8:0) after 9m47s
[14:10:09.767] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:8:0)
[14:10:09.793] Build status: STARTED
[14:10:09.793] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:9:0) after 3m23s
[14:13:32.824] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:9:0)
[14:13:32.843] Build status: STARTED
[14:13:32.843] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:10:0) after 3m6s
[14:16:39.030] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:10:0)
[14:16:39.087] Build status: STARTED
[14:16:39.087] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:11:0) after 6m59s
[14:23:38.509] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:11:0)
[14:23:38.525] Build status: STARTED
[14:23:38.525] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:12:0) after 3m5s
[14:26:43.546] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:12:0)
[14:26:43.569] Build status: STARTED
[14:26:43.569] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:13:0) after 3m24s
[14:30:07.609] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:13:0)
[14:30:07.715] Build status: STARTED
[14:30:07.715] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:14:0) after 3m55s
[14:34:03.290] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:14:0)
[14:34:03.308] Build status: STARTED
[14:34:03.308] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:15:0) after 5m56s
[14:39:59.287] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:15:0)
[14:39:59.310] Build status: STARTED
[14:39:59.310] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:16:0) after 6m32s
[14:46:31.337] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:16:0)
[14:46:31.354] Build status: STARTED
[14:46:31.354] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:17:0) after 5m37s
[14:52:08.418] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:17:0)
[14:52:08.463] Build status: STARTED
[14:52:08.463] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:18:0) after 9m3s
[15:01:11.738] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:18:0)
[15:01:11.765] Build status: STARTED
[15:01:11.765] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:19:0) after 9m41s
[15:10:52.787] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:19:0)
[15:10:52.808] Build status: STARTED
[15:10:52.808] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:20:0) after 2m16s
[15:13:08.934] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:20:0)
[15:13:09.002] Build status: STARTED
[15:13:09.002] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:21:0) after 8m0s
[15:21:09.067] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:21:0)
[15:21:09.178] Build status: STARTED
[15:21:09.178] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:22:0) after 6m41s
[15:27:50.312] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:22:0)
[15:27:50.335] Build status: STARTED
[15:27:50.335] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:23:0) after 2m7s
[15:29:57.510] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:23:0)
[15:29:57.533] Build status: STARTED
[15:29:57.533] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:24:0) after 5m48s
[15:35:45.803] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:24:0)
[15:35:45.828] Build status: STARTED
[15:35:45.828] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:25:0) after 2m54s
[15:38:40.147] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:25:0)
[15:38:40.166] Build status: STARTED
[15:38:40.166] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:26:0) after 9m33s
[15:48:13.143] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:26:0)
[15:48:13.162] Build status: STARTED
[15:48:13.162] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:27:0) after 1m33s
[15:49:46.329] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:27:0)
[15:49:46.346] Build status: STARTED
[15:49:46.346] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:28:0) after 4m8s
[15:53:54.575] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:28:0)
[15:53:54.599] Build status: STARTED
[15:53:54.599] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:29:0) after 2m17s
[15:56:11.613] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:29:0)
[15:56:11.630] Build status: STARTED
[15:56:11.630] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:30:0) after 6m9s
[16:02:20.805] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:30:0)
[16:02:20.827] Build status: STARTED
[16:02:20.827] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:31:0) after 1m54s
[16:04:14.842] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:31:0)
[16:04:14.910] Build status: STARTED
[16:04:14.910] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:32:0) after 6m34s
[16:10:48.961] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:32:0)
[16:10:48.999] Build status: STARTED
[16:10:48.999] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:33:0) after 6m24s
[16:17:13.176] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:33:0)
[16:17:13.199] Build status: STARTED
[16:17:13.199] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:34:0) after 2m44s
[16:19:57.292] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:34:0)
[16:19:57.337] Build status: STARTED
[16:19:57.337] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:35:0) after 8m44s
[16:28:41.307] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:35:0)
[16:28:41.399] Build status: STARTED
[16:28:41.399] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:36:0) after 2m45s
[16:31:26.693] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:36:0)
[16:31:26.868] Build status: STARTED
[16:31:26.868] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:37:0) after 1m50s
[16:33:17.529] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:37:0)
[16:33:17.551] Build status: STARTED
[16:33:17.551] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:38:0) after 2m37s
[16:35:54.872] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:38:0)
[16:35:54.913] Build status: STARTED
[16:35:54.913] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:39:0) after 5m48s
[16:41:43.127] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:39:0)
[16:41:43.148] Build status: STARTED
[16:41:43.148] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:40:0) after 3m33s
[16:45:16.266] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:40:0)
[16:45:16.315] Build status: STARTED
[16:45:16.315] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:41:0) after 8m20s
[16:53:36.353] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:41:0)
[16:53:36.387] Build status: STARTED
[16:53:36.387] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:42:0) after 1m42s
[16:55:18.460] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:42:0)
[16:55:18.482] Build status: STARTED
[16:55:18.482] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:43:0) after 1m53s
[16:57:11.560] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:43:0)
[16:57:11.735] Build status: STARTED
[16:57:11.735] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:44:0) after 9m54s
[17:07:05.752] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:44:0)
[17:07:05.770] Build status: STARTED
[17:07:05.770] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:45:0) after 2m34s
[17:09:39.792] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:45:0)
[17:09:39.828] Build status: STARTED
[17:09:39.828] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:46:0) after 5m39s
[17:15:18.925] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:46:0)
[17:15:18.973] Build status: STARTED
[17:15:18.973] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:47:0) after 8m12s
[17:23:31.213] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:47:0)
[17:23:31.230] Build status: STARTED
[17:23:31.230] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:48:0) after 2m10s
[17:25:41.825] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:48:0)
[17:25:42.011] Build status: STARTED
[17:25:42.011] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:49:0) after 3m31s
[17:29:13.094] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:49:0)
[17:29:13.132] Build status: STARTED
[17:29:13.132] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:50:0) after 3m12s
[17:32:25.398] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:50:0)
[17:32:25.416] Build status: STARTED
[17:32:25.416] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:51:0) after 7m28s
[17:39:53.448] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:51:0)
[17:39:53.472] Build status: STARTED
[17:39:53.472] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:52:0) after 6m22s
[17:46:15.490] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:52:0)
[17:46:15.515] Build status: STARTED
[17:46:15.515] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:53:0) after 2m52s
[17:49:07.550] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:53:0)
[17:49:07.568] Build status: STARTED
[17:49:07.568] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:54:0) after 2m51s
[17:51:58.644] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:54:0)
[17:51:58.676] Build status: STARTED
[17:51:58.676] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:55:0) after 4m30s
[17:56:28.805] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:55:0)
[17:56:28.900] Build status: STARTED
[17:56:28.900] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:56:0) after 7m10s
[18:03:38.968] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:56:0)
[18:03:38.989] Build status: STARTED
[18:03:38.989] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:57:0) after 4m28s
[18:08:07.007] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:57:0)
[18:08:07.033] Build status: STARTED
[18:08:07.033] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:58:0) after 9m23s
[18:17:30.050] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:58:0)
[18:17:30.072] Build status: STARTED
[18:17:30.072] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:59:0) after 6m57s
[18:24:27.279] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:59:0)
[18:24:27.302] Build status: STARTED
[18:24:27.302] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:60:0) after 9m55s
[18:34:22.326] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:60:0)
[18:34:22.348] Build status: STARTED
[18:34:22.348] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:61:0) after 8m14s
[18:42:36.415] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:61:0)
[18:42:36.448] Build status: STARTED
[18:42:36.448] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:62:0) after 9m29s
[18:52:05.559] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:62:0)
[18:52:05.577] Build status: STARTED
[18:52:05.577] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:63:0) after 5m29s
[18:57:34.549] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:63:0)
[18:57:34.671] Build status: STARTED
[18:57:34.671] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:64:0) after 8m2s
[19:05:36.727] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:64:0)
[19:05:36.760] Build status: STARTED
[19:05:36.760] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:65:0) after 5m38s
[19:11:14.989] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:65:0)
[19:11:15.015] Build status: STARTED
[19:11:15.015] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:66:0) after 6m27s
[19:17:42.092] Handling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:66:0)
[19:17:42.132] Build status: STARTED
[19:17:42.132] Scheduling timer "check-buildbucket-build-status" (chromium/win-asan:8934769284635176592:67:0) after 3m44s
[19:19:56.831] Received PubSub notification, asking Buildbucket for the build status
[19:19:56.872] Build:
{
"id": "8769339222482387633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "win-asan"
},
"number": 28155,
"createdBy": "project:chromium",
"createTime": "2023-09-21T13:37:13.872454189Z",
"startTime": "2023-09-21T13:42:11.390747Z",
"endTime": "2023-09-21T19:19:55.960403Z",
"updateTime": "2023-09-21T19:19:55.960403Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e69eae296b0c5472684150ced50b3b2fe64f7c7f",
"ref": "refs/heads/main"
}
}
}
[19:19:56.873] Invocation finished in 5h42m44.4381737s with status FAILED