[18:01:56.995] New invocation is queued and will start shortly
[18:01:58.300] Starting the invocation (attempt 1)
[18:01:58.503] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e749403fa870774b9438b984a0ffe0d972458fac"
[18:01:58.503] Popped gitiles commit info from properties and tags
[18:01:58.503] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:01:58.503] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:01:58.503] Buildbucket request:
{
"requestId": "8942634564561133520",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e749403fa870774b9438b984a0ffe0d972458fac",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8942634564561133520"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:01:58.935] Scheduled build:
{
"id": "8777204502227118369",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1514,
"createdBy": "project:chromium",
"createTime": "2023-06-26T18:01:58.588651385Z",
"updateTime": "2023-06-26T18:01:58.588651385Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e749403fa870774b9438b984a0ffe0d972458fac",
"ref": "refs/heads/main"
}
}
}
[18:01:58.935] Task URL: https://cr-buildbucket.appspot.com/build/8777204502227118369
[18:01:58.935] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:2:0) after 2m4s
[18:02:11.886] Received PubSub notification, asking Buildbucket for the build status
[18:02:11.934] Build status: STARTED
[18:04:03.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:2:0)
[18:04:03.105] Build status: STARTED
[18:04:03.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:4:0) after 3m32s
[18:07:35.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:4:0)
[18:07:35.303] Build status: STARTED
[18:07:35.304] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:5:0) after 9m27s
[18:17:02.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:5:0)
[18:17:02.352] Build status: STARTED
[18:17:02.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:6:0) after 5m35s
[18:22:37.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:6:0)
[18:22:37.746] Build status: STARTED
[18:22:37.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:7:0) after 5m45s
[18:28:23.000] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:7:0)
[18:28:23.154] Build status: STARTED
[18:28:23.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:8:0) after 7m58s
[18:36:21.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:8:0)
[18:36:21.357] Build status: STARTED
[18:36:21.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:9:0) after 1m18s
[18:37:39.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:9:0)
[18:37:39.491] Build status: STARTED
[18:37:39.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:10:0) after 8m9s
[18:45:48.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:10:0)
[18:45:48.610] Build status: STARTED
[18:45:48.610] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:11:0) after 4m45s
[18:50:33.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:11:0)
[18:50:33.657] Build status: STARTED
[18:50:33.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:12:0) after 5m20s
[18:55:53.810] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:12:0)
[18:55:53.834] Build status: STARTED
[18:55:53.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:13:0) after 6m38s
[19:02:31.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:13:0)
[19:02:31.896] Build status: STARTED
[19:02:31.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:14:0) after 2m17s
[19:04:48.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:14:0)
[19:04:48.941] Build status: STARTED
[19:04:48.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:15:0) after 7m42s
[19:12:30.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:15:0)
[19:12:31.021] Build status: STARTED
[19:12:31.021] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:16:0) after 9m42s
[19:22:13.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:16:0)
[19:22:13.154] Build status: STARTED
[19:22:13.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:17:0) after 1m58s
[19:24:11.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:17:0)
[19:24:11.306] Build status: STARTED
[19:24:11.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:18:0) after 2m26s
[19:26:37.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:18:0)
[19:26:37.348] Build status: STARTED
[19:26:37.348] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:19:0) after 2m16s
[19:28:53.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:19:0)
[19:28:53.385] Build status: STARTED
[19:28:53.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:20:0) after 4m41s
[19:33:35.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:20:0)
[19:33:35.280] Build status: STARTED
[19:33:35.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:21:0) after 9m35s
[19:43:10.358] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:21:0)
[19:43:10.378] Build status: STARTED
[19:43:10.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:22:0) after 5m7s
[19:48:17.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:22:0)
[19:48:17.735] Build status: STARTED
[19:48:17.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:23:0) after 9m15s
[19:57:32.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:23:0)
[19:57:32.818] Build status: STARTED
[19:57:32.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:24:0) after 1m29s
[19:59:01.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:24:0)
[19:59:01.958] Build status: STARTED
[19:59:01.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:25:0) after 4m51s
[20:03:53.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:25:0)
[20:03:53.105] Build status: STARTED
[20:03:53.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:26:0) after 3m44s
[20:07:37.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:26:0)
[20:07:37.192] Build status: STARTED
[20:07:37.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:27:0) after 3m10s
[20:10:47.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:27:0)
[20:10:47.272] Build status: STARTED
[20:10:47.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:28:0) after 2m53s
[20:13:40.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:28:0)
[20:13:40.348] Build status: STARTED
[20:13:40.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:29:0) after 7m5s
[20:20:45.389] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:29:0)
[20:20:45.436] Build status: STARTED
[20:20:45.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:30:0) after 7m22s
[20:28:07.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:30:0)
[20:28:07.535] Build status: STARTED
[20:28:07.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:31:0) after 7m45s
[20:35:52.568] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:31:0)
[20:35:52.618] Build status: STARTED
[20:35:52.618] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:32:0) after 7m54s
[20:43:46.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:32:0)
[20:43:46.634] Build status: STARTED
[20:43:46.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:33:0) after 1m1s
[20:44:47.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:33:0)
[20:44:47.857] Build status: STARTED
[20:44:47.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:34:0) after 4m11s
[20:48:58.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:34:0)
[20:48:59.037] Build status: STARTED
[20:48:59.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:35:0) after 8m6s
[20:57:05.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:35:0)
[20:57:05.132] Build status: STARTED
[20:57:05.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:36:0) after 4m5s
[21:01:10.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:36:0)
[21:01:10.184] Build status: STARTED
[21:01:10.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:37:0) after 4m26s
[21:05:36.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:37:0)
[21:05:36.522] Build status: STARTED
[21:05:36.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:38:0) after 6m49s
[21:12:25.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:38:0)
[21:12:25.572] Build status: STARTED
[21:12:25.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:39:0) after 6m19s
[21:18:44.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:39:0)
[21:18:44.629] Build status: STARTED
[21:18:44.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:40:0) after 8m18s
[21:27:02.667] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:40:0)
[21:27:02.686] Build status: STARTED
[21:27:02.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:41:0) after 9m53s
[21:36:55.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:41:0)
[21:36:55.736] Build status: STARTED
[21:36:55.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:42:0) after 8m7s
[21:45:02.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:42:0)
[21:45:02.893] Build status: STARTED
[21:45:02.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:43:0) after 7m12s
[21:52:15.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:43:0)
[21:52:15.353] Build status: STARTED
[21:52:15.353] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:44:0) after 4m17s
[21:56:32.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:44:0)
[21:56:32.414] Build status: STARTED
[21:56:32.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:45:0) after 3m42s
[22:00:14.541] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:45:0)
[22:00:14.566] Build status: STARTED
[22:00:14.566] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:46:0) after 5m5s
[22:05:20.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:46:0)
[22:05:20.157] Build status: STARTED
[22:05:20.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:47:0) after 5m40s
[22:11:00.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:47:0)
[22:11:00.206] Build status: STARTED
[22:11:00.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:48:0) after 9m2s
[22:20:02.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:48:0)
[22:20:02.247] Build status: STARTED
[22:20:02.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:49:0) after 4m20s
[22:24:22.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:49:0)
[22:24:22.305] Build status: STARTED
[22:24:22.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:50:0) after 3m8s
[22:27:30.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:50:0)
[22:27:30.376] Build status: STARTED
[22:27:30.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:51:0) after 7m21s
[22:34:51.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:51:0)
[22:34:51.429] Build status: STARTED
[22:34:51.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:52:0) after 7m21s
[22:42:12.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:52:0)
[22:42:12.771] Build status: STARTED
[22:42:12.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:53:0) after 8m3s
[22:50:15.793] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:53:0)
[22:50:15.817] Build status: STARTED
[22:50:15.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:54:0) after 3m45s
[22:54:00.855] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:54:0)
[22:54:00.878] Build status: STARTED
[22:54:00.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:55:0) after 2m42s
[22:56:42.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:55:0)
[22:56:43.301] Build status: STARTED
[22:56:43.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:56:0) after 3m11s
[22:59:54.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:56:0)
[22:59:54.359] Build status: STARTED
[22:59:54.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:57:0) after 1m44s
[23:01:38.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:57:0)
[23:01:38.427] Build status: STARTED
[23:01:38.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:58:0) after 5m40s
[23:07:18.556] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:58:0)
[23:07:18.593] Build status: STARTED
[23:07:18.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:59:0) after 7m58s
[23:15:16.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:59:0)
[23:15:16.636] Build status: STARTED
[23:15:16.636] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:60:0) after 7m12s
[23:22:28.805] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:60:0)
[23:22:28.829] Build status: STARTED
[23:22:28.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:61:0) after 3m47s
[23:26:15.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:61:0)
[23:26:15.851] Build status: STARTED
[23:26:15.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:62:0) after 5m1s
[23:31:17.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:62:0)
[23:31:17.461] Build status: STARTED
[23:31:17.461] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:63:0) after 2m27s
[23:33:44.489] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:63:0)
[23:33:44.512] Build status: STARTED
[23:33:44.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:64:0) after 5m0s
[23:38:44.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:64:0)
[23:38:44.853] Build status: STARTED
[23:38:44.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:65:0) after 5m34s
[23:44:18.912] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:65:0)
[23:44:18.934] Build status: STARTED
[23:44:18.934] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:66:0) after 1m31s
[23:45:49.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:66:0)
[23:45:50.108] Build status: STARTED
[23:45:50.108] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:67:0) after 3m14s
[23:49:04.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:67:0)
[23:49:04.365] Build status: STARTED
[23:49:04.365] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:68:0) after 6m1s
[23:55:05.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:68:0)
[23:55:05.436] Build status: STARTED
[23:55:05.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:69:0) after 4m59s
[00:00:04.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:69:0)
[00:00:04.593] Build status: STARTED
[00:00:04.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:70:0) after 2m28s
[00:02:32.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:70:0)
[00:02:32.998] Build status: STARTED
[00:02:32.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:71:0) after 4m7s
[00:06:40.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:71:0)
[00:06:40.157] Build status: STARTED
[00:06:40.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:72:0) after 8m5s
[00:14:45.234] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:72:0)
[00:14:45.264] Build status: STARTED
[00:14:45.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:73:0) after 9m40s
[00:24:25.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:73:0)
[00:24:25.369] Build status: STARTED
[00:24:25.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:74:0) after 1m39s
[00:26:04.652] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:74:0)
[00:26:04.677] Build status: STARTED
[00:26:04.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:75:0) after 9m55s
[00:36:00.089] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:75:0)
[00:36:00.111] Build status: STARTED
[00:36:00.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:76:0) after 2m44s
[00:38:44.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:76:0)
[00:38:44.424] Build status: STARTED
[00:38:44.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:77:0) after 9m26s
[00:48:10.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:77:0)
[00:48:10.578] Build status: STARTED
[00:48:10.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:78:0) after 3m52s
[00:52:02.606] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:78:0)
[00:52:02.635] Build status: STARTED
[00:52:02.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:79:0) after 9m9s
[01:01:11.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:79:0)
[01:01:11.708] Build status: STARTED
[01:01:11.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:80:0) after 8m27s
[01:09:38.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:80:0)
[01:09:38.727] Build status: STARTED
[01:09:38.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:81:0) after 9m23s
[01:19:01.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:81:0)
[01:19:01.863] Build status: STARTED
[01:19:01.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:82:0) after 4m34s
[01:23:36.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:82:0)
[01:23:36.198] Build status: STARTED
[01:23:36.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:83:0) after 1m34s
[01:25:10.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:83:0)
[01:25:10.649] Build status: STARTED
[01:25:10.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:84:0) after 8m34s
[01:33:45.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:84:0)
[01:33:45.194] Build status: STARTED
[01:33:45.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:85:0) after 4m9s
[01:37:54.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:85:0)
[01:37:54.315] Build status: STARTED
[01:37:54.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:86:0) after 5m40s
[01:43:34.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:86:0)
[01:43:34.689] Build status: STARTED
[01:43:34.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:87:0) after 3m3s
[01:46:37.686] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:87:0)
[01:46:37.708] Build status: STARTED
[01:46:37.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:88:0) after 5m5s
[01:51:42.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:88:0)
[01:51:42.877] Build status: STARTED
[01:51:42.877] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:89:0) after 3m11s
[01:54:54.072] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:89:0)
[01:54:54.090] Build status: STARTED
[01:54:54.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:90:0) after 8m35s
[02:03:29.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:90:0)
[02:03:29.142] Build status: STARTED
[02:03:29.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:91:0) after 3m4s
[02:06:33.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:91:0)
[02:06:33.573] Build status: STARTED
[02:06:33.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:92:0) after 1m6s
[02:07:39.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:92:0)
[02:07:39.773] Build status: STARTED
[02:07:39.773] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:93:0) after 7m2s
[02:14:42.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:93:0)
[02:14:42.119] Build status: STARTED
[02:14:42.119] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:94:0) after 6m47s
[02:21:29.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:94:0)
[02:21:29.357] Build status: STARTED
[02:21:29.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:95:0) after 2m41s
[02:24:10.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:95:0)
[02:24:10.620] Build status: STARTED
[02:24:10.620] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:96:0) after 8m34s
[02:32:44.719] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:96:0)
[02:32:44.763] Build status: STARTED
[02:32:44.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:97:0) after 6m0s
[02:38:44.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:97:0)
[02:38:44.887] Build status: STARTED
[02:38:44.887] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:98:0) after 4m53s
[02:43:38.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:98:0)
[02:43:38.302] Build status: STARTED
[02:43:38.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:99:0) after 5m16s
[02:48:54.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:99:0)
[02:48:54.374] Build status: STARTED
[02:48:54.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:100:0) after 6m40s
[02:55:34.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:100:0)
[02:55:34.422] Build status: STARTED
[02:55:34.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:101:0) after 3m24s
[02:58:58.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:101:0)
[02:58:58.477] Build status: STARTED
[02:58:58.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:102:0) after 1m48s
[03:00:46.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:102:0)
[03:00:46.527] Build status: STARTED
[03:00:46.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:103:0) after 5m11s
[03:05:57.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:103:0)
[03:05:57.616] Build status: STARTED
[03:05:57.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:104:0) after 9m42s
[03:15:39.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:104:0)
[03:15:39.875] Build status: STARTED
[03:15:39.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:105:0) after 4m15s
[03:19:55.054] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:105:0)
[03:19:55.092] Build status: STARTED
[03:19:55.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:106:0) after 2m29s
[03:22:24.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:106:0)
[03:22:24.358] Build status: STARTED
[03:22:24.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:107:0) after 8m49s
[03:31:13.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:107:0)
[03:31:13.970] Build status: STARTED
[03:31:13.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:108:0) after 8m25s
[03:39:39.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:108:0)
[03:39:39.151] Build status: STARTED
[03:39:39.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:109:0) after 1m8s
[03:40:47.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:109:0)
[03:40:47.189] Build status: STARTED
[03:40:47.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:110:0) after 3m33s
[03:44:20.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:110:0)
[03:44:20.312] Build status: STARTED
[03:44:20.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:111:0) after 8m31s
[03:52:51.359] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:111:0)
[03:52:51.381] Build status: STARTED
[03:52:51.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:112:0) after 9m29s
[04:02:20.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:112:0)
[04:02:20.446] Build status: STARTED
[04:02:20.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:113:0) after 6m1s
[04:08:21.963] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:113:0)
[04:08:21.978] Build status: STARTED
[04:08:21.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:114:0) after 7m14s
[04:15:36.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:114:0)
[04:15:36.083] Build status: STARTED
[04:15:36.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:115:0) after 4m47s
[04:20:23.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:115:0)
[04:20:23.148] Build status: STARTED
[04:20:23.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:116:0) after 8m6s
[04:28:29.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:116:0)
[04:28:29.252] Build status: STARTED
[04:28:29.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:117:0) after 3m2s
[04:31:31.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:117:0)
[04:31:31.330] Build status: STARTED
[04:31:31.330] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:118:0) after 4m44s
[04:36:15.541] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:118:0)
[04:36:15.559] Build status: STARTED
[04:36:15.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:119:0) after 1m42s
[04:37:57.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:119:0)
[04:37:57.611] Build status: STARTED
[04:37:57.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:120:0) after 1m16s
[04:39:13.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:120:0)
[04:39:13.674] Build status: STARTED
[04:39:13.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:121:0) after 7m12s
[04:46:25.714] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:121:0)
[04:46:25.754] Build status: STARTED
[04:46:25.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:122:0) after 1m2s
[04:47:27.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:122:0)
[04:47:28.033] Build status: STARTED
[04:47:28.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:123:0) after 8m49s
[04:56:17.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:123:0)
[04:56:17.195] Build status: STARTED
[04:56:17.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:124:0) after 6m23s
[05:02:40.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:124:0)
[05:02:40.260] Build status: STARTED
[05:02:40.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:125:0) after 6m37s
[05:09:17.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:125:0)
[05:09:17.349] Build status: STARTED
[05:09:17.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:126:0) after 5m19s
[05:14:36.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:126:0)
[05:14:36.560] Build status: STARTED
[05:14:36.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:127:0) after 9m46s
[05:24:22.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:127:0)
[05:24:22.791] Build status: STARTED
[05:24:22.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:128:0) after 9m14s
[05:33:36.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:128:0)
[05:33:36.905] Build status: STARTED
[05:33:36.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:129:0) after 2m28s
[05:36:04.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:129:0)
[05:36:04.977] Build status: STARTED
[05:36:04.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:130:0) after 7m51s
[05:43:56.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:130:0)
[05:43:56.022] Build status: STARTED
[05:43:56.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:131:0) after 6m43s
[05:50:39.158] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:131:0)
[05:50:39.181] Build status: STARTED
[05:50:39.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:132:0) after 8m11s
[05:58:50.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:132:0)
[05:58:50.631] Build status: STARTED
[05:58:50.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:133:0) after 8m26s
[06:07:16.656] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:133:0)
[06:07:16.770] Build status: STARTED
[06:07:16.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:134:0) after 6m28s
[06:13:44.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:134:0)
[06:13:44.933] Build status: STARTED
[06:13:44.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:135:0) after 1m21s
[06:15:05.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:135:0)
[06:15:05.987] Build status: STARTED
[06:15:05.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:136:0) after 5m19s
[06:20:25.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:136:0)
[06:20:25.064] Build status: STARTED
[06:20:25.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8942634564561133520:137:0) after 7m5s
[06:20:46.721] Received PubSub notification, asking Buildbucket for the build status
[06:20:46.739] Build:
{
"id": "8777204502227118369",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1514,
"createdBy": "project:chromium",
"createTime": "2023-06-26T18:01:58.588651385Z",
"startTime": "2023-06-26T18:02:11.328085Z",
"endTime": "2023-06-27T06:20:46.106703Z",
"updateTime": "2023-06-27T06:20:46.106703Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e749403fa870774b9438b984a0ffe0d972458fac",
"ref": "refs/heads/main"
}
}
}
[06:20:46.743] Invocation finished in 12h18m49.763666992s with status FAILED