[19:55:13.417] New invocation is queued and will start shortly
[19:55:14.780] Starting the invocation (attempt 1)
[19:55:14.819] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e737acb86b6d1eb5e1f31f7fa6fa04120837ac69"
[19:55:14.819] Popped gitiles commit info from properties and tags
[19:55:14.819] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:55:14.819] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:55:14.819] Buildbucket request:
{
"requestId": "8946794898452729136",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e737acb86b6d1eb5e1f31f7fa6fa04120837ac69",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8946794898452729136"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:55:15.294] Scheduled build:
{
"id": "8781364836248542289",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1421,
"createdBy": "project:chromium",
"createTime": "2023-05-11T19:55:14.884370202Z",
"updateTime": "2023-05-11T19:55:14.884370202Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e737acb86b6d1eb5e1f31f7fa6fa04120837ac69",
"ref": "refs/heads/main"
}
}
}
[19:55:15.294] Task URL: https://cr-buildbucket.appspot.com/build/8781364836248542289
[19:55:15.294] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:2:0) after 4m45s
[19:55:41.450] Received PubSub notification, asking Buildbucket for the build status
[19:55:41.471] Build status: STARTED
[20:00:00.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:2:0)
[20:00:00.403] Build status: STARTED
[20:00:00.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:4:0) after 8m53s
[20:08:53.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:4:0)
[20:08:53.810] Build status: STARTED
[20:08:53.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:5:0) after 5m13s
[20:14:06.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:5:0)
[20:14:06.921] Build status: STARTED
[20:14:06.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:6:0) after 2m44s
[20:16:51.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:6:0)
[20:16:51.283] Build status: STARTED
[20:16:51.283] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:7:0) after 3m7s
[20:19:58.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:7:0)
[20:19:58.496] Build status: STARTED
[20:19:58.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:8:0) after 2m22s
[20:22:20.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:8:0)
[20:22:20.987] Build status: STARTED
[20:22:20.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:9:0) after 4m38s
[20:26:59.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:9:0)
[20:26:59.150] Build status: STARTED
[20:26:59.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:10:0) after 3m29s
[20:30:28.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:10:0)
[20:30:28.250] Build status: STARTED
[20:30:28.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:11:0) after 7m43s
[20:38:11.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:11:0)
[20:38:11.531] Build status: STARTED
[20:38:11.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:12:0) after 4m17s
[20:42:28.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:12:0)
[20:42:28.577] Build status: STARTED
[20:42:28.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:13:0) after 2m53s
[20:45:21.609] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:13:0)
[20:45:21.630] Build status: STARTED
[20:45:21.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:14:0) after 9m27s
[20:54:48.655] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:14:0)
[20:54:48.719] Build status: STARTED
[20:54:48.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:15:0) after 2m48s
[20:57:37.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:15:0)
[20:57:37.070] Build status: STARTED
[20:57:37.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:16:0) after 5m52s
[21:03:29.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:16:0)
[21:03:29.195] Build status: STARTED
[21:03:29.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:17:0) after 5m57s
[21:09:26.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:17:0)
[21:09:26.285] Build status: STARTED
[21:09:26.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:18:0) after 3m15s
[21:12:41.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:18:0)
[21:12:41.744] Build status: STARTED
[21:12:41.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:19:0) after 3m19s
[21:16:00.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:19:0)
[21:16:00.900] Build status: STARTED
[21:16:00.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:20:0) after 1m38s
[21:17:39.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:20:0)
[21:17:39.047] Build status: STARTED
[21:17:39.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:21:0) after 3m18s
[21:20:57.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:21:0)
[21:20:57.275] Build status: STARTED
[21:20:57.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:22:0) after 1m3s
[21:22:00.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:22:0)
[21:22:00.350] Build status: STARTED
[21:22:00.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:23:0) after 6m32s
[21:28:32.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:23:0)
[21:28:32.381] Build status: STARTED
[21:28:32.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:24:0) after 7m32s
[21:36:04.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:24:0)
[21:36:04.422] Build status: STARTED
[21:36:04.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:25:0) after 3m35s
[21:39:39.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:25:0)
[21:39:39.845] Build status: STARTED
[21:39:39.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:26:0) after 5m15s
[21:44:54.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:26:0)
[21:44:54.999] Build status: STARTED
[21:44:54.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:27:0) after 7m14s
[21:52:09.051] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:27:0)
[21:52:09.073] Build status: STARTED
[21:52:09.073] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:28:0) after 8m41s
[22:00:50.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:28:0)
[22:00:50.161] Build status: STARTED
[22:00:50.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:29:0) after 5m13s
[22:06:03.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:29:0)
[22:06:03.210] Build status: STARTED
[22:06:03.210] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:30:0) after 4m13s
[22:10:16.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:30:0)
[22:10:16.302] Build status: STARTED
[22:10:16.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:31:0) after 5m37s
[22:15:53.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:31:0)
[22:15:53.855] Build status: STARTED
[22:15:53.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:32:0) after 6m22s
[22:22:16.307] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:32:0)
[22:22:16.328] Build status: STARTED
[22:22:16.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:33:0) after 4m15s
[22:26:31.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:33:0)
[22:26:31.431] Build status: STARTED
[22:26:31.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:34:0) after 1m12s
[22:27:43.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:34:0)
[22:27:43.516] Build status: STARTED
[22:27:43.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:35:0) after 7m55s
[22:35:38.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:35:0)
[22:35:38.701] Build status: STARTED
[22:35:38.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:36:0) after 2m37s
[22:38:15.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:36:0)
[22:38:15.843] Build status: STARTED
[22:38:15.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:37:0) after 9m57s
[22:48:12.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:37:0)
[22:48:12.891] Build status: STARTED
[22:48:12.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:38:0) after 8m10s
[22:56:23.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:38:0)
[22:56:23.295] Build status: STARTED
[22:56:23.295] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:39:0) after 6m25s
[23:02:48.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:39:0)
[23:02:48.898] Build status: STARTED
[23:02:48.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:40:0) after 2m15s
[23:05:04.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:40:0)
[23:05:04.222] Build status: STARTED
[23:05:04.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:41:0) after 1m33s
[23:06:37.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:41:0)
[23:06:37.479] Build status: STARTED
[23:06:37.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:42:0) after 1m35s
[23:08:12.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:42:0)
[23:08:12.655] Build status: STARTED
[23:08:12.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:43:0) after 2m47s
[23:11:00.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:43:0)
[23:11:00.063] Build status: STARTED
[23:11:00.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:44:0) after 2m10s
[23:13:10.372] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:44:0)
[23:13:10.393] Build status: STARTED
[23:13:10.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:45:0) after 8m32s
[23:21:42.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:45:0)
[23:21:42.446] Build status: STARTED
[23:21:42.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:46:0) after 1m25s
[23:23:07.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:46:0)
[23:23:07.518] Build status: STARTED
[23:23:07.518] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:47:0) after 1m3s
[23:24:10.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:47:0)
[23:24:10.767] Build status: STARTED
[23:24:10.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:48:0) after 5m58s
[23:30:08.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:48:0)
[23:30:08.937] Build status: STARTED
[23:30:08.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:49:0) after 6m36s
[23:36:45.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:49:0)
[23:36:45.243] Build status: STARTED
[23:36:45.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:50:0) after 9m43s
[23:46:28.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:50:0)
[23:46:28.435] Build status: STARTED
[23:46:28.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:51:0) after 3m22s
[23:49:51.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:51:0)
[23:49:51.270] Build status: STARTED
[23:49:51.270] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:52:0) after 5m28s
[23:55:19.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:52:0)
[23:55:19.473] Build status: STARTED
[23:55:19.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:53:0) after 5m49s
[00:01:09.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:53:0)
[00:01:09.300] Build status: STARTED
[00:01:09.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:54:0) after 4m11s
[00:05:20.554] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:54:0)
[00:05:20.587] Build status: STARTED
[00:05:20.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:55:0) after 8m13s
[00:13:33.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:55:0)
[00:13:33.679] Build status: STARTED
[00:13:33.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:56:0) after 3m10s
[00:16:43.735] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:56:0)
[00:16:43.763] Build status: STARTED
[00:16:43.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:57:0) after 5m12s
[00:21:55.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:57:0)
[00:21:55.920] Build status: STARTED
[00:21:55.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:58:0) after 4m5s
[00:26:00.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:58:0)
[00:26:01.039] Build status: STARTED
[00:26:01.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:59:0) after 9m41s
[00:35:42.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:59:0)
[00:35:42.267] Build status: STARTED
[00:35:42.267] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:60:0) after 7m7s
[00:42:49.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:60:0)
[00:42:49.608] Build status: STARTED
[00:42:49.608] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:61:0) after 4m51s
[00:47:40.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:61:0)
[00:47:40.772] Build status: STARTED
[00:47:40.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:62:0) after 4m17s
[00:51:57.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:62:0)
[00:51:57.859] Build status: STARTED
[00:51:57.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:63:0) after 4m18s
[00:56:15.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:63:0)
[00:56:15.884] Build status: STARTED
[00:56:15.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:64:0) after 3m0s
[00:59:15.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:64:0)
[00:59:15.929] Build status: STARTED
[00:59:15.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:65:0) after 4m28s
[01:03:43.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:65:0)
[01:03:43.976] Build status: STARTED
[01:03:43.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:66:0) after 8m10s
[01:11:54.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:66:0)
[01:11:54.210] Build status: STARTED
[01:11:54.210] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:67:0) after 6m23s
[01:18:17.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:67:0)
[01:18:17.424] Build status: STARTED
[01:18:17.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:68:0) after 5m57s
[01:24:15.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:68:0)
[01:24:15.123] Build status: STARTED
[01:24:15.123] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:69:0) after 3m22s
[01:27:37.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:69:0)
[01:27:37.217] Build status: STARTED
[01:27:37.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:70:0) after 9m29s
[01:37:06.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:70:0)
[01:37:06.289] Build status: STARTED
[01:37:06.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:71:0) after 3m58s
[01:41:04.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:71:0)
[01:41:04.348] Build status: STARTED
[01:41:04.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:72:0) after 9m8s
[01:50:12.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:72:0)
[01:50:12.433] Build status: STARTED
[01:50:12.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:73:0) after 9m59s
[02:00:12.314] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:73:0)
[02:00:12.400] Build status: STARTED
[02:00:12.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:74:0) after 4m7s
[02:04:19.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:74:0)
[02:04:19.822] Build status: STARTED
[02:04:19.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:75:0) after 5m23s
[02:09:42.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:75:0)
[02:09:42.957] Build status: STARTED
[02:09:42.957] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:76:0) after 1m59s
[02:11:42.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:76:0)
[02:11:42.041] Build status: STARTED
[02:11:42.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:77:0) after 3m0s
[02:14:42.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:77:0)
[02:14:42.408] Build status: STARTED
[02:14:42.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:78:0) after 6m17s
[02:20:59.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:78:0)
[02:20:59.636] Build status: STARTED
[02:20:59.636] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:79:0) after 6m25s
[02:27:24.977] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:79:0)
[02:27:24.993] Build status: STARTED
[02:27:24.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:80:0) after 8m35s
[02:36:00.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:80:0)
[02:36:00.125] Build status: STARTED
[02:36:00.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:81:0) after 6m53s
[02:42:53.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:81:0)
[02:42:53.316] Build status: STARTED
[02:42:53.316] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:82:0) after 6m2s
[02:48:55.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:82:0)
[02:48:55.515] Build status: STARTED
[02:48:55.515] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:83:0) after 3m14s
[02:52:09.541] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:83:0)
[02:52:09.560] Build status: STARTED
[02:52:09.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:84:0) after 9m50s
[03:01:59.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:84:0)
[03:01:59.748] Build status: STARTED
[03:01:59.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:85:0) after 3m21s
[03:05:20.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:85:0)
[03:05:20.929] Build status: STARTED
[03:05:20.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:86:0) after 6m10s
[03:11:31.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:86:0)
[03:11:31.188] Build status: STARTED
[03:11:31.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:87:0) after 2m48s
[03:14:19.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:87:0)
[03:14:19.487] Build status: STARTED
[03:14:19.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:88:0) after 2m24s
[03:16:43.516] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:88:0)
[03:16:43.538] Build status: STARTED
[03:16:43.538] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:89:0) after 1m15s
[03:17:58.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:89:0)
[03:17:58.588] Build status: STARTED
[03:17:58.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:90:0) after 9m49s
[03:27:47.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:90:0)
[03:27:47.612] Build status: STARTED
[03:27:47.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:91:0) after 3m9s
[03:30:56.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:91:0)
[03:30:56.706] Build status: STARTED
[03:30:56.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:92:0) after 8m28s
[03:39:24.837] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:92:0)
[03:39:24.857] Build status: STARTED
[03:39:24.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:93:0) after 7m21s
[03:46:46.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:93:0)
[03:46:46.232] Build status: STARTED
[03:46:46.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:94:0) after 7m39s
[03:54:25.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:94:0)
[03:54:25.334] Build status: STARTED
[03:54:25.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:95:0) after 4m18s
[03:58:43.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:95:0)
[03:58:43.455] Build status: STARTED
[03:58:43.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:96:0) after 3m54s
[04:02:37.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:96:0)
[04:02:37.551] Build status: STARTED
[04:02:37.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:97:0) after 6m46s
[04:09:23.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:97:0)
[04:09:23.623] Build status: STARTED
[04:09:23.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:98:0) after 1m45s
[04:11:08.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:98:0)
[04:11:08.764] Build status: STARTED
[04:11:08.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:99:0) after 6m24s
[04:17:32.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:99:0)
[04:17:32.871] Build status: STARTED
[04:17:32.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:100:0) after 1m46s
[04:19:19.047] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:100:0)
[04:19:19.065] Build status: STARTED
[04:19:19.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:101:0) after 3m49s
[04:23:08.089] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:101:0)
[04:23:08.110] Build status: STARTED
[04:23:08.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:102:0) after 2m18s
[04:25:26.190] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:102:0)
[04:25:26.211] Build status: STARTED
[04:25:26.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:103:0) after 9m47s
[04:35:13.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:103:0)
[04:35:13.548] Build status: STARTED
[04:35:13.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:104:0) after 4m25s
[04:39:38.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:104:0)
[04:39:38.633] Build status: STARTED
[04:39:38.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:105:0) after 7m48s
[04:47:26.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:105:0)
[04:47:26.688] Build status: STARTED
[04:47:26.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:106:0) after 4m7s
[04:51:33.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:106:0)
[04:51:33.836] Build status: STARTED
[04:51:33.836] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:107:0) after 3m15s
[04:54:48.980] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:107:0)
[04:54:49.032] Build status: STARTED
[04:54:49.032] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:108:0) after 2m20s
[04:57:09.184] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:108:0)
[04:57:09.288] Build status: STARTED
[04:57:09.288] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:109:0) after 5m25s
[05:02:34.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:109:0)
[05:02:34.665] Build status: STARTED
[05:02:34.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:110:0) after 4m38s
[05:07:12.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:110:0)
[05:07:12.881] Build status: STARTED
[05:07:12.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:111:0) after 4m18s
[05:11:31.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:111:0)
[05:11:31.254] Build status: STARTED
[05:11:31.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:112:0) after 1m59s
[05:13:30.391] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:112:0)
[05:13:30.408] Build status: STARTED
[05:13:30.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:113:0) after 3m28s
[05:16:58.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:113:0)
[05:16:58.560] Build status: STARTED
[05:16:58.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:114:0) after 7m51s
[05:24:49.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:114:0)
[05:24:49.676] Build status: STARTED
[05:24:49.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:115:0) after 2m18s
[05:27:07.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:115:0)
[05:27:07.720] Build status: STARTED
[05:27:07.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:116:0) after 7m43s
[05:34:50.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:116:0)
[05:34:50.774] Build status: STARTED
[05:34:50.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:117:0) after 6m23s
[05:41:13.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:117:0)
[05:41:13.827] Build status: STARTED
[05:41:13.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:118:0) after 2m16s
[05:43:29.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:118:0)
[05:43:29.900] Build status: STARTED
[05:43:29.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:119:0) after 8m42s
[05:52:12.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:119:0)
[05:52:12.314] Build status: STARTED
[05:52:12.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:120:0) after 7m3s
[05:59:15.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:120:0)
[05:59:15.500] Build status: STARTED
[05:59:15.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:121:0) after 6m15s
[06:05:30.627] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:121:0)
[06:05:30.646] Build status: STARTED
[06:05:30.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:122:0) after 5m35s
[06:11:05.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:122:0)
[06:11:05.769] Build status: STARTED
[06:11:05.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:123:0) after 4m17s
[06:15:22.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:123:0)
[06:15:22.896] Build status: STARTED
[06:15:22.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:124:0) after 4m42s
[06:20:04.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:124:0)
[06:20:04.999] Build status: STARTED
[06:20:04.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:125:0) after 1m46s
[06:21:51.199] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:125:0)
[06:21:51.231] Build status: STARTED
[06:21:51.231] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8946794898452729136:126:0) after 9m2s
[06:23:36.921] Received PubSub notification, asking Buildbucket for the build status
[06:23:36.942] Build:
{
"id": "8781364836248542289",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1421,
"createdBy": "project:chromium",
"createTime": "2023-05-11T19:55:14.884370202Z",
"startTime": "2023-05-11T19:55:40.215995Z",
"endTime": "2023-05-12T06:23:36.255465993Z",
"updateTime": "2023-05-12T06:23:36.255465993Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e737acb86b6d1eb5e1f31f7fa6fa04120837ac69",
"ref": "refs/heads/main"
}
}
}
[06:23:36.942] Invocation finished in 10h28m23.543317621s with status FAILED