[15:42:10.946] New invocation is queued and will start shortly
[15:42:12.103] Starting the invocation (attempt 1)
[15:42:12.133] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c879b8bc5ba4145816fc69c3c3a10f748415ce60"
[15:42:12.133] Popped gitiles commit info from properties and tags
[15:42:12.133] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:42:12.134] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:42:12.134] Buildbucket request:
{
"requestId": "8939200673258720336",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c879b8bc5ba4145816fc69c3c3a10f748415ce60",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8939200673258720336"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:42:12.685] Scheduled build:
{
"id": "8773770611240643569",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1588,
"createdBy": "project:chromium",
"createTime": "2023-08-03T15:42:12.227420976Z",
"updateTime": "2023-08-03T15:42:12.227420976Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c879b8bc5ba4145816fc69c3c3a10f748415ce60",
"ref": "refs/heads/main"
}
}
}
[15:42:12.685] Task URL: https://cr-buildbucket.appspot.com/build/8773770611240643569
[15:42:12.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:2:0) after 4m27s
[15:42:13.754] Received PubSub notification, asking Buildbucket for the build status
[15:42:13.785] Build status: SCHEDULED
[15:42:57.412] Received PubSub notification, asking Buildbucket for the build status
[15:42:57.499] Build status: STARTED
[15:46:39.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:2:0)
[15:46:39.811] Build status: STARTED
[15:46:39.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:5:0) after 3m28s
[15:50:07.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:5:0)
[15:50:08.087] Build status: STARTED
[15:50:08.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:6:0) after 1m46s
[15:51:54.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:6:0)
[15:51:54.288] Build status: STARTED
[15:51:54.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:7:0) after 1m35s
[15:53:29.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:7:0)
[15:53:29.763] Build status: STARTED
[15:53:29.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:8:0) after 1m23s
[15:54:52.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:8:0)
[15:54:52.924] Build status: STARTED
[15:54:52.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:9:0) after 2m30s
[15:57:23.073] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:9:0)
[15:57:23.096] Build status: STARTED
[15:57:23.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:10:0) after 6m23s
[16:03:46.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:10:0)
[16:03:46.216] Build status: STARTED
[16:03:46.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:11:0) after 8m25s
[16:12:11.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:11:0)
[16:12:11.351] Build status: STARTED
[16:12:11.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:12:0) after 7m0s
[16:19:11.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:12:0)
[16:19:11.499] Build status: STARTED
[16:19:11.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:13:0) after 9m1s
[16:28:12.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:13:0)
[16:28:12.700] Build status: STARTED
[16:28:12.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:14:0) after 8m0s
[16:36:12.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:14:0)
[16:36:12.945] Build status: STARTED
[16:36:12.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:15:0) after 1m20s
[16:37:32.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:15:0)
[16:37:33.034] Build status: STARTED
[16:37:33.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:16:0) after 8m43s
[16:46:16.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:16:0)
[16:46:16.086] Build status: STARTED
[16:46:16.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:17:0) after 7m31s
[16:53:47.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:17:0)
[16:53:47.336] Build status: STARTED
[16:53:47.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:18:0) after 9m1s
[17:02:48.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:18:0)
[17:02:48.599] Build status: STARTED
[17:02:48.599] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:19:0) after 5m19s
[17:08:07.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:19:0)
[17:08:07.924] Build status: STARTED
[17:08:07.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:20:0) after 4m6s
[17:12:13.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:20:0)
[17:12:14.002] Build status: STARTED
[17:12:14.002] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:21:0) after 3m4s
[17:15:18.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:21:0)
[17:15:18.105] Build status: STARTED
[17:15:18.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:22:0) after 6m11s
[17:21:29.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:22:0)
[17:21:29.181] Build status: STARTED
[17:21:29.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:23:0) after 4m2s
[17:25:31.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:23:0)
[17:25:31.731] Build status: STARTED
[17:25:31.731] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:24:0) after 4m49s
[17:30:20.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:24:0)
[17:30:20.794] Build status: STARTED
[17:30:20.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:25:0) after 4m43s
[17:35:03.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:25:0)
[17:35:03.866] Build status: STARTED
[17:35:03.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:26:0) after 9m31s
[17:44:34.898] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:26:0)
[17:44:34.916] Build status: STARTED
[17:44:34.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:27:0) after 5m34s
[17:50:09.041] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:27:0)
[17:50:09.076] Build status: STARTED
[17:50:09.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:28:0) after 2m43s
[17:52:52.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:28:0)
[17:52:52.248] Build status: STARTED
[17:52:52.248] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:29:0) after 3m8s
[17:56:00.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:29:0)
[17:56:00.612] Build status: STARTED
[17:56:00.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:30:0) after 1m7s
[17:57:07.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:30:0)
[17:57:07.778] Build status: STARTED
[17:57:07.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:31:0) after 7m57s
[18:05:05.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:31:0)
[18:05:05.110] Build status: STARTED
[18:05:05.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:32:0) after 8m34s
[18:13:39.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:32:0)
[18:13:39.162] Build status: STARTED
[18:13:39.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:33:0) after 8m16s
[18:21:55.349] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:33:0)
[18:21:55.383] Build status: STARTED
[18:21:55.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:34:0) after 1m2s
[18:22:57.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:34:0)
[18:22:57.886] Build status: STARTED
[18:22:57.887] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:35:0) after 3m2s
[18:25:59.950] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:35:0)
[18:25:59.966] Build status: STARTED
[18:25:59.966] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:36:0) after 1m9s
[18:27:09.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:36:0)
[18:27:09.171] Build status: STARTED
[18:27:09.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:37:0) after 7m6s
[18:34:15.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:37:0)
[18:34:15.217] Build status: STARTED
[18:34:15.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:38:0) after 8m43s
[18:42:58.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:38:0)
[18:42:58.510] Build status: STARTED
[18:42:58.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:39:0) after 9m10s
[18:52:09.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:39:0)
[18:52:09.071] Build status: STARTED
[18:52:09.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:40:0) after 9m48s
[19:01:57.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:40:0)
[19:01:57.181] Build status: STARTED
[19:01:57.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:41:0) after 7m17s
[19:09:14.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:41:0)
[19:09:14.675] Build status: STARTED
[19:09:14.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:42:0) after 3m6s
[19:12:20.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:42:0)
[19:12:20.726] Build status: STARTED
[19:12:20.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:43:0) after 3m22s
[19:15:42.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:43:0)
[19:15:42.777] Build status: STARTED
[19:15:42.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:44:0) after 6m30s
[19:22:12.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:44:0)
[19:22:12.892] Build status: STARTED
[19:22:12.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:45:0) after 4m48s
[19:27:00.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:45:0)
[19:27:00.996] Build status: STARTED
[19:27:00.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:46:0) after 8m22s
[19:35:22.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:46:0)
[19:35:22.990] Build status: STARTED
[19:35:22.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:47:0) after 2m32s
[19:37:55.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:47:0)
[19:37:55.041] Build status: STARTED
[19:37:55.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:48:0) after 3m24s
[19:41:19.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:48:0)
[19:41:19.272] Build status: STARTED
[19:41:19.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:49:0) after 2m41s
[19:44:00.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:49:0)
[19:44:00.331] Build status: STARTED
[19:44:00.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:50:0) after 2m45s
[19:46:45.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:50:0)
[19:46:45.666] Build status: STARTED
[19:46:45.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:51:0) after 3m9s
[19:49:54.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:51:0)
[19:49:54.709] Build status: STARTED
[19:49:54.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:52:0) after 2m25s
[19:52:19.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:52:0)
[19:52:19.729] Build status: STARTED
[19:52:19.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:53:0) after 6m47s
[19:59:06.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:53:0)
[19:59:06.915] Build status: STARTED
[19:59:06.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:54:0) after 7m12s
[20:06:19.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:54:0)
[20:06:19.074] Build status: STARTED
[20:06:19.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:55:0) after 8m37s
[20:14:56.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:55:0)
[20:14:56.174] Build status: STARTED
[20:14:56.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:56:0) after 1m19s
[20:16:15.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:56:0)
[20:16:15.422] Build status: STARTED
[20:16:15.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:57:0) after 3m47s
[20:20:02.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:57:0)
[20:20:02.478] Build status: STARTED
[20:20:02.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:58:0) after 2m23s
[20:22:25.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:58:0)
[20:22:25.571] Build status: STARTED
[20:22:25.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:59:0) after 2m28s
[20:24:53.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:59:0)
[20:24:53.578] Build status: STARTED
[20:24:53.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:60:0) after 6m42s
[20:31:35.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:60:0)
[20:31:35.632] Build status: STARTED
[20:31:35.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:61:0) after 3m4s
[20:34:39.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:61:0)
[20:34:39.694] Build status: STARTED
[20:34:39.694] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:62:0) after 5m34s
[20:40:13.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:62:0)
[20:40:13.755] Build status: STARTED
[20:40:13.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:63:0) after 6m3s
[20:46:17.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:63:0)
[20:46:17.331] Build status: STARTED
[20:46:17.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:64:0) after 6m45s
[20:53:02.357] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:64:0)
[20:53:02.376] Build status: STARTED
[20:53:02.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:65:0) after 9m38s
[21:02:40.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:65:0)
[21:02:40.447] Build status: STARTED
[21:02:40.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:66:0) after 7m43s
[21:10:23.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:66:0)
[21:10:23.588] Build status: STARTED
[21:10:23.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:67:0) after 2m32s
[21:12:55.781] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:67:0)
[21:12:55.800] Build status: STARTED
[21:12:55.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:68:0) after 7m59s
[21:20:55.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:68:0)
[21:20:55.161] Build status: STARTED
[21:20:55.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:69:0) after 8m19s
[21:29:14.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:69:0)
[21:29:14.339] Build status: STARTED
[21:29:14.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:70:0) after 2m31s
[21:31:45.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:70:0)
[21:31:45.439] Build status: STARTED
[21:31:45.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:71:0) after 9m29s
[21:41:14.458] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:71:0)
[21:41:14.614] Build status: STARTED
[21:41:14.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:72:0) after 1m54s
[21:43:08.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:72:0)
[21:43:08.723] Build status: STARTED
[21:43:08.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:73:0) after 7m42s
[21:50:50.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:73:0)
[21:50:50.892] Build status: STARTED
[21:50:50.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:74:0) after 3m49s
[21:54:40.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:74:0)
[21:54:40.203] Build status: STARTED
[21:54:40.203] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:75:0) after 3m28s
[21:58:08.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:75:0)
[21:58:08.274] Build status: STARTED
[21:58:08.274] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:76:0) after 8m32s
[22:06:40.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:76:0)
[22:06:40.761] Build status: STARTED
[22:06:40.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:77:0) after 5m53s
[22:12:33.804] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:77:0)
[22:12:33.894] Build status: STARTED
[22:12:33.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:78:0) after 6m26s
[22:18:59.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:78:0)
[22:19:00.009] Build status: STARTED
[22:19:00.009] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:79:0) after 4m24s
[22:23:24.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:79:0)
[22:23:24.202] Build status: STARTED
[22:23:24.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:80:0) after 4m27s
[22:27:51.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:80:0)
[22:27:51.800] Build status: STARTED
[22:27:51.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:81:0) after 9m55s
[22:37:46.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:81:0)
[22:37:46.895] Build status: STARTED
[22:37:46.895] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:82:0) after 5m10s
[22:42:57.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:82:0)
[22:42:57.090] Build status: STARTED
[22:42:57.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:83:0) after 4m8s
[22:47:05.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:83:0)
[22:47:05.234] Build status: STARTED
[22:47:05.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:84:0) after 6m3s
[22:53:08.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:84:0)
[22:53:08.379] Build status: STARTED
[22:53:08.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:85:0) after 1m4s
[22:54:12.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:85:0)
[22:54:12.502] Build status: STARTED
[22:54:12.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:86:0) after 2m8s
[22:56:21.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:86:0)
[22:56:21.111] Build status: STARTED
[22:56:21.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:87:0) after 6m24s
[23:02:45.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:87:0)
[23:02:45.219] Build status: STARTED
[23:02:45.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:88:0) after 2m47s
[23:05:32.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:88:0)
[23:05:32.349] Build status: STARTED
[23:05:32.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:89:0) after 8m28s
[23:14:00.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:89:0)
[23:14:00.500] Build status: STARTED
[23:14:00.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:90:0) after 6m44s
[23:20:44.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:90:0)
[23:20:44.674] Build status: STARTED
[23:20:44.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:91:0) after 3m43s
[23:24:27.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:91:0)
[23:24:27.807] Build status: STARTED
[23:24:27.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:92:0) after 5m9s
[23:29:36.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:92:0)
[23:29:36.850] Build status: STARTED
[23:29:36.850] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:93:0) after 8m8s
[23:37:44.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:93:0)
[23:37:44.974] Build status: STARTED
[23:37:44.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:94:0) after 9m22s
[23:47:07.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:94:0)
[23:47:07.042] Build status: STARTED
[23:47:07.042] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:95:0) after 7m7s
[23:54:14.293] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:95:0)
[23:54:14.314] Build status: STARTED
[23:54:14.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:96:0) after 2m41s
[23:56:55.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:96:0)
[23:56:55.350] Build status: STARTED
[23:56:55.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:97:0) after 7m2s
[00:03:57.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:97:0)
[00:03:57.790] Build status: STARTED
[00:03:57.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:98:0) after 3m28s
[00:07:26.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:98:0)
[00:07:26.084] Build status: STARTED
[00:07:26.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:99:0) after 9m47s
[00:17:13.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:99:0)
[00:17:13.202] Build status: STARTED
[00:17:13.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:100:0) after 1m0s
[00:18:13.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:100:0)
[00:18:13.761] Build status: STARTED
[00:18:13.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:101:0) after 8m26s
[00:26:39.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:101:0)
[00:26:40.034] Build status: STARTED
[00:26:40.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:102:0) after 2m6s
[00:28:46.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:102:0)
[00:28:46.221] Build status: STARTED
[00:28:46.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:103:0) after 6m36s
[00:35:22.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:103:0)
[00:35:22.286] Build status: STARTED
[00:35:22.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:104:0) after 5m33s
[00:40:55.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:104:0)
[00:40:55.562] Build status: STARTED
[00:40:55.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:105:0) after 8m28s
[00:49:23.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:105:0)
[00:49:23.638] Build status: STARTED
[00:49:23.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:106:0) after 6m2s
[00:55:25.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:106:0)
[00:55:25.869] Build status: STARTED
[00:55:25.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:107:0) after 2m11s
[00:57:37.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:107:0)
[00:57:37.081] Build status: STARTED
[00:57:37.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:108:0) after 8m43s
[01:06:20.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:108:0)
[01:06:20.101] Build status: STARTED
[01:06:20.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:109:0) after 6m57s
[01:13:17.144] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:109:0)
[01:13:17.164] Build status: STARTED
[01:13:17.164] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:110:0) after 2m40s
[01:15:57.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:110:0)
[01:15:57.415] Build status: STARTED
[01:15:57.415] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:111:0) after 7m38s
[01:23:35.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:111:0)
[01:23:35.533] Build status: STARTED
[01:23:35.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:112:0) after 9m0s
[01:32:35.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:112:0)
[01:32:35.867] Build status: STARTED
[01:32:35.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:113:0) after 5m15s
[01:37:51.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:113:0)
[01:37:51.281] Build status: STARTED
[01:37:51.281] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:114:0) after 5m49s
[01:43:40.459] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:114:0)
[01:43:40.497] Build status: STARTED
[01:43:40.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:115:0) after 6m52s
[01:50:32.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:115:0)
[01:50:32.673] Build status: STARTED
[01:50:32.673] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:116:0) after 6m17s
[01:56:49.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:116:0)
[01:56:49.962] Build status: STARTED
[01:56:49.962] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:117:0) after 1m23s
[01:58:13.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:117:0)
[01:58:13.038] Build status: STARTED
[01:58:13.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:118:0) after 9m24s
[02:07:37.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:118:0)
[02:07:37.101] Build status: STARTED
[02:07:37.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:119:0) after 9m20s
[02:16:57.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:119:0)
[02:16:57.301] Build status: STARTED
[02:16:57.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:120:0) after 7m15s
[02:24:12.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:120:0)
[02:24:12.571] Build status: STARTED
[02:24:12.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:121:0) after 3m11s
[02:27:23.705] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:121:0)
[02:27:23.797] Build status: STARTED
[02:27:23.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:122:0) after 4m18s
[02:31:41.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:122:0)
[02:31:41.929] Build status: STARTED
[02:31:41.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:123:0) after 2m49s
[02:34:31.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:123:0)
[02:34:31.206] Build status: STARTED
[02:34:31.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:124:0) after 4m7s
[02:38:38.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:124:0)
[02:38:38.363] Build status: STARTED
[02:38:38.363] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:125:0) after 3m36s
[02:42:14.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:125:0)
[02:42:14.480] Build status: STARTED
[02:42:14.480] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:126:0) after 8m11s
[02:50:25.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:126:0)
[02:50:25.632] Build status: STARTED
[02:50:25.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:127:0) after 8m42s
[02:59:07.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:127:0)
[02:59:07.756] Build status: STARTED
[02:59:07.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:128:0) after 4m21s
[03:03:28.784] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:128:0)
[03:03:28.815] Build status: STARTED
[03:03:28.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:129:0) after 2m41s
[03:06:09.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:129:0)
[03:06:09.865] Build status: STARTED
[03:06:09.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:130:0) after 5m9s
[03:11:19.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:130:0)
[03:11:19.061] Build status: STARTED
[03:11:19.062] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:131:0) after 7m40s
[03:18:59.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:131:0)
[03:18:59.198] Build status: STARTED
[03:18:59.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:132:0) after 7m4s
[03:26:03.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:132:0)
[03:26:03.336] Build status: STARTED
[03:26:03.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:133:0) after 4m44s
[03:30:47.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:133:0)
[03:30:47.492] Build status: STARTED
[03:30:47.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:134:0) after 3m54s
[03:34:41.593] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:134:0)
[03:34:41.625] Build status: STARTED
[03:34:41.625] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:135:0) after 2m22s
[03:37:03.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:135:0)
[03:37:03.632] Build status: STARTED
[03:37:03.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:136:0) after 3m55s
[03:40:58.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:136:0)
[03:40:58.716] Build status: STARTED
[03:40:58.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:137:0) after 3m0s
[03:43:58.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:137:0)
[03:43:58.796] Build status: STARTED
[03:43:58.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:138:0) after 6m34s
[03:50:32.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:138:0)
[03:50:32.874] Build status: STARTED
[03:50:32.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:139:0) after 6m13s
[03:56:46.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:139:0)
[03:56:46.084] Build status: STARTED
[03:56:46.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939200673258720336:140:0) after 9m14s
[04:05:20.982] Received PubSub notification, asking Buildbucket for the build status
[04:05:21.004] Build:
{
"id": "8773770611240643569",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1588,
"createdBy": "project:chromium",
"createTime": "2023-08-03T15:42:12.227420976Z",
"startTime": "2023-08-03T15:42:56.794561Z",
"endTime": "2023-08-04T04:05:19.739913Z",
"updateTime": "2023-08-04T04:05:19.739913Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c879b8bc5ba4145816fc69c3c3a10f748415ce60",
"ref": "refs/heads/main"
}
}
}
[04:05:21.004] Invocation finished in 12h23m10.084632636s with status FAILED