[20:57:12.343] New invocation is queued and will start shortly
[20:57:13.476] Starting the invocation (attempt 1)
[20:57:13.508] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e11d9458f14502dc7bd41facdef3ccc81e323b80"
[20:57:13.508] Popped gitiles commit info from properties and tags
[20:57:13.508] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:57:13.508] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:57:13.508] Buildbucket request:
{
"requestId": "8945975626170375872",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e11d9458f14502dc7bd41facdef3ccc81e323b80",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945975626170375872"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:57:13.938] Scheduled build:
{
"id": "8780545564204620657",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1441,
"createdBy": "project:chromium",
"createTime": "2023-05-20T20:57:13.591987248Z",
"updateTime": "2023-05-20T20:57:13.591987248Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e11d9458f14502dc7bd41facdef3ccc81e323b80",
"ref": "refs/heads/main"
}
}
}
[20:57:13.938] Task URL: https://cr-buildbucket.appspot.com/build/8780545564204620657
[20:57:13.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:2:0) after 2m31s
[20:57:27.047] Received PubSub notification, asking Buildbucket for the build status
[20:57:27.073] Build status: STARTED
[20:59:45.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:2:0)
[20:59:45.084] Build status: STARTED
[20:59:45.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:4:0) after 3m34s
[21:03:19.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:4:0)
[21:03:19.597] Build status: STARTED
[21:03:19.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:5:0) after 9m33s
[21:12:52.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:5:0)
[21:12:52.651] Build status: STARTED
[21:12:52.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:6:0) after 8m15s
[21:21:07.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:6:0)
[21:21:07.706] Build status: STARTED
[21:21:07.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:7:0) after 8m56s
[21:30:03.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:7:0)
[21:30:03.755] Build status: STARTED
[21:30:03.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:8:0) after 1m56s
[21:31:59.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:8:0)
[21:31:59.799] Build status: STARTED
[21:31:59.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:9:0) after 9m35s
[21:41:34.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:9:0)
[21:41:34.846] Build status: STARTED
[21:41:34.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:10:0) after 6m39s
[21:48:14.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:10:0)
[21:48:14.447] Build status: STARTED
[21:48:14.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:11:0) after 8m10s
[21:56:24.471] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:11:0)
[21:56:24.490] Build status: STARTED
[21:56:24.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:12:0) after 5m25s
[22:01:49.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:12:0)
[22:01:49.781] Build status: STARTED
[22:01:49.781] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:13:0) after 4m20s
[22:06:10.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:13:0)
[22:06:10.167] Build status: STARTED
[22:06:10.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:14:0) after 2m3s
[22:08:13.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:14:0)
[22:08:13.856] Build status: STARTED
[22:08:13.856] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:15:0) after 7m25s
[22:15:39.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:15:0)
[22:15:39.187] Build status: STARTED
[22:15:39.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:16:0) after 2m6s
[22:17:45.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:16:0)
[22:17:45.341] Build status: STARTED
[22:17:45.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:17:0) after 3m47s
[22:21:32.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:17:0)
[22:21:32.833] Build status: STARTED
[22:21:32.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:18:0) after 8m13s
[22:29:45.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:18:0)
[22:29:45.951] Build status: STARTED
[22:29:45.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:19:0) after 7m23s
[22:37:08.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:19:0)
[22:37:08.991] Build status: STARTED
[22:37:08.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:20:0) after 6m38s
[22:43:47.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:20:0)
[22:43:47.030] Build status: STARTED
[22:43:47.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:21:0) after 1m13s
[22:45:00.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:21:0)
[22:45:00.238] Build status: STARTED
[22:45:00.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:22:0) after 4m6s
[22:49:06.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:22:0)
[22:49:06.386] Build status: STARTED
[22:49:06.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:23:0) after 2m34s
[22:51:40.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:23:0)
[22:51:40.437] Build status: STARTED
[22:51:40.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:24:0) after 5m47s
[22:57:27.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:24:0)
[22:57:27.535] Build status: STARTED
[22:57:27.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:25:0) after 6m42s
[23:04:09.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:25:0)
[23:04:09.564] Build status: STARTED
[23:04:09.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:26:0) after 7m7s
[23:11:16.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:26:0)
[23:11:16.619] Build status: STARTED
[23:11:16.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:27:0) after 3m35s
[23:14:51.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:27:0)
[23:14:51.673] Build status: STARTED
[23:14:51.673] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:28:0) after 8m52s
[23:23:43.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:28:0)
[23:23:43.887] Build status: STARTED
[23:23:43.887] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:29:0) after 7m2s
[23:30:45.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:29:0)
[23:30:45.960] Build status: STARTED
[23:30:45.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:30:0) after 8m27s
[23:39:13.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:30:0)
[23:39:13.532] Build status: STARTED
[23:39:13.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:31:0) after 9m57s
[23:49:10.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:31:0)
[23:49:10.572] Build status: STARTED
[23:49:10.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:32:0) after 6m10s
[23:55:20.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:32:0)
[23:55:20.727] Build status: STARTED
[23:55:20.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:33:0) after 9m44s
[00:05:05.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:33:0)
[00:05:05.107] Build status: STARTED
[00:05:05.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:34:0) after 1m23s
[00:06:28.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:34:0)
[00:06:28.153] Build status: STARTED
[00:06:28.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:35:0) after 8m10s
[00:14:38.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:35:0)
[00:14:38.249] Build status: STARTED
[00:14:38.249] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:36:0) after 8m52s
[00:23:30.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:36:0)
[00:23:30.364] Build status: STARTED
[00:23:30.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:37:0) after 1m14s
[00:24:44.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:37:0)
[00:24:44.624] Build status: STARTED
[00:24:44.624] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:38:0) after 7m15s
[00:31:59.646] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:38:0)
[00:31:59.670] Build status: STARTED
[00:31:59.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:39:0) after 7m41s
[00:39:40.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:39:0)
[00:39:40.998] Build status: STARTED
[00:39:40.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:40:0) after 1m8s
[00:40:49.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:40:0)
[00:40:49.209] Build status: STARTED
[00:40:49.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:41:0) after 6m51s
[00:47:40.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:41:0)
[00:47:40.439] Build status: STARTED
[00:47:40.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:42:0) after 1m6s
[00:48:46.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:42:0)
[00:48:46.477] Build status: STARTED
[00:48:46.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:43:0) after 8m31s
[00:57:17.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:43:0)
[00:57:17.539] Build status: STARTED
[00:57:17.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:44:0) after 8m10s
[01:05:27.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:44:0)
[01:05:27.577] Build status: STARTED
[01:05:27.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:45:0) after 7m21s
[01:12:48.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:45:0)
[01:12:48.615] Build status: STARTED
[01:12:48.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:46:0) after 3m51s
[01:16:39.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:46:0)
[01:16:39.862] Build status: STARTED
[01:16:39.862] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:47:0) after 7m17s
[01:23:56.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:47:0)
[01:23:56.904] Build status: STARTED
[01:23:56.904] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:48:0) after 2m3s
[01:25:59.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:48:0)
[01:26:00.071] Build status: STARTED
[01:26:00.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:49:0) after 3m46s
[01:29:46.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:49:0)
[01:29:46.166] Build status: STARTED
[01:29:46.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:50:0) after 4m6s
[01:33:52.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:50:0)
[01:33:52.219] Build status: STARTED
[01:33:52.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:51:0) after 4m7s
[01:37:59.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:51:0)
[01:37:59.258] Build status: STARTED
[01:37:59.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:52:0) after 2m3s
[01:40:02.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:52:0)
[01:40:02.319] Build status: STARTED
[01:40:02.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:53:0) after 1m4s
[01:41:06.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:53:0)
[01:41:06.568] Build status: STARTED
[01:41:06.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:54:0) after 7m28s
[01:48:34.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:54:0)
[01:48:34.624] Build status: STARTED
[01:48:34.624] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:55:0) after 3m41s
[01:52:15.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:55:0)
[01:52:15.695] Build status: STARTED
[01:52:15.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:56:0) after 5m30s
[01:57:46.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:56:0)
[01:57:46.110] Build status: STARTED
[01:57:46.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:57:0) after 9m18s
[02:07:04.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:57:0)
[02:07:04.151] Build status: STARTED
[02:07:04.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:58:0) after 4m24s
[02:11:28.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:58:0)
[02:11:28.307] Build status: STARTED
[02:11:28.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:59:0) after 9m13s
[02:20:41.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:59:0)
[02:20:41.642] Build status: STARTED
[02:20:41.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:60:0) after 9m57s
[02:30:38.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:60:0)
[02:30:38.690] Build status: STARTED
[02:30:38.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:61:0) after 5m21s
[02:35:59.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:61:0)
[02:35:59.764] Build status: STARTED
[02:35:59.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:62:0) after 9m58s
[02:45:57.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:62:0)
[02:45:57.799] Build status: STARTED
[02:45:57.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:63:0) after 6m8s
[02:52:05.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:63:0)
[02:52:05.833] Build status: STARTED
[02:52:05.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:64:0) after 4m10s
[02:56:16.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:64:0)
[02:56:16.320] Build status: STARTED
[02:56:16.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:65:0) after 2m18s
[02:58:34.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:65:0)
[02:58:34.371] Build status: STARTED
[02:58:34.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:66:0) after 4m2s
[03:02:36.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:66:0)
[03:02:36.534] Build status: STARTED
[03:02:36.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:67:0) after 3m30s
[03:06:06.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:67:0)
[03:06:06.708] Build status: STARTED
[03:06:06.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:68:0) after 5m45s
[03:11:51.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:68:0)
[03:11:51.894] Build status: STARTED
[03:11:51.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:69:0) after 1m23s
[03:13:14.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:69:0)
[03:13:14.941] Build status: STARTED
[03:13:14.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:70:0) after 3m13s
[03:16:27.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:70:0)
[03:16:28.010] Build status: STARTED
[03:16:28.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:71:0) after 7m27s
[03:23:55.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:71:0)
[03:23:55.679] Build status: STARTED
[03:23:55.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:72:0) after 7m55s
[03:31:50.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:72:0)
[03:31:50.767] Build status: STARTED
[03:31:50.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:73:0) after 2m0s
[03:33:51.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:73:0)
[03:33:51.379] Build status: STARTED
[03:33:51.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:74:0) after 9m7s
[03:42:58.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:74:0)
[03:42:58.417] Build status: STARTED
[03:42:58.417] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:75:0) after 2m1s
[03:44:59.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:75:0)
[03:44:59.539] Build status: STARTED
[03:44:59.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:76:0) after 6m6s
[03:51:05.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:76:0)
[03:51:05.869] Build status: STARTED
[03:51:05.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:77:0) after 1m0s
[03:52:06.095] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:77:0)
[03:52:06.171] Build status: STARTED
[03:52:06.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:78:0) after 1m29s
[03:53:35.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:78:0)
[03:53:35.217] Build status: STARTED
[03:53:35.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:79:0) after 5m21s
[03:58:56.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:79:0)
[03:58:56.259] Build status: STARTED
[03:58:56.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:80:0) after 7m20s
[04:06:16.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:80:0)
[04:06:16.314] Build status: STARTED
[04:06:16.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:81:0) after 6m18s
[04:12:34.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:81:0)
[04:12:34.927] Build status: STARTED
[04:12:34.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:82:0) after 5m29s
[04:18:03.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:82:0)
[04:18:03.971] Build status: STARTED
[04:18:03.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:83:0) after 3m42s
[04:21:45.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:83:0)
[04:21:46.018] Build status: STARTED
[04:21:46.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:84:0) after 8m53s
[04:30:39.124] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:84:0)
[04:30:39.150] Build status: STARTED
[04:30:39.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:85:0) after 4m33s
[04:35:12.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:85:0)
[04:35:12.235] Build status: STARTED
[04:35:12.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:86:0) after 7m27s
[04:42:39.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:86:0)
[04:42:39.405] Build status: STARTED
[04:42:39.406] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:87:0) after 9m35s
[04:52:14.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:87:0)
[04:52:14.560] Build status: STARTED
[04:52:14.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:88:0) after 7m50s
[05:00:04.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:88:0)
[05:00:04.591] Build status: STARTED
[05:00:04.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:89:0) after 1m55s
[05:01:59.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:89:0)
[05:01:59.995] Build status: STARTED
[05:01:59.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:90:0) after 9m13s
[05:11:13.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:90:0)
[05:11:13.074] Build status: STARTED
[05:11:13.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:91:0) after 5m59s
[05:17:12.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:91:0)
[05:17:12.185] Build status: STARTED
[05:17:12.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:92:0) after 4m40s
[05:21:52.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:92:0)
[05:21:52.268] Build status: STARTED
[05:21:52.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:93:0) after 1m11s
[05:23:03.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:93:0)
[05:23:03.319] Build status: STARTED
[05:23:03.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:94:0) after 1m49s
[05:24:52.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:94:0)
[05:24:52.362] Build status: STARTED
[05:24:52.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:95:0) after 3m50s
[05:28:42.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:95:0)
[05:28:42.573] Build status: STARTED
[05:28:42.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:96:0) after 5m7s
[05:33:49.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:96:0)
[05:33:49.687] Build status: STARTED
[05:33:49.687] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:97:0) after 1m5s
[05:34:54.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:97:0)
[05:34:54.736] Build status: STARTED
[05:34:54.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:98:0) after 7m3s
[05:41:57.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:98:0)
[05:41:57.777] Build status: STARTED
[05:41:57.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:99:0) after 9m39s
[05:51:36.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:99:0)
[05:51:36.844] Build status: STARTED
[05:51:36.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:100:0) after 3m5s
[05:54:41.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:100:0)
[05:54:41.968] Build status: STARTED
[05:54:41.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:101:0) after 8m6s
[06:02:48.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:101:0)
[06:02:48.593] Build status: STARTED
[06:02:48.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:102:0) after 3m5s
[06:05:53.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:102:0)
[06:05:53.689] Build status: STARTED
[06:05:53.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:103:0) after 6m33s
[06:12:26.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:103:0)
[06:12:26.938] Build status: STARTED
[06:12:26.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:104:0) after 8m5s
[06:20:31.963] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:104:0)
[06:20:31.987] Build status: STARTED
[06:20:31.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:105:0) after 3m59s
[06:24:31.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:105:0)
[06:24:31.371] Build status: STARTED
[06:24:31.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:106:0) after 8m27s
[06:32:58.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:106:0)
[06:32:58.557] Build status: STARTED
[06:32:58.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:107:0) after 9m33s
[06:42:31.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:107:0)
[06:42:31.996] Build status: STARTED
[06:42:31.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:108:0) after 2m57s
[06:45:29.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:108:0)
[06:45:29.446] Build status: STARTED
[06:45:29.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:109:0) after 8m20s
[06:53:49.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:109:0)
[06:53:49.725] Build status: STARTED
[06:53:49.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:110:0) after 8m14s
[07:02:04.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:110:0)
[07:02:04.328] Build status: STARTED
[07:02:04.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:111:0) after 6m5s
[07:08:09.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:111:0)
[07:08:09.376] Build status: STARTED
[07:08:09.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:112:0) after 4m21s
[07:12:30.413] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:112:0)
[07:12:30.581] Build status: STARTED
[07:12:30.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:113:0) after 8m28s
[07:20:58.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:113:0)
[07:20:58.648] Build status: STARTED
[07:20:58.648] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:114:0) after 9m42s
[07:30:40.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:114:0)
[07:30:40.876] Build status: STARTED
[07:30:40.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:115:0) after 6m0s
[07:36:40.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:115:0)
[07:36:40.935] Build status: STARTED
[07:36:40.935] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:116:0) after 2m14s
[07:38:55.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:116:0)
[07:38:55.173] Build status: STARTED
[07:38:55.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:117:0) after 4m34s
[07:43:29.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:117:0)
[07:43:29.445] Build status: STARTED
[07:43:29.445] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:118:0) after 6m46s
[07:50:15.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:118:0)
[07:50:15.512] Build status: STARTED
[07:50:15.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:119:0) after 9m47s
[08:00:02.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:119:0)
[08:00:02.810] Build status: STARTED
[08:00:02.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:120:0) after 2m30s
[08:02:32.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:120:0)
[08:02:32.848] Build status: STARTED
[08:02:32.848] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:121:0) after 4m45s
[08:07:17.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:121:0)
[08:07:17.938] Build status: STARTED
[08:07:17.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:122:0) after 3m54s
[08:11:11.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:122:0)
[08:11:11.975] Build status: STARTED
[08:11:11.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:123:0) after 7m48s
[08:19:00.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:123:0)
[08:19:00.101] Build status: STARTED
[08:19:00.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:124:0) after 4m15s
[08:23:15.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:124:0)
[08:23:15.149] Build status: STARTED
[08:23:15.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:125:0) after 6m18s
[08:29:33.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:125:0)
[08:29:33.218] Build status: STARTED
[08:29:33.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:126:0) after 3m15s
[08:32:48.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:126:0)
[08:32:48.266] Build status: STARTED
[08:32:48.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:127:0) after 3m32s
[08:36:20.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:127:0)
[08:36:20.363] Build status: STARTED
[08:36:20.363] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:128:0) after 8m49s
[08:45:09.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:128:0)
[08:45:09.420] Build status: STARTED
[08:45:09.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:129:0) after 5m23s
[08:50:32.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:129:0)
[08:50:32.462] Build status: STARTED
[08:50:32.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:130:0) after 8m53s
[08:59:25.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:130:0)
[08:59:25.511] Build status: STARTED
[08:59:25.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:131:0) after 8m18s
[09:07:43.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:131:0)
[09:07:43.555] Build status: STARTED
[09:07:43.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:132:0) after 5m0s
[09:12:43.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:132:0)
[09:12:43.593] Build status: STARTED
[09:12:43.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:133:0) after 7m3s
[09:19:46.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:133:0)
[09:19:46.793] Build status: STARTED
[09:19:46.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945975626170375872:134:0) after 3m32s
[09:20:07.306] Received PubSub notification, asking Buildbucket for the build status
[09:20:07.332] Build:
{
"id": "8780545564204620657",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1441,
"createdBy": "project:chromium",
"createTime": "2023-05-20T20:57:13.591987248Z",
"startTime": "2023-05-20T20:57:20.583037Z",
"endTime": "2023-05-21T09:20:06.668931Z",
"updateTime": "2023-05-21T09:20:06.668931Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e11d9458f14502dc7bd41facdef3ccc81e323b80",
"ref": "refs/heads/main"
}
}
}
[09:20:07.332] Invocation finished in 12h22m54.999549373s with status FAILED