[09:13:34.883] New invocation is queued and will start shortly
[09:13:36.071] Starting the invocation (attempt 1)
[09:13:36.105] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9bc323c055045504834b9237b4201548027b8deb"
[09:13:36.105] Popped gitiles commit info from properties and tags
[09:13:36.105] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:13:36.106] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:13:36.106] Buildbucket request:
{
"requestId": "8937141391681753328",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9bc323c055045504834b9237b4201548027b8deb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8937141391681753328"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:13:36.626] Scheduled build:
{
"id": "8771711329674241921",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1632,
"createdBy": "project:chromium",
"createTime": "2023-08-26T09:13:36.167850248Z",
"updateTime": "2023-08-26T09:13:36.167850248Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9bc323c055045504834b9237b4201548027b8deb",
"ref": "refs/heads/main"
}
}
}
[09:13:36.626] Task URL: https://cr-buildbucket.appspot.com/build/8771711329674241921
[09:13:36.626] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:2:0) after 1m10s
[09:13:37.575] Received PubSub notification, asking Buildbucket for the build status
[09:13:37.600] Build status: SCHEDULED
[09:13:40.424] Received PubSub notification, asking Buildbucket for the build status
[09:13:40.454] Build status: STARTED
[09:14:46.656] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:2:0)
[09:14:46.681] Build status: STARTED
[09:14:46.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:5:0) after 4m29s
[09:19:15.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:5:0)
[09:19:15.909] Build status: STARTED
[09:19:15.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:6:0) after 5m35s
[09:24:51.040] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:6:0)
[09:24:51.066] Build status: STARTED
[09:24:51.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:7:0) after 2m55s
[09:27:46.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:7:0)
[09:27:46.307] Build status: STARTED
[09:27:46.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:8:0) after 9m28s
[09:37:14.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:8:0)
[09:37:14.344] Build status: STARTED
[09:37:14.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:9:0) after 6m36s
[09:43:50.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:9:0)
[09:43:50.401] Build status: STARTED
[09:43:50.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:10:0) after 7m2s
[09:50:52.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:10:0)
[09:50:52.433] Build status: STARTED
[09:50:52.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:11:0) after 9m18s
[10:00:10.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:11:0)
[10:00:10.806] Build status: STARTED
[10:00:10.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:12:0) after 2m23s
[10:02:33.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:12:0)
[10:02:34.010] Build status: STARTED
[10:02:34.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:13:0) after 7m22s
[10:09:56.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:13:0)
[10:09:56.065] Build status: STARTED
[10:09:56.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:14:0) after 4m52s
[10:14:48.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:14:0)
[10:14:48.133] Build status: STARTED
[10:14:48.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:15:0) after 8m56s
[10:23:44.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:15:0)
[10:23:44.173] Build status: STARTED
[10:23:44.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:16:0) after 4m28s
[10:28:12.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:16:0)
[10:28:12.367] Build status: STARTED
[10:28:12.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:17:0) after 6m52s
[10:35:04.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:17:0)
[10:35:04.438] Build status: STARTED
[10:35:04.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:18:0) after 6m55s
[10:41:59.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:18:0)
[10:41:59.503] Build status: STARTED
[10:41:59.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:19:0) after 2m5s
[10:44:04.668] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:19:0)
[10:44:04.749] Build status: STARTED
[10:44:04.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:20:0) after 6m4s
[10:50:08.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:20:0)
[10:50:08.751] Build status: STARTED
[10:50:08.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:21:0) after 3m41s
[10:53:49.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:21:0)
[10:53:49.813] Build status: STARTED
[10:53:49.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:22:0) after 4m49s
[10:58:38.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:22:0)
[10:58:38.868] Build status: STARTED
[10:58:38.868] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:23:0) after 8m16s
[11:06:54.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:23:0)
[11:06:54.923] Build status: STARTED
[11:06:54.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:24:0) after 8m20s
[11:15:14.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:24:0)
[11:15:15.011] Build status: STARTED
[11:15:15.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:25:0) after 8m51s
[11:24:06.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:25:0)
[11:24:06.499] Build status: STARTED
[11:24:06.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:26:0) after 4m11s
[11:28:17.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:26:0)
[11:28:17.556] Build status: STARTED
[11:28:17.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:27:0) after 2m10s
[11:30:27.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:27:0)
[11:30:27.598] Build status: STARTED
[11:30:27.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:28:0) after 8m46s
[11:39:13.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:28:0)
[11:39:13.748] Build status: STARTED
[11:39:13.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:29:0) after 4m3s
[11:43:16.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:29:0)
[11:43:16.853] Build status: STARTED
[11:43:16.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:30:0) after 3m24s
[11:46:41.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:30:0)
[11:46:41.051] Build status: STARTED
[11:46:41.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:31:0) after 6m43s
[11:53:24.082] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:31:0)
[11:53:24.101] Build status: STARTED
[11:53:24.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:32:0) after 8m8s
[12:01:32.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:32:0)
[12:01:32.238] Build status: STARTED
[12:01:32.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:33:0) after 8m15s
[12:09:47.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:33:0)
[12:09:47.299] Build status: STARTED
[12:09:47.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:34:0) after 8m1s
[12:17:48.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:34:0)
[12:17:48.395] Build status: STARTED
[12:17:48.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:35:0) after 3m6s
[12:20:54.576] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:35:0)
[12:20:54.594] Build status: STARTED
[12:20:54.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:36:0) after 1m16s
[12:22:10.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:36:0)
[12:22:10.634] Build status: STARTED
[12:22:10.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:37:0) after 2m20s
[12:24:30.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:37:0)
[12:24:30.844] Build status: STARTED
[12:24:30.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:38:0) after 4m26s
[12:28:57.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:38:0)
[12:28:57.456] Build status: STARTED
[12:28:57.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:39:0) after 8m12s
[12:37:09.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:39:0)
[12:37:09.527] Build status: STARTED
[12:37:09.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:40:0) after 3m18s
[12:40:27.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:40:0)
[12:40:27.590] Build status: STARTED
[12:40:27.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:41:0) after 1m24s
[12:41:51.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:41:0)
[12:41:51.645] Build status: STARTED
[12:41:51.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:42:0) after 8m23s
[12:50:14.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:42:0)
[12:50:14.808] Build status: STARTED
[12:50:14.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:43:0) after 1m32s
[12:51:46.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:43:0)
[12:51:46.961] Build status: STARTED
[12:51:46.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:44:0) after 1m20s
[12:53:07.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:44:0)
[12:53:07.078] Build status: STARTED
[12:53:07.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:45:0) after 9m4s
[13:02:11.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:45:0)
[13:02:11.127] Build status: STARTED
[13:02:11.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:46:0) after 4m53s
[13:07:04.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:46:0)
[13:07:04.178] Build status: STARTED
[13:07:04.178] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:47:0) after 4m16s
[13:11:20.196] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:47:0)
[13:11:20.244] Build status: STARTED
[13:11:20.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:48:0) after 9m3s
[13:20:23.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:48:0)
[13:20:23.301] Build status: STARTED
[13:20:23.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:49:0) after 2m54s
[13:23:17.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:49:0)
[13:23:17.392] Build status: STARTED
[13:23:17.392] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:50:0) after 4m51s
[13:28:08.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:50:0)
[13:28:08.533] Build status: STARTED
[13:28:08.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:51:0) after 2m31s
[13:30:39.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:51:0)
[13:30:39.600] Build status: STARTED
[13:30:39.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:52:0) after 3m12s
[13:33:51.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:52:0)
[13:33:51.683] Build status: STARTED
[13:33:51.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:53:0) after 2m18s
[13:36:09.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:53:0)
[13:36:09.731] Build status: STARTED
[13:36:09.731] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:54:0) after 8m9s
[13:44:18.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:54:0)
[13:44:18.873] Build status: STARTED
[13:44:18.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:55:0) after 1m21s
[13:45:40.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:55:0)
[13:45:40.036] Build status: STARTED
[13:45:40.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:56:0) after 3m36s
[13:49:16.631] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:56:0)
[13:49:16.657] Build status: STARTED
[13:49:16.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:57:0) after 3m41s
[13:52:57.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:57:0)
[13:52:57.825] Build status: STARTED
[13:52:57.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:58:0) after 7m58s
[14:00:56.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:58:0)
[14:00:56.555] Build status: STARTED
[14:00:56.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:59:0) after 8m55s
[14:09:51.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:59:0)
[14:09:51.612] Build status: STARTED
[14:09:51.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:60:0) after 8m38s
[14:18:29.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:60:0)
[14:18:29.665] Build status: STARTED
[14:18:29.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:61:0) after 6m15s
[14:24:44.691] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:61:0)
[14:24:44.754] Build status: STARTED
[14:24:44.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:62:0) after 9m7s
[14:33:51.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:62:0)
[14:33:52.003] Build status: STARTED
[14:33:52.003] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:63:0) after 2m38s
[14:36:30.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:63:0)
[14:36:30.122] Build status: STARTED
[14:36:30.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:64:0) after 6m19s
[14:42:49.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:64:0)
[14:42:49.159] Build status: STARTED
[14:42:49.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:65:0) after 4m17s
[14:47:06.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:65:0)
[14:47:06.229] Build status: STARTED
[14:47:06.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:66:0) after 6m41s
[14:53:47.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:66:0)
[14:53:47.285] Build status: STARTED
[14:53:47.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:67:0) after 4m9s
[14:57:56.319] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:67:0)
[14:57:56.391] Build status: STARTED
[14:57:56.391] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:68:0) after 7m17s
[15:05:13.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:68:0)
[15:05:13.675] Build status: STARTED
[15:05:13.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:69:0) after 3m17s
[15:08:30.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:69:0)
[15:08:30.746] Build status: STARTED
[15:08:30.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:70:0) after 8m4s
[15:16:34.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:70:0)
[15:16:34.896] Build status: STARTED
[15:16:34.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:71:0) after 3m6s
[15:19:40.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:71:0)
[15:19:41.010] Build status: STARTED
[15:19:41.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:72:0) after 8m31s
[15:28:12.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:72:0)
[15:28:12.083] Build status: STARTED
[15:28:12.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:73:0) after 9m46s
[15:37:58.274] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:73:0)
[15:37:58.293] Build status: STARTED
[15:37:58.294] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:74:0) after 5m40s
[15:43:38.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:74:0)
[15:43:38.348] Build status: STARTED
[15:43:38.348] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:75:0) after 2m18s
[15:45:56.445] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:75:0)
[15:45:56.471] Build status: STARTED
[15:45:56.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:76:0) after 8m59s
[15:54:55.526] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:76:0)
[15:54:55.549] Build status: STARTED
[15:54:55.549] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:77:0) after 4m10s
[15:59:05.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:77:0)
[15:59:05.587] Build status: STARTED
[15:59:05.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:78:0) after 9m28s
[16:08:33.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:78:0)
[16:08:33.649] Build status: STARTED
[16:08:33.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:79:0) after 2m38s
[16:11:11.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:79:0)
[16:11:11.693] Build status: STARTED
[16:11:11.694] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:80:0) after 3m40s
[16:14:51.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:80:0)
[16:14:51.786] Build status: STARTED
[16:14:51.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:81:0) after 6m2s
[16:20:53.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:81:0)
[16:20:53.849] Build status: STARTED
[16:20:53.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:82:0) after 1m8s
[16:22:02.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:82:0)
[16:22:02.069] Build status: STARTED
[16:22:02.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:83:0) after 3m26s
[16:25:28.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:83:0)
[16:25:28.367] Build status: STARTED
[16:25:28.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:84:0) after 5m4s
[16:30:32.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:84:0)
[16:30:32.432] Build status: STARTED
[16:30:32.432] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:85:0) after 2m2s
[16:32:34.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:85:0)
[16:32:34.679] Build status: STARTED
[16:32:34.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:86:0) after 9m38s
[16:42:12.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:86:0)
[16:42:12.716] Build status: STARTED
[16:42:12.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:87:0) after 1m35s
[16:43:47.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:87:0)
[16:43:47.987] Build status: STARTED
[16:43:47.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:88:0) after 4m24s
[16:48:12.100] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:88:0)
[16:48:12.236] Build status: STARTED
[16:48:12.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:89:0) after 3m3s
[16:51:15.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:89:0)
[16:51:15.292] Build status: STARTED
[16:51:15.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:90:0) after 7m6s
[16:58:21.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:90:0)
[16:58:21.333] Build status: STARTED
[16:58:21.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:91:0) after 2m23s
[17:00:44.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:91:0)
[17:00:44.381] Build status: STARTED
[17:00:44.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:92:0) after 6m18s
[17:07:02.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:92:0)
[17:07:02.424] Build status: STARTED
[17:07:02.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:93:0) after 4m47s
[17:11:49.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:93:0)
[17:11:49.486] Build status: STARTED
[17:11:49.486] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:94:0) after 7m36s
[17:19:25.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:94:0)
[17:19:25.657] Build status: STARTED
[17:19:25.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:95:0) after 9m44s
[17:29:09.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:95:0)
[17:29:09.747] Build status: STARTED
[17:29:09.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:96:0) after 7m5s
[17:36:14.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:96:0)
[17:36:14.856] Build status: STARTED
[17:36:14.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:97:0) after 3m56s
[17:40:10.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:97:0)
[17:40:10.913] Build status: STARTED
[17:40:10.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:98:0) after 5m13s
[17:45:23.937] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:98:0)
[17:45:23.957] Build status: STARTED
[17:45:23.957] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:99:0) after 2m7s
[17:47:31.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:99:0)
[17:47:31.079] Build status: STARTED
[17:47:31.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:100:0) after 9m4s
[17:56:35.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:100:0)
[17:56:35.216] Build status: STARTED
[17:56:35.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:101:0) after 7m1s
[18:03:36.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:101:0)
[18:03:36.323] Build status: STARTED
[18:03:36.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:102:0) after 1m4s
[18:04:40.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:102:0)
[18:04:40.414] Build status: STARTED
[18:04:40.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:103:0) after 1m33s
[18:06:13.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:103:0)
[18:06:13.511] Build status: STARTED
[18:06:13.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:104:0) after 5m22s
[18:11:35.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:104:0)
[18:11:35.653] Build status: STARTED
[18:11:35.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:105:0) after 6m24s
[18:17:59.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:105:0)
[18:17:59.714] Build status: STARTED
[18:17:59.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:106:0) after 6m7s
[18:24:06.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:106:0)
[18:24:06.725] Build status: STARTED
[18:24:06.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:107:0) after 8m28s
[18:32:34.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:107:0)
[18:32:34.821] Build status: STARTED
[18:32:34.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:108:0) after 3m58s
[18:36:33.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:108:0)
[18:36:33.108] Build status: STARTED
[18:36:33.108] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:109:0) after 3m45s
[18:40:18.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:109:0)
[18:40:18.418] Build status: STARTED
[18:40:18.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:110:0) after 3m35s
[18:43:54.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:110:0)
[18:43:54.220] Build status: STARTED
[18:43:54.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:111:0) after 3m38s
[18:47:32.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:111:0)
[18:47:32.323] Build status: STARTED
[18:47:32.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:112:0) after 3m14s
[18:50:46.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:112:0)
[18:50:46.449] Build status: STARTED
[18:50:46.449] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:113:0) after 5m17s
[18:56:03.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:113:0)
[18:56:03.587] Build status: STARTED
[18:56:03.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:114:0) after 6m46s
[19:02:49.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:114:0)
[19:02:49.629] Build status: STARTED
[19:02:49.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:115:0) after 6m15s
[19:09:04.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:115:0)
[19:09:04.807] Build status: STARTED
[19:09:04.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:116:0) after 3m43s
[19:12:47.963] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:116:0)
[19:12:47.982] Build status: STARTED
[19:12:47.982] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:117:0) after 3m25s
[19:16:13.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:117:0)
[19:16:13.124] Build status: STARTED
[19:16:13.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:118:0) after 5m9s
[19:21:22.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:118:0)
[19:21:22.330] Build status: STARTED
[19:21:22.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:119:0) after 2m5s
[19:23:27.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:119:0)
[19:23:27.559] Build status: STARTED
[19:23:27.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:120:0) after 6m58s
[19:30:25.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:120:0)
[19:30:25.661] Build status: STARTED
[19:30:25.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:121:0) after 5m38s
[19:36:03.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:121:0)
[19:36:03.783] Build status: STARTED
[19:36:03.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:122:0) after 8m4s
[19:44:07.925] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:122:0)
[19:44:07.943] Build status: STARTED
[19:44:07.943] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:123:0) after 7m29s
[19:51:37.090] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:123:0)
[19:51:37.132] Build status: STARTED
[19:51:37.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:124:0) after 5m21s
[19:56:58.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:124:0)
[19:56:58.224] Build status: STARTED
[19:56:58.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:125:0) after 2m7s
[19:59:05.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:125:0)
[19:59:05.266] Build status: STARTED
[19:59:05.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:126:0) after 9m14s
[20:08:19.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:126:0)
[20:08:19.613] Build status: STARTED
[20:08:19.613] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:127:0) after 5m5s
[20:13:24.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:127:0)
[20:13:24.789] Build status: STARTED
[20:13:24.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:128:0) after 8m25s
[20:21:50.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:128:0)
[20:21:50.137] Build status: STARTED
[20:21:50.137] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:129:0) after 8m57s
[20:30:47.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:129:0)
[20:30:47.228] Build status: STARTED
[20:30:47.228] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:130:0) after 1m18s
[20:32:05.388] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:130:0)
[20:32:05.409] Build status: STARTED
[20:32:05.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:131:0) after 6m57s
[20:39:02.517] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:131:0)
[20:39:02.614] Build status: STARTED
[20:39:02.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:132:0) after 7m0s
[20:46:02.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:132:0)
[20:46:02.660] Build status: STARTED
[20:46:02.660] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:133:0) after 7m54s
[20:53:56.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:133:0)
[20:53:56.857] Build status: STARTED
[20:53:56.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:134:0) after 5m31s
[20:59:27.882] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:134:0)
[20:59:27.903] Build status: STARTED
[20:59:27.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:135:0) after 9m28s
[21:08:56.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:135:0)
[21:08:56.025] Build status: STARTED
[21:08:56.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:136:0) after 6m11s
[21:15:07.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:136:0)
[21:15:07.093] Build status: STARTED
[21:15:07.093] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:137:0) after 1m42s
[21:16:49.155] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:137:0)
[21:16:49.175] Build status: STARTED
[21:16:49.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:138:0) after 1m8s
[21:17:57.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:138:0)
[21:17:57.314] Build status: STARTED
[21:17:57.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:139:0) after 7m53s
[21:25:50.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:139:0)
[21:25:50.442] Build status: STARTED
[21:25:50.442] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:140:0) after 2m46s
[21:28:36.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:140:0)
[21:28:36.649] Build status: STARTED
[21:28:36.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:141:0) after 3m32s
[21:32:08.677] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:141:0)
[21:32:08.707] Build status: STARTED
[21:32:08.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937141391681753328:142:0) after 4m40s
[21:36:31.472] Received PubSub notification, asking Buildbucket for the build status
[21:36:31.502] Build:
{
"id": "8771711329674241921",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1632,
"createdBy": "project:chromium",
"createTime": "2023-08-26T09:13:36.167850248Z",
"startTime": "2023-08-26T09:13:39.463210Z",
"endTime": "2023-08-26T21:36:30.800567Z",
"updateTime": "2023-08-26T21:36:30.800567Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9bc323c055045504834b9237b4201548027b8deb",
"ref": "refs/heads/main"
}
}
}
[21:36:31.502] Invocation finished in 12h22m56.632930044s with status FAILED