[21:36:32.325] New invocation is queued and will start shortly
[21:36:33.398] Starting the invocation (attempt 1)
[21:36:33.423] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e63fa16f28b47885411b40115559af24173a491a"
[21:36:33.423] Popped gitiles commit info from properties and tags
[21:36:33.424] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:36:33.425] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:36:33.425] Buildbucket request:
{
"requestId": "8937094648836959168",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e63fa16f28b47885411b40115559af24173a491a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8937094648836959168"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:36:34.026] Scheduled build:
{
"id": "8771664586967388833",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1633,
"createdBy": "project:chromium",
"createTime": "2023-08-26T21:36:33.486450639Z",
"updateTime": "2023-08-26T21:36:33.486450639Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e63fa16f28b47885411b40115559af24173a491a",
"ref": "refs/heads/main"
}
}
}
[21:36:34.026] Task URL: https://cr-buildbucket.appspot.com/build/8771664586967388833
[21:36:34.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:2:0) after 2m22s
[21:36:34.943] Received PubSub notification, asking Buildbucket for the build status
[21:36:34.994] Build status: SCHEDULED
[21:36:42.479] Received PubSub notification, asking Buildbucket for the build status
[21:36:42.493] Build status: STARTED
[21:38:56.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:2:0)
[21:38:56.072] Build status: STARTED
[21:38:56.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:5:0) after 3m57s
[21:42:53.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:5:0)
[21:42:53.134] Build status: STARTED
[21:42:53.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:6:0) after 3m19s
[21:46:12.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:6:0)
[21:46:12.174] Build status: STARTED
[21:46:12.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:7:0) after 4m26s
[21:50:38.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:7:0)
[21:50:38.238] Build status: STARTED
[21:50:38.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:8:0) after 7m13s
[21:57:51.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:8:0)
[21:57:51.289] Build status: STARTED
[21:57:51.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:9:0) after 3m34s
[22:01:25.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:9:0)
[22:01:25.367] Build status: STARTED
[22:01:25.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:10:0) after 3m47s
[22:05:12.488] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:10:0)
[22:05:12.513] Build status: STARTED
[22:05:12.513] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:11:0) after 3m30s
[22:08:42.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:11:0)
[22:08:42.558] Build status: STARTED
[22:08:42.558] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:12:0) after 9m14s
[22:17:56.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:12:0)
[22:17:56.623] Build status: STARTED
[22:17:56.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:13:0) after 2m7s
[22:20:04.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:13:0)
[22:20:04.714] Build status: STARTED
[22:20:04.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:14:0) after 5m32s
[22:25:36.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:14:0)
[22:25:36.776] Build status: STARTED
[22:25:36.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:15:0) after 9m6s
[22:34:42.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:15:0)
[22:34:43.012] Build status: STARTED
[22:34:43.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:16:0) after 7m37s
[22:42:20.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:16:0)
[22:42:20.216] Build status: STARTED
[22:42:20.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:17:0) after 9m43s
[22:52:03.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:17:0)
[22:52:03.332] Build status: STARTED
[22:52:03.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:18:0) after 4m8s
[22:56:11.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:18:0)
[22:56:11.381] Build status: STARTED
[22:56:11.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:19:0) after 4m23s
[23:00:34.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:19:0)
[23:00:34.500] Build status: STARTED
[23:00:34.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:20:0) after 6m9s
[23:06:43.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:20:0)
[23:06:43.838] Build status: STARTED
[23:06:43.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:21:0) after 7m31s
[23:14:14.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:21:0)
[23:14:14.865] Build status: STARTED
[23:14:14.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:22:0) after 5m1s
[23:19:16.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:22:0)
[23:19:16.075] Build status: STARTED
[23:19:16.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:23:0) after 3m44s
[23:23:00.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:23:0)
[23:23:00.317] Build status: STARTED
[23:23:00.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:24:0) after 5m44s
[23:28:44.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:24:0)
[23:28:44.929] Build status: STARTED
[23:28:44.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:25:0) after 2m58s
[23:31:43.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:25:0)
[23:31:43.422] Build status: STARTED
[23:31:43.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:26:0) after 4m41s
[23:36:25.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:26:0)
[23:36:25.350] Build status: STARTED
[23:36:25.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:27:0) after 8m8s
[23:44:33.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:27:0)
[23:44:33.512] Build status: STARTED
[23:44:33.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:28:0) after 3m53s
[23:48:26.977] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:28:0)
[23:48:27.000] Build status: STARTED
[23:48:27.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:29:0) after 9m34s
[23:58:01.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:29:0)
[23:58:01.113] Build status: STARTED
[23:58:01.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:30:0) after 1m33s
[23:59:34.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:30:0)
[23:59:34.155] Build status: STARTED
[23:59:34.155] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:31:0) after 8m59s
[00:08:33.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:31:0)
[00:08:33.292] Build status: STARTED
[00:08:33.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:32:0) after 8m58s
[00:17:31.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:32:0)
[00:17:31.367] Build status: STARTED
[00:17:31.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:33:0) after 4m22s
[00:21:53.388] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:33:0)
[00:21:53.412] Build status: STARTED
[00:21:53.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:34:0) after 2m25s
[00:24:18.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:34:0)
[00:24:18.453] Build status: STARTED
[00:24:18.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:35:0) after 4m3s
[00:28:21.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:35:0)
[00:28:21.572] Build status: STARTED
[00:28:21.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:36:0) after 5m18s
[00:33:39.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:36:0)
[00:33:39.630] Build status: STARTED
[00:33:39.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:37:0) after 6m54s
[00:40:33.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:37:0)
[00:40:33.703] Build status: STARTED
[00:40:33.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:38:0) after 1m43s
[00:42:16.733] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:38:0)
[00:42:16.783] Build status: STARTED
[00:42:16.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:39:0) after 3m15s
[00:45:31.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:39:0)
[00:45:31.930] Build status: STARTED
[00:45:31.930] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:40:0) after 8m32s
[00:54:03.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:40:0)
[00:54:03.981] Build status: STARTED
[00:54:03.981] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:41:0) after 8m3s
[01:02:07.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:41:0)
[01:02:07.259] Build status: STARTED
[01:02:07.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:42:0) after 4m44s
[01:06:51.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:42:0)
[01:06:51.310] Build status: STARTED
[01:06:51.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:43:0) after 7m7s
[01:13:58.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:43:0)
[01:13:58.931] Build status: STARTED
[01:13:58.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:44:0) after 7m58s
[01:21:57.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:44:0)
[01:21:57.166] Build status: STARTED
[01:21:57.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:45:0) after 6m31s
[01:28:28.184] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:45:0)
[01:28:28.205] Build status: STARTED
[01:28:28.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:46:0) after 6m39s
[01:35:07.414] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:46:0)
[01:35:07.443] Build status: STARTED
[01:35:07.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:47:0) after 9m51s
[01:44:58.459] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:47:0)
[01:44:58.485] Build status: STARTED
[01:44:58.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:48:0) after 8m49s
[01:53:47.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:48:0)
[01:53:47.514] Build status: STARTED
[01:53:47.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:49:0) after 8m2s
[02:01:49.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:49:0)
[02:01:49.554] Build status: STARTED
[02:01:49.554] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:50:0) after 4m57s
[02:06:46.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:50:0)
[02:06:46.622] Build status: STARTED
[02:06:46.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:51:0) after 3m9s
[02:09:55.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:51:0)
[02:09:55.670] Build status: STARTED
[02:09:55.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:52:0) after 4m28s
[02:14:23.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:52:0)
[02:14:23.777] Build status: STARTED
[02:14:23.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:53:0) after 2m43s
[02:17:06.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:53:0)
[02:17:06.801] Build status: STARTED
[02:17:06.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:54:0) after 5m29s
[02:22:35.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:54:0)
[02:22:35.942] Build status: STARTED
[02:22:35.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:55:0) after 2m14s
[02:24:49.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:55:0)
[02:24:49.981] Build status: STARTED
[02:24:49.981] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:56:0) after 9m7s
[02:33:57.065] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:56:0)
[02:33:57.112] Build status: STARTED
[02:33:57.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:57:0) after 8m5s
[02:42:02.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:57:0)
[02:42:02.246] Build status: STARTED
[02:42:02.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:58:0) after 4m11s
[02:46:13.365] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:58:0)
[02:46:13.386] Build status: STARTED
[02:46:13.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:59:0) after 2m39s
[02:48:52.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:59:0)
[02:48:52.471] Build status: STARTED
[02:48:52.472] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:60:0) after 4m54s
[02:53:46.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:60:0)
[02:53:46.604] Build status: STARTED
[02:53:46.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:61:0) after 1m6s
[02:54:52.627] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:61:0)
[02:54:52.672] Build status: STARTED
[02:54:52.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:62:0) after 4m8s
[02:59:00.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:62:0)
[02:59:01.006] Build status: STARTED
[02:59:01.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:63:0) after 8m22s
[03:07:23.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:63:0)
[03:07:23.063] Build status: STARTED
[03:07:23.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:64:0) after 9m7s
[03:16:30.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:64:0)
[03:16:30.294] Build status: STARTED
[03:16:30.294] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:65:0) after 4m31s
[03:21:01.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:65:0)
[03:21:01.327] Build status: STARTED
[03:21:01.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:66:0) after 3m15s
[03:24:16.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:66:0)
[03:24:16.389] Build status: STARTED
[03:24:16.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:67:0) after 7m39s
[03:31:55.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:67:0)
[03:31:55.438] Build status: STARTED
[03:31:55.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:68:0) after 3m44s
[03:35:39.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:68:0)
[03:35:39.474] Build status: STARTED
[03:35:39.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:69:0) after 3m40s
[03:39:19.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:69:0)
[03:39:19.611] Build status: STARTED
[03:39:19.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:70:0) after 4m54s
[03:44:13.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:70:0)
[03:44:13.730] Build status: STARTED
[03:44:13.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:71:0) after 8m28s
[03:52:41.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:71:0)
[03:52:41.881] Build status: STARTED
[03:52:41.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:72:0) after 1m8s
[03:53:49.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:72:0)
[03:53:49.921] Build status: STARTED
[03:53:49.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:73:0) after 7m2s
[04:00:52.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:73:0)
[04:00:52.070] Build status: STARTED
[04:00:52.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:74:0) after 8m59s
[04:09:51.156] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:74:0)
[04:09:51.177] Build status: STARTED
[04:09:51.177] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:75:0) after 7m59s
[04:17:50.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:75:0)
[04:17:50.329] Build status: STARTED
[04:17:50.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:76:0) after 4m0s
[04:21:50.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:76:0)
[04:21:50.382] Build status: STARTED
[04:21:50.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:77:0) after 3m25s
[04:25:15.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:77:0)
[04:25:15.424] Build status: STARTED
[04:25:15.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:78:0) after 8m25s
[04:33:40.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:78:0)
[04:33:40.491] Build status: STARTED
[04:33:40.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:79:0) after 8m5s
[04:41:45.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:79:0)
[04:41:45.611] Build status: STARTED
[04:41:45.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:80:0) after 5m7s
[04:46:52.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:80:0)
[04:46:52.744] Build status: STARTED
[04:46:52.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:81:0) after 5m48s
[04:52:40.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:81:0)
[04:52:40.919] Build status: STARTED
[04:52:40.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:82:0) after 9m36s
[05:02:16.960] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:82:0)
[05:02:16.982] Build status: STARTED
[05:02:16.982] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:83:0) after 4m17s
[05:06:34.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:83:0)
[05:06:34.102] Build status: STARTED
[05:06:34.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:84:0) after 5m9s
[05:11:43.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:84:0)
[05:11:43.157] Build status: STARTED
[05:11:43.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:85:0) after 5m11s
[05:16:54.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:85:0)
[05:16:54.222] Build status: STARTED
[05:16:54.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:86:0) after 9m33s
[05:26:27.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:86:0)
[05:26:27.262] Build status: STARTED
[05:26:27.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:87:0) after 2m5s
[05:28:32.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:87:0)
[05:28:32.314] Build status: STARTED
[05:28:32.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:88:0) after 4m27s
[05:32:59.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:88:0)
[05:32:59.351] Build status: STARTED
[05:32:59.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:89:0) after 3m32s
[05:36:31.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:89:0)
[05:36:31.429] Build status: STARTED
[05:36:31.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:90:0) after 7m0s
[05:43:31.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:90:0)
[05:43:31.551] Build status: STARTED
[05:43:31.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:91:0) after 3m36s
[05:47:07.869] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:91:0)
[05:47:07.893] Build status: STARTED
[05:47:07.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:92:0) after 4m51s
[05:51:59.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:92:0)
[05:51:59.051] Build status: STARTED
[05:51:59.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:93:0) after 3m43s
[05:55:42.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:93:0)
[05:55:42.086] Build status: STARTED
[05:55:42.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:94:0) after 4m45s
[06:00:27.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:94:0)
[06:00:27.287] Build status: STARTED
[06:00:27.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:95:0) after 3m1s
[06:03:28.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:95:0)
[06:03:28.522] Build status: STARTED
[06:03:28.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:96:0) after 8m1s
[06:11:29.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:96:0)
[06:11:29.562] Build status: STARTED
[06:11:29.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:97:0) after 6m33s
[06:18:02.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:97:0)
[06:18:02.629] Build status: STARTED
[06:18:02.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:98:0) after 8m30s
[06:26:32.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:98:0)
[06:26:32.679] Build status: STARTED
[06:26:32.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:99:0) after 3m11s
[06:29:43.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:99:0)
[06:29:43.727] Build status: STARTED
[06:29:43.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:100:0) after 3m57s
[06:33:40.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:100:0)
[06:33:40.772] Build status: STARTED
[06:33:40.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:101:0) after 4m23s
[06:38:03.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:101:0)
[06:38:03.853] Build status: STARTED
[06:38:03.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:102:0) after 5m36s
[06:43:39.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:102:0)
[06:43:39.905] Build status: STARTED
[06:43:39.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:103:0) after 9m13s
[06:52:52.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:103:0)
[06:52:53.034] Build status: STARTED
[06:52:53.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:104:0) after 6m37s
[06:59:30.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:104:0)
[06:59:30.217] Build status: STARTED
[06:59:30.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:105:0) after 8m37s
[07:08:07.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:105:0)
[07:08:07.437] Build status: STARTED
[07:08:07.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:106:0) after 8m30s
[07:16:37.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:106:0)
[07:16:37.516] Build status: STARTED
[07:16:37.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:107:0) after 9m57s
[07:26:34.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:107:0)
[07:26:34.678] Build status: STARTED
[07:26:34.678] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:108:0) after 6m13s
[07:32:47.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:108:0)
[07:32:47.763] Build status: STARTED
[07:32:47.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:109:0) after 7m47s
[07:40:34.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:109:0)
[07:40:34.854] Build status: STARTED
[07:40:34.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:110:0) after 8m3s
[07:48:37.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:110:0)
[07:48:38.149] Build status: STARTED
[07:48:38.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:111:0) after 6m13s
[07:54:51.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:111:0)
[07:54:51.280] Build status: STARTED
[07:54:51.280] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:112:0) after 6m20s
[08:01:11.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:112:0)
[08:01:11.440] Build status: STARTED
[08:01:11.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:113:0) after 6m26s
[08:07:37.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:113:0)
[08:07:37.504] Build status: STARTED
[08:07:37.504] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:114:0) after 2m47s
[08:10:24.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:114:0)
[08:10:24.684] Build status: STARTED
[08:10:24.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:115:0) after 3m13s
[08:13:37.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:115:0)
[08:13:37.773] Build status: STARTED
[08:13:37.773] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:116:0) after 3m29s
[08:17:06.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:116:0)
[08:17:06.984] Build status: STARTED
[08:17:06.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:117:0) after 4m21s
[08:21:28.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:117:0)
[08:21:28.042] Build status: STARTED
[08:21:28.042] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:118:0) after 7m52s
[08:29:20.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:118:0)
[08:29:20.088] Build status: STARTED
[08:29:20.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:119:0) after 2m43s
[08:32:03.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:119:0)
[08:32:03.435] Build status: STARTED
[08:32:03.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:120:0) after 1m0s
[08:33:03.788] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:120:0)
[08:33:04.003] Build status: STARTED
[08:33:04.003] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:121:0) after 4m38s
[08:37:42.047] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:121:0)
[08:37:42.070] Build status: STARTED
[08:37:42.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:122:0) after 5m55s
[08:43:37.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:122:0)
[08:43:37.489] Build status: STARTED
[08:43:37.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:123:0) after 7m19s
[08:50:56.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:123:0)
[08:50:56.707] Build status: STARTED
[08:50:56.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:124:0) after 7m34s
[08:58:30.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:124:0)
[08:58:30.821] Build status: STARTED
[08:58:30.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:125:0) after 8m37s
[09:07:07.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:125:0)
[09:07:07.926] Build status: STARTED
[09:07:07.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:126:0) after 1m18s
[09:08:25.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:126:0)
[09:08:26.063] Build status: STARTED
[09:08:26.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:127:0) after 4m6s
[09:12:32.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:127:0)
[09:12:32.286] Build status: STARTED
[09:12:32.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:128:0) after 9m19s
[09:21:51.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:128:0)
[09:21:51.327] Build status: STARTED
[09:21:51.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:129:0) after 5m38s
[09:27:29.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:129:0)
[09:27:29.392] Build status: STARTED
[09:27:29.392] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:130:0) after 4m30s
[09:31:59.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:130:0)
[09:31:59.485] Build status: STARTED
[09:31:59.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:131:0) after 6m24s
[09:38:23.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:131:0)
[09:38:23.752] Build status: STARTED
[09:38:23.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:132:0) after 1m29s
[09:39:52.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:132:0)
[09:39:52.809] Build status: STARTED
[09:39:52.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:133:0) after 3m53s
[09:43:45.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:133:0)
[09:43:45.872] Build status: STARTED
[09:43:45.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:134:0) after 6m42s
[09:50:27.999] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:134:0)
[09:50:28.026] Build status: STARTED
[09:50:28.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:135:0) after 2m22s
[09:52:50.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:135:0)
[09:52:50.083] Build status: STARTED
[09:52:50.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:136:0) after 2m11s
[09:55:01.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:136:0)
[09:55:01.264] Build status: STARTED
[09:55:01.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:137:0) after 4m10s
[09:59:11.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:137:0)
[09:59:11.664] Build status: STARTED
[09:59:11.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:138:0) after 3m41s
[10:02:52.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:138:0)
[10:02:52.990] Build status: STARTED
[10:02:52.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8937094648836959168:139:0) after 4m42s
[10:03:00.753] Received PubSub notification, asking Buildbucket for the build status
[10:03:00.773] Build:
{
"id": "8771664586967388833",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1633,
"createdBy": "project:chromium",
"createTime": "2023-08-26T21:36:33.486450639Z",
"startTime": "2023-08-26T21:36:41.858730Z",
"endTime": "2023-08-27T10:03:00.124528Z",
"updateTime": "2023-08-27T10:03:00.124528Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e63fa16f28b47885411b40115559af24173a491a",
"ref": "refs/heads/main"
}
}
}
[10:03:00.773] Invocation finished in 12h26m28.453647006s with status FAILED