[02:39:22.444] New invocation is queued and will start shortly
[02:39:23.783] Starting the invocation (attempt 1)
[02:39:23.819] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2fac95a880e660d9bbe23485f67ccc35abeffbd6"
[02:39:23.819] Popped gitiles commit info from properties and tags
[02:39:23.819] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:39:23.820] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:39:23.820] Buildbucket request:
{
"requestId": "8931639778111197616",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2fac95a880e660d9bbe23485f67ccc35abeffbd6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8931639778111197616"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:39:24.441] Scheduled build:
{
"id": "8766209715930355489",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1756,
"createdBy": "project:chromium",
"createTime": "2023-10-26T02:39:23.894625597Z",
"updateTime": "2023-10-26T02:39:23.894625597Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2fac95a880e660d9bbe23485f67ccc35abeffbd6",
"ref": "refs/heads/main"
}
}
}
[02:39:24.441] Task URL: https://cr-buildbucket.appspot.com/build/8766209715930355489
[02:39:24.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:2:0) after 5m37s
[02:39:25.426] Received PubSub notification, asking Buildbucket for the build status
[02:39:25.441] Build status: SCHEDULED
[02:39:56.907] Received PubSub notification, asking Buildbucket for the build status
[02:39:56.937] Build status: STARTED
[02:45:01.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:2:0)
[02:45:01.636] Build status: STARTED
[02:45:01.636] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:5:0) after 9m36s
[02:54:37.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:5:0)
[02:54:37.770] Build status: STARTED
[02:54:37.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:6:0) after 8m41s
[03:03:18.895] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:6:0)
[03:03:18.914] Build status: STARTED
[03:03:18.914] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:7:0) after 4m10s
[03:07:28.977] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:7:0)
[03:07:28.999] Build status: STARTED
[03:07:28.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:8:0) after 4m56s
[03:12:25.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:8:0)
[03:12:25.134] Build status: STARTED
[03:12:25.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:9:0) after 6m32s
[03:18:57.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:9:0)
[03:18:57.269] Build status: STARTED
[03:18:57.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:10:0) after 2m1s
[03:20:58.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:10:0)
[03:20:58.550] Build status: STARTED
[03:20:58.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:11:0) after 4m39s
[03:25:37.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:11:0)
[03:25:37.645] Build status: STARTED
[03:25:37.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:12:0) after 2m0s
[03:27:37.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:12:0)
[03:27:37.709] Build status: STARTED
[03:27:37.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:13:0) after 9m15s
[03:36:52.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:13:0)
[03:36:52.743] Build status: STARTED
[03:36:52.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:14:0) after 6m50s
[03:43:42.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:14:0)
[03:43:42.908] Build status: STARTED
[03:43:42.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:15:0) after 5m15s
[03:48:58.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:15:0)
[03:48:58.034] Build status: STARTED
[03:48:58.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:16:0) after 9m15s
[03:58:13.065] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:16:0)
[03:58:13.089] Build status: STARTED
[03:58:13.089] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:17:0) after 8m0s
[04:06:13.095] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:17:0)
[04:06:13.198] Build status: STARTED
[04:06:13.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:18:0) after 1m46s
[04:07:59.235] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:18:0)
[04:07:59.254] Build status: STARTED
[04:07:59.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:19:0) after 6m26s
[04:14:25.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:19:0)
[04:14:25.400] Build status: STARTED
[04:14:25.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:20:0) after 6m0s
[04:20:25.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:20:0)
[04:20:25.599] Build status: STARTED
[04:20:25.599] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:21:0) after 9m14s
[04:29:39.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:21:0)
[04:29:39.795] Build status: STARTED
[04:29:39.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:22:0) after 1m36s
[04:31:16.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:22:0)
[04:31:16.081] Build status: STARTED
[04:31:16.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:23:0) after 4m20s
[04:35:36.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:23:0)
[04:35:36.191] Build status: STARTED
[04:35:36.191] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:24:0) after 3m28s
[04:39:04.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:24:0)
[04:39:05.009] Build status: STARTED
[04:39:05.009] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:25:0) after 8m35s
[04:47:40.040] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:25:0)
[04:47:40.126] Build status: STARTED
[04:47:40.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:26:0) after 9m51s
[04:57:31.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:26:0)
[04:57:31.184] Build status: STARTED
[04:57:31.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:27:0) after 8m39s
[05:06:10.282] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:27:0)
[05:06:10.308] Build status: STARTED
[05:06:10.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:28:0) after 1m10s
[05:07:20.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:28:0)
[05:07:20.507] Build status: STARTED
[05:07:20.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:29:0) after 8m38s
[05:15:58.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:29:0)
[05:15:58.787] Build status: STARTED
[05:15:58.787] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:30:0) after 8m58s
[05:24:56.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:30:0)
[05:24:56.937] Build status: STARTED
[05:24:56.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:31:0) after 3m26s
[05:28:22.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:31:0)
[05:28:22.998] Build status: STARTED
[05:28:22.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:32:0) after 6m41s
[05:35:04.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:32:0)
[05:35:04.425] Build status: STARTED
[05:35:04.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:33:0) after 6m1s
[05:41:05.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:33:0)
[05:41:05.737] Build status: STARTED
[05:41:05.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:34:0) after 4m57s
[05:46:02.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:34:0)
[05:46:02.995] Build status: STARTED
[05:46:02.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:35:0) after 8m34s
[05:54:37.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:35:0)
[05:54:37.502] Build status: STARTED
[05:54:37.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:36:0) after 3m42s
[05:58:19.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:36:0)
[05:58:19.646] Build status: STARTED
[05:58:19.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:37:0) after 8m11s
[06:06:30.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:37:0)
[06:06:30.863] Build status: STARTED
[06:06:30.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:38:0) after 8m54s
[06:15:25.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:38:0)
[06:15:25.196] Build status: STARTED
[06:15:25.196] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:39:0) after 6m24s
[06:21:49.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:39:0)
[06:21:49.417] Build status: STARTED
[06:21:49.417] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:40:0) after 8m17s
[06:30:06.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:40:0)
[06:30:06.511] Build status: STARTED
[06:30:06.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:41:0) after 2m7s
[06:32:13.536] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:41:0)
[06:32:13.557] Build status: STARTED
[06:32:13.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:42:0) after 5m28s
[06:37:41.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:42:0)
[06:37:41.705] Build status: STARTED
[06:37:41.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:43:0) after 5m12s
[06:42:53.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:43:0)
[06:42:53.859] Build status: STARTED
[06:42:53.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:44:0) after 3m9s
[06:46:02.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:44:0)
[06:46:02.944] Build status: STARTED
[06:46:02.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:45:0) after 9m7s
[06:55:10.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:45:0)
[06:55:10.043] Build status: STARTED
[06:55:10.043] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:46:0) after 4m17s
[06:59:27.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:46:0)
[06:59:27.120] Build status: STARTED
[06:59:27.120] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:47:0) after 7m59s
[07:07:26.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:47:0)
[07:07:26.197] Build status: STARTED
[07:07:26.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:48:0) after 9m18s
[07:16:44.458] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:48:0)
[07:16:44.494] Build status: STARTED
[07:16:44.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:49:0) after 2m38s
[07:19:22.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:49:0)
[07:19:22.611] Build status: STARTED
[07:19:22.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:50:0) after 4m20s
[07:23:43.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:50:0)
[07:23:43.060] Build status: STARTED
[07:23:43.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:51:0) after 6m22s
[07:30:05.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:51:0)
[07:30:05.233] Build status: STARTED
[07:30:05.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:52:0) after 7m56s
[07:38:01.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:52:0)
[07:38:01.474] Build status: STARTED
[07:38:01.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:53:0) after 4m7s
[07:42:08.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:53:0)
[07:42:08.906] Build status: STARTED
[07:42:08.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:54:0) after 3m41s
[07:45:50.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:54:0)
[07:45:50.190] Build status: STARTED
[07:45:50.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:55:0) after 2m17s
[07:48:07.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:55:0)
[07:48:07.475] Build status: STARTED
[07:48:07.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:56:0) after 3m18s
[07:51:25.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:56:0)
[07:51:25.654] Build status: STARTED
[07:51:25.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:57:0) after 3m44s
[07:55:09.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:57:0)
[07:55:09.927] Build status: STARTED
[07:55:09.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:58:0) after 2m8s
[07:57:18.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:58:0)
[07:57:18.135] Build status: STARTED
[07:57:18.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:59:0) after 3m46s
[08:01:04.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:59:0)
[08:01:04.350] Build status: STARTED
[08:01:04.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:60:0) after 8m57s
[08:10:01.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:60:0)
[08:10:01.584] Build status: STARTED
[08:10:01.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:61:0) after 8m59s
[08:19:00.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:61:0)
[08:19:00.684] Build status: STARTED
[08:19:00.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:62:0) after 1m22s
[08:20:22.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:62:0)
[08:20:22.741] Build status: STARTED
[08:20:22.741] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:63:0) after 8m50s
[08:29:12.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:63:0)
[08:29:12.901] Build status: STARTED
[08:29:12.901] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:64:0) after 2m58s
[08:32:10.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:64:0)
[08:32:10.961] Build status: STARTED
[08:32:10.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:65:0) after 9m12s
[08:41:23.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:65:0)
[08:41:23.029] Build status: STARTED
[08:41:23.029] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:66:0) after 3m36s
[08:44:59.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:66:0)
[08:44:59.401] Build status: STARTED
[08:44:59.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:67:0) after 9m39s
[08:54:38.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:67:0)
[08:54:38.603] Build status: STARTED
[08:54:38.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:68:0) after 8m21s
[09:02:59.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:68:0)
[09:02:59.756] Build status: STARTED
[09:02:59.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:69:0) after 3m5s
[09:06:04.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:69:0)
[09:06:04.799] Build status: STARTED
[09:06:04.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:70:0) after 4m25s
[09:10:29.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:70:0)
[09:10:29.867] Build status: STARTED
[09:10:29.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:71:0) after 3m45s
[09:14:15.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:71:0)
[09:14:15.082] Build status: STARTED
[09:14:15.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:72:0) after 1m10s
[09:15:25.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:72:0)
[09:15:25.148] Build status: STARTED
[09:15:25.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:73:0) after 1m52s
[09:17:17.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:73:0)
[09:17:17.193] Build status: STARTED
[09:17:17.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:74:0) after 1m4s
[09:18:21.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:74:0)
[09:18:21.357] Build status: STARTED
[09:18:21.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:75:0) after 1m7s
[09:19:28.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:75:0)
[09:19:28.435] Build status: STARTED
[09:19:28.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:76:0) after 7m43s
[09:27:11.714] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:76:0)
[09:27:11.738] Build status: STARTED
[09:27:11.738] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:77:0) after 5m26s
[09:32:38.010] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:77:0)
[09:32:38.036] Build status: STARTED
[09:32:38.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:78:0) after 5m18s
[09:37:56.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:78:0)
[09:37:56.168] Build status: STARTED
[09:37:56.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:79:0) after 2m38s
[09:40:34.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:79:0)
[09:40:34.349] Build status: STARTED
[09:40:34.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:80:0) after 5m16s
[09:45:50.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:80:0)
[09:45:50.555] Build status: STARTED
[09:45:50.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:81:0) after 8m30s
[09:54:20.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:81:0)
[09:54:20.756] Build status: STARTED
[09:54:20.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:82:0) after 7m19s
[10:01:39.805] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:82:0)
[10:01:39.974] Build status: STARTED
[10:01:39.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:83:0) after 6m28s
[10:08:08.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:83:0)
[10:08:08.207] Build status: STARTED
[10:08:08.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:84:0) after 5m15s
[10:13:23.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:84:0)
[10:13:23.321] Build status: STARTED
[10:13:23.321] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:85:0) after 6m16s
[10:19:39.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:85:0)
[10:19:39.583] Build status: STARTED
[10:19:39.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:86:0) after 2m4s
[10:21:44.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:86:0)
[10:21:44.134] Build status: STARTED
[10:21:44.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:87:0) after 6m59s
[10:28:43.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:87:0)
[10:28:43.495] Build status: STARTED
[10:28:43.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:88:0) after 7m22s
[10:36:05.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:88:0)
[10:36:05.670] Build status: STARTED
[10:36:05.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:89:0) after 9m40s
[10:45:45.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:89:0)
[10:45:45.815] Build status: STARTED
[10:45:45.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:90:0) after 8m15s
[10:54:00.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:90:0)
[10:54:00.937] Build status: STARTED
[10:54:00.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:91:0) after 8m17s
[11:02:17.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:91:0)
[11:02:17.999] Build status: STARTED
[11:02:17.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:92:0) after 2m42s
[11:05:00.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:92:0)
[11:05:00.166] Build status: STARTED
[11:05:00.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:93:0) after 9m47s
[11:14:47.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:93:0)
[11:14:47.269] Build status: STARTED
[11:14:47.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:94:0) after 5m53s
[11:20:40.297] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:94:0)
[11:20:40.320] Build status: STARTED
[11:20:40.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:95:0) after 8m22s
[11:29:02.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:95:0)
[11:29:02.796] Build status: STARTED
[11:29:02.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:96:0) after 4m0s
[11:33:03.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:96:0)
[11:33:03.364] Build status: STARTED
[11:33:03.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:97:0) after 7m56s
[11:40:59.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:97:0)
[11:40:59.410] Build status: STARTED
[11:40:59.411] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:98:0) after 4m30s
[11:45:29.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:98:0)
[11:45:29.584] Build status: STARTED
[11:45:29.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:99:0) after 4m6s
[11:49:35.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:99:0)
[11:49:35.633] Build status: STARTED
[11:49:35.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:100:0) after 7m31s
[11:57:06.679] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:100:0)
[11:57:06.700] Build status: STARTED
[11:57:06.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:101:0) after 6m0s
[12:03:06.733] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:101:0)
[12:03:06.764] Build status: STARTED
[12:03:06.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:102:0) after 4m22s
[12:07:28.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:102:0)
[12:07:28.852] Build status: STARTED
[12:07:28.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:103:0) after 1m8s
[12:08:36.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:103:0)
[12:08:36.980] Build status: STARTED
[12:08:36.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:104:0) after 8m0s
[12:16:37.120] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:104:0)
[12:16:37.142] Build status: STARTED
[12:16:37.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:105:0) after 8m42s
[12:25:19.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:105:0)
[12:25:19.208] Build status: STARTED
[12:25:19.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:106:0) after 5m2s
[12:30:21.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:106:0)
[12:30:21.339] Build status: STARTED
[12:30:21.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:107:0) after 4m31s
[12:34:52.485] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:107:0)
[12:34:52.515] Build status: STARTED
[12:34:52.515] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:108:0) after 6m46s
[12:41:38.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:108:0)
[12:41:38.572] Build status: STARTED
[12:41:38.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:109:0) after 9m57s
[12:51:36.070] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:109:0)
[12:51:36.087] Build status: STARTED
[12:51:36.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:110:0) after 4m4s
[12:55:40.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:110:0)
[12:55:40.150] Build status: STARTED
[12:55:40.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:111:0) after 9m8s
[13:04:48.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:111:0)
[13:04:48.314] Build status: STARTED
[13:04:48.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:112:0) after 2m24s
[13:07:12.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:112:0)
[13:07:12.535] Build status: STARTED
[13:07:12.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:113:0) after 2m9s
[13:09:21.719] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:113:0)
[13:09:21.745] Build status: STARTED
[13:09:21.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:114:0) after 1m13s
[13:10:34.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:114:0)
[13:10:34.979] Build status: STARTED
[13:10:34.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:115:0) after 9m3s
[13:19:38.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:115:0)
[13:19:38.442] Build status: STARTED
[13:19:38.442] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:116:0) after 5m53s
[13:25:31.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:116:0)
[13:25:31.496] Build status: STARTED
[13:25:31.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:117:0) after 4m56s
[13:30:27.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:117:0)
[13:30:27.572] Build status: STARTED
[13:30:27.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:118:0) after 2m17s
[13:32:44.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:118:0)
[13:32:44.650] Build status: STARTED
[13:32:44.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:119:0) after 4m15s
[13:36:59.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:119:0)
[13:36:59.751] Build status: STARTED
[13:36:59.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:120:0) after 1m52s
[13:38:51.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:120:0)
[13:38:52.011] Build status: STARTED
[13:38:52.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:121:0) after 9m33s
[13:48:25.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:121:0)
[13:48:25.200] Build status: STARTED
[13:48:25.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:122:0) after 8m21s
[13:56:46.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:122:0)
[13:56:46.269] Build status: STARTED
[13:56:46.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:123:0) after 4m24s
[14:01:10.357] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:123:0)
[14:01:10.402] Build status: STARTED
[14:01:10.402] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:124:0) after 3m8s
[14:04:18.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:124:0)
[14:04:18.493] Build status: STARTED
[14:04:18.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:125:0) after 1m3s
[14:05:21.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:125:0)
[14:05:21.768] Build status: STARTED
[14:05:21.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:126:0) after 4m37s
[14:09:58.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:126:0)
[14:09:58.866] Build status: STARTED
[14:09:58.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:127:0) after 6m16s
[14:16:15.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:127:0)
[14:16:15.202] Build status: STARTED
[14:16:15.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:128:0) after 5m11s
[14:21:26.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:128:0)
[14:21:26.339] Build status: STARTED
[14:21:26.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:129:0) after 1m49s
[14:23:15.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:129:0)
[14:23:15.398] Build status: STARTED
[14:23:15.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:130:0) after 6m59s
[14:30:14.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:130:0)
[14:30:14.585] Build status: STARTED
[14:30:14.585] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:131:0) after 9m40s
[14:39:54.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:131:0)
[14:39:54.656] Build status: STARTED
[14:39:54.656] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:132:0) after 6m42s
[14:46:36.686] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:132:0)
[14:46:36.707] Build status: STARTED
[14:46:36.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:133:0) after 4m15s
[14:50:51.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:133:0)
[14:50:51.759] Build status: STARTED
[14:50:51.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:134:0) after 3m55s
[14:54:46.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:134:0)
[14:54:46.801] Build status: STARTED
[14:54:46.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:135:0) after 1m12s
[14:55:59.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:135:0)
[14:55:59.139] Build status: STARTED
[14:55:59.139] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:136:0) after 2m17s
[14:58:16.271] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:136:0)
[14:58:16.298] Build status: STARTED
[14:58:16.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:137:0) after 2m40s
[15:00:56.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:137:0)
[15:00:56.363] Build status: STARTED
[15:00:56.363] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8931639778111197616:138:0) after 4m33s
[15:02:35.531] Received PubSub notification, asking Buildbucket for the build status
[15:02:35.602] Build:
{
"id": "8766209715930355489",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1756,
"createdBy": "project:chromium",
"createTime": "2023-10-26T02:39:23.894625597Z",
"startTime": "2023-10-26T02:39:55.929870Z",
"endTime": "2023-10-26T15:02:34.499968Z",
"updateTime": "2023-10-26T15:02:34.499968Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2fac95a880e660d9bbe23485f67ccc35abeffbd6",
"ref": "refs/heads/main"
}
}
}
[15:02:35.608] Invocation finished in 12h23m13.177286294s with status FAILED