[12:02:39.615] New invocation is queued and will start shortly
[12:02:40.742] Starting the invocation (attempt 1)
[12:02:40.786] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3ef5d12ac2991313dafbee5d08b40afe96486c4f"
[12:02:40.786] Popped gitiles commit info from properties and tags
[12:02:40.786] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:02:40.787] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:02:40.787] Buildbucket request:
{
"requestId": "8933959860334122160",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ef5d12ac2991313dafbee5d08b40afe96486c4f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8933959860334122160"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:02:41.634] Scheduled build:
{
"id": "8768529798311418225",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1701,
"createdBy": "project:chromium",
"createTime": "2023-09-30T12:02:40.915892600Z",
"updateTime": "2023-09-30T12:02:40.915892600Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ef5d12ac2991313dafbee5d08b40afe96486c4f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:02:41.634] Task URL: https://cr-buildbucket.appspot.com/build/8768529798311418225
[12:02:41.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:2:0) after 3m45s
[12:02:42.538] Received PubSub notification, asking Buildbucket for the build status
[12:02:42.649] Build status: SCHEDULED
[12:02:57.614] Received PubSub notification, asking Buildbucket for the build status
[12:02:57.641] Build status: STARTED
[12:06:26.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:2:0)
[12:06:26.672] Build status: STARTED
[12:06:26.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:5:0) after 2m52s
[12:09:18.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:5:0)
[12:09:18.722] Build status: STARTED
[12:09:18.722] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:6:0) after 1m51s
[12:11:09.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:6:0)
[12:11:09.770] Build status: STARTED
[12:11:09.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:7:0) after 2m53s
[12:14:02.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:7:0)
[12:14:02.959] Build status: STARTED
[12:14:02.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:8:0) after 1m44s
[12:15:46.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:8:0)
[12:15:47.005] Build status: STARTED
[12:15:47.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:9:0) after 2m28s
[12:18:15.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:9:0)
[12:18:15.146] Build status: STARTED
[12:18:15.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:10:0) after 9m24s
[12:27:39.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:10:0)
[12:27:39.286] Build status: STARTED
[12:27:39.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:11:0) after 3m4s
[12:30:43.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:11:0)
[12:30:43.336] Build status: STARTED
[12:30:43.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:12:0) after 2m27s
[12:33:10.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:12:0)
[12:33:10.420] Build status: STARTED
[12:33:10.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:13:0) after 8m53s
[12:42:03.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:13:0)
[12:42:03.525] Build status: STARTED
[12:42:03.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:14:0) after 4m19s
[12:46:22.544] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:14:0)
[12:46:22.564] Build status: STARTED
[12:46:22.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:15:0) after 8m57s
[12:55:19.593] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:15:0)
[12:55:19.614] Build status: STARTED
[12:55:19.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:16:0) after 8m38s
[13:03:57.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:16:0)
[13:03:57.743] Build status: STARTED
[13:03:57.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:17:0) after 3m18s
[13:07:15.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:17:0)
[13:07:16.034] Build status: STARTED
[13:07:16.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:18:0) after 2m8s
[13:09:24.074] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:18:0)
[13:09:24.157] Build status: STARTED
[13:09:24.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:19:0) after 1m0s
[13:10:24.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:19:0)
[13:10:24.212] Build status: STARTED
[13:10:24.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:20:0) after 2m6s
[13:12:30.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:20:0)
[13:12:30.337] Build status: STARTED
[13:12:30.337] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:21:0) after 2m32s
[13:15:02.357] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:21:0)
[13:15:02.379] Build status: STARTED
[13:15:02.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:22:0) after 2m30s
[13:17:32.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:22:0)
[13:17:32.456] Build status: STARTED
[13:17:32.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:23:0) after 5m31s
[13:23:03.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:23:0)
[13:23:03.502] Build status: STARTED
[13:23:03.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:24:0) after 1m11s
[13:24:14.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:24:0)
[13:24:14.635] Build status: STARTED
[13:24:14.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:25:0) after 3m55s
[13:28:09.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:25:0)
[13:28:09.659] Build status: STARTED
[13:28:09.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:26:0) after 7m24s
[13:35:33.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:26:0)
[13:35:33.774] Build status: STARTED
[13:35:33.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:27:0) after 1m0s
[13:36:33.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:27:0)
[13:36:33.816] Build status: STARTED
[13:36:33.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:28:0) after 3m12s
[13:39:45.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:28:0)
[13:39:45.954] Build status: STARTED
[13:39:45.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:29:0) after 1m58s
[13:41:43.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:29:0)
[13:41:44.003] Build status: STARTED
[13:41:44.003] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:30:0) after 9m7s
[13:50:51.022] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:30:0)
[13:50:51.058] Build status: STARTED
[13:50:51.058] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:31:0) after 2m54s
[13:53:45.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:31:0)
[13:53:45.313] Build status: STARTED
[13:53:45.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:32:0) after 2m22s
[13:56:07.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:32:0)
[13:56:07.451] Build status: STARTED
[13:56:07.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:33:0) after 5m1s
[14:01:08.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:33:0)
[14:01:08.540] Build status: STARTED
[14:01:08.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:34:0) after 8m44s
[14:09:52.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:34:0)
[14:09:52.582] Build status: STARTED
[14:09:52.582] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:35:0) after 5m8s
[14:15:00.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:35:0)
[14:15:00.629] Build status: STARTED
[14:15:00.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:36:0) after 4m8s
[14:19:08.748] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:36:0)
[14:19:08.769] Build status: STARTED
[14:19:08.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:37:0) after 9m35s
[14:28:43.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:37:0)
[14:28:43.810] Build status: STARTED
[14:28:43.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:38:0) after 8m38s
[14:37:21.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:38:0)
[14:37:21.852] Build status: STARTED
[14:37:21.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:39:0) after 1m47s
[14:39:08.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:39:0)
[14:39:08.940] Build status: STARTED
[14:39:08.940] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:40:0) after 9m17s
[14:48:26.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:40:0)
[14:48:26.040] Build status: STARTED
[14:48:26.040] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:41:0) after 9m35s
[14:58:01.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:41:0)
[14:58:01.202] Build status: STARTED
[14:58:01.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:42:0) after 8m16s
[15:06:17.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:42:0)
[15:06:17.283] Build status: STARTED
[15:06:17.283] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:43:0) after 4m40s
[15:10:57.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:43:0)
[15:10:57.381] Build status: STARTED
[15:10:57.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:44:0) after 2m23s
[15:13:20.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:44:0)
[15:13:20.429] Build status: STARTED
[15:13:20.430] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:45:0) after 6m6s
[15:19:26.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:45:0)
[15:19:26.487] Build status: STARTED
[15:19:26.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:46:0) after 4m19s
[15:23:45.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:46:0)
[15:23:45.724] Build status: STARTED
[15:23:45.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:47:0) after 7m37s
[15:31:22.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:47:0)
[15:31:22.873] Build status: STARTED
[15:31:22.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:48:0) after 9m28s
[15:40:50.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:48:0)
[15:40:50.936] Build status: STARTED
[15:40:50.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:49:0) after 3m18s
[15:44:09.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:49:0)
[15:44:09.184] Build status: STARTED
[15:44:09.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:50:0) after 9m23s
[15:53:32.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:50:0)
[15:53:32.235] Build status: STARTED
[15:53:32.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:51:0) after 5m59s
[15:59:31.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:51:0)
[15:59:31.281] Build status: STARTED
[15:59:31.281] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:52:0) after 8m7s
[16:07:38.388] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:52:0)
[16:07:38.411] Build status: STARTED
[16:07:38.411] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:53:0) after 5m56s
[16:13:34.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:53:0)
[16:13:34.622] Build status: STARTED
[16:13:34.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:54:0) after 1m52s
[16:15:26.837] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:54:0)
[16:15:26.861] Build status: STARTED
[16:15:26.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:55:0) after 9m3s
[16:24:29.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:55:0)
[16:24:30.009] Build status: STARTED
[16:24:30.009] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:56:0) after 7m9s
[16:31:39.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:56:0)
[16:31:39.184] Build status: STARTED
[16:31:39.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:57:0) after 9m17s
[16:40:56.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:57:0)
[16:40:56.284] Build status: STARTED
[16:40:56.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:58:0) after 9m6s
[16:50:02.318] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:58:0)
[16:50:02.339] Build status: STARTED
[16:50:02.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:59:0) after 2m9s
[16:52:11.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:59:0)
[16:52:11.390] Build status: STARTED
[16:52:11.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:60:0) after 4m57s
[16:57:08.367] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:60:0)
[16:57:08.681] Build status: STARTED
[16:57:08.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:61:0) after 6m31s
[17:03:39.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:61:0)
[17:03:39.727] Build status: STARTED
[17:03:39.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:62:0) after 4m44s
[17:08:23.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:62:0)
[17:08:23.951] Build status: STARTED
[17:08:23.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:63:0) after 4m6s
[17:12:30.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:63:0)
[17:12:30.037] Build status: STARTED
[17:12:30.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:64:0) after 8m19s
[17:20:49.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:64:0)
[17:20:49.309] Build status: STARTED
[17:20:49.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:65:0) after 5m2s
[17:25:51.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:65:0)
[17:25:51.596] Build status: STARTED
[17:25:51.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:66:0) after 2m46s
[17:28:37.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:66:0)
[17:28:37.687] Build status: STARTED
[17:28:37.687] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:67:0) after 6m49s
[17:35:26.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:67:0)
[17:35:26.875] Build status: STARTED
[17:35:26.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:68:0) after 4m47s
[17:40:13.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:68:0)
[17:40:13.925] Build status: STARTED
[17:40:13.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:69:0) after 3m9s
[17:43:23.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:69:0)
[17:43:23.125] Build status: STARTED
[17:43:23.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:70:0) after 1m19s
[17:44:42.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:70:0)
[17:44:42.336] Build status: STARTED
[17:44:42.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:71:0) after 5m25s
[17:50:07.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:71:0)
[17:50:07.486] Build status: STARTED
[17:50:07.486] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:72:0) after 4m24s
[17:54:31.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:72:0)
[17:54:31.502] Build status: STARTED
[17:54:31.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:73:0) after 2m12s
[17:56:43.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:73:0)
[17:56:43.708] Build status: STARTED
[17:56:43.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:74:0) after 2m52s
[17:59:35.760] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:74:0)
[17:59:35.783] Build status: STARTED
[17:59:35.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:75:0) after 9m13s
[18:08:48.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:75:0)
[18:08:48.861] Build status: STARTED
[18:08:48.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:76:0) after 4m22s
[18:13:10.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:76:0)
[18:13:10.919] Build status: STARTED
[18:13:10.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:77:0) after 4m52s
[18:18:02.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:77:0)
[18:18:02.987] Build status: STARTED
[18:18:02.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:78:0) after 1m39s
[18:19:42.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:78:0)
[18:19:42.172] Build status: STARTED
[18:19:42.172] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:79:0) after 9m8s
[18:28:50.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:79:0)
[18:28:50.228] Build status: STARTED
[18:28:50.228] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:80:0) after 7m53s
[18:36:43.300] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:80:0)
[18:36:43.338] Build status: STARTED
[18:36:43.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:81:0) after 3m13s
[18:39:56.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:81:0)
[18:39:56.604] Build status: STARTED
[18:39:56.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:82:0) after 1m23s
[18:41:19.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:82:0)
[18:41:19.724] Build status: STARTED
[18:41:19.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:83:0) after 8m0s
[18:49:19.843] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:83:0)
[18:49:19.875] Build status: STARTED
[18:49:19.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:84:0) after 9m23s
[18:58:42.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:84:0)
[18:58:43.007] Build status: STARTED
[18:58:43.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:85:0) after 9m51s
[19:08:34.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:85:0)
[19:08:34.061] Build status: STARTED
[19:08:34.061] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:86:0) after 6m0s
[19:14:34.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:86:0)
[19:14:34.105] Build status: STARTED
[19:14:34.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:87:0) after 6m2s
[19:20:36.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:87:0)
[19:20:36.144] Build status: STARTED
[19:20:36.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:88:0) after 3m19s
[19:23:55.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:88:0)
[19:23:55.429] Build status: STARTED
[19:23:55.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:89:0) after 8m59s
[19:32:54.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:89:0)
[19:32:54.543] Build status: STARTED
[19:32:54.543] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:90:0) after 2m31s
[19:35:25.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:90:0)
[19:35:25.619] Build status: STARTED
[19:35:25.620] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:91:0) after 9m34s
[19:44:59.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:91:0)
[19:44:59.710] Build status: STARTED
[19:44:59.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:92:0) after 9m31s
[19:54:30.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:92:0)
[19:54:30.749] Build status: STARTED
[19:54:30.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:93:0) after 5m20s
[19:59:50.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:93:0)
[19:59:50.792] Build status: STARTED
[19:59:50.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:94:0) after 6m47s
[20:06:37.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:94:0)
[20:06:37.963] Build status: STARTED
[20:06:37.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:95:0) after 6m43s
[20:13:20.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:95:0)
[20:13:21.019] Build status: STARTED
[20:13:21.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:96:0) after 9m25s
[20:22:46.041] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:96:0)
[20:22:46.066] Build status: STARTED
[20:22:46.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:97:0) after 9m8s
[20:31:54.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:97:0)
[20:31:54.548] Build status: STARTED
[20:31:54.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:98:0) after 3m32s
[20:35:26.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:98:0)
[20:35:26.614] Build status: STARTED
[20:35:26.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:99:0) after 5m41s
[20:41:07.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:99:0)
[20:41:07.664] Build status: STARTED
[20:41:07.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:100:0) after 9m53s
[20:51:00.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:100:0)
[20:51:00.713] Build status: STARTED
[20:51:00.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:101:0) after 8m34s
[20:59:34.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:101:0)
[20:59:34.756] Build status: STARTED
[20:59:34.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:102:0) after 5m12s
[21:04:46.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:102:0)
[21:04:47.015] Build status: STARTED
[21:04:47.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:103:0) after 8m42s
[21:13:29.038] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:103:0)
[21:13:29.109] Build status: STARTED
[21:13:29.109] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:104:0) after 5m17s
[21:18:46.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:104:0)
[21:18:46.120] Build status: STARTED
[21:18:46.120] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:105:0) after 9m49s
[21:28:35.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:105:0)
[21:28:35.168] Build status: STARTED
[21:28:35.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:106:0) after 4m22s
[21:32:57.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:106:0)
[21:32:57.211] Build status: STARTED
[21:32:57.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:107:0) after 2m20s
[21:35:17.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:107:0)
[21:35:17.335] Build status: STARTED
[21:35:17.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:108:0) after 4m4s
[21:39:21.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:108:0)
[21:39:21.380] Build status: STARTED
[21:39:21.380] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:109:0) after 2m47s
[21:42:08.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:109:0)
[21:42:08.429] Build status: STARTED
[21:42:08.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:110:0) after 7m2s
[21:49:10.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:110:0)
[21:49:10.767] Build status: STARTED
[21:49:10.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:111:0) after 2m2s
[21:51:12.907] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:111:0)
[21:51:12.928] Build status: STARTED
[21:51:12.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:112:0) after 5m51s
[21:57:03.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:112:0)
[21:57:03.976] Build status: STARTED
[21:57:03.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:113:0) after 4m31s
[22:01:35.220] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:113:0)
[22:01:35.280] Build status: STARTED
[22:01:35.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:114:0) after 1m50s
[22:03:25.681] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:114:0)
[22:03:25.705] Build status: STARTED
[22:03:25.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:115:0) after 4m35s
[22:08:00.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:115:0)
[22:08:00.849] Build status: STARTED
[22:08:00.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:116:0) after 6m34s
[22:14:34.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:116:0)
[22:14:34.996] Build status: STARTED
[22:14:34.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:117:0) after 4m51s
[22:19:26.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:117:0)
[22:19:26.047] Build status: STARTED
[22:19:26.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:118:0) after 9m37s
[22:29:03.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:118:0)
[22:29:03.869] Build status: STARTED
[22:29:03.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:119:0) after 9m18s
[22:38:22.166] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:119:0)
[22:38:22.185] Build status: STARTED
[22:38:22.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:120:0) after 8m33s
[22:46:55.272] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:120:0)
[22:46:55.297] Build status: STARTED
[22:46:55.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:121:0) after 3m13s
[22:50:08.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:121:0)
[22:50:08.485] Build status: STARTED
[22:50:08.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:122:0) after 7m49s
[22:57:57.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:122:0)
[22:57:57.654] Build status: STARTED
[22:57:57.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:123:0) after 7m45s
[23:05:42.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:123:0)
[23:05:42.778] Build status: STARTED
[23:05:42.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:124:0) after 3m29s
[23:09:11.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:124:0)
[23:09:11.847] Build status: STARTED
[23:09:11.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:125:0) after 7m26s
[23:16:37.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:125:0)
[23:16:37.898] Build status: STARTED
[23:16:37.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:126:0) after 8m0s
[23:24:38.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:126:0)
[23:24:38.204] Build status: STARTED
[23:24:38.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:127:0) after 8m20s
[23:32:58.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:127:0)
[23:32:58.266] Build status: STARTED
[23:32:58.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:128:0) after 5m59s
[23:38:57.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:128:0)
[23:38:57.318] Build status: STARTED
[23:38:57.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:129:0) after 1m18s
[23:40:15.373] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:129:0)
[23:40:15.393] Build status: STARTED
[23:40:15.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:130:0) after 6m25s
[23:46:40.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:130:0)
[23:46:40.563] Build status: STARTED
[23:46:40.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:131:0) after 7m9s
[23:53:49.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:131:0)
[23:53:49.609] Build status: STARTED
[23:53:49.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:132:0) after 8m49s
[00:02:38.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:132:0)
[00:02:38.658] Build status: STARTED
[00:02:38.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:133:0) after 1m24s
[00:04:02.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:133:0)
[00:04:02.855] Build status: STARTED
[00:04:02.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:134:0) after 4m28s
[00:08:30.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:134:0)
[00:08:30.944] Build status: STARTED
[00:08:30.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:135:0) after 6m53s
[00:15:24.020] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:135:0)
[00:15:24.115] Build status: STARTED
[00:15:24.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:136:0) after 9m41s
[00:25:05.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:136:0)
[00:25:05.193] Build status: STARTED
[00:25:05.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:137:0) after 4m31s
[00:29:36.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:137:0)
[00:29:36.232] Build status: STARTED
[00:29:36.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8933959860334122160:138:0) after 2m32s
[00:30:27.474] Received PubSub notification, asking Buildbucket for the build status
[00:30:27.496] Build:
{
"id": "8768529798311418225",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1701,
"createdBy": "project:chromium",
"createTime": "2023-09-30T12:02:40.915892600Z",
"startTime": "2023-09-30T12:02:54.460098Z",
"endTime": "2023-10-01T00:30:26.663743Z",
"updateTime": "2023-10-01T00:30:26.663743Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3ef5d12ac2991313dafbee5d08b40afe96486c4f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:30:27.496] Invocation finished in 12h27m47.893499891s with status FAILED