[21:25:19.542] New invocation is queued and will start shortly
[21:25:20.657] Starting the invocation (attempt 1)
[21:25:20.682] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9711c65c0047d50d61d9b3a6845346c2609dfaf4"
[21:25:20.682] Popped gitiles commit info from properties and tags
[21:25:20.682] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:25:20.682] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:25:20.682] Buildbucket request:
{
"requestId": "8935736399810763408",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9711c65c0047d50d61d9b3a6845346c2609dfaf4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935736399810763408"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:25:21.393] Scheduled build:
{
"id": "8770306337812788257",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1662,
"createdBy": "project:chromium",
"createTime": "2023-09-10T21:25:20.820208165Z",
"updateTime": "2023-09-10T21:25:20.820208165Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9711c65c0047d50d61d9b3a6845346c2609dfaf4",
"ref": "refs/heads/main"
}
}
}
[21:25:21.393] Task URL: https://cr-buildbucket.appspot.com/build/8770306337812788257
[21:25:21.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:2:0) after 5m8s
[21:25:22.360] Received PubSub notification, asking Buildbucket for the build status
[21:25:22.376] Build status: SCHEDULED
[21:25:22.942] Received PubSub notification, asking Buildbucket for the build status
[21:25:22.959] Build status: STARTED
[21:30:29.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:2:0)
[21:30:29.499] Build status: STARTED
[21:30:29.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:5:0) after 9m42s
[21:40:11.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:5:0)
[21:40:11.609] Build status: STARTED
[21:40:11.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:6:0) after 7m11s
[21:47:22.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:6:0)
[21:47:22.607] Build status: STARTED
[21:47:22.607] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:7:0) after 3m45s
[21:51:07.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:7:0)
[21:51:07.736] Build status: STARTED
[21:51:07.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:8:0) after 5m37s
[21:56:44.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:8:0)
[21:56:44.774] Build status: STARTED
[21:56:44.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:9:0) after 2m6s
[21:58:50.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:9:0)
[21:58:50.865] Build status: STARTED
[21:58:50.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:10:0) after 5m57s
[22:04:48.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:10:0)
[22:04:48.111] Build status: STARTED
[22:04:48.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:11:0) after 3m11s
[22:07:59.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:11:0)
[22:07:59.186] Build status: STARTED
[22:07:59.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:12:0) after 3m7s
[22:11:06.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:12:0)
[22:11:06.338] Build status: STARTED
[22:11:06.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:13:0) after 2m52s
[22:13:58.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:13:0)
[22:13:58.540] Build status: STARTED
[22:13:58.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:14:0) after 9m28s
[22:23:26.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:14:0)
[22:23:26.575] Build status: STARTED
[22:23:26.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:15:0) after 1m2s
[22:24:28.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:15:0)
[22:24:28.617] Build status: STARTED
[22:24:28.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:16:0) after 1m13s
[22:25:41.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:16:0)
[22:25:41.699] Build status: STARTED
[22:25:41.699] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:17:0) after 8m35s
[22:34:16.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:17:0)
[22:34:16.878] Build status: STARTED
[22:34:16.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:18:0) after 7m14s
[22:41:30.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:18:0)
[22:41:30.916] Build status: STARTED
[22:41:30.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:19:0) after 4m32s
[22:46:03.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:19:0)
[22:46:03.147] Build status: STARTED
[22:46:03.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:20:0) after 3m29s
[22:49:32.318] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:20:0)
[22:49:32.343] Build status: STARTED
[22:49:32.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:21:0) after 2m1s
[22:51:33.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:21:0)
[22:51:33.522] Build status: STARTED
[22:51:33.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:22:0) after 8m6s
[22:59:39.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:22:0)
[22:59:39.563] Build status: STARTED
[22:59:39.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:23:0) after 4m22s
[23:04:01.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:23:0)
[23:04:01.763] Build status: STARTED
[23:04:01.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:24:0) after 4m51s
[23:08:53.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:24:0)
[23:08:53.138] Build status: STARTED
[23:08:53.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:25:0) after 7m31s
[23:16:24.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:25:0)
[23:16:24.638] Build status: STARTED
[23:16:24.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:26:0) after 1m48s
[23:18:12.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:26:0)
[23:18:12.684] Build status: STARTED
[23:18:12.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:27:0) after 8m56s
[23:27:08.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:27:0)
[23:27:08.726] Build status: STARTED
[23:27:08.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:28:0) after 5m36s
[23:32:44.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:28:0)
[23:32:44.758] Build status: STARTED
[23:32:44.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:29:0) after 1m29s
[23:34:13.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:29:0)
[23:34:13.810] Build status: STARTED
[23:34:13.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:30:0) after 7m39s
[23:41:52.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:30:0)
[23:41:52.899] Build status: STARTED
[23:41:52.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:31:0) after 2m53s
[23:44:45.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:31:0)
[23:44:45.981] Build status: STARTED
[23:44:45.981] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:32:0) after 7m37s
[23:52:22.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:32:0)
[23:52:23.022] Build status: STARTED
[23:52:23.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:33:0) after 2m10s
[23:54:33.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:33:0)
[23:54:33.054] Build status: STARTED
[23:54:33.054] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:34:0) after 6m52s
[00:01:25.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:34:0)
[00:01:25.149] Build status: STARTED
[00:01:25.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:35:0) after 9m38s
[00:11:03.444] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:35:0)
[00:11:03.509] Build status: STARTED
[00:11:03.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:36:0) after 9m32s
[00:20:35.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:36:0)
[00:20:35.550] Build status: STARTED
[00:20:35.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:37:0) after 9m13s
[00:29:48.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:37:0)
[00:29:48.679] Build status: STARTED
[00:29:48.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:38:0) after 6m6s
[00:35:54.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:38:0)
[00:35:54.799] Build status: STARTED
[00:35:54.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:39:0) after 8m55s
[00:44:49.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:39:0)
[00:44:49.847] Build status: STARTED
[00:44:49.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:40:0) after 4m22s
[00:49:11.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:40:0)
[00:49:11.879] Build status: STARTED
[00:49:11.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:41:0) after 2m12s
[00:51:23.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:41:0)
[00:51:24.019] Build status: STARTED
[00:51:24.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:42:0) after 8m33s
[00:59:57.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:42:0)
[00:59:57.041] Build status: STARTED
[00:59:57.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:43:0) after 6m8s
[01:06:05.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:43:0)
[01:06:05.079] Build status: STARTED
[01:06:05.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:44:0) after 2m51s
[01:08:56.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:44:0)
[01:08:56.189] Build status: STARTED
[01:08:56.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:45:0) after 4m45s
[01:13:41.313] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:45:0)
[01:13:41.338] Build status: STARTED
[01:13:41.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:46:0) after 6m20s
[01:20:01.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:46:0)
[01:20:01.478] Build status: STARTED
[01:20:01.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:47:0) after 6m5s
[01:26:06.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:47:0)
[01:26:06.951] Build status: STARTED
[01:26:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:48:0) after 7m20s
[01:33:26.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:48:0)
[01:33:26.984] Build status: STARTED
[01:33:26.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:49:0) after 5m3s
[01:38:29.999] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:49:0)
[01:38:30.018] Build status: STARTED
[01:38:30.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:50:0) after 2m3s
[01:40:33.244] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:50:0)
[01:40:33.298] Build status: STARTED
[01:40:33.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:51:0) after 9m35s
[01:50:08.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:51:0)
[01:50:08.569] Build status: STARTED
[01:50:08.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:52:0) after 2m33s
[01:52:41.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:52:0)
[01:52:41.606] Build status: STARTED
[01:52:41.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:53:0) after 6m10s
[01:58:51.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:53:0)
[01:58:51.685] Build status: STARTED
[01:58:51.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:54:0) after 7m44s
[02:06:35.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:54:0)
[02:06:35.705] Build status: STARTED
[02:06:35.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:55:0) after 6m46s
[02:13:21.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:55:0)
[02:13:21.842] Build status: STARTED
[02:13:21.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:56:0) after 9m54s
[02:23:15.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:56:0)
[02:23:15.881] Build status: STARTED
[02:23:15.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:57:0) after 3m31s
[02:26:47.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:57:0)
[02:26:47.064] Build status: STARTED
[02:26:47.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:58:0) after 8m14s
[02:35:01.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:58:0)
[02:35:01.323] Build status: STARTED
[02:35:01.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:59:0) after 3m29s
[02:38:30.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:59:0)
[02:38:30.499] Build status: STARTED
[02:38:30.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:60:0) after 5m40s
[02:44:10.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:60:0)
[02:44:10.681] Build status: STARTED
[02:44:10.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:61:0) after 9m45s
[02:53:55.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:61:0)
[02:53:55.746] Build status: STARTED
[02:53:55.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:62:0) after 7m8s
[03:01:03.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:62:0)
[03:01:03.801] Build status: STARTED
[03:01:03.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:63:0) after 3m24s
[03:04:27.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:63:0)
[03:04:27.838] Build status: STARTED
[03:04:27.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:64:0) after 3m38s
[03:08:05.841] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:64:0)
[03:08:05.912] Build status: STARTED
[03:08:05.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:65:0) after 5m46s
[03:13:52.030] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:65:0)
[03:13:52.048] Build status: STARTED
[03:13:52.048] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:66:0) after 7m35s
[03:21:27.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:66:0)
[03:21:27.129] Build status: STARTED
[03:21:27.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:67:0) after 8m25s
[03:29:52.144] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:67:0)
[03:29:52.160] Build status: STARTED
[03:29:52.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:68:0) after 3m22s
[03:33:14.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:68:0)
[03:33:14.368] Build status: STARTED
[03:33:14.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:69:0) after 8m26s
[03:41:40.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:69:0)
[03:41:40.499] Build status: STARTED
[03:41:40.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:70:0) after 9m40s
[03:51:20.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:70:0)
[03:51:20.572] Build status: STARTED
[03:51:20.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:71:0) after 6m28s
[03:57:48.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:71:0)
[03:57:48.632] Build status: STARTED
[03:57:48.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:72:0) after 4m19s
[04:02:08.065] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:72:0)
[04:02:08.090] Build status: STARTED
[04:02:08.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:73:0) after 7m13s
[04:09:21.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:73:0)
[04:09:21.502] Build status: STARTED
[04:09:21.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:74:0) after 9m10s
[04:18:31.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:74:0)
[04:18:31.551] Build status: STARTED
[04:18:31.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:75:0) after 4m26s
[04:22:57.574] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:75:0)
[04:22:57.615] Build status: STARTED
[04:22:57.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:76:0) after 3m28s
[04:26:25.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:76:0)
[04:26:25.952] Build status: STARTED
[04:26:25.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:77:0) after 7m38s
[04:34:04.070] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:77:0)
[04:34:04.112] Build status: STARTED
[04:34:04.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:78:0) after 2m30s
[04:36:34.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:78:0)
[04:36:34.251] Build status: STARTED
[04:36:34.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:79:0) after 4m50s
[04:41:24.271] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:79:0)
[04:41:24.297] Build status: STARTED
[04:41:24.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:80:0) after 9m55s
[04:51:19.379] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:80:0)
[04:51:19.454] Build status: STARTED
[04:51:19.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:81:0) after 8m31s
[04:59:50.646] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:81:0)
[04:59:50.681] Build status: STARTED
[04:59:50.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:82:0) after 7m17s
[05:07:07.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:82:0)
[05:07:07.847] Build status: STARTED
[05:07:07.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:83:0) after 5m15s
[05:12:22.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:83:0)
[05:12:22.885] Build status: STARTED
[05:12:22.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:84:0) after 7m54s
[05:20:17.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:84:0)
[05:20:17.162] Build status: STARTED
[05:20:17.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:85:0) after 7m13s
[05:27:30.314] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:85:0)
[05:27:30.343] Build status: STARTED
[05:27:30.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:86:0) after 9m19s
[05:36:49.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:86:0)
[05:36:49.386] Build status: STARTED
[05:36:49.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:87:0) after 7m24s
[05:44:13.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:87:0)
[05:44:13.689] Build status: STARTED
[05:44:13.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:88:0) after 9m4s
[05:53:17.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:88:0)
[05:53:17.869] Build status: STARTED
[05:53:17.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:89:0) after 3m38s
[05:56:55.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:89:0)
[05:56:55.915] Build status: STARTED
[05:56:55.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:90:0) after 1m3s
[05:57:59.054] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:90:0)
[05:57:59.080] Build status: STARTED
[05:57:59.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:91:0) after 3m27s
[06:01:26.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:91:0)
[06:01:26.146] Build status: STARTED
[06:01:26.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:92:0) after 4m15s
[06:05:41.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:92:0)
[06:05:41.220] Build status: STARTED
[06:05:41.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:93:0) after 1m35s
[06:07:16.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:93:0)
[06:07:16.211] Build status: STARTED
[06:07:16.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:94:0) after 6m43s
[06:13:59.234] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:94:0)
[06:13:59.258] Build status: STARTED
[06:13:59.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:95:0) after 6m55s
[06:20:54.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:95:0)
[06:20:54.323] Build status: STARTED
[06:20:54.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:96:0) after 8m5s
[06:28:59.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:96:0)
[06:28:59.642] Build status: STARTED
[06:28:59.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:97:0) after 3m32s
[06:32:31.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:97:0)
[06:32:31.680] Build status: STARTED
[06:32:31.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:98:0) after 2m58s
[06:35:29.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:98:0)
[06:35:29.822] Build status: STARTED
[06:35:29.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:99:0) after 3m23s
[06:38:52.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:99:0)
[06:38:52.864] Build status: STARTED
[06:38:52.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:100:0) after 7m53s
[06:46:46.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:100:0)
[06:46:46.042] Build status: STARTED
[06:46:46.042] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:101:0) after 1m1s
[06:47:47.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:101:0)
[06:47:47.457] Build status: STARTED
[06:47:47.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:102:0) after 6m17s
[06:54:04.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:102:0)
[06:54:04.732] Build status: STARTED
[06:54:04.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:103:0) after 6m34s
[07:00:38.762] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:103:0)
[07:00:38.801] Build status: STARTED
[07:00:38.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:104:0) after 9m54s
[07:10:33.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:104:0)
[07:10:33.204] Build status: STARTED
[07:10:33.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:105:0) after 9m22s
[07:19:55.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:105:0)
[07:19:55.517] Build status: STARTED
[07:19:55.517] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:106:0) after 5m27s
[07:25:22.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:106:0)
[07:25:22.786] Build status: STARTED
[07:25:22.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:107:0) after 7m24s
[07:32:46.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:107:0)
[07:32:46.998] Build status: STARTED
[07:32:46.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:108:0) after 4m27s
[07:37:14.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:108:0)
[07:37:14.111] Build status: STARTED
[07:37:14.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:109:0) after 2m1s
[07:39:15.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:109:0)
[07:39:15.156] Build status: STARTED
[07:39:15.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:110:0) after 1m48s
[07:41:03.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:110:0)
[07:41:03.241] Build status: STARTED
[07:41:03.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:111:0) after 2m11s
[07:43:14.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:111:0)
[07:43:14.289] Build status: STARTED
[07:43:14.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:112:0) after 8m15s
[07:51:29.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:112:0)
[07:51:29.434] Build status: STARTED
[07:51:29.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:113:0) after 9m26s
[08:00:55.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:113:0)
[08:00:55.901] Build status: STARTED
[08:00:55.901] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:114:0) after 2m53s
[08:03:49.211] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:114:0)
[08:03:49.278] Build status: STARTED
[08:03:49.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:115:0) after 1m43s
[08:05:32.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:115:0)
[08:05:32.338] Build status: STARTED
[08:05:32.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:116:0) after 9m9s
[08:14:41.365] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:116:0)
[08:14:41.388] Build status: STARTED
[08:14:41.388] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:117:0) after 2m34s
[08:17:15.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:117:0)
[08:17:15.448] Build status: STARTED
[08:17:15.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:118:0) after 8m51s
[08:26:06.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:118:0)
[08:26:06.488] Build status: STARTED
[08:26:06.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:119:0) after 7m28s
[08:33:34.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:119:0)
[08:33:34.528] Build status: STARTED
[08:33:34.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:120:0) after 5m15s
[08:38:49.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:120:0)
[08:38:49.713] Build status: STARTED
[08:38:49.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:121:0) after 8m1s
[08:46:50.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:121:0)
[08:46:50.816] Build status: STARTED
[08:46:50.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:122:0) after 7m4s
[08:53:54.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:122:0)
[08:53:54.974] Build status: STARTED
[08:53:54.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:123:0) after 3m30s
[08:57:25.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:123:0)
[08:57:25.075] Build status: STARTED
[08:57:25.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:124:0) after 4m52s
[09:02:17.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:124:0)
[09:02:17.099] Build status: STARTED
[09:02:17.099] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:125:0) after 9m58s
[09:12:15.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:125:0)
[09:12:15.151] Build status: STARTED
[09:12:15.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:126:0) after 7m26s
[09:19:41.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:126:0)
[09:19:41.274] Build status: STARTED
[09:19:41.274] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:127:0) after 5m35s
[09:25:16.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:127:0)
[09:25:16.395] Build status: STARTED
[09:25:16.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:128:0) after 4m22s
[09:29:38.507] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:128:0)
[09:29:38.606] Build status: STARTED
[09:29:38.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:129:0) after 1m39s
[09:31:17.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:129:0)
[09:31:17.653] Build status: STARTED
[09:31:17.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:130:0) after 9m40s
[09:40:57.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:130:0)
[09:40:57.780] Build status: STARTED
[09:40:57.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:131:0) after 2m21s
[09:43:18.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:131:0)
[09:43:18.923] Build status: STARTED
[09:43:18.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935736399810763408:132:0) after 7m49s
[09:48:46.828] Received PubSub notification, asking Buildbucket for the build status
[09:48:46.911] Build:
{
"id": "8770306337812788257",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1662,
"createdBy": "project:chromium",
"createTime": "2023-09-10T21:25:20.820208165Z",
"startTime": "2023-09-10T21:25:22.185949Z",
"endTime": "2023-09-11T09:48:45.779418Z",
"updateTime": "2023-09-11T09:48:45.779418Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9711c65c0047d50d61d9b3a6845346c2609dfaf4",
"ref": "refs/heads/main"
}
}
}
[09:48:46.911] Invocation finished in 12h23m27.37936182s with status FAILED