[00:43:06.192] New invocation is queued and will start shortly
[00:43:07.271] Starting the invocation (attempt 1)
[00:43:07.316] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aff30f14339ca844d9f41d1b59069544611b8e9d"
[00:43:07.316] Popped gitiles commit info from properties and tags
[00:43:07.316] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:43:07.316] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:43:07.316] Buildbucket request:
{
"requestId": "8922225008728963072",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aff30f14339ca844d9f41d1b59069544611b8e9d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922225008728963072"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:43:08.489] Scheduled build:
{
"id": "8756794946750522977",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1962,
"createdBy": "project:chromium",
"createTime": "2024-02-07T00:43:07.455687035Z",
"updateTime": "2024-02-07T00:43:07.455687035Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aff30f14339ca844d9f41d1b59069544611b8e9d",
"ref": "refs/heads/main"
}
}
}
[00:43:08.489] Task URL: https://cr-buildbucket.appspot.com/build/8756794946750522977
[00:43:08.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:2:0) after 6m51s
[00:43:09.583] Received PubSub notification, asking Buildbucket for the build status
[00:43:09.604] Build status: SCHEDULED
[00:44:35.613] Received PubSub notification, asking Buildbucket for the build status
[00:44:35.666] Build status: STARTED
[00:49:59.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:2:0)
[00:49:59.593] Build status: STARTED
[00:49:59.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:5:0) after 9m25s
[00:59:24.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:5:0)
[00:59:24.760] Build status: STARTED
[00:59:24.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:6:0) after 5m58s
[01:05:22.937] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:6:0)
[01:05:22.977] Build status: STARTED
[01:05:22.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:7:0) after 8m56s
[01:14:19.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:7:0)
[01:14:19.060] Build status: STARTED
[01:14:19.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:8:0) after 5m15s
[01:19:34.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:8:0)
[01:19:34.254] Build status: STARTED
[01:19:34.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:9:0) after 8m33s
[01:28:07.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:9:0)
[01:28:07.502] Build status: STARTED
[01:28:07.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:10:0) after 8m28s
[01:36:35.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:10:0)
[01:36:35.619] Build status: STARTED
[01:36:35.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:11:0) after 5m42s
[01:42:17.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:11:0)
[01:42:17.680] Build status: STARTED
[01:42:17.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:12:0) after 9m27s
[01:51:44.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:12:0)
[01:51:44.759] Build status: STARTED
[01:51:44.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:13:0) after 6m6s
[01:57:50.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:13:0)
[01:57:50.816] Build status: STARTED
[01:57:50.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:14:0) after 3m48s
[02:01:38.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:14:0)
[02:01:38.875] Build status: STARTED
[02:01:38.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:15:0) after 3m1s
[02:04:39.927] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:15:0)
[02:04:40.004] Build status: STARTED
[02:04:40.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:16:0) after 2m2s
[02:06:42.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:16:0)
[02:06:42.111] Build status: STARTED
[02:06:42.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:17:0) after 2m15s
[02:08:57.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:17:0)
[02:08:57.115] Build status: STARTED
[02:08:57.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:18:0) after 5m3s
[02:14:00.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:18:0)
[02:14:00.225] Build status: STARTED
[02:14:00.225] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:19:0) after 8m34s
[02:22:34.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:19:0)
[02:22:34.425] Build status: STARTED
[02:22:34.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:20:0) after 9m48s
[02:32:22.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:20:0)
[02:32:22.540] Build status: STARTED
[02:32:22.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:21:0) after 8m13s
[02:40:35.667] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:21:0)
[02:40:35.692] Build status: STARTED
[02:40:35.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:22:0) after 3m29s
[02:44:05.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:22:0)
[02:44:05.463] Build status: STARTED
[02:44:05.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:23:0) after 6m48s
[02:50:53.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:23:0)
[02:50:53.520] Build status: STARTED
[02:50:53.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:24:0) after 3m45s
[02:54:38.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:24:0)
[02:54:38.678] Build status: STARTED
[02:54:38.678] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:25:0) after 9m2s
[03:03:40.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:25:0)
[03:03:40.742] Build status: STARTED
[03:03:40.742] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:26:0) after 7m43s
[03:11:23.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:26:0)
[03:11:23.897] Build status: STARTED
[03:11:23.897] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:27:0) after 1m51s
[03:13:15.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:27:0)
[03:13:15.148] Build status: STARTED
[03:13:15.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:28:0) after 7m2s
[03:20:17.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:28:0)
[03:20:17.481] Build status: STARTED
[03:20:17.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:29:0) after 2m52s
[03:23:09.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:29:0)
[03:23:09.545] Build status: STARTED
[03:23:09.545] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:30:0) after 2m51s
[03:26:00.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:30:0)
[03:26:00.804] Build status: STARTED
[03:26:00.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:31:0) after 6m42s
[03:32:43.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:31:0)
[03:32:43.365] Build status: STARTED
[03:32:43.365] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:32:0) after 1m37s
[03:34:20.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:32:0)
[03:34:20.731] Build status: STARTED
[03:34:20.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:33:0) after 3m14s
[03:37:35.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:33:0)
[03:37:35.482] Build status: STARTED
[03:37:35.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:34:0) after 9m56s
[03:47:31.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:34:0)
[03:47:31.631] Build status: STARTED
[03:47:31.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:35:0) after 4m42s
[03:52:13.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:35:0)
[03:52:13.829] Build status: STARTED
[03:52:13.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:36:0) after 4m40s
[03:56:54.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:36:0)
[03:56:54.140] Build status: STARTED
[03:56:54.140] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:37:0) after 8m39s
[04:05:33.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:37:0)
[04:05:33.305] Build status: STARTED
[04:05:33.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:38:0) after 8m8s
[04:13:41.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:38:0)
[04:13:41.365] Build status: STARTED
[04:13:41.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:39:0) after 2m55s
[04:16:36.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:39:0)
[04:16:36.539] Build status: STARTED
[04:16:36.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:40:0) after 5m11s
[04:21:47.707] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:40:0)
[04:21:47.727] Build status: STARTED
[04:21:47.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:41:0) after 1m59s
[04:23:46.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:41:0)
[04:23:46.828] Build status: STARTED
[04:23:46.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:42:0) after 9m15s
[04:33:01.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:42:0)
[04:33:01.860] Build status: STARTED
[04:33:01.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:43:0) after 3m42s
[04:36:44.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:43:0)
[04:36:44.054] Build status: STARTED
[04:36:44.054] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:44:0) after 6m5s
[04:42:49.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:44:0)
[04:42:49.096] Build status: STARTED
[04:42:49.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:45:0) after 6m38s
[04:49:27.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:45:0)
[04:49:27.157] Build status: STARTED
[04:49:27.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:46:0) after 5m52s
[04:55:19.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:46:0)
[04:55:19.227] Build status: STARTED
[04:55:19.227] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:47:0) after 3m31s
[04:58:50.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:47:0)
[04:58:50.459] Build status: STARTED
[04:58:50.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:48:0) after 3m1s
[05:01:51.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:48:0)
[05:01:51.676] Build status: STARTED
[05:01:51.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:49:0) after 2m29s
[05:04:20.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:49:0)
[05:04:20.759] Build status: STARTED
[05:04:20.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:50:0) after 3m27s
[05:07:47.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:50:0)
[05:07:47.946] Build status: STARTED
[05:07:47.946] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:51:0) after 8m43s
[05:16:31.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:51:0)
[05:16:31.070] Build status: STARTED
[05:16:31.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:52:0) after 6m12s
[05:22:43.110] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:52:0)
[05:22:43.133] Build status: STARTED
[05:22:43.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:53:0) after 4m51s
[05:27:34.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:53:0)
[05:27:34.330] Build status: STARTED
[05:27:34.330] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:54:0) after 1m53s
[05:29:27.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:54:0)
[05:29:27.564] Build status: STARTED
[05:29:27.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:55:0) after 2m41s
[05:32:08.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:55:0)
[05:32:08.632] Build status: STARTED
[05:32:08.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:56:0) after 8m23s
[05:40:31.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:56:0)
[05:40:31.824] Build status: STARTED
[05:40:31.824] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:57:0) after 1m6s
[05:41:37.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:57:0)
[05:41:37.909] Build status: STARTED
[05:41:37.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:58:0) after 3m54s
[05:45:32.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:58:0)
[05:45:32.075] Build status: STARTED
[05:45:32.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:59:0) after 6m38s
[05:52:10.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:59:0)
[05:52:10.231] Build status: STARTED
[05:52:10.231] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:60:0) after 7m1s
[05:59:11.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:60:0)
[05:59:11.708] Build status: STARTED
[05:59:11.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:61:0) after 1m49s
[06:01:00.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:61:0)
[06:01:00.873] Build status: STARTED
[06:01:00.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:62:0) after 6m7s
[06:07:08.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:62:0)
[06:07:08.124] Build status: STARTED
[06:07:08.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:63:0) after 5m40s
[06:12:48.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:63:0)
[06:12:48.484] Build status: STARTED
[06:12:48.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:64:0) after 3m21s
[06:16:10.373] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:64:0)
[06:16:10.422] Build status: STARTED
[06:16:10.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:65:0) after 8m12s
[06:24:22.556] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:65:0)
[06:24:22.575] Build status: STARTED
[06:24:22.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:66:0) after 6m44s
[06:31:06.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:66:0)
[06:31:06.676] Build status: STARTED
[06:31:06.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:67:0) after 7m2s
[06:38:08.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:67:0)
[06:38:08.855] Build status: STARTED
[06:38:08.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:68:0) after 6m27s
[06:44:36.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:68:0)
[06:44:36.156] Build status: STARTED
[06:44:36.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:69:0) after 6m14s
[06:50:50.216] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:69:0)
[06:50:50.241] Build status: STARTED
[06:50:50.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:70:0) after 5m52s
[06:56:42.274] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:70:0)
[06:56:42.296] Build status: STARTED
[06:56:42.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:71:0) after 8m21s
[07:05:03.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:71:0)
[07:05:03.403] Build status: STARTED
[07:05:03.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:72:0) after 8m17s
[07:13:20.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:72:0)
[07:13:20.556] Build status: STARTED
[07:13:20.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:73:0) after 5m15s
[07:18:35.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:73:0)
[07:18:35.684] Build status: STARTED
[07:18:35.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:74:0) after 3m28s
[07:22:03.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:74:0)
[07:22:03.734] Build status: STARTED
[07:22:03.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:75:0) after 5m10s
[07:27:13.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:75:0)
[07:27:14.002] Build status: STARTED
[07:27:14.002] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:76:0) after 3m51s
[07:31:05.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:76:0)
[07:31:05.081] Build status: STARTED
[07:31:05.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:77:0) after 8m41s
[07:39:46.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:77:0)
[07:39:46.260] Build status: STARTED
[07:39:46.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:78:0) after 7m52s
[07:47:38.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:78:0)
[07:47:38.441] Build status: STARTED
[07:47:38.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:79:0) after 7m3s
[07:54:41.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:79:0)
[07:54:41.576] Build status: STARTED
[07:54:41.576] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:80:0) after 6m53s
[08:01:34.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:80:0)
[08:01:34.634] Build status: STARTED
[08:01:34.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:81:0) after 7m23s
[08:08:57.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:81:0)
[08:08:57.799] Build status: STARTED
[08:08:57.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:82:0) after 6m4s
[08:15:01.978] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:82:0)
[08:15:02.007] Build status: STARTED
[08:15:02.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:83:0) after 1m36s
[08:16:38.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:83:0)
[08:16:38.056] Build status: STARTED
[08:16:38.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:84:0) after 6m21s
[08:22:59.318] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:84:0)
[08:22:59.369] Build status: STARTED
[08:22:59.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:85:0) after 3m40s
[08:26:39.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:85:0)
[08:26:39.815] Build status: STARTED
[08:26:39.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:86:0) after 7m5s
[08:33:44.855] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:86:0)
[08:33:44.884] Build status: STARTED
[08:33:44.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:87:0) after 2m8s
[08:35:52.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:87:0)
[08:35:52.955] Build status: STARTED
[08:35:52.955] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:88:0) after 5m49s
[08:41:42.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:88:0)
[08:41:42.102] Build status: STARTED
[08:41:42.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:89:0) after 1m54s
[08:43:36.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:89:0)
[08:43:36.164] Build status: STARTED
[08:43:36.164] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:90:0) after 1m54s
[08:45:30.207] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:90:0)
[08:45:30.237] Build status: STARTED
[08:45:30.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:91:0) after 4m30s
[08:50:00.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:91:0)
[08:50:00.342] Build status: STARTED
[08:50:00.342] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:92:0) after 4m49s
[08:54:49.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:92:0)
[08:54:49.404] Build status: STARTED
[08:54:49.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:93:0) after 1m35s
[08:56:24.622] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:93:0)
[08:56:24.663] Build status: STARTED
[08:56:24.663] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:94:0) after 3m55s
[09:00:19.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:94:0)
[09:00:19.963] Build status: STARTED
[09:00:19.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:95:0) after 8m47s
[09:09:07.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:95:0)
[09:09:07.063] Build status: STARTED
[09:09:07.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:96:0) after 2m6s
[09:11:13.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:96:0)
[09:11:13.226] Build status: STARTED
[09:11:13.226] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:97:0) after 3m20s
[09:14:33.310] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:97:0)
[09:14:33.400] Build status: STARTED
[09:14:33.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:98:0) after 3m10s
[09:17:43.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:98:0)
[09:17:43.471] Build status: STARTED
[09:17:43.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:99:0) after 5m29s
[09:23:12.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:99:0)
[09:23:12.555] Build status: STARTED
[09:23:12.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:100:0) after 5m43s
[09:28:55.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:100:0)
[09:28:55.603] Build status: STARTED
[09:28:55.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:101:0) after 8m12s
[09:37:07.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:101:0)
[09:37:07.761] Build status: STARTED
[09:37:07.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:102:0) after 4m35s
[09:41:42.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:102:0)
[09:41:42.928] Build status: STARTED
[09:41:42.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:103:0) after 3m58s
[09:45:40.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:103:0)
[09:45:41.008] Build status: STARTED
[09:45:41.008] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:104:0) after 3m43s
[09:49:24.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:104:0)
[09:49:24.366] Build status: STARTED
[09:49:24.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:105:0) after 9m22s
[09:58:46.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:105:0)
[09:58:46.522] Build status: STARTED
[09:58:46.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:106:0) after 9m42s
[10:08:28.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:106:0)
[10:08:28.591] Build status: STARTED
[10:08:28.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:107:0) after 3m39s
[10:12:07.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:107:0)
[10:12:07.762] Build status: STARTED
[10:12:07.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:108:0) after 9m11s
[10:21:19.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:108:0)
[10:21:19.017] Build status: STARTED
[10:21:19.017] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:109:0) after 9m13s
[10:30:32.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:109:0)
[10:30:32.340] Build status: STARTED
[10:30:32.340] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:110:0) after 7m50s
[10:38:22.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:110:0)
[10:38:22.520] Build status: STARTED
[10:38:22.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:111:0) after 5m22s
[10:43:44.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:111:0)
[10:43:44.753] Build status: STARTED
[10:43:44.753] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:112:0) after 7m12s
[10:50:56.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:112:0)
[10:50:56.799] Build status: STARTED
[10:50:56.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:113:0) after 7m59s
[10:58:55.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:113:0)
[10:58:55.902] Build status: STARTED
[10:58:55.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:114:0) after 2m36s
[11:01:32.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:114:0)
[11:01:32.066] Build status: STARTED
[11:01:32.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:115:0) after 1m0s
[11:02:32.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:115:0)
[11:02:32.325] Build status: STARTED
[11:02:32.325] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:116:0) after 6m54s
[11:09:26.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:116:0)
[11:09:26.420] Build status: STARTED
[11:09:26.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:117:0) after 7m26s
[11:16:52.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:117:0)
[11:16:52.505] Build status: STARTED
[11:16:52.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:118:0) after 2m10s
[11:19:02.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:118:0)
[11:19:02.639] Build status: STARTED
[11:19:02.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:119:0) after 6m20s
[11:25:22.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:119:0)
[11:25:22.894] Build status: STARTED
[11:25:22.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:120:0) after 1m42s
[11:27:05.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:120:0)
[11:27:05.059] Build status: STARTED
[11:27:05.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:121:0) after 6m44s
[11:33:50.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:121:0)
[11:33:50.448] Build status: STARTED
[11:33:50.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:122:0) after 2m59s
[11:36:49.603] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:122:0)
[11:36:49.733] Build status: STARTED
[11:36:49.733] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:123:0) after 2m47s
[11:39:37.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:123:0)
[11:39:37.087] Build status: STARTED
[11:39:37.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:124:0) after 4m27s
[11:44:04.117] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:124:0)
[11:44:04.143] Build status: STARTED
[11:44:04.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:125:0) after 9m21s
[11:53:25.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:125:0)
[11:53:25.252] Build status: STARTED
[11:53:25.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:126:0) after 4m56s
[11:58:21.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:126:0)
[11:58:21.512] Build status: STARTED
[11:58:21.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:127:0) after 3m28s
[12:01:49.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:127:0)
[12:01:49.580] Build status: STARTED
[12:01:49.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:128:0) after 4m41s
[12:06:30.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:128:0)
[12:06:30.903] Build status: STARTED
[12:06:30.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:129:0) after 9m19s
[12:15:49.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:129:0)
[12:15:49.963] Build status: STARTED
[12:15:49.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:130:0) after 4m17s
[12:20:07.184] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:130:0)
[12:20:07.205] Build status: STARTED
[12:20:07.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:131:0) after 9m48s
[12:29:55.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:131:0)
[12:29:55.502] Build status: STARTED
[12:29:55.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:132:0) after 7m31s
[12:37:26.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:132:0)
[12:37:26.775] Build status: STARTED
[12:37:26.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:133:0) after 1m55s
[12:39:21.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:133:0)
[12:39:21.835] Build status: STARTED
[12:39:21.835] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:134:0) after 3m51s
[12:43:13.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:134:0)
[12:43:13.052] Build status: STARTED
[12:43:13.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:135:0) after 3m53s
[12:47:06.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:135:0)
[12:47:06.401] Build status: STARTED
[12:47:06.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:136:0) after 5m9s
[12:52:15.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:136:0)
[12:52:15.529] Build status: STARTED
[12:52:15.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:137:0) after 2m29s
[12:54:44.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:137:0)
[12:54:44.597] Build status: STARTED
[12:54:44.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:138:0) after 3m34s
[12:58:18.638] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:138:0)
[12:58:18.686] Build status: STARTED
[12:58:18.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922225008728963072:139:0) after 7m41s
[13:04:19.694] Received PubSub notification, asking Buildbucket for the build status
[13:04:19.711] Build:
{
"id": "8756794946750522977",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1962,
"createdBy": "project:chromium",
"createTime": "2024-02-07T00:43:07.455687035Z",
"startTime": "2024-02-07T00:44:34.348254Z",
"endTime": "2024-02-07T13:04:18.445818Z",
"updateTime": "2024-02-07T13:04:18.445818Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aff30f14339ca844d9f41d1b59069544611b8e9d",
"ref": "refs/heads/main"
}
}
}
[13:04:19.711] Invocation finished in 12h21m13.526408253s with status FAILED