[13:16:54.650] New invocation is queued and will start shortly
[13:16:55.932] Starting the invocation (attempt 1)
[13:16:55.962] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/11b51e39a445da2fa9a88a1962cdfad256140f33"
[13:16:55.962] Popped gitiles commit info from properties and tags
[13:16:55.962] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:16:55.962] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:16:55.962] Buildbucket request:
{
"requestId": "8930240713262082336",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11b51e39a445da2fa9a88a1962cdfad256140f33",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8930240713262082336"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:16:57.025] Scheduled build:
{
"id": "8764810651159164081",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1786,
"createdBy": "project:chromium",
"createTime": "2023-11-10T13:16:56.033726856Z",
"updateTime": "2023-11-10T13:16:56.033726856Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11b51e39a445da2fa9a88a1962cdfad256140f33",
"ref": "refs/heads/main"
}
}
}
[13:16:57.025] Task URL: https://cr-buildbucket.appspot.com/build/8764810651159164081
[13:16:57.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:2:0) after 6m31s
[13:16:57.613] Received PubSub notification, asking Buildbucket for the build status
[13:16:57.645] Build status: SCHEDULED
[13:16:58.592] Received PubSub notification, asking Buildbucket for the build status
[13:16:58.614] Build status: STARTED
[13:23:28.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:2:0)
[13:23:28.125] Build status: STARTED
[13:23:28.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:5:0) after 2m39s
[13:26:07.603] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:5:0)
[13:26:07.629] Build status: STARTED
[13:26:07.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:6:0) after 9m8s
[13:35:15.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:6:0)
[13:35:15.858] Build status: STARTED
[13:35:15.858] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:7:0) after 7m58s
[13:43:13.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:7:0)
[13:43:13.924] Build status: STARTED
[13:43:13.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:8:0) after 9m4s
[13:52:17.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:8:0)
[13:52:17.966] Build status: STARTED
[13:52:17.966] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:9:0) after 9m33s
[14:01:51.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:9:0)
[14:01:51.239] Build status: STARTED
[14:01:51.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:10:0) after 3m13s
[14:05:04.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:10:0)
[14:05:04.406] Build status: STARTED
[14:05:04.406] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:11:0) after 7m7s
[14:12:11.444] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:11:0)
[14:12:11.496] Build status: STARTED
[14:12:11.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:12:0) after 5m58s
[14:18:09.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:12:0)
[14:18:09.596] Build status: STARTED
[14:18:09.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:13:0) after 6m27s
[14:24:36.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:13:0)
[14:24:37.004] Build status: STARTED
[14:24:37.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:14:0) after 3m21s
[14:27:58.143] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:14:0)
[14:27:58.168] Build status: STARTED
[14:27:58.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:15:0) after 3m55s
[14:31:53.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:15:0)
[14:31:53.215] Build status: STARTED
[14:31:53.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:16:0) after 1m1s
[14:32:54.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:16:0)
[14:32:54.276] Build status: STARTED
[14:32:54.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:17:0) after 1m33s
[14:34:27.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:17:0)
[14:34:27.416] Build status: STARTED
[14:34:27.416] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:18:0) after 1m34s
[14:36:01.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:18:0)
[14:36:01.571] Build status: STARTED
[14:36:01.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:19:0) after 4m34s
[14:40:35.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:19:0)
[14:40:35.627] Build status: STARTED
[14:40:35.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:20:0) after 5m22s
[14:45:57.715] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:20:0)
[14:45:57.736] Build status: STARTED
[14:45:57.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:21:0) after 6m5s
[14:52:02.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:21:0)
[14:52:03.000] Build status: STARTED
[14:52:03.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:22:0) after 4m14s
[14:56:17.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:22:0)
[14:56:17.069] Build status: STARTED
[14:56:17.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:23:0) after 7m41s
[15:03:58.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:23:0)
[15:03:58.204] Build status: STARTED
[15:03:58.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:24:0) after 4m24s
[15:08:22.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:24:0)
[15:08:22.269] Build status: STARTED
[15:08:22.270] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:25:0) after 1m40s
[15:10:02.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:25:0)
[15:10:02.345] Build status: STARTED
[15:10:02.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:26:0) after 4m9s
[15:14:11.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:26:0)
[15:14:11.390] Build status: STARTED
[15:14:11.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:27:0) after 5m2s
[15:19:13.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:27:0)
[15:19:13.455] Build status: STARTED
[15:19:13.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:28:0) after 5m42s
[15:24:55.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:28:0)
[15:24:55.557] Build status: STARTED
[15:24:55.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:29:0) after 5m41s
[15:30:37.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:29:0)
[15:30:37.564] Build status: STARTED
[15:30:37.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:30:0) after 9m59s
[15:40:36.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:30:0)
[15:40:36.689] Build status: STARTED
[15:40:36.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:31:0) after 3m27s
[15:44:03.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:31:0)
[15:44:03.739] Build status: STARTED
[15:44:03.739] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:32:0) after 8m33s
[15:52:37.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:32:0)
[15:52:37.124] Build status: STARTED
[15:52:37.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:33:0) after 9m46s
[16:02:23.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:33:0)
[16:02:23.364] Build status: STARTED
[16:02:23.365] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:34:0) after 4m22s
[16:06:45.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:34:0)
[16:06:45.454] Build status: STARTED
[16:06:45.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:35:0) after 8m27s
[16:15:12.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:35:0)
[16:15:12.576] Build status: STARTED
[16:15:12.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:36:0) after 8m39s
[16:23:51.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:36:0)
[16:23:51.642] Build status: STARTED
[16:23:51.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:37:0) after 2m32s
[16:26:23.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:37:0)
[16:26:23.765] Build status: STARTED
[16:26:23.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:38:0) after 2m54s
[16:29:17.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:38:0)
[16:29:17.922] Build status: STARTED
[16:29:17.922] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:39:0) after 3m5s
[16:32:23.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:39:0)
[16:32:23.289] Build status: STARTED
[16:32:23.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:40:0) after 8m7s
[16:40:30.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:40:0)
[16:40:30.373] Build status: STARTED
[16:40:30.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:41:0) after 4m43s
[16:45:13.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:41:0)
[16:45:13.492] Build status: STARTED
[16:45:13.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:42:0) after 6m25s
[16:51:38.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:42:0)
[16:51:38.541] Build status: STARTED
[16:51:38.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:43:0) after 8m53s
[17:00:31.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:43:0)
[17:00:31.633] Build status: STARTED
[17:00:31.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:44:0) after 2m0s
[17:02:31.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:44:0)
[17:02:31.752] Build status: STARTED
[17:02:31.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:45:0) after 4m55s
[17:07:26.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:45:0)
[17:07:26.987] Build status: STARTED
[17:07:26.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:46:0) after 2m30s
[17:09:57.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:46:0)
[17:09:57.070] Build status: STARTED
[17:09:57.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:47:0) after 5m58s
[17:15:55.253] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:47:0)
[17:15:55.274] Build status: STARTED
[17:15:55.274] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:48:0) after 7m28s
[17:23:23.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:48:0)
[17:23:23.385] Build status: STARTED
[17:23:23.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:49:0) after 6m36s
[17:29:59.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:49:0)
[17:29:59.470] Build status: STARTED
[17:29:59.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:50:0) after 5m54s
[17:35:53.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:50:0)
[17:35:53.580] Build status: STARTED
[17:35:53.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:51:0) after 2m36s
[17:38:29.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:51:0)
[17:38:29.689] Build status: STARTED
[17:38:29.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:52:0) after 3m57s
[17:42:26.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:52:0)
[17:42:26.734] Build status: STARTED
[17:42:26.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:53:0) after 7m34s
[17:50:00.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:53:0)
[17:50:00.890] Build status: STARTED
[17:50:00.890] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:54:0) after 6m15s
[17:56:15.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:54:0)
[17:56:15.908] Build status: STARTED
[17:56:15.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:55:0) after 7m31s
[18:03:46.923] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:55:0)
[18:03:46.949] Build status: STARTED
[18:03:46.949] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:56:0) after 9m26s
[18:13:13.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:56:0)
[18:13:13.076] Build status: STARTED
[18:13:13.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:57:0) after 5m3s
[18:18:16.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:57:0)
[18:18:16.256] Build status: STARTED
[18:18:16.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:58:0) after 3m35s
[18:21:51.282] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:58:0)
[18:21:51.307] Build status: STARTED
[18:21:51.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:59:0) after 7m35s
[18:29:26.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:59:0)
[18:29:26.550] Build status: STARTED
[18:29:26.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:60:0) after 2m10s
[18:31:36.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:60:0)
[18:31:36.645] Build status: STARTED
[18:31:36.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:61:0) after 5m17s
[18:36:53.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:61:0)
[18:36:53.696] Build status: STARTED
[18:36:53.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:62:0) after 7m32s
[18:44:25.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:62:0)
[18:44:25.775] Build status: STARTED
[18:44:25.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:63:0) after 8m27s
[18:52:52.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:63:0)
[18:52:52.871] Build status: STARTED
[18:52:52.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:64:0) after 8m9s
[19:01:02.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:64:0)
[19:01:02.496] Build status: STARTED
[19:01:02.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:65:0) after 7m52s
[19:08:54.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:65:0)
[19:08:54.675] Build status: STARTED
[19:08:54.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:66:0) after 1m45s
[19:10:40.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:66:0)
[19:10:40.182] Build status: STARTED
[19:10:40.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:67:0) after 9m17s
[19:19:57.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:67:0)
[19:19:57.428] Build status: STARTED
[19:19:57.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:68:0) after 5m36s
[19:25:33.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:68:0)
[19:25:33.476] Build status: STARTED
[19:25:33.476] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:69:0) after 9m33s
[19:35:06.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:69:0)
[19:35:06.683] Build status: STARTED
[19:35:06.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:70:0) after 5m52s
[19:40:58.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:70:0)
[19:40:58.731] Build status: STARTED
[19:40:58.731] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:71:0) after 2m40s
[19:43:38.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:71:0)
[19:43:38.882] Build status: STARTED
[19:43:38.882] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:72:0) after 3m12s
[19:46:51.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:72:0)
[19:46:51.030] Build status: STARTED
[19:46:51.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:73:0) after 5m24s
[19:52:15.061] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:73:0)
[19:52:15.083] Build status: STARTED
[19:52:15.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:74:0) after 5m44s
[19:57:59.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:74:0)
[19:57:59.183] Build status: STARTED
[19:57:59.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:75:0) after 3m12s
[20:01:11.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:75:0)
[20:01:11.301] Build status: STARTED
[20:01:11.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:76:0) after 7m10s
[20:08:21.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:76:0)
[20:08:21.370] Build status: STARTED
[20:08:21.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:77:0) after 2m19s
[20:10:40.414] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:77:0)
[20:10:40.437] Build status: STARTED
[20:10:40.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:78:0) after 9m15s
[20:19:55.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:78:0)
[20:19:55.583] Build status: STARTED
[20:19:55.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:79:0) after 1m49s
[20:21:44.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:79:0)
[20:21:44.729] Build status: STARTED
[20:21:44.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:80:0) after 7m59s
[20:29:43.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:80:0)
[20:29:43.872] Build status: STARTED
[20:29:43.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:81:0) after 7m50s
[20:37:33.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:81:0)
[20:37:33.974] Build status: STARTED
[20:37:33.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:82:0) after 7m1s
[20:44:35.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:82:0)
[20:44:35.076] Build status: STARTED
[20:44:35.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:83:0) after 5m37s
[20:50:12.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:83:0)
[20:50:12.222] Build status: STARTED
[20:50:12.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:84:0) after 4m30s
[20:54:42.253] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:84:0)
[20:54:42.273] Build status: STARTED
[20:54:42.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:85:0) after 9m15s
[21:03:57.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:85:0)
[21:03:57.399] Build status: STARTED
[21:03:57.399] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:86:0) after 7m23s
[21:11:20.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:86:0)
[21:11:20.527] Build status: STARTED
[21:11:20.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:87:0) after 9m42s
[21:21:02.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:87:0)
[21:21:02.583] Build status: STARTED
[21:21:02.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:88:0) after 7m39s
[21:28:41.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:88:0)
[21:28:41.640] Build status: STARTED
[21:28:41.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:89:0) after 3m22s
[21:32:03.667] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:89:0)
[21:32:03.692] Build status: STARTED
[21:32:03.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:90:0) after 8m34s
[21:40:37.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:90:0)
[21:40:37.767] Build status: STARTED
[21:40:37.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:91:0) after 1m11s
[21:41:48.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:91:0)
[21:41:48.804] Build status: STARTED
[21:41:48.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:92:0) after 4m3s
[21:45:51.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:92:0)
[21:45:51.859] Build status: STARTED
[21:45:51.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:93:0) after 4m23s
[21:50:14.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:93:0)
[21:50:15.076] Build status: STARTED
[21:50:15.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:94:0) after 4m45s
[21:55:00.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:94:0)
[21:55:00.127] Build status: STARTED
[21:55:00.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:95:0) after 2m52s
[21:57:52.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:95:0)
[21:57:52.212] Build status: STARTED
[21:57:52.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:96:0) after 2m40s
[22:00:32.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:96:0)
[22:00:32.846] Build status: STARTED
[22:00:32.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:97:0) after 8m19s
[22:08:51.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:97:0)
[22:08:51.973] Build status: STARTED
[22:08:51.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:98:0) after 9m52s
[22:18:44.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:98:0)
[22:18:44.088] Build status: STARTED
[22:18:44.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:99:0) after 7m7s
[22:25:51.110] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:99:0)
[22:25:51.179] Build status: STARTED
[22:25:51.179] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:100:0) after 8m26s
[22:34:17.205] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:100:0)
[22:34:17.227] Build status: STARTED
[22:34:17.227] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:101:0) after 5m21s
[22:39:38.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:101:0)
[22:39:38.391] Build status: STARTED
[22:39:38.391] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:102:0) after 5m13s
[22:44:51.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:102:0)
[22:44:51.461] Build status: STARTED
[22:44:51.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:103:0) after 8m49s
[22:53:40.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:103:0)
[22:53:40.487] Build status: STARTED
[22:53:40.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:104:0) after 1m26s
[22:55:06.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:104:0)
[22:55:06.499] Build status: STARTED
[22:55:06.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:105:0) after 1m30s
[22:56:36.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:105:0)
[22:56:36.886] Build status: STARTED
[22:56:36.886] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:106:0) after 3m36s
[23:00:13.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:106:0)
[23:00:13.123] Build status: STARTED
[23:00:13.123] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:107:0) after 6m10s
[23:06:23.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:107:0)
[23:06:23.168] Build status: STARTED
[23:06:23.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:108:0) after 1m13s
[23:07:36.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:108:0)
[23:07:36.221] Build status: STARTED
[23:07:36.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:109:0) after 2m46s
[23:10:22.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:109:0)
[23:10:22.275] Build status: STARTED
[23:10:22.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:110:0) after 9m47s
[23:20:09.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:110:0)
[23:20:09.483] Build status: STARTED
[23:20:09.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:111:0) after 1m7s
[23:21:16.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:111:0)
[23:21:16.527] Build status: STARTED
[23:21:16.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:112:0) after 7m1s
[23:28:17.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:112:0)
[23:28:17.600] Build status: STARTED
[23:28:17.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:113:0) after 6m5s
[23:34:22.762] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:113:0)
[23:34:22.785] Build status: STARTED
[23:34:22.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:114:0) after 6m33s
[23:40:55.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:114:0)
[23:40:55.911] Build status: STARTED
[23:40:55.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:115:0) after 9m14s
[23:50:09.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:115:0)
[23:50:10.030] Build status: STARTED
[23:50:10.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:116:0) after 6m22s
[23:56:32.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:116:0)
[23:56:32.081] Build status: STARTED
[23:56:32.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:117:0) after 7m48s
[00:04:20.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:117:0)
[00:04:20.134] Build status: STARTED
[00:04:20.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:118:0) after 3m21s
[00:07:41.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:118:0)
[00:07:41.335] Build status: STARTED
[00:07:41.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:119:0) after 8m0s
[00:15:41.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:119:0)
[00:15:41.398] Build status: STARTED
[00:15:41.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:120:0) after 3m28s
[00:19:09.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:120:0)
[00:19:09.587] Build status: STARTED
[00:19:09.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:121:0) after 3m21s
[00:22:30.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:121:0)
[00:22:30.661] Build status: STARTED
[00:22:30.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:122:0) after 1m3s
[00:23:33.695] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:122:0)
[00:23:33.732] Build status: STARTED
[00:23:33.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:123:0) after 6m50s
[00:30:23.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:123:0)
[00:30:23.795] Build status: STARTED
[00:30:23.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:124:0) after 1m28s
[00:31:51.834] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:124:0)
[00:31:51.874] Build status: STARTED
[00:31:51.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:125:0) after 4m32s
[00:36:23.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:125:0)
[00:36:23.952] Build status: STARTED
[00:36:23.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:126:0) after 9m18s
[00:45:42.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:126:0)
[00:45:42.156] Build status: STARTED
[00:45:42.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:127:0) after 8m37s
[00:54:19.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:127:0)
[00:54:19.490] Build status: STARTED
[00:54:19.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:128:0) after 7m36s
[01:01:55.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:128:0)
[01:01:55.588] Build status: STARTED
[01:01:55.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:129:0) after 4m26s
[01:06:21.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:129:0)
[01:06:21.638] Build status: STARTED
[01:06:21.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:130:0) after 7m40s
[01:14:01.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:130:0)
[01:14:01.794] Build status: STARTED
[01:14:01.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:131:0) after 9m39s
[01:23:40.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:131:0)
[01:23:40.864] Build status: STARTED
[01:23:40.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:132:0) after 9m5s
[01:32:46.011] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:132:0)
[01:32:46.036] Build status: STARTED
[01:32:46.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8930240713262082336:133:0) after 9m20s
[01:35:08.564] Received PubSub notification, asking Buildbucket for the build status
[01:35:08.594] Build:
{
"id": "8764810651159164081",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1786,
"createdBy": "project:chromium",
"createTime": "2023-11-10T13:16:56.033726856Z",
"startTime": "2023-11-10T13:16:57.828858Z",
"endTime": "2023-11-11T01:35:07.681630Z",
"updateTime": "2023-11-11T01:35:07.681630Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "11b51e39a445da2fa9a88a1962cdfad256140f33",
"ref": "refs/heads/main"
}
}
}
[01:35:08.594] Invocation finished in 12h18m13.950151728s with status FAILED