[18:34:55.950] New invocation is queued and will start shortly
[18:34:57.027] Starting the invocation (attempt 1)
[18:34:57.060] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2844dd2fc3ae1c992ec9033b25277c3a37443e9a"
[18:34:57.060] Popped gitiles commit info from properties and tags
[18:34:57.060] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:34:57.060] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:34:57.060] Buildbucket request:
{
"requestId": "8929586526304383968",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2844dd2fc3ae1c992ec9033b25277c3a37443e9a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929586526304383968"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:34:57.643] Scheduled build:
{
"id": "8764156464413720385",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1800,
"createdBy": "project:chromium",
"createTime": "2023-11-17T18:34:57.130049727Z",
"updateTime": "2023-11-17T18:34:57.130049727Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2844dd2fc3ae1c992ec9033b25277c3a37443e9a",
"ref": "refs/heads/main"
}
}
}
[18:34:57.643] Task URL: https://cr-buildbucket.appspot.com/build/8764156464413720385
[18:34:57.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:2:0) after 4m19s
[18:34:58.610] Received PubSub notification, asking Buildbucket for the build status
[18:34:58.647] Build status: SCHEDULED
[18:35:00.315] Received PubSub notification, asking Buildbucket for the build status
[18:35:00.337] Build status: STARTED
[18:39:16.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:2:0)
[18:39:16.708] Build status: STARTED
[18:39:16.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:5:0) after 2m34s
[18:41:50.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:5:0)
[18:41:50.929] Build status: STARTED
[18:41:50.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:6:0) after 5m27s
[18:47:17.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:6:0)
[18:47:18.000] Build status: STARTED
[18:47:18.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:7:0) after 3m25s
[18:50:43.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:7:0)
[18:50:43.067] Build status: STARTED
[18:50:43.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:8:0) after 1m55s
[18:52:38.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:8:0)
[18:52:38.160] Build status: STARTED
[18:52:38.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:9:0) after 4m7s
[18:56:45.184] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:9:0)
[18:56:45.205] Build status: STARTED
[18:56:45.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:10:0) after 4m17s
[19:01:02.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:10:0)
[19:01:02.346] Build status: STARTED
[19:01:02.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:11:0) after 8m55s
[19:09:57.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:11:0)
[19:09:57.502] Build status: STARTED
[19:09:57.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:12:0) after 5m52s
[19:15:49.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:12:0)
[19:15:49.600] Build status: STARTED
[19:15:49.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:13:0) after 6m49s
[19:22:38.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:13:0)
[19:22:38.706] Build status: STARTED
[19:22:38.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:14:0) after 5m51s
[19:28:29.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:14:0)
[19:28:29.795] Build status: STARTED
[19:28:29.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:15:0) after 6m22s
[19:34:51.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:15:0)
[19:34:51.861] Build status: STARTED
[19:34:51.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:16:0) after 5m39s
[19:40:30.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:16:0)
[19:40:30.938] Build status: STARTED
[19:40:30.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:17:0) after 9m38s
[19:50:09.356] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:17:0)
[19:50:09.384] Build status: STARTED
[19:50:09.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:18:0) after 3m57s
[19:54:06.417] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:18:0)
[19:54:06.444] Build status: STARTED
[19:54:06.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:19:0) after 1m29s
[19:55:35.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:19:0)
[19:55:35.508] Build status: STARTED
[19:55:35.508] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:20:0) after 3m49s
[19:59:24.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:20:0)
[19:59:24.736] Build status: STARTED
[19:59:24.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:21:0) after 2m23s
[20:01:47.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:21:0)
[20:01:47.795] Build status: STARTED
[20:01:47.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:22:0) after 6m3s
[20:07:51.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:22:0)
[20:07:51.237] Build status: STARTED
[20:07:51.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:23:0) after 1m8s
[20:08:59.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:23:0)
[20:08:59.319] Build status: STARTED
[20:08:59.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:24:0) after 8m47s
[20:17:46.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:24:0)
[20:17:46.344] Build status: STARTED
[20:17:46.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:25:0) after 2m23s
[20:20:09.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:25:0)
[20:20:09.421] Build status: STARTED
[20:20:09.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:26:0) after 6m56s
[20:27:06.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:26:0)
[20:27:06.768] Build status: STARTED
[20:27:06.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:27:0) after 9m20s
[20:36:26.804] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:27:0)
[20:36:26.826] Build status: STARTED
[20:36:26.826] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:28:0) after 1m6s
[20:37:32.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:28:0)
[20:37:32.988] Build status: STARTED
[20:37:32.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:29:0) after 3m44s
[20:41:17.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:29:0)
[20:41:17.050] Build status: STARTED
[20:41:17.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:30:0) after 9m24s
[20:50:41.089] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:30:0)
[20:50:41.168] Build status: STARTED
[20:50:41.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:31:0) after 9m31s
[21:00:12.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:31:0)
[21:00:12.253] Build status: STARTED
[21:00:12.253] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:32:0) after 1m15s
[21:01:27.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:32:0)
[21:01:27.290] Build status: STARTED
[21:01:27.290] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:33:0) after 2m1s
[21:03:28.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:33:0)
[21:03:28.349] Build status: STARTED
[21:03:28.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:34:0) after 9m25s
[21:12:53.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:34:0)
[21:12:53.474] Build status: STARTED
[21:12:53.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:35:0) after 5m18s
[21:18:11.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:35:0)
[21:18:11.574] Build status: STARTED
[21:18:11.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:36:0) after 4m37s
[21:22:48.788] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:36:0)
[21:22:48.809] Build status: STARTED
[21:22:48.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:37:0) after 3m39s
[21:26:27.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:37:0)
[21:26:28.180] Build status: STARTED
[21:26:28.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:38:0) after 9m38s
[21:36:06.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:38:0)
[21:36:06.375] Build status: STARTED
[21:36:06.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:39:0) after 8m42s
[21:44:48.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:39:0)
[21:44:48.501] Build status: STARTED
[21:44:48.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:40:0) after 1m52s
[21:46:40.508] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:40:0)
[21:46:40.534] Build status: STARTED
[21:46:40.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:41:0) after 1m49s
[21:48:29.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:41:0)
[21:48:29.551] Build status: STARTED
[21:48:29.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:42:0) after 9m45s
[21:58:14.574] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:42:0)
[21:58:14.596] Build status: STARTED
[21:58:14.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:43:0) after 8m7s
[22:06:21.729] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:43:0)
[22:06:21.751] Build status: STARTED
[22:06:21.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:44:0) after 5m7s
[22:11:28.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:44:0)
[22:11:28.902] Build status: STARTED
[22:11:28.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:45:0) after 4m33s
[22:16:02.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:45:0)
[22:16:02.094] Build status: STARTED
[22:16:02.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:46:0) after 5m2s
[22:21:04.356] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:46:0)
[22:21:04.385] Build status: STARTED
[22:21:04.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:47:0) after 8m37s
[22:29:41.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:47:0)
[22:29:41.489] Build status: STARTED
[22:29:41.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:48:0) after 2m6s
[22:31:47.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:48:0)
[22:31:47.584] Build status: STARTED
[22:31:47.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:49:0) after 9m21s
[22:41:08.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:49:0)
[22:41:08.638] Build status: STARTED
[22:41:08.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:50:0) after 9m3s
[22:50:11.784] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:50:0)
[22:50:11.845] Build status: STARTED
[22:50:11.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:51:0) after 9m4s
[22:59:16.041] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:51:0)
[22:59:16.068] Build status: STARTED
[22:59:16.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:52:0) after 5m24s
[23:04:40.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:52:0)
[23:04:40.601] Build status: STARTED
[23:04:40.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:53:0) after 1m38s
[23:06:18.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:53:0)
[23:06:18.963] Build status: STARTED
[23:06:18.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:54:0) after 3m54s
[23:10:13.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:54:0)
[23:10:13.388] Build status: STARTED
[23:10:13.388] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:55:0) after 8m7s
[23:18:20.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:55:0)
[23:18:20.447] Build status: STARTED
[23:18:20.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:56:0) after 1m53s
[23:20:13.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:56:0)
[23:20:13.873] Build status: STARTED
[23:20:13.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:57:0) after 1m19s
[23:21:33.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:57:0)
[23:21:33.805] Build status: STARTED
[23:21:33.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:58:0) after 4m57s
[23:26:30.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:58:0)
[23:26:31.022] Build status: STARTED
[23:26:31.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:59:0) after 9m39s
[23:36:10.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:59:0)
[23:36:10.469] Build status: STARTED
[23:36:10.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:60:0) after 1m59s
[23:38:09.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:60:0)
[23:38:09.694] Build status: STARTED
[23:38:09.694] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:61:0) after 5m50s
[23:44:00.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:61:0)
[23:44:00.439] Build status: STARTED
[23:44:00.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:62:0) after 6m19s
[23:50:19.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:62:0)
[23:50:19.501] Build status: STARTED
[23:50:19.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:63:0) after 4m31s
[23:54:50.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:63:0)
[23:54:50.875] Build status: STARTED
[23:54:50.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:64:0) after 2m16s
[23:57:07.389] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:64:0)
[23:57:07.410] Build status: STARTED
[23:57:07.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:65:0) after 5m31s
[00:02:38.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:65:0)
[00:02:38.925] Build status: STARTED
[00:02:38.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:66:0) after 4m49s
[00:07:27.985] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:66:0)
[00:07:28.008] Build status: STARTED
[00:07:28.008] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:67:0) after 4m40s
[00:12:08.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:67:0)
[00:12:08.163] Build status: STARTED
[00:12:08.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:68:0) after 7m17s
[00:19:25.196] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:68:0)
[00:19:25.229] Build status: STARTED
[00:19:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:69:0) after 5m18s
[00:24:43.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:69:0)
[00:24:43.594] Build status: STARTED
[00:24:43.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:70:0) after 3m49s
[00:28:33.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:70:0)
[00:28:33.269] Build status: STARTED
[00:28:33.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:71:0) after 1m13s
[00:29:46.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:71:0)
[00:29:46.540] Build status: STARTED
[00:29:46.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:72:0) after 4m16s
[00:34:02.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:72:0)
[00:34:02.815] Build status: STARTED
[00:34:02.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:73:0) after 8m57s
[00:42:59.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:73:0)
[00:42:59.992] Build status: STARTED
[00:42:59.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:74:0) after 6m0s
[00:49:00.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:74:0)
[00:49:00.149] Build status: STARTED
[00:49:00.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:75:0) after 5m20s
[00:54:20.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:75:0)
[00:54:20.200] Build status: STARTED
[00:54:20.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:76:0) after 4m36s
[00:58:56.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:76:0)
[00:58:56.329] Build status: STARTED
[00:58:56.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:77:0) after 1m6s
[01:00:02.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:77:0)
[01:00:02.594] Build status: STARTED
[01:00:02.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:78:0) after 1m49s
[01:01:51.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:78:0)
[01:01:51.805] Build status: STARTED
[01:01:51.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:79:0) after 4m18s
[01:06:10.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:79:0)
[01:06:10.187] Build status: STARTED
[01:06:10.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:80:0) after 3m13s
[01:09:23.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:80:0)
[01:09:23.262] Build status: STARTED
[01:09:23.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:81:0) after 7m51s
[01:17:14.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:81:0)
[01:17:14.336] Build status: STARTED
[01:17:14.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:82:0) after 4m45s
[01:21:59.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:82:0)
[01:21:59.420] Build status: STARTED
[01:21:59.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:83:0) after 9m2s
[01:31:01.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:83:0)
[01:31:01.702] Build status: STARTED
[01:31:01.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:84:0) after 9m1s
[01:40:02.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:84:0)
[01:40:02.876] Build status: STARTED
[01:40:02.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:85:0) after 2m33s
[01:42:35.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:85:0)
[01:42:36.180] Build status: STARTED
[01:42:36.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:86:0) after 6m53s
[01:49:29.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:86:0)
[01:49:29.467] Build status: STARTED
[01:49:29.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:87:0) after 6m33s
[01:56:03.055] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:87:0)
[01:56:03.089] Build status: STARTED
[01:56:03.089] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:88:0) after 9m54s
[02:05:57.143] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:88:0)
[02:05:57.190] Build status: STARTED
[02:05:57.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:89:0) after 5m27s
[02:11:24.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:89:0)
[02:11:24.536] Build status: STARTED
[02:11:24.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:90:0) after 8m52s
[02:20:16.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:90:0)
[02:20:16.713] Build status: STARTED
[02:20:16.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:91:0) after 2m56s
[02:23:12.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:91:0)
[02:23:12.844] Build status: STARTED
[02:23:12.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:92:0) after 9m23s
[02:32:36.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:92:0)
[02:32:36.398] Build status: STARTED
[02:32:36.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:93:0) after 2m10s
[02:34:46.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:93:0)
[02:34:46.456] Build status: STARTED
[02:34:46.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:94:0) after 5m34s
[02:40:20.495] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:94:0)
[02:40:20.691] Build status: STARTED
[02:40:20.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:95:0) after 1m11s
[02:41:31.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:95:0)
[02:41:31.749] Build status: STARTED
[02:41:31.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:96:0) after 5m38s
[02:47:09.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:96:0)
[02:47:09.827] Build status: STARTED
[02:47:09.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:97:0) after 2m27s
[02:49:37.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:97:0)
[02:49:37.455] Build status: STARTED
[02:49:37.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:98:0) after 2m42s
[02:52:19.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:98:0)
[02:52:19.516] Build status: STARTED
[02:52:19.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:99:0) after 6m52s
[02:59:11.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:99:0)
[02:59:11.678] Build status: STARTED
[02:59:11.678] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:100:0) after 5m57s
[03:05:08.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:100:0)
[03:05:08.875] Build status: STARTED
[03:05:08.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:101:0) after 2m44s
[03:07:53.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:101:0)
[03:07:53.026] Build status: STARTED
[03:07:53.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:102:0) after 6m3s
[03:13:56.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:102:0)
[03:13:56.279] Build status: STARTED
[03:13:56.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:103:0) after 8m41s
[03:22:37.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:103:0)
[03:22:37.489] Build status: STARTED
[03:22:37.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:104:0) after 6m21s
[03:28:58.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:104:0)
[03:28:58.534] Build status: STARTED
[03:28:58.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:105:0) after 6m1s
[03:34:59.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:105:0)
[03:34:59.621] Build status: STARTED
[03:34:59.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:106:0) after 7m25s
[03:42:24.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:106:0)
[03:42:24.796] Build status: STARTED
[03:42:24.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:107:0) after 3m4s
[03:45:28.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:107:0)
[03:45:28.865] Build status: STARTED
[03:45:28.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:108:0) after 6m15s
[03:51:43.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:108:0)
[03:51:43.909] Build status: STARTED
[03:51:43.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:109:0) after 6m16s
[03:58:00.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:109:0)
[03:58:00.265] Build status: STARTED
[03:58:00.265] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:110:0) after 2m50s
[04:00:50.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:110:0)
[04:00:50.621] Build status: STARTED
[04:00:50.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:111:0) after 2m34s
[04:03:24.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:111:0)
[04:03:24.666] Build status: STARTED
[04:03:24.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:112:0) after 5m20s
[04:08:44.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:112:0)
[04:08:44.960] Build status: STARTED
[04:08:44.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:113:0) after 3m39s
[04:12:24.055] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:113:0)
[04:12:24.082] Build status: STARTED
[04:12:24.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:114:0) after 2m38s
[04:15:02.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:114:0)
[04:15:02.535] Build status: STARTED
[04:15:02.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:115:0) after 8m37s
[04:23:39.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:115:0)
[04:23:39.601] Build status: STARTED
[04:23:39.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:116:0) after 4m34s
[04:28:13.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:116:0)
[04:28:13.841] Build status: STARTED
[04:28:13.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:117:0) after 2m51s
[04:31:04.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:117:0)
[04:31:04.910] Build status: STARTED
[04:31:04.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:118:0) after 7m3s
[04:38:08.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:118:0)
[04:38:08.328] Build status: STARTED
[04:38:08.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:119:0) after 1m5s
[04:39:13.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:119:0)
[04:39:13.451] Build status: STARTED
[04:39:13.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:120:0) after 7m7s
[04:46:20.679] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:120:0)
[04:46:20.742] Build status: STARTED
[04:46:20.742] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:121:0) after 3m55s
[04:50:15.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:121:0)
[04:50:15.793] Build status: STARTED
[04:50:15.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:122:0) after 9m22s
[04:59:37.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:122:0)
[04:59:37.974] Build status: STARTED
[04:59:37.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:123:0) after 3m21s
[05:02:59.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:123:0)
[05:02:59.077] Build status: STARTED
[05:02:59.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:124:0) after 4m40s
[05:07:39.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:124:0)
[05:07:39.194] Build status: STARTED
[05:07:39.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:125:0) after 5m50s
[05:13:29.276] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:125:0)
[05:13:29.298] Build status: STARTED
[05:13:29.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:126:0) after 8m46s
[05:22:15.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:126:0)
[05:22:15.457] Build status: STARTED
[05:22:15.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:127:0) after 5m21s
[05:27:36.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:127:0)
[05:27:36.711] Build status: STARTED
[05:27:36.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:128:0) after 5m19s
[05:32:55.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:128:0)
[05:32:55.775] Build status: STARTED
[05:32:55.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:129:0) after 1m32s
[05:34:28.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:129:0)
[05:34:28.075] Build status: STARTED
[05:34:28.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:130:0) after 3m53s
[05:38:21.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:130:0)
[05:38:21.133] Build status: STARTED
[05:38:21.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:131:0) after 7m54s
[05:46:15.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:131:0)
[05:46:15.189] Build status: STARTED
[05:46:15.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:132:0) after 6m2s
[05:52:17.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:132:0)
[05:52:17.370] Build status: STARTED
[05:52:17.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:133:0) after 8m26s
[06:00:43.350] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:133:0)
[06:00:43.378] Build status: STARTED
[06:00:43.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:134:0) after 7m26s
[06:08:09.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:134:0)
[06:08:09.679] Build status: STARTED
[06:08:09.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:135:0) after 3m39s
[06:11:48.716] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:135:0)
[06:11:48.756] Build status: STARTED
[06:11:48.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:136:0) after 9m42s
[06:21:30.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:136:0)
[06:21:30.958] Build status: STARTED
[06:21:30.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:137:0) after 7m28s
[06:28:58.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:137:0)
[06:28:59.015] Build status: STARTED
[06:28:59.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:138:0) after 3m9s
[06:32:08.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:138:0)
[06:32:08.422] Build status: STARTED
[06:32:08.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:139:0) after 5m50s
[06:37:58.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:139:0)
[06:37:58.510] Build status: STARTED
[06:37:58.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:140:0) after 4m53s
[06:42:51.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:140:0)
[06:42:51.838] Build status: STARTED
[06:42:51.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929586526304383968:141:0) after 4m45s
[06:46:25.603] Received PubSub notification, asking Buildbucket for the build status
[06:46:25.622] Build:
{
"id": "8764156464413720385",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1800,
"createdBy": "project:chromium",
"createTime": "2023-11-17T18:34:57.130049727Z",
"startTime": "2023-11-17T18:34:59.814018Z",
"endTime": "2023-11-18T06:46:24.365322Z",
"updateTime": "2023-11-18T06:46:24.365322Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2844dd2fc3ae1c992ec9033b25277c3a37443e9a",
"ref": "refs/heads/main"
}
}
}
[06:46:25.622] Invocation finished in 12h11m29.678394305s with status FAILED