[04:12:17.310] New invocation is queued and will start shortly
[04:12:18.423] Starting the invocation (attempt 1)
[04:12:18.447] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/68835c5df16bae21d710dbb764d5d901a9b9fa16"
[04:12:18.447] Popped gitiles commit info from properties and tags
[04:12:18.447] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:12:18.447] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:12:18.447] Buildbucket request:
{
"requestId": "8940784226046145184",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "68835c5df16bae21d710dbb764d5d901a9b9fa16",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8940784226046145184"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:12:18.829] Scheduled build:
{
"id": "8775354164138057105",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1554,
"createdBy": "project:chromium",
"createTime": "2023-07-17T04:12:18.500711425Z",
"updateTime": "2023-07-17T04:12:18.500711425Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "68835c5df16bae21d710dbb764d5d901a9b9fa16",
"ref": "refs/heads/main"
}
}
}
[04:12:18.829] Task URL: https://cr-buildbucket.appspot.com/build/8775354164138057105
[04:12:18.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:2:0) after 6m9s
[04:13:15.494] Received PubSub notification, asking Buildbucket for the build status
[04:13:15.562] Build status: STARTED
[04:18:27.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:2:0)
[04:18:27.969] Build status: STARTED
[04:18:27.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:4:0) after 1m41s
[04:20:08.995] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:4:0)
[04:20:09.018] Build status: STARTED
[04:20:09.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:5:0) after 3m37s
[04:23:46.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:5:0)
[04:23:46.239] Build status: STARTED
[04:23:46.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:6:0) after 7m39s
[04:31:25.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:6:0)
[04:31:25.440] Build status: STARTED
[04:31:25.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:7:0) after 6m32s
[04:37:57.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:7:0)
[04:37:57.476] Build status: STARTED
[04:37:57.476] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:8:0) after 3m50s
[04:41:47.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:8:0)
[04:41:47.518] Build status: STARTED
[04:41:47.518] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:9:0) after 9m21s
[04:51:08.572] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:9:0)
[04:51:08.594] Build status: STARTED
[04:51:08.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:10:0) after 3m24s
[04:54:32.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:10:0)
[04:54:32.631] Build status: STARTED
[04:54:32.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:11:0) after 5m30s
[05:00:02.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:11:0)
[05:00:02.786] Build status: STARTED
[05:00:02.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:12:0) after 6m35s
[05:06:38.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:12:0)
[05:06:38.026] Build status: STARTED
[05:06:38.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:13:0) after 2m52s
[05:09:30.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:13:0)
[05:09:30.658] Build status: STARTED
[05:09:30.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:14:0) after 1m38s
[05:11:08.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:14:0)
[05:11:08.805] Build status: STARTED
[05:11:08.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:15:0) after 4m39s
[05:15:47.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:15:0)
[05:15:47.842] Build status: STARTED
[05:15:47.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:16:0) after 6m25s
[05:22:12.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:16:0)
[05:22:13.788] Build status: STARTED
[05:22:13.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:17:0) after 8m45s
[05:30:58.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:17:0)
[05:30:58.838] Build status: STARTED
[05:30:58.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:18:0) after 3m55s
[05:34:53.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:18:0)
[05:34:53.873] Build status: STARTED
[05:34:53.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:19:0) after 8m59s
[05:43:52.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:19:0)
[05:43:53.018] Build status: STARTED
[05:43:53.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:20:0) after 3m56s
[05:47:49.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:20:0)
[05:47:49.197] Build status: STARTED
[05:47:49.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:21:0) after 8m45s
[05:56:34.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:21:0)
[05:56:34.327] Build status: STARTED
[05:56:34.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:22:0) after 3m3s
[05:59:37.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:22:0)
[05:59:37.570] Build status: STARTED
[05:59:37.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:23:0) after 5m8s
[06:04:46.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:23:0)
[06:04:46.047] Build status: STARTED
[06:04:46.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:24:0) after 1m53s
[06:06:39.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:24:0)
[06:06:39.170] Build status: STARTED
[06:06:39.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:25:0) after 9m15s
[06:15:54.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:25:0)
[06:15:54.210] Build status: STARTED
[06:15:54.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:26:0) after 9m53s
[06:25:47.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:26:0)
[06:25:47.435] Build status: STARTED
[06:25:47.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:27:0) after 9m48s
[06:35:35.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:27:0)
[06:35:35.474] Build status: STARTED
[06:35:35.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:28:0) after 4m52s
[06:40:27.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:28:0)
[06:40:27.738] Build status: STARTED
[06:40:27.738] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:29:0) after 4m21s
[06:44:48.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:29:0)
[06:44:48.917] Build status: STARTED
[06:44:48.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:30:0) after 6m25s
[06:51:14.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:30:0)
[06:51:14.234] Build status: STARTED
[06:51:14.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:31:0) after 6m45s
[06:57:59.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:31:0)
[06:57:59.379] Build status: STARTED
[06:57:59.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:32:0) after 4m4s
[07:02:03.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:32:0)
[07:02:03.773] Build status: STARTED
[07:02:03.773] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:33:0) after 9m36s
[07:11:39.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:33:0)
[07:11:39.892] Build status: STARTED
[07:11:39.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:34:0) after 6m5s
[07:17:45.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:34:0)
[07:17:45.143] Build status: STARTED
[07:17:45.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:35:0) after 1m49s
[07:19:34.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:35:0)
[07:19:34.240] Build status: STARTED
[07:19:34.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:36:0) after 5m22s
[07:24:56.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:36:0)
[07:24:56.328] Build status: STARTED
[07:24:56.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:37:0) after 4m31s
[07:29:27.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:37:0)
[07:29:27.365] Build status: STARTED
[07:29:27.365] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:38:0) after 3m11s
[07:32:38.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:38:0)
[07:32:38.406] Build status: STARTED
[07:32:38.406] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:39:0) after 8m42s
[07:41:20.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:39:0)
[07:41:20.476] Build status: STARTED
[07:41:20.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:40:0) after 4m1s
[07:45:21.495] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:40:0)
[07:45:21.546] Build status: STARTED
[07:45:21.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:41:0) after 8m0s
[07:53:21.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:41:0)
[07:53:21.716] Build status: STARTED
[07:53:21.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:42:0) after 4m15s
[07:57:36.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:42:0)
[07:57:36.866] Build status: STARTED
[07:57:36.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:43:0) after 6m1s
[08:03:37.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:43:0)
[08:03:37.931] Build status: STARTED
[08:03:37.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:44:0) after 3m0s
[08:06:38.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:44:0)
[08:06:38.048] Build status: STARTED
[08:06:38.048] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:45:0) after 8m41s
[08:15:19.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:45:0)
[08:15:19.096] Build status: STARTED
[08:15:19.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:46:0) after 5m52s
[08:21:11.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:46:0)
[08:21:11.235] Build status: STARTED
[08:21:11.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:47:0) after 6m12s
[08:27:23.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:47:0)
[08:27:23.275] Build status: STARTED
[08:27:23.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:48:0) after 7m5s
[08:34:28.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:48:0)
[08:34:28.401] Build status: STARTED
[08:34:28.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:49:0) after 4m6s
[08:38:34.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:49:0)
[08:38:34.433] Build status: STARTED
[08:38:34.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:50:0) after 5m14s
[08:43:48.459] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:50:0)
[08:43:48.505] Build status: STARTED
[08:43:48.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:51:0) after 5m47s
[08:49:35.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:51:0)
[08:49:35.554] Build status: STARTED
[08:49:35.554] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:52:0) after 9m34s
[08:59:09.568] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:52:0)
[08:59:09.585] Build status: STARTED
[08:59:09.585] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:53:0) after 7m24s
[09:06:33.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:53:0)
[09:06:33.719] Build status: STARTED
[09:06:33.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:54:0) after 1m24s
[09:07:57.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:54:0)
[09:07:57.774] Build status: STARTED
[09:07:57.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:55:0) after 5m38s
[09:13:35.977] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:55:0)
[09:13:36.030] Build status: STARTED
[09:13:36.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:56:0) after 6m11s
[09:19:47.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:56:0)
[09:19:47.170] Build status: STARTED
[09:19:47.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:57:0) after 2m13s
[09:22:00.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:57:0)
[09:22:00.278] Build status: STARTED
[09:22:00.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:58:0) after 5m1s
[09:27:01.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:58:0)
[09:27:01.617] Build status: STARTED
[09:27:01.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:59:0) after 3m51s
[09:30:52.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:59:0)
[09:30:52.766] Build status: STARTED
[09:30:52.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:60:0) after 3m39s
[09:34:31.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:60:0)
[09:34:31.921] Build status: STARTED
[09:34:31.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:61:0) after 2m16s
[09:36:47.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:61:0)
[09:36:48.076] Build status: STARTED
[09:36:48.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:62:0) after 9m58s
[09:46:46.297] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:62:0)
[09:46:46.405] Build status: STARTED
[09:46:46.405] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:63:0) after 6m19s
[09:53:05.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:63:0)
[09:53:05.694] Build status: STARTED
[09:53:05.694] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:64:0) after 7m49s
[10:00:54.714] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:64:0)
[10:00:54.736] Build status: STARTED
[10:00:54.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:65:0) after 9m17s
[10:10:11.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:65:0)
[10:10:11.824] Build status: STARTED
[10:10:11.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:66:0) after 8m8s
[10:18:19.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:66:0)
[10:18:20.128] Build status: STARTED
[10:18:20.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:67:0) after 3m17s
[10:21:37.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:67:0)
[10:21:37.201] Build status: STARTED
[10:21:37.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:68:0) after 4m5s
[10:25:42.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:68:0)
[10:25:42.349] Build status: STARTED
[10:25:42.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:69:0) after 7m43s
[10:33:25.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:69:0)
[10:33:25.487] Build status: STARTED
[10:33:25.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:70:0) after 8m23s
[10:41:48.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:70:0)
[10:41:48.574] Build status: STARTED
[10:41:48.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:71:0) after 2m40s
[10:44:28.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:71:0)
[10:44:28.667] Build status: STARTED
[10:44:28.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:72:0) after 6m23s
[10:50:51.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:72:0)
[10:50:51.709] Build status: STARTED
[10:50:51.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:73:0) after 9m42s
[11:00:33.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:73:0)
[11:00:33.751] Build status: STARTED
[11:00:33.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:74:0) after 4m42s
[11:05:15.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:74:0)
[11:05:15.861] Build status: STARTED
[11:05:15.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:75:0) after 4m7s
[11:09:22.944] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:75:0)
[11:09:22.963] Build status: STARTED
[11:09:22.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:76:0) after 2m33s
[11:11:56.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:76:0)
[11:11:56.085] Build status: STARTED
[11:11:56.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:77:0) after 8m33s
[11:20:29.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:77:0)
[11:20:29.156] Build status: STARTED
[11:20:29.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:78:0) after 7m54s
[11:28:23.300] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:78:0)
[11:28:23.320] Build status: STARTED
[11:28:23.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:79:0) after 8m11s
[11:36:34.408] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:79:0)
[11:36:34.429] Build status: STARTED
[11:36:34.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:80:0) after 6m52s
[11:43:26.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:80:0)
[11:43:26.665] Build status: STARTED
[11:43:26.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:81:0) after 3m51s
[11:47:17.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:81:0)
[11:47:17.674] Build status: STARTED
[11:47:17.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:82:0) after 5m11s
[11:52:28.762] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:82:0)
[11:52:28.780] Build status: STARTED
[11:52:28.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:83:0) after 1m58s
[11:54:26.950] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:83:0)
[11:54:26.980] Build status: STARTED
[11:54:26.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:84:0) after 6m2s
[12:00:29.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:84:0)
[12:00:29.203] Build status: STARTED
[12:00:29.203] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:85:0) after 2m24s
[12:02:53.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:85:0)
[12:02:53.461] Build status: STARTED
[12:02:53.461] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:86:0) after 7m27s
[12:10:20.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:86:0)
[12:10:20.579] Build status: STARTED
[12:10:20.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:87:0) after 8m30s
[12:18:50.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:87:0)
[12:18:50.744] Build status: STARTED
[12:18:50.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:88:0) after 8m26s
[12:27:16.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:88:0)
[12:27:16.783] Build status: STARTED
[12:27:16.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:89:0) after 4m47s
[12:32:03.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:89:0)
[12:32:03.832] Build status: STARTED
[12:32:03.832] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:90:0) after 4m39s
[12:36:43.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:90:0)
[12:36:43.113] Build status: STARTED
[12:36:43.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:91:0) after 6m21s
[12:43:04.461] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:91:0)
[12:43:04.494] Build status: STARTED
[12:43:04.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:92:0) after 7m47s
[12:50:51.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:92:0)
[12:50:51.820] Build status: STARTED
[12:50:51.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:93:0) after 7m50s
[12:58:41.882] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:93:0)
[12:58:41.901] Build status: STARTED
[12:58:41.901] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:94:0) after 4m5s
[13:02:46.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:94:0)
[13:02:46.974] Build status: STARTED
[13:02:46.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:95:0) after 7m56s
[13:10:43.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:95:0)
[13:10:43.167] Build status: STARTED
[13:10:43.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:96:0) after 3m50s
[13:14:33.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:96:0)
[13:14:33.228] Build status: STARTED
[13:14:33.228] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:97:0) after 1m6s
[13:15:39.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:97:0)
[13:15:39.272] Build status: STARTED
[13:15:39.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:98:0) after 5m20s
[13:20:59.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:98:0)
[13:20:59.323] Build status: STARTED
[13:20:59.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:99:0) after 8m19s
[13:29:18.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:99:0)
[13:29:18.373] Build status: STARTED
[13:29:18.373] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:100:0) after 6m50s
[13:36:08.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:100:0)
[13:36:08.473] Build status: STARTED
[13:36:08.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:101:0) after 5m59s
[13:42:07.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:101:0)
[13:42:07.578] Build status: STARTED
[13:42:07.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:102:0) after 9m13s
[13:51:21.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:102:0)
[13:51:21.249] Build status: STARTED
[13:51:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:103:0) after 7m59s
[13:59:20.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:103:0)
[13:59:20.306] Build status: STARTED
[13:59:20.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:104:0) after 3m6s
[14:02:26.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:104:0)
[14:02:26.368] Build status: STARTED
[14:02:26.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:105:0) after 5m55s
[14:08:21.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:105:0)
[14:08:21.549] Build status: STARTED
[14:08:21.549] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:106:0) after 6m31s
[14:14:52.606] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:106:0)
[14:14:52.624] Build status: STARTED
[14:14:52.624] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:107:0) after 8m16s
[14:23:08.652] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:107:0)
[14:23:08.698] Build status: STARTED
[14:23:08.698] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:108:0) after 2m26s
[14:25:34.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:108:0)
[14:25:34.765] Build status: STARTED
[14:25:34.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:109:0) after 5m28s
[14:31:02.798] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:109:0)
[14:31:02.822] Build status: STARTED
[14:31:02.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:110:0) after 3m28s
[14:34:31.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:110:0)
[14:34:31.075] Build status: STARTED
[14:34:31.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:111:0) after 5m26s
[14:39:57.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:111:0)
[14:39:57.140] Build status: STARTED
[14:39:57.140] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:112:0) after 3m54s
[14:43:51.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:112:0)
[14:43:51.219] Build status: STARTED
[14:43:51.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:113:0) after 4m50s
[14:48:41.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:113:0)
[14:48:41.459] Build status: STARTED
[14:48:41.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:114:0) after 5m20s
[14:54:01.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:114:0)
[14:54:01.608] Build status: STARTED
[14:54:01.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:115:0) after 6m18s
[15:00:19.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:115:0)
[15:00:19.779] Build status: STARTED
[15:00:19.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:116:0) after 2m9s
[15:02:28.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:116:0)
[15:02:28.931] Build status: STARTED
[15:02:28.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:117:0) after 3m49s
[15:06:17.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:117:0)
[15:06:17.984] Build status: STARTED
[15:06:17.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:118:0) after 7m4s
[15:13:22.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:118:0)
[15:13:22.055] Build status: STARTED
[15:13:22.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:119:0) after 5m14s
[15:18:36.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:119:0)
[15:18:36.256] Build status: STARTED
[15:18:36.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:120:0) after 8m5s
[15:26:41.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:120:0)
[15:26:41.315] Build status: STARTED
[15:26:41.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:121:0) after 8m17s
[15:34:58.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:121:0)
[15:34:58.391] Build status: STARTED
[15:34:58.391] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:122:0) after 7m32s
[15:42:30.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:122:0)
[15:42:30.671] Build status: STARTED
[15:42:30.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:123:0) after 6m34s
[15:49:05.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:123:0)
[15:49:05.049] Build status: STARTED
[15:49:05.049] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:124:0) after 2m16s
[15:51:22.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:124:0)
[15:51:22.352] Build status: STARTED
[15:51:22.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:125:0) after 3m10s
[15:54:32.347] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:125:0)
[15:54:32.371] Build status: STARTED
[15:54:32.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:126:0) after 9m5s
[16:03:37.526] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:126:0)
[16:03:37.551] Build status: STARTED
[16:03:37.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:127:0) after 3m0s
[16:06:38.568] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:127:0)
[16:06:38.605] Build status: STARTED
[16:06:38.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:128:0) after 3m26s
[16:10:04.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:128:0)
[16:10:04.670] Build status: STARTED
[16:10:04.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:129:0) after 2m45s
[16:12:49.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:129:0)
[16:12:49.765] Build status: STARTED
[16:12:49.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:130:0) after 7m7s
[16:19:56.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:130:0)
[16:19:56.821] Build status: STARTED
[16:19:56.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8940784226046145184:131:0) after 9m41s
[16:28:21.051] Received PubSub notification, asking Buildbucket for the build status
[16:28:21.099] Build:
{
"id": "8775354164138057105",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1554,
"createdBy": "project:chromium",
"createTime": "2023-07-17T04:12:18.500711425Z",
"startTime": "2023-07-17T04:13:14.867810Z",
"endTime": "2023-07-17T16:28:20.255122Z",
"updateTime": "2023-07-17T16:28:20.255122Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "68835c5df16bae21d710dbb764d5d901a9b9fa16",
"ref": "refs/heads/main"
}
}
}
[16:28:21.099] Invocation finished in 12h16m3.802509862s with status FAILED