[10:04:38.082] New invocation is queued and will start shortly
[10:04:39.152] Starting the invocation (attempt 1)
[10:04:39.182] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5872430bd182d074c675148d5c11ed06ad22b2f2"
[10:04:39.182] Popped gitiles commit info from properties and tags
[10:04:39.182] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:04:39.182] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:04:39.182] Buildbucket request:
{
"requestId": "8939856088669998176",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5872430bd182d074c675148d5c11ed06ad22b2f2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8939856088669998176"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:04:39.777] Scheduled build:
{
"id": "8774426026789262305",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1574,
"createdBy": "project:chromium",
"createTime": "2023-07-27T10:04:39.252618041Z",
"updateTime": "2023-07-27T10:04:39.252618041Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5872430bd182d074c675148d5c11ed06ad22b2f2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:04:39.777] Task URL: https://cr-buildbucket.appspot.com/build/8774426026789262305
[10:04:39.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:2:0) after 6m12s
[10:04:39.939] Received PubSub notification, asking Buildbucket for the build status
[10:04:39.963] Build status: SCHEDULED
[10:05:02.999] Received PubSub notification, asking Buildbucket for the build status
[10:05:03.044] Build status: STARTED
[10:10:52.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:2:0)
[10:10:52.318] Build status: STARTED
[10:10:52.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:5:0) after 6m55s
[10:17:47.358] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:5:0)
[10:17:47.461] Build status: STARTED
[10:17:47.461] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:6:0) after 8m16s
[10:26:03.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:6:0)
[10:26:03.521] Build status: STARTED
[10:26:03.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:7:0) after 9m40s
[10:35:43.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:7:0)
[10:35:43.617] Build status: STARTED
[10:35:43.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:8:0) after 6m54s
[10:42:37.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:8:0)
[10:42:37.688] Build status: STARTED
[10:42:37.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:9:0) after 9m4s
[10:51:41.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:9:0)
[10:51:41.828] Build status: STARTED
[10:51:41.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:10:0) after 9m30s
[11:01:11.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:10:0)
[11:01:11.977] Build status: STARTED
[11:01:11.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:11:0) after 5m28s
[11:06:40.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:11:0)
[11:06:40.081] Build status: STARTED
[11:06:40.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:12:0) after 1m27s
[11:08:07.305] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:12:0)
[11:08:07.324] Build status: STARTED
[11:08:07.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:13:0) after 9m49s
[11:17:56.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:13:0)
[11:17:56.375] Build status: STARTED
[11:17:56.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:14:0) after 7m54s
[11:25:50.694] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:14:0)
[11:25:50.726] Build status: STARTED
[11:25:50.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:15:0) after 3m30s
[11:29:21.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:15:0)
[11:29:21.107] Build status: STARTED
[11:29:21.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:16:0) after 1m58s
[11:31:19.342] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:16:0)
[11:31:19.363] Build status: STARTED
[11:31:19.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:17:0) after 1m37s
[11:32:56.441] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:17:0)
[11:32:56.462] Build status: STARTED
[11:32:56.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:18:0) after 1m8s
[11:34:04.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:18:0)
[11:34:04.503] Build status: STARTED
[11:34:04.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:19:0) after 3m27s
[11:37:31.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:19:0)
[11:37:31.669] Build status: STARTED
[11:37:31.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:20:0) after 9m14s
[11:46:45.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:20:0)
[11:46:45.717] Build status: STARTED
[11:46:45.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:21:0) after 7m4s
[11:53:49.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:21:0)
[11:53:49.905] Build status: STARTED
[11:53:49.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:22:0) after 7m18s
[12:01:07.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:22:0)
[12:01:08.047] Build status: STARTED
[12:01:08.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:23:0) after 1m17s
[12:02:25.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:23:0)
[12:02:25.086] Build status: STARTED
[12:02:25.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:24:0) after 2m35s
[12:05:00.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:24:0)
[12:05:00.223] Build status: STARTED
[12:05:00.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:25:0) after 3m46s
[12:08:46.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:25:0)
[12:08:46.481] Build status: STARTED
[12:08:46.481] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:26:0) after 8m37s
[12:17:23.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:26:0)
[12:17:23.806] Build status: STARTED
[12:17:23.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:27:0) after 3m9s
[12:20:33.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:27:0)
[12:20:33.087] Build status: STARTED
[12:20:33.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:28:0) after 2m49s
[12:23:22.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:28:0)
[12:23:22.251] Build status: STARTED
[12:23:22.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:29:0) after 8m59s
[12:32:21.274] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:29:0)
[12:32:21.292] Build status: STARTED
[12:32:21.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:30:0) after 6m9s
[12:38:30.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:30:0)
[12:38:30.450] Build status: STARTED
[12:38:30.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:31:0) after 9m55s
[12:48:25.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:31:0)
[12:48:25.579] Build status: STARTED
[12:48:25.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:32:0) after 4m6s
[12:52:31.627] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:32:0)
[12:52:31.766] Build status: STARTED
[12:52:31.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:33:0) after 4m27s
[12:56:58.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:33:0)
[12:56:58.916] Build status: STARTED
[12:56:58.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:34:0) after 7m42s
[13:04:41.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:34:0)
[13:04:41.175] Build status: STARTED
[13:04:41.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:35:0) after 6m46s
[13:11:27.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:35:0)
[13:11:27.283] Build status: STARTED
[13:11:27.283] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:36:0) after 1m6s
[13:12:33.358] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:36:0)
[13:12:33.382] Build status: STARTED
[13:12:33.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:37:0) after 7m37s
[13:20:10.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:37:0)
[13:20:10.547] Build status: STARTED
[13:20:10.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:38:0) after 3m43s
[13:23:53.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:38:0)
[13:23:53.878] Build status: STARTED
[13:23:53.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:39:0) after 4m34s
[13:28:28.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:39:0)
[13:28:28.102] Build status: STARTED
[13:28:28.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:40:0) after 3m48s
[13:32:16.278] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:40:0)
[13:32:16.297] Build status: STARTED
[13:32:16.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:41:0) after 7m53s
[13:40:09.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:41:0)
[13:40:09.402] Build status: STARTED
[13:40:09.402] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:42:0) after 9m35s
[13:49:44.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:42:0)
[13:49:44.483] Build status: STARTED
[13:49:44.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:43:0) after 9m19s
[13:59:03.508] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:43:0)
[13:59:03.528] Build status: STARTED
[13:59:03.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:44:0) after 3m30s
[14:02:33.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:44:0)
[14:02:33.588] Build status: STARTED
[14:02:33.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:45:0) after 7m46s
[14:10:19.631] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:45:0)
[14:10:19.667] Build status: STARTED
[14:10:19.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:46:0) after 6m12s
[14:16:31.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:46:0)
[14:16:31.752] Build status: STARTED
[14:16:31.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:47:0) after 5m2s
[14:21:33.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:47:0)
[14:21:33.791] Build status: STARTED
[14:21:33.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:48:0) after 2m2s
[14:23:35.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:48:0)
[14:23:35.851] Build status: STARTED
[14:23:35.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:49:0) after 9m39s
[14:33:15.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:49:0)
[14:33:15.025] Build status: STARTED
[14:33:15.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:50:0) after 4m28s
[14:37:43.185] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:50:0)
[14:37:43.208] Build status: STARTED
[14:37:43.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:51:0) after 6m40s
[14:44:23.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:51:0)
[14:44:23.246] Build status: STARTED
[14:44:23.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:52:0) after 3m12s
[14:47:35.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:52:0)
[14:47:35.459] Build status: STARTED
[14:47:35.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:53:0) after 7m41s
[14:55:16.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:53:0)
[14:55:16.525] Build status: STARTED
[14:55:16.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:54:0) after 3m28s
[14:58:44.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:54:0)
[14:58:44.620] Build status: STARTED
[14:58:44.620] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:55:0) after 5m5s
[15:03:49.681] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:55:0)
[15:03:49.700] Build status: STARTED
[15:03:49.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:56:0) after 6m51s
[15:10:40.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:56:0)
[15:10:40.751] Build status: STARTED
[15:10:40.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:57:0) after 7m51s
[15:18:31.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:57:0)
[15:18:31.890] Build status: STARTED
[15:18:31.890] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:58:0) after 2m33s
[15:21:04.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:58:0)
[15:21:04.963] Build status: STARTED
[15:21:04.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:59:0) after 4m40s
[15:25:45.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:59:0)
[15:25:45.104] Build status: STARTED
[15:25:45.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:60:0) after 3m3s
[15:28:49.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:60:0)
[15:28:49.622] Build status: STARTED
[15:28:49.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:61:0) after 2m43s
[15:31:32.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:61:0)
[15:31:32.768] Build status: STARTED
[15:31:32.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:62:0) after 9m1s
[15:40:33.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:62:0)
[15:40:33.957] Build status: STARTED
[15:40:33.957] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:63:0) after 1m38s
[15:42:12.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:63:0)
[15:42:12.314] Build status: STARTED
[15:42:12.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:64:0) after 4m37s
[15:46:49.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:64:0)
[15:46:49.366] Build status: STARTED
[15:46:49.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:65:0) after 8m2s
[15:54:51.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:65:0)
[15:54:51.617] Build status: STARTED
[15:54:51.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:66:0) after 9m13s
[16:04:04.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:66:0)
[16:04:04.857] Build status: STARTED
[16:04:04.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:67:0) after 8m44s
[16:12:48.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:67:0)
[16:12:48.923] Build status: STARTED
[16:12:48.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:68:0) after 7m13s
[16:20:02.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:68:0)
[16:20:02.053] Build status: STARTED
[16:20:02.053] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:69:0) after 7m41s
[16:27:43.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:69:0)
[16:27:43.115] Build status: STARTED
[16:27:43.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:70:0) after 8m15s
[16:35:58.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:70:0)
[16:35:58.148] Build status: STARTED
[16:35:58.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:71:0) after 4m12s
[16:40:10.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:71:0)
[16:40:10.214] Build status: STARTED
[16:40:10.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:72:0) after 5m49s
[16:45:59.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:72:0)
[16:45:59.368] Build status: STARTED
[16:45:59.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:73:0) after 3m23s
[16:49:22.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:73:0)
[16:49:22.560] Build status: STARTED
[16:49:22.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:74:0) after 2m27s
[16:51:50.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:74:0)
[16:51:50.796] Build status: STARTED
[16:51:50.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:75:0) after 6m56s
[16:58:47.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:75:0)
[16:58:47.167] Build status: STARTED
[16:58:47.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:76:0) after 5m5s
[17:03:52.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:76:0)
[17:03:52.259] Build status: STARTED
[17:03:52.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:77:0) after 4m17s
[17:08:09.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:77:0)
[17:08:09.438] Build status: STARTED
[17:08:09.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:78:0) after 9m18s
[17:17:27.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:78:0)
[17:17:27.536] Build status: STARTED
[17:17:27.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:79:0) after 6m52s
[17:24:19.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:79:0)
[17:24:19.682] Build status: STARTED
[17:24:19.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:80:0) after 3m55s
[17:28:14.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:80:0)
[17:28:14.794] Build status: STARTED
[17:28:14.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:81:0) after 5m29s
[17:33:43.898] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:81:0)
[17:33:43.924] Build status: STARTED
[17:33:43.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:82:0) after 8m50s
[17:42:33.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:82:0)
[17:42:33.995] Build status: STARTED
[17:42:33.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:83:0) after 4m23s
[17:46:57.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:83:0)
[17:46:57.109] Build status: STARTED
[17:46:57.109] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:84:0) after 5m53s
[17:52:50.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:84:0)
[17:52:50.163] Build status: STARTED
[17:52:50.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:85:0) after 8m42s
[18:01:32.451] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:85:0)
[18:01:32.483] Build status: STARTED
[18:01:32.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:86:0) after 8m39s
[18:10:11.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:86:0)
[18:10:11.541] Build status: STARTED
[18:10:11.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:87:0) after 4m35s
[18:14:46.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:87:0)
[18:14:46.611] Build status: STARTED
[18:14:46.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:88:0) after 9m44s
[18:24:30.651] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:88:0)
[18:24:30.680] Build status: STARTED
[18:24:30.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:89:0) after 7m57s
[18:32:27.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:89:0)
[18:32:27.778] Build status: STARTED
[18:32:27.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:90:0) after 5m58s
[18:38:25.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:90:0)
[18:38:25.926] Build status: STARTED
[18:38:25.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:91:0) after 3m11s
[18:41:36.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:91:0)
[18:41:36.992] Build status: STARTED
[18:41:36.992] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:92:0) after 3m37s
[18:45:14.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:92:0)
[18:45:14.206] Build status: STARTED
[18:45:14.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:93:0) after 1m29s
[18:46:43.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:93:0)
[18:46:43.252] Build status: STARTED
[18:46:43.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:94:0) after 7m30s
[18:54:13.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:94:0)
[18:54:13.306] Build status: STARTED
[18:54:13.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:95:0) after 1m32s
[18:55:45.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:95:0)
[18:55:45.403] Build status: STARTED
[18:55:45.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:96:0) after 1m7s
[18:56:52.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:96:0)
[18:56:52.459] Build status: STARTED
[18:56:52.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:97:0) after 2m11s
[18:59:03.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:97:0)
[18:59:03.597] Build status: STARTED
[18:59:03.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:98:0) after 6m45s
[19:05:48.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:98:0)
[19:05:48.685] Build status: STARTED
[19:05:48.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:99:0) after 3m35s
[19:09:23.707] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:99:0)
[19:09:23.750] Build status: STARTED
[19:09:23.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:100:0) after 4m43s
[19:14:06.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:100:0)
[19:14:06.904] Build status: STARTED
[19:14:06.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:101:0) after 2m24s
[19:16:30.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:101:0)
[19:16:30.915] Build status: STARTED
[19:16:30.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:102:0) after 4m51s
[19:21:22.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:102:0)
[19:21:22.143] Build status: STARTED
[19:21:22.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:103:0) after 9m57s
[19:31:19.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:103:0)
[19:31:19.489] Build status: STARTED
[19:31:19.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:104:0) after 7m20s
[19:38:39.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:104:0)
[19:38:39.530] Build status: STARTED
[19:38:39.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:105:0) after 2m9s
[19:40:48.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:105:0)
[19:40:48.630] Build status: STARTED
[19:40:48.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:106:0) after 7m0s
[19:47:48.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:106:0)
[19:47:48.764] Build status: STARTED
[19:47:48.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:107:0) after 2m14s
[19:50:02.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:107:0)
[19:50:02.807] Build status: STARTED
[19:50:02.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:108:0) after 2m27s
[19:52:29.938] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:108:0)
[19:52:29.962] Build status: STARTED
[19:52:29.962] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:109:0) after 8m37s
[20:01:07.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:109:0)
[20:01:07.367] Build status: STARTED
[20:01:07.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:110:0) after 8m17s
[20:09:24.428] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:110:0)
[20:09:24.450] Build status: STARTED
[20:09:24.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:111:0) after 7m0s
[20:16:24.471] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:111:0)
[20:16:24.491] Build status: STARTED
[20:16:24.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:112:0) after 8m12s
[20:24:36.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:112:0)
[20:24:36.599] Build status: STARTED
[20:24:36.599] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:113:0) after 9m58s
[20:34:34.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:113:0)
[20:34:34.654] Build status: STARTED
[20:34:34.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:114:0) after 6m49s
[20:41:23.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:114:0)
[20:41:23.726] Build status: STARTED
[20:41:23.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:115:0) after 1m29s
[20:42:52.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:115:0)
[20:42:52.777] Build status: STARTED
[20:42:52.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:116:0) after 8m41s
[20:51:33.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:116:0)
[20:51:33.939] Build status: STARTED
[20:51:33.939] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:117:0) after 7m20s
[20:58:53.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:117:0)
[20:58:54.006] Build status: STARTED
[20:58:54.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:118:0) after 5m4s
[21:03:58.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:118:0)
[21:03:58.121] Build status: STARTED
[21:03:58.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:119:0) after 7m35s
[21:11:33.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:119:0)
[21:11:33.199] Build status: STARTED
[21:11:33.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:120:0) after 7m11s
[21:18:44.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:120:0)
[21:18:44.314] Build status: STARTED
[21:18:44.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:121:0) after 4m11s
[21:22:55.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:121:0)
[21:22:55.445] Build status: STARTED
[21:22:55.445] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:122:0) after 4m40s
[21:27:35.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:122:0)
[21:27:35.492] Build status: STARTED
[21:27:35.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:123:0) after 2m49s
[21:30:24.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:123:0)
[21:30:24.542] Build status: STARTED
[21:30:24.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:124:0) after 1m59s
[21:32:24.317] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:124:0)
[21:32:24.358] Build status: STARTED
[21:32:24.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:125:0) after 1m40s
[21:34:04.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:125:0)
[21:34:04.450] Build status: STARTED
[21:34:04.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:126:0) after 5m57s
[21:40:01.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:126:0)
[21:40:01.522] Build status: STARTED
[21:40:01.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:127:0) after 7m48s
[21:47:49.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:127:0)
[21:47:49.725] Build status: STARTED
[21:47:49.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:128:0) after 9m4s
[21:56:53.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:128:0)
[21:56:53.909] Build status: STARTED
[21:56:53.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:129:0) after 2m7s
[21:59:01.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:129:0)
[21:59:01.055] Build status: STARTED
[21:59:01.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:130:0) after 2m47s
[22:01:48.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:130:0)
[22:01:48.160] Build status: STARTED
[22:01:48.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:131:0) after 8m22s
[22:10:10.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:131:0)
[22:10:10.361] Build status: STARTED
[22:10:10.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:132:0) after 1m30s
[22:11:40.413] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:132:0)
[22:11:40.451] Build status: STARTED
[22:11:40.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:133:0) after 6m59s
[22:18:39.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:133:0)
[22:18:39.508] Build status: STARTED
[22:18:39.508] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:134:0) after 6m1s
[22:24:40.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:134:0)
[22:24:40.600] Build status: STARTED
[22:24:40.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:135:0) after 4m33s
[22:29:13.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:135:0)
[22:29:13.713] Build status: STARTED
[22:29:13.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8939856088669998176:136:0) after 7m29s
[22:30:34.188] Received PubSub notification, asking Buildbucket for the build status
[22:30:34.261] Build:
{
"id": "8774426026789262305",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1574,
"createdBy": "project:chromium",
"createTime": "2023-07-27T10:04:39.252618041Z",
"startTime": "2023-07-27T10:05:02.268778Z",
"endTime": "2023-07-27T22:30:33.619351Z",
"updateTime": "2023-07-27T22:30:33.619351Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5872430bd182d074c675148d5c11ed06ad22b2f2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:30:34.261] Invocation finished in 12h25m56.186080635s with status FAILED