[15:25:20.969] New invocation is queued and will start shortly
[15:25:22.823] Starting the invocation (attempt 1)
[15:25:22.846] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4a9844778189b66de53ab921039a4cebd17dfaeb"
[15:25:22.846] Popped gitiles commit info from properties and tags
[15:25:22.846] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:25:22.847] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:25:22.847] Buildbucket request:
{
"requestId": "8909576524268997440",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4a9844778189b66de53ab921039a4cebd17dfaeb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8909576524268997440"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:25:23.463] Scheduled build:
{
"id": "8744146461566494465",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2402,
"createdBy": "project:chromium",
"createTime": "2024-06-25T15:25:22.917662089Z",
"updateTime": "2024-06-25T15:25:22.917662089Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4a9844778189b66de53ab921039a4cebd17dfaeb",
"ref": "refs/heads/main"
}
}
}
[15:25:23.463] Task URL: https://cr-buildbucket.appspot.com/build/8744146461566494465
[15:25:23.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:2:0) after 9m6s
[15:25:24.368] Received PubSub notification, asking Buildbucket for the build status
[15:25:24.391] Build status: SCHEDULED
[15:26:34.287] Received PubSub notification, asking Buildbucket for the build status
[15:26:34.350] Build status: STARTED
[15:34:29.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:2:0)
[15:34:29.521] Build status: STARTED
[15:34:29.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:5:0) after 2m24s
[15:36:53.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:5:0)
[15:36:53.821] Build status: STARTED
[15:36:53.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:6:0) after 8m36s
[15:45:29.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:6:0)
[15:45:29.908] Build status: STARTED
[15:45:29.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:7:0) after 9m14s
[15:54:43.938] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:7:0)
[15:54:43.956] Build status: STARTED
[15:54:43.956] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:8:0) after 7m1s
[16:01:45.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:8:0)
[16:01:45.081] Build status: STARTED
[16:01:45.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:9:0) after 4m37s
[16:06:22.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:9:0)
[16:06:22.131] Build status: STARTED
[16:06:22.131] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:10:0) after 2m23s
[16:08:45.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:10:0)
[16:08:45.129] Build status: STARTED
[16:08:45.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:11:0) after 2m46s
[16:11:31.184] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:11:0)
[16:11:31.212] Build status: STARTED
[16:11:31.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:12:0) after 8m53s
[16:20:24.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:12:0)
[16:20:24.271] Build status: STARTED
[16:20:24.271] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:13:0) after 6m47s
[16:27:11.373] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:13:0)
[16:27:11.398] Build status: STARTED
[16:27:11.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:14:0) after 7m23s
[16:34:34.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:14:0)
[16:34:34.453] Build status: STARTED
[16:34:34.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:15:0) after 1m22s
[16:35:56.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:15:0)
[16:35:56.494] Build status: STARTED
[16:35:56.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:16:0) after 9m6s
[16:45:02.516] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:16:0)
[16:45:02.542] Build status: STARTED
[16:45:02.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:17:0) after 8m15s
[16:53:17.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:17:0)
[16:53:17.652] Build status: STARTED
[16:53:17.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:18:0) after 2m57s
[16:56:14.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:18:0)
[16:56:14.714] Build status: STARTED
[16:56:14.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:19:0) after 4m3s
[17:00:17.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:19:0)
[17:00:17.931] Build status: STARTED
[17:00:17.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:20:0) after 8m32s
[17:08:50.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:20:0)
[17:08:50.076] Build status: STARTED
[17:08:50.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:21:0) after 8m42s
[17:17:32.123] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:21:0)
[17:17:32.188] Build status: STARTED
[17:17:32.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:22:0) after 2m20s
[17:19:52.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:22:0)
[17:19:52.209] Build status: STARTED
[17:19:52.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:23:0) after 3m8s
[17:23:00.234] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:23:0)
[17:23:00.422] Build status: STARTED
[17:23:00.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:24:0) after 3m53s
[17:26:53.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:24:0)
[17:26:53.520] Build status: STARTED
[17:26:53.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:25:0) after 4m24s
[17:31:17.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:25:0)
[17:31:17.554] Build status: STARTED
[17:31:17.554] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:26:0) after 6m5s
[17:37:22.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:26:0)
[17:37:22.596] Build status: STARTED
[17:37:22.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:27:0) after 3m44s
[17:41:06.667] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:27:0)
[17:41:06.685] Build status: STARTED
[17:41:06.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:28:0) after 4m5s
[17:45:11.715] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:28:0)
[17:45:11.768] Build status: STARTED
[17:45:11.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:29:0) after 4m39s
[17:49:50.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:29:0)
[17:49:50.817] Build status: STARTED
[17:49:50.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:30:0) after 2m13s
[17:52:03.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:30:0)
[17:52:03.911] Build status: STARTED
[17:52:03.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:31:0) after 9m9s
[18:01:13.090] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:31:0)
[18:01:13.112] Build status: STARTED
[18:01:13.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:32:0) after 9m55s
[18:11:08.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:32:0)
[18:11:08.197] Build status: STARTED
[18:11:08.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:33:0) after 4m56s
[18:16:04.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:33:0)
[18:16:04.277] Build status: STARTED
[18:16:04.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:34:0) after 1m38s
[18:17:42.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:34:0)
[18:17:42.328] Build status: STARTED
[18:17:42.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:35:0) after 6m34s
[18:24:16.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:35:0)
[18:24:16.390] Build status: STARTED
[18:24:16.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:36:0) after 6m43s
[18:30:59.623] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:36:0)
[18:30:59.653] Build status: STARTED
[18:30:59.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:37:0) after 9m35s
[18:40:34.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:37:0)
[18:40:34.729] Build status: STARTED
[18:40:34.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:38:0) after 7m42s
[18:48:16.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:38:0)
[18:48:16.826] Build status: STARTED
[18:48:16.826] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:39:0) after 2m25s
[18:50:41.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:39:0)
[18:50:41.868] Build status: STARTED
[18:50:41.868] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:40:0) after 3m53s
[18:54:34.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:40:0)
[18:54:34.925] Build status: STARTED
[18:54:34.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:41:0) after 7m58s
[19:02:32.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:41:0)
[19:02:32.972] Build status: STARTED
[19:02:32.972] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:42:0) after 4m12s
[19:06:45.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:42:0)
[19:06:45.165] Build status: STARTED
[19:06:45.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:43:0) after 1m14s
[19:07:59.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:43:0)
[19:07:59.271] Build status: STARTED
[19:07:59.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:44:0) after 7m9s
[19:15:08.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:44:0)
[19:15:08.320] Build status: STARTED
[19:15:08.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:45:0) after 4m51s
[19:19:59.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:45:0)
[19:19:59.437] Build status: STARTED
[19:19:59.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:46:0) after 4m15s
[19:24:14.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:46:0)
[19:24:14.650] Build status: STARTED
[19:24:14.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:47:0) after 5m26s
[19:29:40.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:47:0)
[19:29:40.708] Build status: STARTED
[19:29:40.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:48:0) after 8m23s
[19:38:03.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:48:0)
[19:38:03.767] Build status: STARTED
[19:38:03.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:49:0) after 5m1s
[19:43:04.804] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:49:0)
[19:43:04.822] Build status: STARTED
[19:43:04.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:50:0) after 4m2s
[19:47:06.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:50:0)
[19:47:06.898] Build status: STARTED
[19:47:06.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:51:0) after 7m9s
[19:54:15.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:51:0)
[19:54:15.938] Build status: STARTED
[19:54:15.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:52:0) after 9m0s
[20:03:15.978] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:52:0)
[20:03:16.067] Build status: STARTED
[20:03:16.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:53:0) after 3m24s
[20:06:40.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:53:0)
[20:06:40.918] Build status: STARTED
[20:06:40.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:54:0) after 9m20s
[20:16:00.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:54:0)
[20:16:00.994] Build status: STARTED
[20:16:00.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:55:0) after 1m13s
[20:17:14.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:55:0)
[20:17:14.054] Build status: STARTED
[20:17:14.054] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:56:0) after 7m47s
[20:25:01.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:56:0)
[20:25:01.111] Build status: STARTED
[20:25:01.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:57:0) after 3m45s
[20:28:46.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:57:0)
[20:28:46.213] Build status: STARTED
[20:28:46.213] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:58:0) after 5m32s
[20:34:18.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:58:0)
[20:34:18.343] Build status: STARTED
[20:34:18.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:59:0) after 7m26s
[20:41:44.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:59:0)
[20:41:44.421] Build status: STARTED
[20:41:44.421] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:60:0) after 1m23s
[20:43:07.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:60:0)
[20:43:07.556] Build status: STARTED
[20:43:07.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:61:0) after 7m23s
[20:50:30.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:61:0)
[20:50:30.618] Build status: STARTED
[20:50:30.618] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:62:0) after 1m23s
[20:51:53.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:62:0)
[20:51:53.784] Build status: STARTED
[20:51:53.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:63:0) after 4m0s
[20:55:53.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:63:0)
[20:55:53.871] Build status: STARTED
[20:55:53.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:64:0) after 5m21s
[21:01:14.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:64:0)
[21:01:15.034] Build status: STARTED
[21:01:15.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:65:0) after 7m18s
[21:08:33.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:65:0)
[21:08:33.090] Build status: STARTED
[21:08:33.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:66:0) after 5m27s
[21:14:00.123] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:66:0)
[21:14:00.150] Build status: STARTED
[21:14:00.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:67:0) after 7m18s
[21:21:18.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:67:0)
[21:21:18.201] Build status: STARTED
[21:21:18.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:68:0) after 4m3s
[21:25:21.232] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:68:0)
[21:25:21.264] Build status: STARTED
[21:25:21.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:69:0) after 6m22s
[21:31:43.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:69:0)
[21:31:43.358] Build status: STARTED
[21:31:43.358] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:70:0) after 2m33s
[21:34:16.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:70:0)
[21:34:16.456] Build status: STARTED
[21:34:16.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:71:0) after 3m15s
[21:37:31.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:71:0)
[21:37:31.530] Build status: STARTED
[21:37:31.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:72:0) after 9m15s
[21:46:46.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:72:0)
[21:46:46.646] Build status: STARTED
[21:46:46.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:73:0) after 1m38s
[21:48:24.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:73:0)
[21:48:24.790] Build status: STARTED
[21:48:24.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:74:0) after 9m18s
[21:57:42.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:74:0)
[21:57:42.922] Build status: STARTED
[21:57:42.922] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:75:0) after 1m11s
[21:58:54.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:75:0)
[21:58:54.142] Build status: STARTED
[21:58:54.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:76:0) after 9m4s
[22:07:58.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:76:0)
[22:07:58.205] Build status: STARTED
[22:07:58.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:77:0) after 2m18s
[22:10:16.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:77:0)
[22:10:16.261] Build status: STARTED
[22:10:16.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:78:0) after 8m28s
[22:18:44.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:78:0)
[22:18:44.367] Build status: STARTED
[22:18:44.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:79:0) after 4m29s
[22:23:13.389] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:79:0)
[22:23:13.484] Build status: STARTED
[22:23:13.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:80:0) after 5m25s
[22:28:38.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:80:0)
[22:28:38.513] Build status: STARTED
[22:28:38.513] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:81:0) after 8m2s
[22:36:40.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:81:0)
[22:36:40.614] Build status: STARTED
[22:36:40.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:82:0) after 3m41s
[22:40:21.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:82:0)
[22:40:21.658] Build status: STARTED
[22:40:21.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:83:0) after 4m9s
[22:44:30.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:83:0)
[22:44:30.744] Build status: STARTED
[22:44:30.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:84:0) after 2m45s
[22:47:15.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:84:0)
[22:47:15.817] Build status: STARTED
[22:47:15.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:85:0) after 4m24s
[22:51:39.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:85:0)
[22:51:39.919] Build status: STARTED
[22:51:39.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:86:0) after 1m51s
[22:53:30.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:86:0)
[22:53:31.012] Build status: STARTED
[22:53:31.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:87:0) after 4m52s
[22:58:23.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:87:0)
[22:58:23.170] Build status: STARTED
[22:58:23.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:88:0) after 3m29s
[23:01:52.205] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:88:0)
[23:01:52.237] Build status: STARTED
[23:01:52.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:89:0) after 4m45s
[23:06:37.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:89:0)
[23:06:37.340] Build status: STARTED
[23:06:37.340] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:90:0) after 9m12s
[23:15:49.927] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:90:0)
[23:15:49.945] Build status: STARTED
[23:15:49.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:91:0) after 1m31s
[23:17:21.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:91:0)
[23:17:21.507] Build status: STARTED
[23:17:21.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:92:0) after 5m52s
[23:23:13.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:92:0)
[23:23:13.696] Build status: STARTED
[23:23:13.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:93:0) after 5m0s
[23:28:15.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:93:0)
[23:28:15.025] Build status: STARTED
[23:28:15.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:94:0) after 4m18s
[23:32:33.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:94:0)
[23:32:33.150] Build status: STARTED
[23:32:33.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:95:0) after 2m55s
[23:35:28.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:95:0)
[23:35:28.332] Build status: STARTED
[23:35:28.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:96:0) after 5m4s
[23:40:32.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:96:0)
[23:40:32.585] Build status: STARTED
[23:40:32.585] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:97:0) after 6m29s
[23:47:01.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:97:0)
[23:47:01.802] Build status: STARTED
[23:47:01.802] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:98:0) after 1m43s
[23:48:45.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:98:0)
[23:48:45.135] Build status: STARTED
[23:48:45.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:99:0) after 6m39s
[23:55:24.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:99:0)
[23:55:24.215] Build status: STARTED
[23:55:24.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:100:0) after 8m52s
[00:04:16.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:100:0)
[00:04:16.297] Build status: STARTED
[00:04:16.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:101:0) after 1m48s
[00:06:04.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:101:0)
[00:06:04.377] Build status: STARTED
[00:06:04.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:102:0) after 7m3s
[00:13:07.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:102:0)
[00:13:07.430] Build status: STARTED
[00:13:07.430] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:103:0) after 1m2s
[00:14:09.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:103:0)
[00:14:09.619] Build status: STARTED
[00:14:09.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:104:0) after 9m3s
[00:23:12.655] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:104:0)
[00:23:12.677] Build status: STARTED
[00:23:12.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:105:0) after 9m38s
[00:32:50.835] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:105:0)
[00:32:51.090] Build status: STARTED
[00:32:51.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:106:0) after 2m23s
[00:35:14.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:106:0)
[00:35:14.182] Build status: STARTED
[00:35:14.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:107:0) after 5m53s
[00:41:07.228] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:107:0)
[00:41:07.276] Build status: STARTED
[00:41:07.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:108:0) after 2m26s
[00:43:33.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:108:0)
[00:43:33.362] Build status: STARTED
[00:43:33.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:109:0) after 2m0s
[00:45:33.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:109:0)
[00:45:33.450] Build status: STARTED
[00:45:33.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:110:0) after 8m54s
[00:54:27.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:110:0)
[00:54:27.590] Build status: STARTED
[00:54:27.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:111:0) after 1m2s
[00:55:29.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:111:0)
[00:55:29.634] Build status: STARTED
[00:55:29.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:112:0) after 4m9s
[00:59:38.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:112:0)
[00:59:38.678] Build status: STARTED
[00:59:38.678] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:113:0) after 5m56s
[01:05:34.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:113:0)
[01:05:34.720] Build status: STARTED
[01:05:34.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:114:0) after 9m42s
[01:15:16.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:114:0)
[01:15:16.845] Build status: STARTED
[01:15:16.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:115:0) after 2m14s
[01:17:30.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:115:0)
[01:17:30.898] Build status: STARTED
[01:17:30.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:116:0) after 6m14s
[01:23:44.928] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:116:0)
[01:23:44.951] Build status: STARTED
[01:23:44.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:117:0) after 1m20s
[01:25:04.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:117:0)
[01:25:04.998] Build status: STARTED
[01:25:04.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:118:0) after 8m25s
[01:33:30.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:118:0)
[01:33:30.130] Build status: STARTED
[01:33:30.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:119:0) after 1m40s
[01:35:10.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:119:0)
[01:35:10.372] Build status: STARTED
[01:35:10.372] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:120:0) after 6m46s
[01:41:56.451] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:120:0)
[01:41:56.478] Build status: STARTED
[01:41:56.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:121:0) after 2m4s
[01:44:00.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:121:0)
[01:44:00.564] Build status: STARTED
[01:44:00.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:122:0) after 3m11s
[01:47:11.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:122:0)
[01:47:11.641] Build status: STARTED
[01:47:11.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:123:0) after 1m52s
[01:49:03.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:123:0)
[01:49:03.761] Build status: STARTED
[01:49:03.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:124:0) after 3m32s
[01:52:35.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:124:0)
[01:52:35.833] Build status: STARTED
[01:52:35.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:125:0) after 9m13s
[02:01:49.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:125:0)
[02:01:49.125] Build status: STARTED
[02:01:49.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:126:0) after 3m1s
[02:04:50.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:126:0)
[02:04:50.128] Build status: STARTED
[02:04:50.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:127:0) after 2m20s
[02:07:10.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:127:0)
[02:07:10.192] Build status: STARTED
[02:07:10.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:128:0) after 3m4s
[02:10:14.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:128:0)
[02:10:14.227] Build status: STARTED
[02:10:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:129:0) after 5m17s
[02:15:31.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:129:0)
[02:15:31.334] Build status: STARTED
[02:15:31.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:130:0) after 8m54s
[02:24:25.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:130:0)
[02:24:25.389] Build status: STARTED
[02:24:25.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:131:0) after 9m50s
[02:34:15.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:131:0)
[02:34:15.465] Build status: STARTED
[02:34:15.465] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:132:0) after 4m46s
[02:39:01.503] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:132:0)
[02:39:01.531] Build status: STARTED
[02:39:01.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:133:0) after 9m58s
[02:48:59.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:133:0)
[02:48:59.603] Build status: STARTED
[02:48:59.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:134:0) after 4m53s
[02:53:52.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:134:0)
[02:53:52.645] Build status: STARTED
[02:53:52.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:135:0) after 7m24s
[03:01:16.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:135:0)
[03:01:16.691] Build status: STARTED
[03:01:16.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:136:0) after 1m58s
[03:03:15.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:136:0)
[03:03:15.477] Build status: STARTED
[03:03:15.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:137:0) after 7m54s
[03:11:09.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:137:0)
[03:11:09.520] Build status: STARTED
[03:11:09.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:138:0) after 6m57s
[03:18:06.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:138:0)
[03:18:06.575] Build status: STARTED
[03:18:06.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:139:0) after 6m34s
[03:24:40.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:139:0)
[03:24:40.655] Build status: STARTED
[03:24:40.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:140:0) after 8m7s
[03:32:47.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:140:0)
[03:32:50.551] Build status: STARTED
[03:32:50.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8909576524268997440:141:0) after 9m17s
[03:40:55.581] Received PubSub notification, asking Buildbucket for the build status
[03:40:55.597] Build:
{
"id": "8744146461566494465",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 2402,
"createdBy": "project:chromium",
"createTime": "2024-06-25T15:25:22.917662089Z",
"startTime": "2024-06-25T15:26:34.010741119Z",
"endTime": "2024-06-26T03:40:55.351105868Z",
"updateTime": "2024-06-26T03:40:55.351105868Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4a9844778189b66de53ab921039a4cebd17dfaeb",
"ref": "refs/heads/main"
}
}
}
[03:40:55.597] Invocation finished in 12h15m34.641157996s with status FAILED