[16:24:18.553] New invocation is queued and will start shortly
[16:24:20.105] Starting the invocation (attempt 1)
[16:24:20.131] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c8cf875ff2f97f60846129f2516d168c31c72a0d"
[16:24:20.132] Popped gitiles commit info from properties and tags
[16:24:20.132] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:24:20.133] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:24:20.133] Buildbucket request:
{
"requestId": "8894805509322449456",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8cf875ff2f97f60846129f2516d168c31c72a0d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8894805509322449456"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:24:20.784] Scheduled build:
{
"id": "8729375446933432961",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3004,
"createdBy": "project:chromium",
"createTime": "2024-12-05T16:24:20.200174541Z",
"updateTime": "2024-12-05T16:24:20.200174541Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8cf875ff2f97f60846129f2516d168c31c72a0d",
"ref": "refs/heads/main"
}
}
}
[16:24:20.784] Task URL: https://cr-buildbucket.appspot.com/build/8729375446933432961
[16:24:20.784] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:2:0) after 5m53s
[16:24:21.763] Received PubSub notification, asking Buildbucket for the build status
[16:24:21.785] Build status: SCHEDULED
[16:28:27.073] Received PubSub notification, asking Buildbucket for the build status
[16:28:27.149] Build status: STARTED
[16:30:13.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:2:0)
[16:30:13.880] Build status: STARTED
[16:30:13.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:5:0) after 6m16s
[16:36:29.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:5:0)
[16:36:29.969] Build status: STARTED
[16:36:29.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:6:0) after 4m16s
[16:40:46.018] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:6:0)
[16:40:46.056] Build status: STARTED
[16:40:46.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:7:0) after 3m52s
[16:44:38.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:7:0)
[16:44:38.102] Build status: STARTED
[16:44:38.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:8:0) after 8m29s
[16:53:07.235] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:8:0)
[16:53:07.261] Build status: STARTED
[16:53:07.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:9:0) after 1m32s
[16:54:39.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:9:0)
[16:54:39.305] Build status: STARTED
[16:54:39.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:10:0) after 8m6s
[17:02:45.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:10:0)
[17:02:45.415] Build status: STARTED
[17:02:45.415] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:11:0) after 5m53s
[17:08:38.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:11:0)
[17:08:38.423] Build status: STARTED
[17:08:38.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:12:0) after 3m58s
[17:12:36.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:12:0)
[17:12:36.470] Build status: STARTED
[17:12:36.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:13:0) after 9m29s
[17:22:05.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:13:0)
[17:22:05.563] Build status: STARTED
[17:22:05.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:14:0) after 9m50s
[17:31:55.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:14:0)
[17:31:55.615] Build status: STARTED
[17:31:55.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:15:0) after 5m10s
[17:37:05.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:15:0)
[17:37:05.666] Build status: STARTED
[17:37:05.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:16:0) after 1m59s
[17:39:04.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:16:0)
[17:39:04.747] Build status: STARTED
[17:39:04.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:17:0) after 4m37s
[17:43:41.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:17:0)
[17:43:41.775] Build status: STARTED
[17:43:41.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:18:0) after 9m46s
[17:53:27.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:18:0)
[17:53:27.814] Build status: STARTED
[17:53:27.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:19:0) after 7m0s
[18:00:27.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:19:0)
[18:00:27.888] Build status: STARTED
[18:00:27.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:20:0) after 5m16s
[18:05:43.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:20:0)
[18:05:43.980] Build status: STARTED
[18:05:43.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:21:0) after 8m39s
[18:14:23.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:21:0)
[18:14:23.061] Build status: STARTED
[18:14:23.061] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:22:0) after 6m37s
[18:21:00.150] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:22:0)
[18:21:00.170] Build status: STARTED
[18:21:00.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:23:0) after 2m55s
[18:23:55.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:23:0)
[18:23:55.266] Build status: STARTED
[18:23:55.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:24:0) after 2m41s
[18:26:36.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:24:0)
[18:26:36.320] Build status: STARTED
[18:26:36.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:25:0) after 1m48s
[18:28:24.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:25:0)
[18:28:24.404] Build status: STARTED
[18:28:24.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:26:0) after 5m15s
[18:33:39.467] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:26:0)
[18:33:39.528] Build status: STARTED
[18:33:39.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:27:0) after 9m51s
[18:43:30.593] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:27:0)
[18:43:30.614] Build status: STARTED
[18:43:30.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:28:0) after 4m28s
[18:47:58.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:28:0)
[18:47:58.659] Build status: STARTED
[18:47:58.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:29:0) after 5m59s
[18:53:57.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:29:0)
[18:53:57.759] Build status: STARTED
[18:53:57.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:30:0) after 3m37s
[18:57:34.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:30:0)
[18:57:34.923] Build status: STARTED
[18:57:34.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:31:0) after 3m10s
[19:00:44.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:31:0)
[19:00:45.025] Build status: STARTED
[19:00:45.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:32:0) after 8m49s
[19:09:34.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:32:0)
[19:09:34.098] Build status: STARTED
[19:09:34.098] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:33:0) after 6m41s
[19:16:15.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:33:0)
[19:16:15.296] Build status: STARTED
[19:16:15.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:34:0) after 1m56s
[19:18:11.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:34:0)
[19:18:11.381] Build status: STARTED
[19:18:11.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:35:0) after 9m50s
[19:28:01.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:35:0)
[19:28:01.441] Build status: STARTED
[19:28:01.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:36:0) after 4m51s
[19:32:52.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:36:0)
[19:32:52.669] Build status: STARTED
[19:32:52.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:37:0) after 7m39s
[19:40:31.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:37:0)
[19:40:31.866] Build status: STARTED
[19:40:31.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:38:0) after 5m19s
[19:45:50.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:38:0)
[19:45:50.910] Build status: STARTED
[19:45:50.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:39:0) after 3m57s
[19:49:47.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:39:0)
[19:49:47.983] Build status: STARTED
[19:49:47.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:40:0) after 3m11s
[19:52:59.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:40:0)
[19:52:59.085] Build status: STARTED
[19:52:59.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:41:0) after 1m18s
[19:54:17.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:41:0)
[19:54:17.217] Build status: STARTED
[19:54:17.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:42:0) after 6m29s
[20:00:46.243] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:42:0)
[20:00:46.338] Build status: STARTED
[20:00:46.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:43:0) after 9m31s
[20:10:17.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:43:0)
[20:10:17.440] Build status: STARTED
[20:10:17.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:44:0) after 2m37s
[20:12:54.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:44:0)
[20:12:54.479] Build status: STARTED
[20:12:54.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:45:0) after 3m8s
[20:16:02.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:45:0)
[20:16:02.612] Build status: STARTED
[20:16:02.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:46:0) after 9m2s
[20:25:04.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:46:0)
[20:25:04.680] Build status: STARTED
[20:25:04.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:47:0) after 6m34s
[20:31:38.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:47:0)
[20:31:38.751] Build status: STARTED
[20:31:38.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:48:0) after 2m9s
[20:33:47.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:48:0)
[20:33:47.800] Build status: STARTED
[20:33:47.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:49:0) after 8m41s
[20:42:28.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:49:0)
[20:42:28.923] Build status: STARTED
[20:42:28.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:50:0) after 9m54s
[20:52:22.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:50:0)
[20:52:22.990] Build status: STARTED
[20:52:22.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:51:0) after 4m2s
[20:56:25.071] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:51:0)
[20:56:25.107] Build status: STARTED
[20:56:25.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:52:0) after 9m20s
[21:05:45.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:52:0)
[21:05:45.158] Build status: STARTED
[21:05:45.158] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:53:0) after 6m44s
[21:12:29.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:53:0)
[21:12:29.166] Build status: STARTED
[21:12:29.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:54:0) after 8m25s
[21:20:54.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:54:0)
[21:20:54.262] Build status: STARTED
[21:20:54.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:55:0) after 4m29s
[21:25:23.370] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:55:0)
[21:25:23.390] Build status: STARTED
[21:25:23.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:56:0) after 1m50s
[21:27:13.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:56:0)
[21:27:13.531] Build status: STARTED
[21:27:13.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:57:0) after 9m31s
[21:36:44.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:57:0)
[21:36:44.661] Build status: STARTED
[21:36:44.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:58:0) after 8m6s
[21:44:50.735] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:58:0)
[21:44:50.768] Build status: STARTED
[21:44:50.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:59:0) after 1m44s
[21:46:34.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:59:0)
[21:46:34.914] Build status: STARTED
[21:46:34.914] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:60:0) after 8m4s
[21:54:38.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:60:0)
[21:54:38.961] Build status: STARTED
[21:54:38.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:61:0) after 8m29s
[22:03:08.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:61:0)
[22:03:08.090] Build status: STARTED
[22:03:08.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:62:0) after 5m12s
[22:08:20.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:62:0)
[22:08:20.178] Build status: STARTED
[22:08:20.178] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:63:0) after 8m42s
[22:17:02.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:63:0)
[22:17:02.382] Build status: STARTED
[22:17:02.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:64:0) after 3m31s
[22:20:33.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:64:0)
[22:20:33.525] Build status: STARTED
[22:20:33.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:65:0) after 1m4s
[22:21:37.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:65:0)
[22:21:37.659] Build status: STARTED
[22:21:37.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:66:0) after 9m32s
[22:31:09.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:66:0)
[22:31:09.735] Build status: STARTED
[22:31:09.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:67:0) after 4m32s
[22:35:41.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:67:0)
[22:35:41.789] Build status: STARTED
[22:35:41.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:68:0) after 2m30s
[22:38:11.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:68:0)
[22:38:11.804] Build status: STARTED
[22:38:11.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:69:0) after 4m18s
[22:42:29.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:69:0)
[22:42:29.904] Build status: STARTED
[22:42:29.904] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:70:0) after 2m27s
[22:44:56.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:70:0)
[22:44:57.035] Build status: STARTED
[22:44:57.035] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:71:0) after 6m13s
[22:51:10.061] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:71:0)
[22:51:10.109] Build status: STARTED
[22:51:10.109] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:72:0) after 4m35s
[22:55:45.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:72:0)
[22:55:45.156] Build status: STARTED
[22:55:45.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:73:0) after 3m56s
[22:59:41.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:73:0)
[22:59:41.366] Build status: STARTED
[22:59:41.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:74:0) after 4m54s
[23:04:35.389] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:74:0)
[23:04:35.409] Build status: STARTED
[23:04:35.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:75:0) after 1m2s
[23:05:37.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:75:0)
[23:05:37.453] Build status: STARTED
[23:05:37.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:76:0) after 1m0s
[23:06:37.480] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:76:0)
[23:06:37.501] Build status: STARTED
[23:06:37.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:77:0) after 3m50s
[23:10:27.577] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:77:0)
[23:10:27.671] Build status: STARTED
[23:10:27.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:78:0) after 2m0s
[23:12:27.707] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:78:0)
[23:12:27.728] Build status: STARTED
[23:12:27.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:79:0) after 4m1s
[23:16:28.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:79:0)
[23:16:28.776] Build status: STARTED
[23:16:28.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:80:0) after 4m19s
[23:20:47.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:80:0)
[23:20:47.927] Build status: STARTED
[23:20:47.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:81:0) after 1m47s
[23:22:34.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:81:0)
[23:22:35.022] Build status: STARTED
[23:22:35.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:82:0) after 1m15s
[23:23:50.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:82:0)
[23:23:50.068] Build status: STARTED
[23:23:50.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:83:0) after 3m55s
[23:27:45.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:83:0)
[23:27:45.120] Build status: STARTED
[23:27:45.120] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:84:0) after 7m32s
[23:35:17.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:84:0)
[23:35:17.167] Build status: STARTED
[23:35:17.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:85:0) after 9m4s
[23:44:21.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:85:0)
[23:44:21.282] Build status: STARTED
[23:44:21.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:86:0) after 9m5s
[23:53:26.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:86:0)
[23:53:26.340] Build status: STARTED
[23:53:26.340] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:87:0) after 9m39s
[00:03:05.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:87:0)
[00:03:05.444] Build status: STARTED
[00:03:05.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:88:0) after 3m57s
[00:07:02.468] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:88:0)
[00:07:02.490] Build status: STARTED
[00:07:02.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:89:0) after 4m49s
[00:11:51.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:89:0)
[00:11:51.665] Build status: STARTED
[00:11:51.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:90:0) after 2m20s
[00:14:11.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:90:0)
[00:14:11.768] Build status: STARTED
[00:14:11.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:91:0) after 7m39s
[00:21:50.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:91:0)
[00:21:50.810] Build status: STARTED
[00:21:50.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:92:0) after 6m25s
[00:28:15.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:92:0)
[00:28:15.865] Build status: STARTED
[00:28:15.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:93:0) after 6m0s
[00:34:15.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:93:0)
[00:34:15.912] Build status: STARTED
[00:34:15.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:94:0) after 4m13s
[00:38:28.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:94:0)
[00:38:28.996] Build status: STARTED
[00:38:28.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:95:0) after 6m53s
[00:45:22.185] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:95:0)
[00:45:22.200] Build status: STARTED
[00:45:22.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:96:0) after 9m45s
[00:55:07.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:96:0)
[00:55:07.251] Build status: STARTED
[00:55:07.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:97:0) after 8m47s
[01:03:54.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:97:0)
[01:03:54.269] Build status: STARTED
[01:03:54.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:98:0) after 9m28s
[01:13:22.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:98:0)
[01:13:22.350] Build status: STARTED
[01:13:22.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:99:0) after 5m54s
[01:19:16.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:99:0)
[01:19:16.393] Build status: STARTED
[01:19:16.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:100:0) after 4m51s
[01:24:07.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:100:0)
[01:24:07.442] Build status: STARTED
[01:24:07.442] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:101:0) after 5m52s
[01:29:59.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:101:0)
[01:29:59.451] Build status: STARTED
[01:29:59.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:102:0) after 8m25s
[01:38:24.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:102:0)
[01:38:24.519] Build status: STARTED
[01:38:24.519] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:103:0) after 8m3s
[01:46:27.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:103:0)
[01:46:27.642] Build status: STARTED
[01:46:27.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:104:0) after 3m56s
[01:50:23.668] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:104:0)
[01:50:23.684] Build status: STARTED
[01:50:23.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:105:0) after 9m56s
[02:00:19.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:105:0)
[02:00:19.797] Build status: STARTED
[02:00:19.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:106:0) after 9m1s
[02:09:20.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:106:0)
[02:09:20.857] Build status: STARTED
[02:09:20.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:107:0) after 2m43s
[02:12:03.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:107:0)
[02:12:03.935] Build status: STARTED
[02:12:03.935] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:108:0) after 4m52s
[02:16:56.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:108:0)
[02:16:56.159] Build status: STARTED
[02:16:56.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:109:0) after 3m55s
[02:20:51.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:109:0)
[02:20:51.266] Build status: STARTED
[02:20:51.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:110:0) after 6m5s
[02:26:56.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:110:0)
[02:26:56.385] Build status: STARTED
[02:26:56.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:111:0) after 2m2s
[02:28:58.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:111:0)
[02:28:58.563] Build status: STARTED
[02:28:58.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:112:0) after 5m57s
[02:34:55.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:112:0)
[02:34:55.651] Build status: STARTED
[02:34:55.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:113:0) after 7m44s
[02:42:39.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:113:0)
[02:42:39.710] Build status: STARTED
[02:42:39.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:114:0) after 7m4s
[02:49:43.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:114:0)
[02:49:43.882] Build status: STARTED
[02:49:43.882] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:115:0) after 2m50s
[02:52:33.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:115:0)
[02:52:33.926] Build status: STARTED
[02:52:33.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:116:0) after 2m54s
[02:55:27.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:116:0)
[02:55:27.977] Build status: STARTED
[02:55:27.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:117:0) after 8m14s
[03:03:41.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:117:0)
[03:03:42.025] Build status: STARTED
[03:03:42.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:118:0) after 9m0s
[03:12:42.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:118:0)
[03:12:42.475] Build status: STARTED
[03:12:42.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:119:0) after 7m22s
[03:20:04.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:119:0)
[03:20:04.744] Build status: STARTED
[03:20:04.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:120:0) after 4m59s
[03:25:03.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:120:0)
[03:25:03.829] Build status: STARTED
[03:25:03.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:121:0) after 2m55s
[03:27:59.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:121:0)
[03:27:59.287] Build status: STARTED
[03:27:59.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:122:0) after 8m7s
[03:36:06.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:122:0)
[03:36:06.622] Build status: STARTED
[03:36:06.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:123:0) after 1m55s
[03:38:01.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:123:0)
[03:38:01.726] Build status: STARTED
[03:38:01.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:124:0) after 6m47s
[03:44:48.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:124:0)
[03:44:48.755] Build status: STARTED
[03:44:48.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:125:0) after 4m38s
[03:49:26.788] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:125:0)
[03:49:26.810] Build status: STARTED
[03:49:26.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:126:0) after 9m31s
[03:58:57.880] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:126:0)
[03:58:57.917] Build status: STARTED
[03:58:57.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:127:0) after 2m29s
[04:01:26.932] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:127:0)
[04:01:26.975] Build status: STARTED
[04:01:26.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:128:0) after 6m54s
[04:08:21.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:128:0)
[04:08:21.083] Build status: STARTED
[04:08:21.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:129:0) after 7m17s
[04:15:38.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:129:0)
[04:15:38.148] Build status: STARTED
[04:15:38.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:130:0) after 1m23s
[04:17:01.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:130:0)
[04:17:01.277] Build status: STARTED
[04:17:01.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:131:0) after 1m47s
[04:18:48.470] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:131:0)
[04:18:48.502] Build status: STARTED
[04:18:48.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:132:0) after 7m57s
[04:26:45.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:132:0)
[04:26:45.565] Build status: STARTED
[04:26:45.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894805509322449456:133:0) after 3m16s
[04:29:56.822] Received PubSub notification, asking Buildbucket for the build status
[04:29:56.842] Build:
{
"id": "8729375446933432961",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3004,
"createdBy": "project:chromium",
"createTime": "2024-12-05T16:24:20.200174541Z",
"startTime": "2024-12-05T16:28:26.533875452Z",
"endTime": "2024-12-06T04:29:56.371922981Z",
"updateTime": "2024-12-06T04:29:56.371922981Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c8cf875ff2f97f60846129f2516d168c31c72a0d",
"ref": "refs/heads/main"
}
}
}
[04:29:56.842] Invocation finished in 12h5m38.303609321s with status FAILED