[02:10:44.519] New invocation is queued and will start shortly
[02:10:45.592] Starting the invocation (attempt 1)
[02:10:45.631] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/391625a615622694ec78595d5f6ccf530370983c"
[02:10:45.631] Popped gitiles commit info from properties and tags
[02:10:45.631] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:10:45.631] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:10:45.631] Buildbucket request:
{
"requestId": "8938073964101736576",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "391625a615622694ec78595d5f6ccf530370983c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8938073964101736576"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:10:46.236] Scheduled build:
{
"id": "8772643902189566769",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1612,
"createdBy": "project:chromium",
"createTime": "2023-08-16T02:10:45.711035322Z",
"updateTime": "2023-08-16T02:10:45.711035322Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "391625a615622694ec78595d5f6ccf530370983c",
"ref": "refs/heads/main"
}
}
}
[02:10:46.236] Task URL: https://cr-buildbucket.appspot.com/build/8772643902189566769
[02:10:46.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:2:0) after 7m59s
[02:10:47.183] Received PubSub notification, asking Buildbucket for the build status
[02:10:47.213] Build status: SCHEDULED
[02:10:52.598] Received PubSub notification, asking Buildbucket for the build status
[02:10:52.620] Build status: STARTED
[02:18:45.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:2:0)
[02:18:45.471] Build status: STARTED
[02:18:45.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:5:0) after 4m28s
[02:23:13.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:5:0)
[02:23:13.775] Build status: STARTED
[02:23:13.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:6:0) after 7m45s
[02:30:58.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:6:0)
[02:30:58.921] Build status: STARTED
[02:30:58.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:7:0) after 5m0s
[02:35:59.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:7:0)
[02:35:59.028] Build status: STARTED
[02:35:59.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:8:0) after 4m1s
[02:40:00.319] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:8:0)
[02:40:00.352] Build status: STARTED
[02:40:00.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:9:0) after 9m22s
[02:49:22.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:9:0)
[02:49:22.564] Build status: STARTED
[02:49:22.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:10:0) after 8m21s
[02:57:43.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:10:0)
[02:57:43.650] Build status: STARTED
[02:57:43.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:11:0) after 9m38s
[03:07:21.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:11:0)
[03:07:21.762] Build status: STARTED
[03:07:21.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:12:0) after 6m56s
[03:14:17.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:12:0)
[03:14:18.018] Build status: STARTED
[03:14:18.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:13:0) after 2m33s
[03:16:51.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:13:0)
[03:16:51.221] Build status: STARTED
[03:16:51.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:14:0) after 9m34s
[03:26:25.365] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:14:0)
[03:26:25.418] Build status: STARTED
[03:26:25.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:15:0) after 9m10s
[03:35:35.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:15:0)
[03:35:35.675] Build status: STARTED
[03:35:35.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:16:0) after 5m1s
[03:40:36.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:16:0)
[03:40:36.908] Build status: STARTED
[03:40:36.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:17:0) after 7m4s
[03:47:40.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:17:0)
[03:47:40.907] Build status: STARTED
[03:47:40.907] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:18:0) after 9m18s
[03:56:59.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:18:0)
[03:56:59.124] Build status: STARTED
[03:56:59.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:19:0) after 2m27s
[03:59:26.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:19:0)
[03:59:26.214] Build status: STARTED
[03:59:26.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:20:0) after 1m23s
[04:00:49.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:20:0)
[04:00:49.324] Build status: STARTED
[04:00:49.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:21:0) after 8m7s
[04:08:56.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:21:0)
[04:08:56.468] Build status: STARTED
[04:08:56.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:22:0) after 9m24s
[04:18:20.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:22:0)
[04:18:21.001] Build status: STARTED
[04:18:21.001] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:23:0) after 4m18s
[04:22:39.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:23:0)
[04:22:39.078] Build status: STARTED
[04:22:39.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:24:0) after 7m0s
[04:29:39.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:24:0)
[04:29:39.128] Build status: STARTED
[04:29:39.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:25:0) after 6m41s
[04:36:20.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:25:0)
[04:36:20.210] Build status: STARTED
[04:36:20.210] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:26:0) after 5m0s
[04:41:20.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:26:0)
[04:41:20.306] Build status: STARTED
[04:41:20.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:27:0) after 7m23s
[04:48:43.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:27:0)
[04:48:43.364] Build status: STARTED
[04:48:43.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:28:0) after 3m9s
[04:51:52.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:28:0)
[04:51:52.443] Build status: STARTED
[04:51:52.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:29:0) after 5m45s
[04:57:37.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:29:0)
[04:57:37.502] Build status: STARTED
[04:57:37.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:30:0) after 6m23s
[05:04:00.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:30:0)
[05:04:00.621] Build status: STARTED
[05:04:00.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:31:0) after 9m9s
[05:13:09.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:31:0)
[05:13:09.715] Build status: STARTED
[05:13:09.715] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:32:0) after 8m2s
[05:21:12.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:32:0)
[05:21:12.121] Build status: STARTED
[05:21:12.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:33:0) after 7m8s
[05:28:20.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:33:0)
[05:28:20.267] Build status: STARTED
[05:28:20.267] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:34:0) after 6m14s
[05:34:34.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:34:0)
[05:34:34.385] Build status: STARTED
[05:34:34.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:35:0) after 2m59s
[05:37:33.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:35:0)
[05:37:33.655] Build status: STARTED
[05:37:33.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:36:0) after 1m10s
[05:38:43.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:36:0)
[05:38:43.869] Build status: STARTED
[05:38:43.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:37:0) after 7m25s
[05:46:08.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:37:0)
[05:46:09.066] Build status: STARTED
[05:46:09.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:38:0) after 3m43s
[05:49:52.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:38:0)
[05:49:52.130] Build status: STARTED
[05:49:52.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:39:0) after 1m57s
[05:51:49.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:39:0)
[05:51:49.250] Build status: STARTED
[05:51:49.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:40:0) after 4m7s
[05:55:56.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:40:0)
[05:55:56.306] Build status: STARTED
[05:55:56.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:41:0) after 2m55s
[05:58:51.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:41:0)
[05:58:51.576] Build status: STARTED
[05:58:51.576] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:42:0) after 8m24s
[06:07:15.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:42:0)
[06:07:15.926] Build status: STARTED
[06:07:15.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:43:0) after 4m7s
[06:11:23.070] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:43:0)
[06:11:23.114] Build status: STARTED
[06:11:23.114] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:44:0) after 6m42s
[06:18:05.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:44:0)
[06:18:05.166] Build status: STARTED
[06:18:05.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:45:0) after 1m2s
[06:19:07.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:45:0)
[06:19:07.245] Build status: STARTED
[06:19:07.245] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:46:0) after 5m13s
[06:24:20.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:46:0)
[06:24:20.491] Build status: STARTED
[06:24:20.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:47:0) after 5m25s
[06:29:45.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:47:0)
[06:29:45.785] Build status: STARTED
[06:29:45.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:48:0) after 9m56s
[06:39:42.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:48:0)
[06:39:42.358] Build status: STARTED
[06:39:42.358] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:49:0) after 7m6s
[06:46:48.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:49:0)
[06:46:48.420] Build status: STARTED
[06:46:48.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:50:0) after 5m15s
[06:52:03.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:50:0)
[06:52:03.590] Build status: STARTED
[06:52:03.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:51:0) after 6m5s
[06:58:08.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:51:0)
[06:58:08.707] Build status: STARTED
[06:58:08.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:52:0) after 9m57s
[07:08:05.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:52:0)
[07:08:05.973] Build status: STARTED
[07:08:05.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:53:0) after 7m38s
[07:15:44.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:53:0)
[07:15:44.612] Build status: STARTED
[07:15:44.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:54:0) after 2m20s
[07:18:04.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:54:0)
[07:18:04.701] Build status: STARTED
[07:18:04.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:55:0) after 9m24s
[07:27:28.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:55:0)
[07:27:28.794] Build status: STARTED
[07:27:28.794] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:56:0) after 3m23s
[07:30:51.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:56:0)
[07:30:51.980] Build status: STARTED
[07:30:51.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:57:0) after 8m19s
[07:39:11.207] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:57:0)
[07:39:11.229] Build status: STARTED
[07:39:11.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:58:0) after 7m59s
[07:47:10.631] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:58:0)
[07:47:10.664] Build status: STARTED
[07:47:10.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:59:0) after 3m56s
[07:51:06.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:59:0)
[07:51:06.775] Build status: STARTED
[07:51:06.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:60:0) after 9m56s
[08:01:02.807] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:60:0)
[08:01:02.864] Build status: STARTED
[08:01:02.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:61:0) after 5m52s
[08:06:55.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:61:0)
[08:06:55.200] Build status: STARTED
[08:06:55.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:62:0) after 5m50s
[08:12:45.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:62:0)
[08:12:45.524] Build status: STARTED
[08:12:45.524] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:63:0) after 1m16s
[08:14:01.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:63:0)
[08:14:01.975] Build status: STARTED
[08:14:01.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:64:0) after 4m51s
[08:18:53.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:64:0)
[08:18:53.108] Build status: STARTED
[08:18:53.108] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:65:0) after 4m17s
[08:23:10.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:65:0)
[08:23:10.285] Build status: STARTED
[08:23:10.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:66:0) after 6m31s
[08:29:41.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:66:0)
[08:29:41.424] Build status: STARTED
[08:29:41.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:67:0) after 1m54s
[08:31:35.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:67:0)
[08:31:35.659] Build status: STARTED
[08:31:35.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:68:0) after 1m37s
[08:33:12.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:68:0)
[08:33:12.717] Build status: STARTED
[08:33:12.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:69:0) after 5m35s
[08:38:47.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:69:0)
[08:38:47.843] Build status: STARTED
[08:38:47.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:70:0) after 6m47s
[08:45:34.927] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:70:0)
[08:45:34.951] Build status: STARTED
[08:45:34.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:71:0) after 3m33s
[08:49:07.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:71:0)
[08:49:08.000] Build status: STARTED
[08:49:08.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:72:0) after 2m50s
[08:51:58.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:72:0)
[08:51:58.165] Build status: STARTED
[08:51:58.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:73:0) after 9m6s
[09:01:04.372] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:73:0)
[09:01:04.410] Build status: STARTED
[09:01:04.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:74:0) after 6m7s
[09:07:11.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:74:0)
[09:07:11.971] Build status: STARTED
[09:07:11.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:75:0) after 5m7s
[09:12:19.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:75:0)
[09:12:19.097] Build status: STARTED
[09:12:19.097] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:76:0) after 9m25s
[09:21:44.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:76:0)
[09:21:44.166] Build status: STARTED
[09:21:44.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:77:0) after 3m24s
[09:25:08.199] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:77:0)
[09:25:08.223] Build status: STARTED
[09:25:08.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:78:0) after 6m6s
[09:31:14.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:78:0)
[09:31:14.323] Build status: STARTED
[09:31:14.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:79:0) after 4m32s
[09:35:46.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:79:0)
[09:35:46.439] Build status: STARTED
[09:35:46.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:80:0) after 6m1s
[09:41:47.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:80:0)
[09:41:47.609] Build status: STARTED
[09:41:47.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:81:0) after 1m8s
[09:42:55.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:81:0)
[09:42:55.804] Build status: STARTED
[09:42:55.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:82:0) after 8m40s
[09:51:35.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:82:0)
[09:51:35.860] Build status: STARTED
[09:51:35.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:83:0) after 3m8s
[09:54:43.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:83:0)
[09:54:43.954] Build status: STARTED
[09:54:43.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:84:0) after 1m16s
[09:56:00.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:84:0)
[09:56:00.052] Build status: STARTED
[09:56:00.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:85:0) after 7m55s
[10:03:55.081] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:85:0)
[10:03:55.107] Build status: STARTED
[10:03:55.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:86:0) after 9m19s
[10:13:14.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:86:0)
[10:13:14.338] Build status: STARTED
[10:13:14.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:87:0) after 3m24s
[10:16:38.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:87:0)
[10:16:38.539] Build status: STARTED
[10:16:38.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:88:0) after 3m49s
[10:20:27.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:88:0)
[10:20:27.629] Build status: STARTED
[10:20:27.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:89:0) after 8m42s
[10:29:09.746] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:89:0)
[10:29:09.764] Build status: STARTED
[10:29:09.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:90:0) after 6m0s
[10:35:10.073] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:90:0)
[10:35:10.117] Build status: STARTED
[10:35:10.117] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:91:0) after 6m17s
[10:41:27.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:91:0)
[10:41:27.199] Build status: STARTED
[10:41:27.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:92:0) after 6m54s
[10:48:21.243] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:92:0)
[10:48:21.300] Build status: STARTED
[10:48:21.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:93:0) after 8m12s
[10:56:33.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:93:0)
[10:56:33.345] Build status: STARTED
[10:56:33.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:94:0) after 1m53s
[10:58:26.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:94:0)
[10:58:26.428] Build status: STARTED
[10:58:26.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:95:0) after 6m8s
[11:04:34.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:95:0)
[11:04:34.610] Build status: STARTED
[11:04:34.610] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:96:0) after 5m22s
[11:09:56.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:96:0)
[11:09:56.657] Build status: STARTED
[11:09:56.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:97:0) after 6m9s
[11:16:05.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:97:0)
[11:16:05.775] Build status: STARTED
[11:16:05.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:98:0) after 6m54s
[11:22:59.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:98:0)
[11:22:59.839] Build status: STARTED
[11:22:59.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:99:0) after 9m7s
[11:32:06.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:99:0)
[11:32:06.916] Build status: STARTED
[11:32:06.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:100:0) after 8m20s
[11:40:26.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:100:0)
[11:40:27.040] Build status: STARTED
[11:40:27.040] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:101:0) after 5m9s
[11:45:36.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:101:0)
[11:45:36.165] Build status: STARTED
[11:45:36.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:102:0) after 4m12s
[11:49:48.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:102:0)
[11:49:48.308] Build status: STARTED
[11:49:48.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:103:0) after 9m4s
[11:58:52.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:103:0)
[11:58:52.470] Build status: STARTED
[11:58:52.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:104:0) after 7m30s
[12:06:22.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:104:0)
[12:06:22.653] Build status: STARTED
[12:06:22.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:105:0) after 2m10s
[12:08:32.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:105:0)
[12:08:32.765] Build status: STARTED
[12:08:32.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:106:0) after 4m41s
[12:13:13.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:106:0)
[12:13:13.870] Build status: STARTED
[12:13:13.870] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:107:0) after 5m52s
[12:19:06.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:107:0)
[12:19:06.082] Build status: STARTED
[12:19:06.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:108:0) after 4m49s
[12:23:55.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:108:0)
[12:23:55.142] Build status: STARTED
[12:23:55.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:109:0) after 9m17s
[12:33:12.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:109:0)
[12:33:12.268] Build status: STARTED
[12:33:12.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:110:0) after 6m18s
[12:39:30.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:110:0)
[12:39:30.352] Build status: STARTED
[12:39:30.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:111:0) after 2m25s
[12:41:55.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:111:0)
[12:41:55.888] Build status: STARTED
[12:41:55.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:112:0) after 4m7s
[12:46:02.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:112:0)
[12:46:02.994] Build status: STARTED
[12:46:02.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:113:0) after 1m15s
[12:47:18.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:113:0)
[12:47:18.190] Build status: STARTED
[12:47:18.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:114:0) after 4m46s
[12:52:04.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:114:0)
[12:52:04.690] Build status: STARTED
[12:52:04.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:115:0) after 4m55s
[12:56:59.920] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:115:0)
[12:56:59.942] Build status: STARTED
[12:56:59.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:116:0) after 1m55s
[12:58:55.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:116:0)
[12:58:55.305] Build status: STARTED
[12:58:55.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:117:0) after 1m5s
[13:00:00.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:117:0)
[13:00:00.711] Build status: STARTED
[13:00:00.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:118:0) after 3m13s
[13:03:13.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:118:0)
[13:03:13.827] Build status: STARTED
[13:03:13.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:119:0) after 8m2s
[13:11:15.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:119:0)
[13:11:15.930] Build status: STARTED
[13:11:15.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:120:0) after 4m30s
[13:15:45.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:120:0)
[13:15:46.054] Build status: STARTED
[13:15:46.054] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:121:0) after 9m56s
[13:25:42.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:121:0)
[13:25:42.293] Build status: STARTED
[13:25:42.294] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:122:0) after 6m32s
[13:32:14.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:122:0)
[13:32:14.532] Build status: STARTED
[13:32:14.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:123:0) after 2m4s
[13:34:18.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:123:0)
[13:34:18.609] Build status: STARTED
[13:34:18.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:124:0) after 3m33s
[13:37:51.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:124:0)
[13:37:51.843] Build status: STARTED
[13:37:51.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:125:0) after 8m14s
[13:46:05.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:125:0)
[13:46:05.940] Build status: STARTED
[13:46:05.940] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:126:0) after 4m57s
[13:51:03.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:126:0)
[13:51:03.030] Build status: STARTED
[13:51:03.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:127:0) after 5m34s
[13:56:37.073] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:127:0)
[13:56:37.092] Build status: STARTED
[13:56:37.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:128:0) after 1m4s
[13:57:41.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:128:0)
[13:57:41.176] Build status: STARTED
[13:57:41.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:129:0) after 8m59s
[14:06:40.220] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:129:0)
[14:06:40.251] Build status: STARTED
[14:06:40.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:130:0) after 7m11s
[14:13:51.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:130:0)
[14:13:51.368] Build status: STARTED
[14:13:51.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:131:0) after 7m26s
[14:21:17.471] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:131:0)
[14:21:17.509] Build status: STARTED
[14:21:17.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:132:0) after 6m0s
[14:27:18.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:132:0)
[14:27:18.075] Build status: STARTED
[14:27:18.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8938073964101736576:133:0) after 9m51s
[14:34:06.960] Received PubSub notification, asking Buildbucket for the build status
[14:34:06.993] Build:
{
"id": "8772643902189566769",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1612,
"createdBy": "project:chromium",
"createTime": "2023-08-16T02:10:45.711035322Z",
"startTime": "2023-08-16T02:10:52.023732Z",
"endTime": "2023-08-16T14:34:06.009183Z",
"updateTime": "2023-08-16T14:34:06.009183Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "391625a615622694ec78595d5f6ccf530370983c",
"ref": "refs/heads/main"
}
}
}
[14:34:06.993] Invocation finished in 12h23m22.48911794s with status FAILED