[03:58:03.510] New invocation is queued and will start shortly
[03:58:04.629] Starting the invocation (attempt 1)
[03:58:04.656] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/377928bf12af36125b5f7df0186f984a3e34062e"
[03:58:04.656] Popped gitiles commit info from properties and tags
[03:58:04.656] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:58:04.656] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:58:04.657] Buildbucket request:
{
"requestId": "8923028115904762144",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "377928bf12af36125b5f7df0186f984a3e34062e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923028115904762144"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:58:05.211] Scheduled build:
{
"id": "8757598053984700529",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1944,
"createdBy": "project:chromium",
"createTime": "2024-01-29T03:58:04.713195771Z",
"updateTime": "2024-01-29T03:58:04.713195771Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "377928bf12af36125b5f7df0186f984a3e34062e",
"ref": "refs/heads/main"
}
}
}
[03:58:05.212] Task URL: https://cr-buildbucket.appspot.com/build/8757598053984700529
[03:58:05.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:2:0) after 9m58s
[03:58:06.131] Received PubSub notification, asking Buildbucket for the build status
[03:58:06.181] Build status: SCHEDULED
[03:59:06.952] Received PubSub notification, asking Buildbucket for the build status
[03:59:06.972] Build status: STARTED
[04:08:03.293] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:2:0)
[04:08:03.310] Build status: STARTED
[04:08:03.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:5:0) after 3m25s
[04:11:28.516] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:5:0)
[04:11:28.553] Build status: STARTED
[04:11:28.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:6:0) after 7m24s
[04:18:52.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:6:0)
[04:18:52.612] Build status: STARTED
[04:18:52.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:7:0) after 2m59s
[04:21:51.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:7:0)
[04:21:51.655] Build status: STARTED
[04:21:51.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:8:0) after 8m9s
[04:30:00.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:8:0)
[04:30:00.716] Build status: STARTED
[04:30:00.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:9:0) after 3m20s
[04:33:20.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:9:0)
[04:33:20.816] Build status: STARTED
[04:33:20.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:10:0) after 9m42s
[04:43:02.834] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:10:0)
[04:43:02.853] Build status: STARTED
[04:43:02.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:11:0) after 2m18s
[04:45:20.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:11:0)
[04:45:20.980] Build status: STARTED
[04:45:20.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:12:0) after 9m24s
[04:54:44.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:12:0)
[04:54:45.014] Build status: STARTED
[04:54:45.014] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:13:0) after 9m4s
[05:03:49.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:13:0)
[05:03:49.309] Build status: STARTED
[05:03:49.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:14:0) after 2m36s
[05:06:25.349] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:14:0)
[05:06:25.374] Build status: STARTED
[05:06:25.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:15:0) after 4m11s
[05:10:36.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:15:0)
[05:10:36.416] Build status: STARTED
[05:10:36.416] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:16:0) after 8m27s
[05:19:03.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:16:0)
[05:19:03.463] Build status: STARTED
[05:19:03.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:17:0) after 9m38s
[05:28:41.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:17:0)
[05:28:41.534] Build status: STARTED
[05:28:41.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:18:0) after 8m5s
[05:36:46.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:18:0)
[05:36:46.679] Build status: STARTED
[05:36:46.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:19:0) after 4m8s
[05:40:55.051] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:19:0)
[05:40:55.070] Build status: STARTED
[05:40:55.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:20:0) after 7m49s
[05:48:44.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:20:0)
[05:48:44.126] Build status: STARTED
[05:48:44.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:21:0) after 9m19s
[05:58:03.216] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:21:0)
[05:58:03.236] Build status: STARTED
[05:58:03.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:22:0) after 7m14s
[06:05:17.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:22:0)
[06:05:17.356] Build status: STARTED
[06:05:17.356] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:23:0) after 2m36s
[06:07:53.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:23:0)
[06:07:53.404] Build status: STARTED
[06:07:53.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:24:0) after 6m2s
[06:13:55.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:24:0)
[06:13:55.491] Build status: STARTED
[06:13:55.491] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:25:0) after 2m52s
[06:16:47.535] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:25:0)
[06:16:47.568] Build status: STARTED
[06:16:47.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:26:0) after 7m13s
[06:24:01.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:26:0)
[06:24:01.238] Build status: STARTED
[06:24:01.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:27:0) after 7m21s
[06:31:22.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:27:0)
[06:31:22.317] Build status: STARTED
[06:31:22.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:28:0) after 3m1s
[06:34:23.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:28:0)
[06:34:23.400] Build status: STARTED
[06:34:23.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:29:0) after 3m39s
[06:38:02.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:29:0)
[06:38:02.489] Build status: STARTED
[06:38:02.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:30:0) after 2m9s
[06:40:11.508] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:30:0)
[06:40:11.528] Build status: STARTED
[06:40:11.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:31:0) after 6m18s
[06:46:29.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:31:0)
[06:46:29.596] Build status: STARTED
[06:46:29.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:32:0) after 8m57s
[06:55:26.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:32:0)
[06:55:26.647] Build status: STARTED
[06:55:26.647] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:33:0) after 1m37s
[06:57:03.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:33:0)
[06:57:03.683] Build status: STARTED
[06:57:03.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:34:0) after 3m11s
[07:00:14.670] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:34:0)
[07:00:14.711] Build status: STARTED
[07:00:14.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:35:0) after 2m49s
[07:03:03.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:35:0)
[07:03:03.878] Build status: STARTED
[07:03:03.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:36:0) after 9m4s
[07:12:07.900] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:36:0)
[07:12:07.986] Build status: STARTED
[07:12:07.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:37:0) after 6m1s
[07:18:09.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:37:0)
[07:18:09.056] Build status: STARTED
[07:18:09.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:38:0) after 9m27s
[07:27:36.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:38:0)
[07:27:36.107] Build status: STARTED
[07:27:36.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:39:0) after 4m22s
[07:31:58.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:39:0)
[07:31:58.173] Build status: STARTED
[07:31:58.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:40:0) after 6m12s
[07:38:10.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:40:0)
[07:38:10.218] Build status: STARTED
[07:38:10.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:41:0) after 7m37s
[07:45:47.306] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:41:0)
[07:45:47.326] Build status: STARTED
[07:45:47.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:42:0) after 6m58s
[07:52:45.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:42:0)
[07:52:45.366] Build status: STARTED
[07:52:45.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:43:0) after 1m42s
[07:54:27.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:43:0)
[07:54:27.420] Build status: STARTED
[07:54:27.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:44:0) after 4m40s
[07:59:07.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:44:0)
[07:59:07.522] Build status: STARTED
[07:59:07.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:45:0) after 6m27s
[08:05:34.541] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:45:0)
[08:05:34.595] Build status: STARTED
[08:05:34.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:46:0) after 7m51s
[08:13:25.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:46:0)
[08:13:25.647] Build status: STARTED
[08:13:25.647] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:47:0) after 4m35s
[08:18:00.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:47:0)
[08:18:00.685] Build status: STARTED
[08:18:00.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:48:0) after 2m35s
[08:20:35.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:48:0)
[08:20:35.932] Build status: STARTED
[08:20:35.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:49:0) after 3m7s
[08:23:42.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:49:0)
[08:23:43.041] Build status: STARTED
[08:23:43.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:50:0) after 6m0s
[08:29:43.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:50:0)
[08:29:43.129] Build status: STARTED
[08:29:43.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:51:0) after 1m11s
[08:30:54.372] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:51:0)
[08:30:54.402] Build status: STARTED
[08:30:54.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:52:0) after 1m53s
[08:32:47.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:52:0)
[08:32:47.451] Build status: STARTED
[08:32:47.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:53:0) after 9m42s
[08:42:29.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:53:0)
[08:42:29.590] Build status: STARTED
[08:42:29.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:54:0) after 2m50s
[08:45:19.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:54:0)
[08:45:19.641] Build status: STARTED
[08:45:19.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:55:0) after 8m8s
[08:53:27.670] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:55:0)
[08:53:27.732] Build status: STARTED
[08:53:27.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:56:0) after 9m59s
[09:03:26.744] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:56:0)
[09:03:26.779] Build status: STARTED
[09:03:26.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:57:0) after 6m21s
[09:09:47.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:57:0)
[09:09:47.790] Build status: STARTED
[09:09:47.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:58:0) after 4m2s
[09:13:50.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:58:0)
[09:13:50.042] Build status: STARTED
[09:13:50.042] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:59:0) after 4m56s
[09:18:46.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:59:0)
[09:18:46.197] Build status: STARTED
[09:18:46.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:60:0) after 7m0s
[09:25:46.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:60:0)
[09:25:46.315] Build status: STARTED
[09:25:46.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:61:0) after 6m59s
[09:32:45.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:61:0)
[09:32:45.357] Build status: STARTED
[09:32:45.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:62:0) after 5m49s
[09:38:34.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:62:0)
[09:38:34.509] Build status: STARTED
[09:38:34.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:63:0) after 6m47s
[09:45:21.536] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:63:0)
[09:45:21.557] Build status: STARTED
[09:45:21.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:64:0) after 5m16s
[09:50:37.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:64:0)
[09:50:37.604] Build status: STARTED
[09:50:37.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:65:0) after 4m42s
[09:55:19.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:65:0)
[09:55:19.658] Build status: STARTED
[09:55:19.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:66:0) after 9m20s
[10:04:39.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:66:0)
[10:04:39.686] Build status: STARTED
[10:04:39.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:67:0) after 6m4s
[10:10:43.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:67:0)
[10:10:43.894] Build status: STARTED
[10:10:43.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:68:0) after 4m59s
[10:15:42.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:68:0)
[10:15:42.986] Build status: STARTED
[10:15:42.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:69:0) after 1m33s
[10:17:16.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:69:0)
[10:17:16.247] Build status: STARTED
[10:17:16.248] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:70:0) after 4m24s
[10:21:40.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:70:0)
[10:21:40.424] Build status: STARTED
[10:21:40.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:71:0) after 3m46s
[10:25:26.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:71:0)
[10:25:26.774] Build status: STARTED
[10:25:26.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:72:0) after 1m3s
[10:26:29.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:72:0)
[10:26:29.817] Build status: STARTED
[10:26:29.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:73:0) after 7m36s
[10:34:06.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:73:0)
[10:34:06.201] Build status: STARTED
[10:34:06.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:74:0) after 2m52s
[10:36:58.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:74:0)
[10:36:58.411] Build status: STARTED
[10:36:58.411] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:75:0) after 4m20s
[10:41:18.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:75:0)
[10:41:18.487] Build status: STARTED
[10:41:18.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:76:0) after 5m16s
[10:46:34.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:76:0)
[10:46:34.601] Build status: STARTED
[10:46:34.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:77:0) after 7m46s
[10:54:20.677] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:77:0)
[10:54:20.696] Build status: STARTED
[10:54:20.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:78:0) after 7m43s
[11:02:03.895] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:78:0)
[11:02:03.958] Build status: STARTED
[11:02:03.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:79:0) after 7m24s
[11:09:27.978] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:79:0)
[11:09:27.995] Build status: STARTED
[11:09:27.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:80:0) after 6m8s
[11:15:36.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:80:0)
[11:15:36.258] Build status: STARTED
[11:15:36.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:81:0) after 7m33s
[11:23:09.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:81:0)
[11:23:09.474] Build status: STARTED
[11:23:09.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:82:0) after 1m12s
[11:24:21.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:82:0)
[11:24:21.608] Build status: STARTED
[11:24:21.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:83:0) after 9m23s
[11:33:44.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:83:0)
[11:33:44.753] Build status: STARTED
[11:33:44.753] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:84:0) after 6m34s
[11:40:18.784] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:84:0)
[11:40:18.809] Build status: STARTED
[11:40:18.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:85:0) after 2m46s
[11:43:04.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:85:0)
[11:43:04.881] Build status: STARTED
[11:43:04.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:86:0) after 6m59s
[11:50:03.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:86:0)
[11:50:03.953] Build status: STARTED
[11:50:03.953] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:87:0) after 6m14s
[11:56:17.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:87:0)
[11:56:18.015] Build status: STARTED
[11:56:18.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:88:0) after 4m2s
[12:00:20.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:88:0)
[12:00:20.088] Build status: STARTED
[12:00:20.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:89:0) after 2m7s
[12:02:27.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:89:0)
[12:02:27.322] Build status: STARTED
[12:02:27.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:90:0) after 1m33s
[12:04:00.509] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:90:0)
[12:04:00.529] Build status: STARTED
[12:04:00.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:91:0) after 4m12s
[12:08:12.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:91:0)
[12:08:12.743] Build status: STARTED
[12:08:12.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:92:0) after 3m11s
[12:11:23.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:92:0)
[12:11:23.925] Build status: STARTED
[12:11:23.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:93:0) after 7m19s
[12:18:42.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:93:0)
[12:18:42.965] Build status: STARTED
[12:18:42.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:94:0) after 3m33s
[12:22:16.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:94:0)
[12:22:16.025] Build status: STARTED
[12:22:16.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:95:0) after 3m59s
[12:26:15.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:95:0)
[12:26:15.069] Build status: STARTED
[12:26:15.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:96:0) after 9m24s
[12:35:39.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:96:0)
[12:35:39.368] Build status: STARTED
[12:35:39.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:97:0) after 4m52s
[12:40:31.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:97:0)
[12:40:31.730] Build status: STARTED
[12:40:31.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:98:0) after 9m10s
[12:49:41.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:98:0)
[12:49:41.976] Build status: STARTED
[12:49:41.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:99:0) after 4m0s
[12:53:41.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:99:0)
[12:53:42.016] Build status: STARTED
[12:53:42.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:100:0) after 9m0s
[13:02:42.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:100:0)
[13:02:42.056] Build status: STARTED
[13:02:42.057] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:101:0) after 1m19s
[13:04:01.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:101:0)
[13:04:01.120] Build status: STARTED
[13:04:01.120] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:102:0) after 1m41s
[13:05:42.185] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:102:0)
[13:05:42.211] Build status: STARTED
[13:05:42.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:103:0) after 3m47s
[13:09:29.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:103:0)
[13:09:29.273] Build status: STARTED
[13:09:29.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:104:0) after 5m49s
[13:15:18.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:104:0)
[13:15:18.327] Build status: STARTED
[13:15:18.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:105:0) after 5m7s
[13:20:25.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:105:0)
[13:20:25.626] Build status: STARTED
[13:20:25.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:106:0) after 2m28s
[13:22:53.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:106:0)
[13:22:53.757] Build status: STARTED
[13:22:53.757] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:107:0) after 7m18s
[13:30:11.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:107:0)
[13:30:11.806] Build status: STARTED
[13:30:11.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:108:0) after 3m12s
[13:33:23.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:108:0)
[13:33:23.915] Build status: STARTED
[13:33:23.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:109:0) after 1m35s
[13:34:58.910] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:109:0)
[13:34:59.025] Build status: STARTED
[13:34:59.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:110:0) after 2m49s
[13:37:48.091] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:110:0)
[13:37:48.124] Build status: STARTED
[13:37:48.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:111:0) after 1m9s
[13:38:57.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:111:0)
[13:38:57.593] Build status: STARTED
[13:38:57.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:112:0) after 7m8s
[13:46:05.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:112:0)
[13:46:05.705] Build status: STARTED
[13:46:05.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:113:0) after 2m43s
[13:48:48.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:113:0)
[13:48:48.769] Build status: STARTED
[13:48:48.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:114:0) after 9m39s
[13:58:27.788] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:114:0)
[13:58:27.810] Build status: STARTED
[13:58:27.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:115:0) after 2m32s
[14:01:00.000] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:115:0)
[14:01:00.020] Build status: STARTED
[14:01:00.020] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:116:0) after 4m59s
[14:05:58.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:116:0)
[14:05:59.017] Build status: STARTED
[14:05:59.017] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:117:0) after 7m36s
[14:13:35.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:117:0)
[14:13:35.165] Build status: STARTED
[14:13:35.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:118:0) after 1m15s
[14:14:50.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:118:0)
[14:14:50.223] Build status: STARTED
[14:14:50.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:119:0) after 5m19s
[14:20:09.379] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:119:0)
[14:20:09.451] Build status: STARTED
[14:20:09.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:120:0) after 8m54s
[14:29:03.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:120:0)
[14:29:03.532] Build status: STARTED
[14:29:03.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:121:0) after 8m41s
[14:37:44.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:121:0)
[14:37:44.632] Build status: STARTED
[14:37:44.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:122:0) after 3m46s
[14:41:30.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:122:0)
[14:41:30.924] Build status: STARTED
[14:41:30.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:123:0) after 8m32s
[14:50:03.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:123:0)
[14:50:03.276] Build status: STARTED
[14:50:03.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:124:0) after 9m15s
[14:59:18.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:124:0)
[14:59:18.407] Build status: STARTED
[14:59:18.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:125:0) after 3m44s
[15:03:02.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:125:0)
[15:03:02.664] Build status: STARTED
[15:03:02.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:126:0) after 6m46s
[15:09:48.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:126:0)
[15:09:48.754] Build status: STARTED
[15:09:48.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:127:0) after 5m37s
[15:15:25.995] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:127:0)
[15:15:26.018] Build status: STARTED
[15:15:26.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:128:0) after 3m59s
[15:19:25.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:128:0)
[15:19:25.196] Build status: STARTED
[15:19:25.196] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:129:0) after 1m5s
[15:20:30.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:129:0)
[15:20:30.307] Build status: STARTED
[15:20:30.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:130:0) after 9m23s
[15:29:53.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:130:0)
[15:29:53.376] Build status: STARTED
[15:29:53.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:131:0) after 6m58s
[15:36:51.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:131:0)
[15:36:51.514] Build status: STARTED
[15:36:51.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:132:0) after 7m31s
[15:44:22.535] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:132:0)
[15:44:22.556] Build status: STARTED
[15:44:22.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:133:0) after 7m59s
[15:52:21.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:133:0)
[15:52:21.902] Build status: STARTED
[15:52:21.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:134:0) after 5m42s
[15:58:04.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:134:0)
[15:58:04.064] Build status: STARTED
[15:58:04.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:135:0) after 2m24s
[16:00:28.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:135:0)
[16:00:28.175] Build status: STARTED
[16:00:28.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:136:0) after 2m5s
[16:02:33.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:136:0)
[16:02:33.279] Build status: STARTED
[16:02:33.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:137:0) after 5m10s
[16:07:43.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:137:0)
[16:07:43.390] Build status: STARTED
[16:07:43.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:138:0) after 2m7s
[16:09:50.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:138:0)
[16:09:50.531] Build status: STARTED
[16:09:50.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:139:0) after 7m7s
[16:16:57.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:139:0)
[16:16:57.617] Build status: STARTED
[16:16:57.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923028115904762144:140:0) after 4m23s
[16:20:57.358] Received PubSub notification, asking Buildbucket for the build status
[16:20:57.381] Build:
{
"id": "8757598053984700529",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1944,
"createdBy": "project:chromium",
"createTime": "2024-01-29T03:58:04.713195771Z",
"startTime": "2024-01-29T03:59:01.860478Z",
"endTime": "2024-01-29T16:20:56.629245Z",
"updateTime": "2024-01-29T16:20:56.629245Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "377928bf12af36125b5f7df0186f984a3e34062e",
"ref": "refs/heads/main"
}
}
}
[16:20:57.381] Invocation finished in 12h22m53.883395667s with status FAILED