[01:23:22.893] New invocation is queued and will start shortly
[01:23:24.292] Starting the invocation (attempt 1)
[01:23:24.330] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb"
[01:23:24.330] Popped gitiles commit info from properties and tags
[01:23:24.330] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:23:24.331] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:23:24.331] Buildbucket request:
{
"requestId": "8923309638240660496",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923309638240660496"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:23:24.996] Scheduled build:
{
"id": "8757879576007236001",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1938,
"createdBy": "project:chromium",
"createTime": "2024-01-26T01:23:24.391773891Z",
"updateTime": "2024-01-26T01:23:24.391773891Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb",
"ref": "refs/heads/main"
}
}
}
[01:23:24.996] Task URL: https://cr-buildbucket.appspot.com/build/8757879576007236001
[01:23:24.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:2:0) after 8m38s
[01:23:25.847] Received PubSub notification, asking Buildbucket for the build status
[01:23:25.879] Build status: SCHEDULED
[01:23:26.528] Received PubSub notification, asking Buildbucket for the build status
[01:23:26.577] Build status: STARTED
[01:32:03.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:2:0)
[01:32:03.175] Build status: STARTED
[01:32:03.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:5:0) after 6m51s
[01:38:54.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:5:0)
[01:38:54.260] Build status: STARTED
[01:38:54.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:6:0) after 7m58s
[01:46:52.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:6:0)
[01:46:52.490] Build status: STARTED
[01:46:52.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:7:0) after 3m39s
[01:50:31.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:7:0)
[01:50:31.635] Build status: STARTED
[01:50:31.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:8:0) after 9m33s
[02:00:04.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:8:0)
[02:00:04.748] Build status: STARTED
[02:00:04.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:9:0) after 1m41s
[02:01:45.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:9:0)
[02:01:45.912] Build status: STARTED
[02:01:45.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:10:0) after 9m49s
[02:11:34.937] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:10:0)
[02:11:34.962] Build status: STARTED
[02:11:34.962] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:11:0) after 8m39s
[02:20:14.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:11:0)
[02:20:14.191] Build status: STARTED
[02:20:14.191] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:12:0) after 4m6s
[02:24:20.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:12:0)
[02:24:20.326] Build status: STARTED
[02:24:20.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:13:0) after 9m15s
[02:33:35.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:13:0)
[02:33:35.378] Build status: STARTED
[02:33:35.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:14:0) after 5m36s
[02:39:11.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:14:0)
[02:39:11.588] Build status: STARTED
[02:39:11.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:15:0) after 5m33s
[02:44:44.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:15:0)
[02:44:44.650] Build status: STARTED
[02:44:44.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:16:0) after 7m59s
[02:52:43.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:16:0)
[02:52:43.918] Build status: STARTED
[02:52:43.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:17:0) after 2m49s
[02:55:33.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:17:0)
[02:55:33.083] Build status: STARTED
[02:55:33.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:18:0) after 5m6s
[03:00:39.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:18:0)
[03:00:39.284] Build status: STARTED
[03:00:39.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:19:0) after 3m26s
[03:04:05.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:19:0)
[03:04:05.497] Build status: STARTED
[03:04:05.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:20:0) after 2m27s
[03:06:32.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:20:0)
[03:06:32.765] Build status: STARTED
[03:06:32.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:21:0) after 5m50s
[03:12:22.804] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:21:0)
[03:12:22.831] Build status: STARTED
[03:12:22.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:22:0) after 6m24s
[03:18:46.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:22:0)
[03:18:46.944] Build status: STARTED
[03:18:46.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:23:0) after 3m18s
[03:22:05.078] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:23:0)
[03:22:05.150] Build status: STARTED
[03:22:05.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:24:0) after 1m38s
[03:23:43.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:24:0)
[03:23:43.314] Build status: STARTED
[03:23:43.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:25:0) after 4m17s
[03:28:00.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:25:0)
[03:28:00.523] Build status: STARTED
[03:28:00.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:26:0) after 9m4s
[03:37:04.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:26:0)
[03:37:04.650] Build status: STARTED
[03:37:04.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:27:0) after 6m22s
[03:43:26.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:27:0)
[03:43:26.701] Build status: STARTED
[03:43:26.701] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:28:0) after 7m24s
[03:50:50.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:28:0)
[03:50:50.927] Build status: STARTED
[03:50:50.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:29:0) after 6m13s
[03:57:04.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:29:0)
[03:57:04.051] Build status: STARTED
[03:57:04.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:30:0) after 3m21s
[04:00:25.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:30:0)
[04:00:25.229] Build status: STARTED
[04:00:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:31:0) after 3m47s
[04:04:12.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:31:0)
[04:04:12.293] Build status: STARTED
[04:04:12.293] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:32:0) after 1m0s
[04:05:12.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:32:0)
[04:05:12.341] Build status: STARTED
[04:05:12.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:33:0) after 1m59s
[04:07:11.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:33:0)
[04:07:11.468] Build status: STARTED
[04:07:11.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:34:0) after 7m51s
[04:15:02.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:34:0)
[04:15:02.583] Build status: STARTED
[04:15:02.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:35:0) after 8m25s
[04:23:27.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:35:0)
[04:23:27.732] Build status: STARTED
[04:23:27.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:36:0) after 5m23s
[04:28:50.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:36:0)
[04:28:50.796] Build status: STARTED
[04:28:50.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:37:0) after 2m51s
[04:31:41.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:37:0)
[04:31:41.861] Build status: STARTED
[04:31:41.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:38:0) after 2m57s
[04:34:39.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:38:0)
[04:34:39.168] Build status: STARTED
[04:34:39.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:39:0) after 2m59s
[04:37:38.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:39:0)
[04:37:38.183] Build status: STARTED
[04:37:38.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:40:0) after 3m17s
[04:40:55.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:40:0)
[04:40:55.292] Build status: STARTED
[04:40:55.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:41:0) after 3m49s
[04:44:44.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:41:0)
[04:44:44.410] Build status: STARTED
[04:44:44.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:42:0) after 3m54s
[04:48:38.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:42:0)
[04:48:38.759] Build status: STARTED
[04:48:38.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:43:0) after 3m54s
[04:52:32.788] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:43:0)
[04:52:32.822] Build status: STARTED
[04:52:32.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:44:0) after 7m29s
[05:00:01.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:44:0)
[05:00:01.906] Build status: STARTED
[05:00:01.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:45:0) after 8m55s
[05:08:56.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:45:0)
[05:08:56.964] Build status: STARTED
[05:08:56.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:46:0) after 3m12s
[05:12:09.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:46:0)
[05:12:09.136] Build status: STARTED
[05:12:09.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:47:0) after 8m50s
[05:20:59.166] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:47:0)
[05:20:59.182] Build status: STARTED
[05:20:59.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:48:0) after 6m17s
[05:28:59.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:48:0)
[05:28:59.392] Build status: STARTED
[05:28:59.392] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:49:0) after 5m19s
[05:34:18.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:49:0)
[05:34:18.496] Build status: STARTED
[05:34:18.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:50:0) after 2m0s
[05:36:18.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:50:0)
[05:36:18.586] Build status: STARTED
[05:36:18.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:51:0) after 3m5s
[05:39:23.706] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:51:0)
[05:39:23.727] Build status: STARTED
[05:39:23.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:52:0) after 5m6s
[05:44:29.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:52:0)
[05:44:29.788] Build status: STARTED
[05:44:29.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:53:0) after 1m45s
[05:48:06.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:53:0)
[05:48:06.689] Build status: STARTED
[05:48:06.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:54:0) after 3m36s
[05:51:42.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:54:0)
[05:51:42.792] Build status: STARTED
[05:51:42.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:55:0) after 2m6s
[05:53:48.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:55:0)
[05:53:48.848] Build status: STARTED
[05:53:48.848] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:56:0) after 3m13s
[05:57:01.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:56:0)
[05:57:01.898] Build status: STARTED
[05:57:01.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:57:0) after 2m28s
[05:59:29.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:57:0)
[05:59:29.999] Build status: STARTED
[05:59:29.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:58:0) after 8m54s
[06:08:24.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:58:0)
[06:08:24.056] Build status: STARTED
[06:08:24.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:59:0) after 6m15s
[06:14:39.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:59:0)
[06:14:39.286] Build status: STARTED
[06:14:39.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:60:0) after 6m27s
[06:21:06.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:60:0)
[06:21:06.454] Build status: STARTED
[06:21:06.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:61:0) after 7m57s
[06:29:03.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:61:0)
[06:29:03.502] Build status: STARTED
[06:29:03.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:62:0) after 7m33s
[06:36:36.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:62:0)
[06:36:36.762] Build status: STARTED
[06:36:36.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:63:0) after 4m43s
[06:41:19.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:63:0)
[06:41:19.847] Build status: STARTED
[06:41:19.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:64:0) after 6m28s
[06:47:47.912] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:64:0)
[06:47:47.929] Build status: STARTED
[06:47:47.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:65:0) after 7m35s
[06:55:22.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:65:0)
[06:55:23.004] Build status: STARTED
[06:55:23.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:66:0) after 8m31s
[07:03:54.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:66:0)
[07:03:54.216] Build status: STARTED
[07:03:54.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:67:0) after 3m34s
[07:07:28.282] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:67:0)
[07:07:28.303] Build status: STARTED
[07:07:28.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:68:0) after 5m38s
[07:13:06.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:68:0)
[07:13:06.441] Build status: STARTED
[07:13:06.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:69:0) after 6m14s
[07:19:20.609] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:69:0)
[07:19:20.628] Build status: STARTED
[07:19:20.628] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:70:0) after 1m42s
[07:21:02.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:70:0)
[07:21:02.721] Build status: STARTED
[07:21:02.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:71:0) after 8m15s
[07:29:17.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:71:0)
[07:29:17.776] Build status: STARTED
[07:29:17.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:72:0) after 2m43s
[07:32:00.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:72:0)
[07:32:00.887] Build status: STARTED
[07:32:00.887] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:73:0) after 6m39s
[07:38:39.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:73:0)
[07:38:39.948] Build status: STARTED
[07:38:39.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:74:0) after 2m8s
[07:40:48.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:74:0)
[07:40:48.122] Build status: STARTED
[07:40:48.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:75:0) after 3m48s
[07:44:36.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:75:0)
[07:44:36.303] Build status: STARTED
[07:44:36.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:76:0) after 3m22s
[07:47:58.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:76:0)
[07:47:58.529] Build status: STARTED
[07:47:58.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:77:0) after 3m53s
[07:51:51.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:77:0)
[07:51:51.636] Build status: STARTED
[07:51:51.636] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:78:0) after 5m14s
[07:57:05.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:78:0)
[07:57:05.926] Build status: STARTED
[07:57:05.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:79:0) after 9m30s
[08:06:36.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:79:0)
[08:06:36.095] Build status: STARTED
[08:06:36.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:80:0) after 8m29s
[08:15:05.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:80:0)
[08:15:05.324] Build status: STARTED
[08:15:05.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:81:0) after 8m21s
[08:23:26.359] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:81:0)
[08:23:26.395] Build status: STARTED
[08:23:26.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:82:0) after 7m13s
[08:30:39.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:82:0)
[08:30:39.520] Build status: STARTED
[08:30:39.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:83:0) after 9m15s
[08:39:54.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:83:0)
[08:39:54.894] Build status: STARTED
[08:39:54.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:84:0) after 3m0s
[08:42:54.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:84:0)
[08:42:54.937] Build status: STARTED
[08:42:54.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:85:0) after 7m8s
[08:50:02.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:85:0)
[08:50:03.024] Build status: STARTED
[08:50:03.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:86:0) after 3m30s
[08:53:33.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:86:0)
[08:53:33.071] Build status: STARTED
[08:53:33.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:87:0) after 4m42s
[08:58:15.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:87:0)
[08:58:15.423] Build status: STARTED
[08:58:15.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:88:0) after 5m12s
[09:03:27.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:88:0)
[09:03:27.674] Build status: STARTED
[09:03:27.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:89:0) after 3m27s
[09:06:54.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:89:0)
[09:06:54.832] Build status: STARTED
[09:06:54.832] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:90:0) after 7m50s
[09:14:44.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:90:0)
[09:14:45.066] Build status: STARTED
[09:14:45.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:91:0) after 8m58s
[09:23:43.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:91:0)
[09:23:43.185] Build status: STARTED
[09:23:43.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:92:0) after 6m26s
[09:30:09.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:92:0)
[09:30:09.312] Build status: STARTED
[09:30:09.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:93:0) after 8m39s
[09:38:48.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:93:0)
[09:38:48.510] Build status: STARTED
[09:38:48.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:94:0) after 4m29s
[09:43:17.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:94:0)
[09:43:17.735] Build status: STARTED
[09:43:17.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:95:0) after 7m2s
[09:50:20.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:95:0)
[09:50:20.175] Build status: STARTED
[09:50:20.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:96:0) after 9m24s
[09:59:44.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:96:0)
[09:59:44.847] Build status: STARTED
[09:59:44.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:97:0) after 8m16s
[10:08:00.862] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:97:0)
[10:08:00.907] Build status: STARTED
[10:08:00.907] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:98:0) after 2m5s
[10:10:06.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:98:0)
[10:10:06.234] Build status: STARTED
[10:10:06.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:99:0) after 9m48s
[10:19:54.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:99:0)
[10:19:54.639] Build status: STARTED
[10:19:54.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:100:0) after 4m38s
[10:24:32.670] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:100:0)
[10:24:32.703] Build status: STARTED
[10:24:32.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:101:0) after 5m17s
[10:29:49.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:101:0)
[10:29:49.989] Build status: STARTED
[10:29:49.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:102:0) after 5m55s
[10:35:45.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:102:0)
[10:35:45.214] Build status: STARTED
[10:35:45.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:103:0) after 2m22s
[10:38:07.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:103:0)
[10:38:07.305] Build status: STARTED
[10:38:07.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:104:0) after 4m15s
[10:42:22.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:104:0)
[10:42:22.691] Build status: STARTED
[10:42:22.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:105:0) after 1m39s
[10:44:01.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:105:0)
[10:44:01.753] Build status: STARTED
[10:44:01.753] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:106:0) after 4m18s
[10:48:20.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:106:0)
[10:48:20.080] Build status: STARTED
[10:48:20.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:107:0) after 1m22s
[10:49:42.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:107:0)
[10:49:42.570] Build status: STARTED
[10:49:42.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:108:0) after 6m34s
[10:56:16.710] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:108:0)
[10:56:16.735] Build status: STARTED
[10:56:16.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:109:0) after 8m26s
[11:04:42.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:109:0)
[11:04:42.893] Build status: STARTED
[11:04:42.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:110:0) after 7m17s
[11:12:00.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:110:0)
[11:12:00.256] Build status: STARTED
[11:12:00.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:111:0) after 6m59s
[11:18:59.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:111:0)
[11:18:59.640] Build status: STARTED
[11:18:59.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:112:0) after 4m1s
[11:23:00.681] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:112:0)
[11:23:00.752] Build status: STARTED
[11:23:00.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:113:0) after 2m49s
[11:25:49.782] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:113:0)
[11:25:49.811] Build status: STARTED
[11:25:49.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:114:0) after 5m14s
[11:31:03.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:114:0)
[11:31:03.896] Build status: STARTED
[11:31:03.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:115:0) after 3m38s
[11:34:42.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:115:0)
[11:34:42.478] Build status: STARTED
[11:34:42.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:116:0) after 3m9s
[11:37:51.508] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:116:0)
[11:37:51.527] Build status: STARTED
[11:37:51.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:117:0) after 9m41s
[11:47:32.686] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:117:0)
[11:47:32.705] Build status: STARTED
[11:47:32.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:118:0) after 3m27s
[11:50:59.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:118:0)
[11:50:59.778] Build status: STARTED
[11:50:59.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:119:0) after 6m16s
[11:57:16.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:119:0)
[11:57:16.175] Build status: STARTED
[11:57:16.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:120:0) after 3m58s
[12:01:14.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:120:0)
[12:01:14.371] Build status: STARTED
[12:01:14.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:121:0) after 5m26s
[12:06:40.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:121:0)
[12:06:40.434] Build status: STARTED
[12:06:40.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:122:0) after 4m27s
[12:11:07.480] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:122:0)
[12:11:07.526] Build status: STARTED
[12:11:07.526] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:123:0) after 2m44s
[12:13:51.803] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:123:0)
[12:13:51.823] Build status: STARTED
[12:13:51.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:124:0) after 9m17s
[12:23:08.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:124:0)
[12:23:08.988] Build status: STARTED
[12:23:08.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:125:0) after 6m52s
[12:30:01.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:125:0)
[12:30:01.022] Build status: STARTED
[12:30:01.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:126:0) after 9m12s
[12:39:13.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:126:0)
[12:39:13.089] Build status: STARTED
[12:39:13.089] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:127:0) after 3m54s
[12:43:07.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:127:0)
[12:43:07.999] Build status: STARTED
[12:43:07.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:128:0) after 8m0s
[12:51:08.038] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:128:0)
[12:51:08.059] Build status: STARTED
[12:51:08.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:129:0) after 3m10s
[12:54:18.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:129:0)
[12:54:18.188] Build status: STARTED
[12:54:18.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:130:0) after 8m37s
[13:02:55.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:130:0)
[13:02:55.300] Build status: STARTED
[13:02:55.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:131:0) after 9m50s
[13:12:45.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:131:0)
[13:12:45.483] Build status: STARTED
[13:12:45.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:132:0) after 5m50s
[13:18:35.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:132:0)
[13:18:35.574] Build status: STARTED
[13:18:35.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:133:0) after 2m23s
[13:20:58.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:133:0)
[13:20:58.743] Build status: STARTED
[13:20:58.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:134:0) after 2m38s
[13:23:36.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:134:0)
[13:23:36.927] Build status: STARTED
[13:23:36.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:135:0) after 2m32s
[13:26:09.022] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:135:0)
[13:26:09.088] Build status: STARTED
[13:26:09.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:136:0) after 5m31s
[13:31:40.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:136:0)
[13:31:40.237] Build status: STARTED
[13:31:40.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:137:0) after 7m47s
[13:39:27.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:137:0)
[13:39:27.352] Build status: STARTED
[13:39:27.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923309638240660496:138:0) after 9m53s
[13:47:24.840] Received PubSub notification, asking Buildbucket for the build status
[13:47:24.859] Build:
{
"id": "8757879576007236001",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1938,
"createdBy": "project:chromium",
"createTime": "2024-01-26T01:23:24.391773891Z",
"startTime": "2024-01-26T01:23:25.918727Z",
"endTime": "2024-01-26T13:47:23.851946Z",
"updateTime": "2024-01-26T13:47:23.851946Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb",
"ref": "refs/heads/main"
}
}
}
[13:47:24.859] Invocation finished in 12h24m1.98155349s with status FAILED