[03:01:53.069] New invocation is queued and will start shortly
[03:01:54.163] Starting the invocation (attempt 1)
[03:01:54.190] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/6ca6a42c236b2187b3667ce688c358fd3400b4e6"
[03:01:54.190] Popped gitiles commit info from properties and tags
[03:01:54.190] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:01:54.190] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:01:54.190] Buildbucket request:
{
"requestId": "8923122247029287568",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ca6a42c236b2187b3667ce688c358fd3400b4e6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923122247029287568"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:01:54.743] Scheduled build:
{
"id": "8757692185135996033",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1942,
"createdBy": "project:chromium",
"createTime": "2024-01-28T03:01:54.252763994Z",
"updateTime": "2024-01-28T03:01:54.252763994Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ca6a42c236b2187b3667ce688c358fd3400b4e6",
"ref": "refs/heads/main"
}
}
}
[03:01:54.743] Task URL: https://cr-buildbucket.appspot.com/build/8757692185135996033
[03:01:54.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:2:0) after 6m37s
[03:08:32.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:2:0)
[03:08:32.389] Build status: STARTED
[03:08:32.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:3:0) after 5m2s
[03:13:34.408] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:3:0)
[03:13:34.435] Build status: STARTED
[03:13:34.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:4:0) after 4m22s
[03:17:56.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:4:0)
[03:17:56.605] Build status: STARTED
[03:17:56.605] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:5:0) after 2m17s
[03:20:13.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:5:0)
[03:20:13.767] Build status: STARTED
[03:20:13.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:6:0) after 6m59s
[03:25:22.734] Received PubSub notification, asking Buildbucket for the build status
[03:25:22.763] Build status: STARTED
[03:25:24.450] Received PubSub notification, asking Buildbucket for the build status
[03:25:24.476] Build status: STARTED
[03:27:13.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:6:0)
[03:27:13.220] Build status: STARTED
[03:27:13.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:9:0) after 9m58s
[03:37:11.317] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:9:0)
[03:37:11.337] Build status: STARTED
[03:37:11.337] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:10:0) after 2m6s
[03:39:17.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:10:0)
[03:39:17.532] Build status: STARTED
[03:39:17.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:11:0) after 6m24s
[03:45:41.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:11:0)
[03:45:41.587] Build status: STARTED
[03:45:41.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:12:0) after 7m29s
[03:53:10.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:12:0)
[03:53:10.785] Build status: STARTED
[03:53:10.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:13:0) after 9m50s
[04:03:00.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:13:0)
[04:03:00.956] Build status: STARTED
[04:03:00.956] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:14:0) after 4m34s
[04:07:35.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:14:0)
[04:07:35.180] Build status: STARTED
[04:07:35.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:15:0) after 3m44s
[04:11:19.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:15:0)
[04:11:19.221] Build status: STARTED
[04:11:19.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:16:0) after 7m55s
[04:19:14.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:16:0)
[04:19:14.367] Build status: STARTED
[04:19:14.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:17:0) after 4m16s
[04:23:30.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:17:0)
[04:23:30.437] Build status: STARTED
[04:23:30.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:18:0) after 6m43s
[04:30:13.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:18:0)
[04:30:13.482] Build status: STARTED
[04:30:13.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:19:0) after 8m10s
[04:38:23.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:19:0)
[04:38:23.690] Build status: STARTED
[04:38:23.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:20:0) after 3m32s
[04:41:55.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:20:0)
[04:41:55.730] Build status: STARTED
[04:41:55.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:21:0) after 4m24s
[04:46:19.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:21:0)
[04:46:19.782] Build status: STARTED
[04:46:19.782] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:22:0) after 8m31s
[04:54:50.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:22:0)
[04:54:50.823] Build status: STARTED
[04:54:50.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:23:0) after 3m28s
[04:58:18.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:23:0)
[04:58:18.860] Build status: STARTED
[04:58:18.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:24:0) after 1m8s
[04:59:26.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:24:0)
[04:59:26.894] Build status: STARTED
[04:59:26.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:25:0) after 2m16s
[05:01:42.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:25:0)
[05:01:42.936] Build status: STARTED
[05:01:42.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:26:0) after 1m30s
[05:03:12.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:26:0)
[05:03:12.999] Build status: STARTED
[05:03:12.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:27:0) after 3m52s
[05:07:05.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:27:0)
[05:07:05.083] Build status: STARTED
[05:07:05.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:28:0) after 4m41s
[05:11:46.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:28:0)
[05:11:46.148] Build status: STARTED
[05:11:46.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:29:0) after 3m1s
[05:14:47.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:29:0)
[05:14:47.192] Build status: STARTED
[05:14:47.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:30:0) after 3m55s
[05:18:42.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:30:0)
[05:18:42.370] Build status: STARTED
[05:18:42.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:31:0) after 7m32s
[05:26:14.391] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:31:0)
[05:26:14.434] Build status: STARTED
[05:26:14.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:32:0) after 6m54s
[05:33:08.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:32:0)
[05:33:08.478] Build status: STARTED
[05:33:08.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:33:0) after 3m1s
[05:36:09.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:33:0)
[05:36:09.718] Build status: STARTED
[05:36:09.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:34:0) after 6m19s
[05:42:28.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:34:0)
[05:42:28.811] Build status: STARTED
[05:42:28.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:35:0) after 3m7s
[05:45:36.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:35:0)
[05:45:36.122] Build status: STARTED
[05:45:36.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:36:0) after 9m0s
[05:54:36.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:36:0)
[05:54:36.246] Build status: STARTED
[05:54:36.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:37:0) after 5m0s
[05:59:36.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:37:0)
[05:59:36.319] Build status: STARTED
[05:59:36.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:38:0) after 8m40s
[06:08:16.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:38:0)
[06:08:16.378] Build status: STARTED
[06:08:16.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:39:0) after 2m20s
[06:10:36.417] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:39:0)
[06:10:36.451] Build status: STARTED
[06:10:36.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:40:0) after 1m18s
[06:11:54.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:40:0)
[06:11:54.511] Build status: STARTED
[06:11:54.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:41:0) after 6m57s
[06:18:51.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:41:0)
[06:18:51.653] Build status: STARTED
[06:18:51.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:42:0) after 9m17s
[06:28:08.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:42:0)
[06:28:08.722] Build status: STARTED
[06:28:08.722] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:43:0) after 2m9s
[06:30:17.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:43:0)
[06:30:17.791] Build status: STARTED
[06:30:17.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:44:0) after 5m28s
[06:35:45.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:44:0)
[06:35:45.835] Build status: STARTED
[06:35:45.835] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:45:0) after 6m47s
[06:42:32.984] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:45:0)
[06:42:33.002] Build status: STARTED
[06:42:33.003] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:46:0) after 8m51s
[06:51:24.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:46:0)
[06:51:24.057] Build status: STARTED
[06:51:24.057] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:47:0) after 7m16s
[06:58:40.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:47:0)
[06:58:40.160] Build status: STARTED
[06:58:40.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:48:0) after 6m6s
[07:04:46.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:48:0)
[07:04:46.228] Build status: STARTED
[07:04:46.228] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:49:0) after 5m26s
[07:10:12.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:49:0)
[07:10:12.270] Build status: STARTED
[07:10:12.270] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:50:0) after 7m30s
[07:17:42.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:50:0)
[07:17:42.309] Build status: STARTED
[07:17:42.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:51:0) after 8m48s
[07:26:30.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:51:0)
[07:26:30.370] Build status: STARTED
[07:26:30.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:52:0) after 5m11s
[07:31:41.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:52:0)
[07:31:41.410] Build status: STARTED
[07:31:41.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:53:0) after 5m11s
[07:36:52.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:53:0)
[07:36:52.448] Build status: STARTED
[07:36:52.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:54:0) after 1m38s
[07:38:30.464] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:54:0)
[07:38:30.484] Build status: STARTED
[07:38:30.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:55:0) after 9m8s
[07:47:39.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:55:0)
[07:47:39.266] Build status: STARTED
[07:47:39.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:56:0) after 3m50s
[07:51:29.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:56:0)
[07:51:29.350] Build status: STARTED
[07:51:29.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:57:0) after 7m42s
[07:59:11.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:57:0)
[07:59:11.447] Build status: STARTED
[07:59:11.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:58:0) after 6m12s
[08:05:23.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:58:0)
[08:05:23.956] Build status: STARTED
[08:05:23.956] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:59:0) after 7m35s
[08:12:59.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:59:0)
[08:12:59.275] Build status: STARTED
[08:12:59.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:60:0) after 5m14s
[08:18:13.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:60:0)
[08:18:13.316] Build status: STARTED
[08:18:13.316] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:61:0) after 7m38s
[08:25:51.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:61:0)
[08:25:51.379] Build status: STARTED
[08:25:51.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:62:0) after 6m58s
[08:32:49.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:62:0)
[08:32:49.495] Build status: STARTED
[08:32:49.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:63:0) after 6m54s
[08:39:43.651] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:63:0)
[08:39:43.690] Build status: STARTED
[08:39:43.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:64:0) after 3m27s
[08:43:10.709] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:64:0)
[08:43:10.727] Build status: STARTED
[08:43:10.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:65:0) after 8m22s
[08:51:32.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:65:0)
[08:51:32.806] Build status: STARTED
[08:51:32.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:66:0) after 5m21s
[08:56:53.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:66:0)
[08:56:53.844] Build status: STARTED
[08:56:53.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:67:0) after 2m38s
[08:59:31.861] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:67:0)
[08:59:31.881] Build status: STARTED
[08:59:31.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:68:0) after 9m23s
[09:08:55.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:68:0)
[09:08:55.149] Build status: STARTED
[09:08:55.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:69:0) after 7m17s
[09:16:12.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:69:0)
[09:16:12.321] Build status: STARTED
[09:16:12.321] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:70:0) after 2m28s
[09:18:40.319] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:70:0)
[09:18:40.342] Build status: STARTED
[09:18:40.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:71:0) after 3m44s
[09:22:24.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:71:0)
[09:22:24.465] Build status: STARTED
[09:22:24.465] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:72:0) after 8m18s
[09:30:42.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:72:0)
[09:30:42.525] Build status: STARTED
[09:30:42.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:73:0) after 6m38s
[09:37:20.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:73:0)
[09:37:20.560] Build status: STARTED
[09:37:20.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:74:0) after 6m4s
[09:43:24.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:74:0)
[09:43:24.602] Build status: STARTED
[09:43:24.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:75:0) after 8m26s
[09:51:50.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:75:0)
[09:51:50.661] Build status: STARTED
[09:51:50.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:76:0) after 8m42s
[10:00:32.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:76:0)
[10:00:32.707] Build status: STARTED
[10:00:32.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:77:0) after 9m5s
[10:09:37.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:77:0)
[10:09:37.905] Build status: STARTED
[10:09:37.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:78:0) after 9m19s
[10:18:57.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:78:0)
[10:18:57.437] Build status: STARTED
[10:18:57.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:79:0) after 6m53s
[10:25:50.458] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:79:0)
[10:25:50.493] Build status: STARTED
[10:25:50.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:80:0) after 5m52s
[10:31:42.861] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:80:0)
[10:31:42.882] Build status: STARTED
[10:31:42.882] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:81:0) after 8m24s
[10:40:06.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:81:0)
[10:40:06.945] Build status: STARTED
[10:40:06.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:82:0) after 5m52s
[10:45:58.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:82:0)
[10:45:59.000] Build status: STARTED
[10:45:59.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:83:0) after 5m36s
[10:51:35.033] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:83:0)
[10:51:35.051] Build status: STARTED
[10:51:35.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:84:0) after 9m6s
[11:00:41.365] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:84:0)
[11:00:41.398] Build status: STARTED
[11:00:41.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:85:0) after 4m47s
[11:05:28.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:85:0)
[11:05:28.565] Build status: STARTED
[11:05:28.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:86:0) after 8m4s
[11:13:32.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:86:0)
[11:13:32.705] Build status: STARTED
[11:13:32.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:87:0) after 3m53s
[11:17:25.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:87:0)
[11:17:25.745] Build status: STARTED
[11:17:25.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:88:0) after 6m50s
[11:24:15.791] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:88:0)
[11:24:15.806] Build status: STARTED
[11:24:15.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:89:0) after 5m25s
[11:29:41.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:89:0)
[11:29:41.109] Build status: STARTED
[11:29:41.109] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:90:0) after 2m35s
[11:32:16.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:90:0)
[11:32:16.564] Build status: STARTED
[11:32:16.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:91:0) after 5m55s
[11:38:11.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:91:0)
[11:38:11.611] Build status: STARTED
[11:38:11.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:92:0) after 6m0s
[11:44:11.642] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:92:0)
[11:44:11.680] Build status: STARTED
[11:44:11.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:93:0) after 9m4s
[11:53:15.744] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:93:0)
[11:53:15.788] Build status: STARTED
[11:53:15.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:94:0) after 4m57s
[11:58:12.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:94:0)
[11:58:12.919] Build status: STARTED
[11:58:12.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:95:0) after 2m37s
[12:00:49.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:95:0)
[12:00:49.961] Build status: STARTED
[12:00:49.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:96:0) after 8m36s
[12:09:25.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:96:0)
[12:09:26.006] Build status: STARTED
[12:09:26.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:97:0) after 5m34s
[12:15:00.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:97:0)
[12:15:00.767] Build status: STARTED
[12:15:00.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:98:0) after 1m19s
[12:16:19.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:98:0)
[12:16:19.879] Build status: STARTED
[12:16:19.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:99:0) after 2m30s
[12:18:49.900] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:99:0)
[12:18:49.921] Build status: STARTED
[12:18:49.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:100:0) after 3m24s
[12:22:14.228] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:100:0)
[12:22:14.256] Build status: STARTED
[12:22:14.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:101:0) after 4m58s
[12:27:12.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:101:0)
[12:27:12.296] Build status: STARTED
[12:27:12.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:102:0) after 4m31s
[12:31:43.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:102:0)
[12:31:43.375] Build status: STARTED
[12:31:43.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:103:0) after 3m48s
[12:35:31.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:103:0)
[12:35:31.644] Build status: STARTED
[12:35:31.644] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:104:0) after 9m35s
[12:45:06.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:104:0)
[12:45:06.702] Build status: STARTED
[12:45:06.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:105:0) after 9m49s
[12:54:55.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:105:0)
[12:54:55.765] Build status: STARTED
[12:54:55.765] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:106:0) after 6m50s
[13:01:45.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:106:0)
[13:01:45.816] Build status: STARTED
[13:01:45.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:107:0) after 4m4s
[13:05:49.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:107:0)
[13:05:49.941] Build status: STARTED
[13:05:49.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:108:0) after 6m23s
[13:12:12.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:108:0)
[13:12:12.993] Build status: STARTED
[13:12:12.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:109:0) after 3m26s
[13:15:39.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:109:0)
[13:15:39.334] Build status: STARTED
[13:15:39.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:110:0) after 2m1s
[13:17:40.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:110:0)
[13:17:40.542] Build status: STARTED
[13:17:40.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:111:0) after 6m43s
[13:24:24.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:111:0)
[13:24:24.440] Build status: STARTED
[13:24:24.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:112:0) after 5m52s
[13:30:16.495] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:112:0)
[13:30:16.516] Build status: STARTED
[13:30:16.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:113:0) after 9m23s
[13:39:39.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:113:0)
[13:39:39.679] Build status: STARTED
[13:39:39.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:114:0) after 2m0s
[13:41:39.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:114:0)
[13:41:39.721] Build status: STARTED
[13:41:39.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:115:0) after 1m6s
[13:42:45.744] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:115:0)
[13:42:45.770] Build status: STARTED
[13:42:45.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:116:0) after 7m28s
[13:50:13.798] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:116:0)
[13:50:13.821] Build status: STARTED
[13:50:13.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:117:0) after 8m9s
[13:58:22.855] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:117:0)
[13:58:22.957] Build status: STARTED
[13:58:22.957] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:118:0) after 3m1s
[14:01:23.975] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:118:0)
[14:01:24.016] Build status: STARTED
[14:01:24.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:119:0) after 1m19s
[14:02:43.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:119:0)
[14:02:43.062] Build status: STARTED
[14:02:43.062] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:120:0) after 4m34s
[14:07:17.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:120:0)
[14:07:17.110] Build status: STARTED
[14:07:17.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:121:0) after 1m32s
[14:08:49.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:121:0)
[14:08:49.247] Build status: STARTED
[14:08:49.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:122:0) after 7m52s
[14:16:41.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:122:0)
[14:16:41.311] Build status: STARTED
[14:16:41.311] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:123:0) after 6m40s
[14:23:21.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:123:0)
[14:23:21.359] Build status: STARTED
[14:23:21.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:124:0) after 3m39s
[14:27:00.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:124:0)
[14:27:00.509] Build status: STARTED
[14:27:00.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:125:0) after 4m1s
[14:31:01.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:125:0)
[14:31:01.703] Build status: STARTED
[14:31:01.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:126:0) after 5m37s
[14:36:38.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:126:0)
[14:36:38.767] Build status: STARTED
[14:36:38.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:127:0) after 2m32s
[14:39:10.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:127:0)
[14:39:10.852] Build status: STARTED
[14:39:10.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:128:0) after 1m25s
[14:40:35.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:128:0)
[14:40:35.896] Build status: STARTED
[14:40:35.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:129:0) after 7m30s
[14:48:05.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:129:0)
[14:48:05.993] Build status: STARTED
[14:48:05.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:130:0) after 4m38s
[14:52:44.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:130:0)
[14:52:44.072] Build status: STARTED
[14:52:44.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:131:0) after 7m14s
[14:59:58.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:131:0)
[14:59:58.156] Build status: STARTED
[14:59:58.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:132:0) after 2m57s
[15:02:55.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:132:0)
[15:02:55.233] Build status: STARTED
[15:02:55.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:133:0) after 7m8s
[15:10:03.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:133:0)
[15:10:03.339] Build status: STARTED
[15:10:03.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:134:0) after 5m28s
[15:15:31.367] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:134:0)
[15:15:31.395] Build status: STARTED
[15:15:31.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:135:0) after 7m16s
[15:22:47.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:135:0)
[15:22:47.460] Build status: STARTED
[15:22:47.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:136:0) after 3m4s
[15:25:51.480] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:136:0)
[15:25:51.533] Build status: STARTED
[15:25:51.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:137:0) after 2m50s
[15:28:41.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:137:0)
[15:28:41.586] Build status: STARTED
[15:28:41.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:138:0) after 3m58s
[15:32:39.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:138:0)
[15:32:39.627] Build status: STARTED
[15:32:39.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923122247029287568:139:0) after 2m43s
[15:33:00.841] Received PubSub notification, asking Buildbucket for the build status
[15:33:00.861] Build:
{
"id": "8757692185135996033",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1942,
"createdBy": "project:chromium",
"createTime": "2024-01-28T03:01:54.252763994Z",
"startTime": "2024-01-28T03:01:55.590593Z",
"endTime": "2024-01-28T15:32:59.441336Z",
"updateTime": "2024-01-28T15:32:59.441336Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "6ca6a42c236b2187b3667ce688c358fd3400b4e6",
"ref": "refs/heads/main"
}
}
}
[15:33:00.861] Invocation finished in 12h31m7.79882146s with status FAILED