[20:43:41.206] New invocation is queued and will start shortly
[20:43:42.354] Starting the invocation (attempt 1)
[20:43:42.396] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fd76d3de34a0704f55fd77623a431fb177892027"
[20:43:42.396] Popped gitiles commit info from properties and tags
[20:43:42.396] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:43:42.396] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:43:42.396] Buildbucket request:
{
"requestId": "8921424698820477888",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fd76d3de34a0704f55fd77623a431fb177892027",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8921424698820477888"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:43:43.001] Scheduled build:
{
"id": "8755994636818331745",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1979,
"createdBy": "project:chromium",
"createTime": "2024-02-15T20:43:42.483589332Z",
"updateTime": "2024-02-15T20:43:42.483589332Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fd76d3de34a0704f55fd77623a431fb177892027",
"ref": "refs/heads/main"
}
}
}
[20:43:43.001] Task URL: https://cr-buildbucket.appspot.com/build/8755994636818331745
[20:43:43.001] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:2:0) after 1m2s
[20:43:43.940] Received PubSub notification, asking Buildbucket for the build status
[20:43:43.998] Build status: SCHEDULED
[20:44:45.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:2:0)
[20:44:45.085] Build status: SCHEDULED
[20:44:45.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:4:0) after 3m47s
[20:48:32.263] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:4:0)
[20:48:32.300] Build status: SCHEDULED
[20:48:32.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:5:0) after 9m14s
[20:57:46.314] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:5:0)
[20:57:46.357] Build status: SCHEDULED
[20:57:46.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:6:0) after 1m13s
[20:58:59.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:6:0)
[20:58:59.436] Build status: SCHEDULED
[20:58:59.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:7:0) after 9m44s
[21:00:02.160] Received PubSub notification, asking Buildbucket for the build status
[21:00:02.214] Build status: STARTED
[21:08:43.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:7:0)
[21:08:43.535] Build status: STARTED
[21:08:43.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:9:0) after 2m12s
[21:10:55.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:9:0)
[21:10:55.735] Build status: STARTED
[21:10:55.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:10:0) after 7m0s
[21:17:56.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:10:0)
[21:17:56.601] Build status: STARTED
[21:17:56.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:11:0) after 5m5s
[21:23:02.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:11:0)
[21:23:02.237] Build status: STARTED
[21:23:02.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:12:0) after 6m46s
[21:29:48.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:12:0)
[21:29:48.313] Build status: STARTED
[21:29:48.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:13:0) after 8m32s
[21:38:20.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:13:0)
[21:38:20.322] Build status: STARTED
[21:38:20.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:14:0) after 9m43s
[21:48:03.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:14:0)
[21:48:03.403] Build status: STARTED
[21:48:03.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:15:0) after 8m8s
[21:56:11.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:15:0)
[21:56:11.498] Build status: STARTED
[21:56:11.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:16:0) after 9m32s
[22:05:43.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:16:0)
[22:05:43.672] Build status: STARTED
[22:05:43.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:17:0) after 8m5s
[22:13:49.110] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:17:0)
[22:13:49.129] Build status: STARTED
[22:13:49.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:18:0) after 6m17s
[22:20:06.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:18:0)
[22:20:06.525] Build status: STARTED
[22:20:06.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:19:0) after 9m39s
[22:29:45.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:19:0)
[22:29:45.649] Build status: STARTED
[22:29:45.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:20:0) after 4m39s
[22:34:25.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:20:0)
[22:34:25.106] Build status: STARTED
[22:34:25.106] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:21:0) after 3m45s
[22:38:10.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:21:0)
[22:38:10.156] Build status: STARTED
[22:38:10.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:22:0) after 2m40s
[22:40:50.360] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:22:0)
[22:40:50.436] Build status: STARTED
[22:40:50.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:23:0) after 5m49s
[22:46:39.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:23:0)
[22:46:39.550] Build status: STARTED
[22:46:39.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:24:0) after 5m18s
[22:51:57.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:24:0)
[22:51:57.593] Build status: STARTED
[22:51:57.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:25:0) after 3m57s
[22:55:54.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:25:0)
[22:55:54.740] Build status: STARTED
[22:55:54.740] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:26:0) after 4m49s
[23:00:43.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:26:0)
[23:00:43.923] Build status: STARTED
[23:00:43.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:27:0) after 6m33s
[23:07:17.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:27:0)
[23:07:17.081] Build status: STARTED
[23:07:17.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:28:0) after 7m38s
[23:14:55.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:28:0)
[23:14:55.134] Build status: STARTED
[23:14:55.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:29:0) after 1m10s
[23:16:05.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:29:0)
[23:16:05.193] Build status: STARTED
[23:16:05.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:30:0) after 7m26s
[23:23:31.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:30:0)
[23:23:31.266] Build status: STARTED
[23:23:31.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:31:0) after 7m53s
[23:31:24.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:31:0)
[23:31:24.337] Build status: STARTED
[23:31:24.337] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:32:0) after 5m22s
[23:36:46.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:32:0)
[23:36:46.356] Build status: STARTED
[23:36:46.356] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:33:0) after 7m41s
[23:44:27.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:33:0)
[23:44:27.419] Build status: STARTED
[23:44:27.419] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:34:0) after 5m5s
[23:49:33.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:34:0)
[23:49:33.169] Build status: STARTED
[23:49:33.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:35:0) after 8m16s
[23:57:49.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:35:0)
[23:57:49.629] Build status: STARTED
[23:57:49.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:36:0) after 8m59s
[00:06:48.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:36:0)
[00:06:48.767] Build status: STARTED
[00:06:48.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:37:0) after 5m5s
[00:11:53.810] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:37:0)
[00:11:53.851] Build status: STARTED
[00:11:53.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:38:0) after 6m15s
[00:18:09.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:38:0)
[00:18:09.091] Build status: STARTED
[00:18:09.091] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:39:0) after 4m0s
[00:22:09.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:39:0)
[00:22:09.263] Build status: STARTED
[00:22:09.263] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:40:0) after 4m32s
[00:26:41.314] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:40:0)
[00:26:41.335] Build status: STARTED
[00:26:41.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:41:0) after 6m16s
[00:32:57.691] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:41:0)
[00:32:57.800] Build status: STARTED
[00:32:57.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:42:0) after 2m11s
[00:35:08.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:42:0)
[00:35:08.991] Build status: STARTED
[00:35:08.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:43:0) after 8m7s
[00:43:16.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:43:0)
[00:43:16.176] Build status: STARTED
[00:43:16.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:44:0) after 6m39s
[00:49:55.207] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:44:0)
[00:49:55.233] Build status: STARTED
[00:49:55.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:45:0) after 1m7s
[00:51:02.349] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:45:0)
[00:51:02.368] Build status: STARTED
[00:51:02.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:46:0) after 5m29s
[00:56:32.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:46:0)
[00:56:32.148] Build status: STARTED
[00:56:32.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:47:0) after 3m37s
[01:00:09.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:47:0)
[01:00:09.430] Build status: STARTED
[01:00:09.430] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:48:0) after 6m47s
[01:06:56.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:48:0)
[01:06:56.462] Build status: STARTED
[01:06:56.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:49:0) after 6m57s
[01:13:53.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:49:0)
[01:13:53.884] Build status: STARTED
[01:13:53.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:50:0) after 5m44s
[01:19:37.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:50:0)
[01:19:37.968] Build status: STARTED
[01:19:37.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:51:0) after 2m42s
[01:22:20.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:51:0)
[01:22:20.104] Build status: STARTED
[01:22:20.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:52:0) after 6m8s
[01:28:28.132] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:52:0)
[01:28:28.165] Build status: STARTED
[01:28:28.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:53:0) after 8m15s
[01:36:43.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:53:0)
[01:36:43.420] Build status: STARTED
[01:36:43.421] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:54:0) after 8m8s
[01:44:51.458] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:54:0)
[01:44:51.482] Build status: STARTED
[01:44:51.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:55:0) after 6m5s
[01:50:56.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:55:0)
[01:50:56.565] Build status: STARTED
[01:50:56.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:56:0) after 9m19s
[02:00:15.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:56:0)
[02:00:15.726] Build status: STARTED
[02:00:15.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:57:0) after 5m41s
[02:05:56.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:57:0)
[02:05:56.822] Build status: STARTED
[02:05:56.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:58:0) after 4m17s
[02:10:13.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:58:0)
[02:10:13.892] Build status: STARTED
[02:10:13.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:59:0) after 8m47s
[02:19:01.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:59:0)
[02:19:01.421] Build status: STARTED
[02:19:01.421] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:60:0) after 1m20s
[02:20:21.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:60:0)
[02:20:21.469] Build status: STARTED
[02:20:21.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:61:0) after 7m54s
[02:28:15.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:61:0)
[02:28:15.889] Build status: STARTED
[02:28:15.889] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:62:0) after 3m46s
[02:32:02.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:62:0)
[02:32:02.174] Build status: STARTED
[02:32:02.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:63:0) after 6m28s
[02:38:30.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:63:0)
[02:38:30.392] Build status: STARTED
[02:38:30.392] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:64:0) after 8m11s
[02:46:41.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:64:0)
[02:46:41.455] Build status: STARTED
[02:46:41.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:65:0) after 1m56s
[02:48:37.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:65:0)
[02:48:37.556] Build status: STARTED
[02:48:37.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:66:0) after 6m11s
[02:54:48.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:66:0)
[02:54:48.898] Build status: STARTED
[02:54:48.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:67:0) after 8m27s
[03:03:16.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:67:0)
[03:03:16.169] Build status: STARTED
[03:03:16.172] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:68:0) after 3m16s
[03:06:32.208] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:68:0)
[03:06:32.253] Build status: STARTED
[03:06:32.253] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:69:0) after 8m37s
[03:15:09.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:69:0)
[03:15:09.805] Build status: STARTED
[03:15:09.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:70:0) after 4m20s
[03:19:29.975] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:70:0)
[03:19:29.997] Build status: STARTED
[03:19:29.997] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:71:0) after 3m52s
[03:23:22.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:71:0)
[03:23:22.436] Build status: STARTED
[03:23:22.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:72:0) after 8m26s
[03:31:48.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:72:0)
[03:31:48.483] Build status: STARTED
[03:31:48.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:73:0) after 9m8s
[03:40:56.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:73:0)
[03:40:56.703] Build status: STARTED
[03:40:56.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:74:0) after 5m25s
[03:46:21.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:74:0)
[03:46:21.759] Build status: STARTED
[03:46:21.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:75:0) after 6m8s
[03:52:29.862] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:75:0)
[03:52:29.941] Build status: STARTED
[03:52:29.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:76:0) after 3m43s
[03:56:13.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:76:0)
[03:56:13.033] Build status: STARTED
[03:56:13.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:77:0) after 1m55s
[03:58:08.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:77:0)
[03:58:08.341] Build status: STARTED
[03:58:08.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:78:0) after 5m50s
[04:03:58.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:78:0)
[04:03:58.905] Build status: STARTED
[04:03:58.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:79:0) after 9m26s
[04:13:25.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:79:0)
[04:13:25.336] Build status: STARTED
[04:13:25.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:80:0) after 8m5s
[04:21:30.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:80:0)
[04:21:30.533] Build status: STARTED
[04:21:30.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:81:0) after 2m5s
[04:23:35.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:81:0)
[04:23:35.639] Build status: STARTED
[04:23:35.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:82:0) after 2m18s
[04:25:53.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:82:0)
[04:25:53.690] Build status: STARTED
[04:25:53.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:83:0) after 4m23s
[04:30:16.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:83:0)
[04:30:16.862] Build status: STARTED
[04:30:16.862] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:84:0) after 8m3s
[04:38:19.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:84:0)
[04:38:19.928] Build status: STARTED
[04:38:19.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:85:0) after 8m40s
[04:47:00.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:85:0)
[04:47:00.110] Build status: STARTED
[04:47:00.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:86:0) after 3m56s
[04:50:56.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:86:0)
[04:50:56.269] Build status: STARTED
[04:50:56.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:87:0) after 2m24s
[04:53:20.507] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:87:0)
[04:53:20.531] Build status: STARTED
[04:53:20.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:88:0) after 2m31s
[04:55:51.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:88:0)
[04:55:51.990] Build status: STARTED
[04:55:51.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:89:0) after 5m48s
[05:01:40.326] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:89:0)
[05:01:40.361] Build status: STARTED
[05:01:40.361] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:90:0) after 7m37s
[05:09:17.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:90:0)
[05:09:17.530] Build status: STARTED
[05:09:17.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:91:0) after 4m54s
[05:14:11.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:91:0)
[05:14:11.598] Build status: STARTED
[05:14:11.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:92:0) after 9m24s
[05:23:35.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:92:0)
[05:23:35.832] Build status: STARTED
[05:23:35.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:93:0) after 4m8s
[05:27:43.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:93:0)
[05:27:43.914] Build status: STARTED
[05:27:43.914] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:94:0) after 9m30s
[05:37:13.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:94:0)
[05:37:13.972] Build status: STARTED
[05:37:13.972] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:95:0) after 9m29s
[05:46:43.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:95:0)
[05:46:43.128] Build status: STARTED
[05:46:43.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:96:0) after 3m1s
[05:49:44.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:96:0)
[05:49:44.239] Build status: STARTED
[05:49:44.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:97:0) after 9m11s
[05:58:55.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:97:0)
[05:58:55.362] Build status: STARTED
[05:58:55.363] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:98:0) after 5m24s
[06:04:19.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:98:0)
[06:04:19.546] Build status: STARTED
[06:04:19.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:99:0) after 1m41s
[06:06:00.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:99:0)
[06:06:00.737] Build status: STARTED
[06:06:00.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:100:0) after 2m49s
[06:08:49.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:100:0)
[06:08:49.838] Build status: STARTED
[06:08:49.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:101:0) after 9m6s
[06:17:55.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:101:0)
[06:17:55.975] Build status: STARTED
[06:17:55.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:102:0) after 6m38s
[06:24:34.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:102:0)
[06:24:34.049] Build status: STARTED
[06:24:34.049] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:103:0) after 4m29s
[06:29:03.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:103:0)
[06:29:03.456] Build status: STARTED
[06:29:03.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:104:0) after 8m42s
[06:37:45.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:104:0)
[06:37:45.626] Build status: STARTED
[06:37:45.626] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:105:0) after 4m51s
[06:42:36.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:105:0)
[06:42:36.773] Build status: STARTED
[06:42:36.773] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:106:0) after 4m23s
[06:46:59.805] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:106:0)
[06:46:59.828] Build status: STARTED
[06:46:59.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:107:0) after 6m13s
[06:53:12.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:107:0)
[06:53:12.884] Build status: STARTED
[06:53:12.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:108:0) after 5m28s
[06:58:40.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:108:0)
[06:58:40.995] Build status: STARTED
[06:58:40.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:109:0) after 5m47s
[07:04:28.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:109:0)
[07:04:28.415] Build status: STARTED
[07:04:28.415] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:110:0) after 2m44s
[07:07:12.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:110:0)
[07:07:12.550] Build status: STARTED
[07:07:12.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:111:0) after 5m32s
[07:12:44.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:111:0)
[07:12:44.601] Build status: STARTED
[07:12:44.601] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:112:0) after 1m25s
[07:14:09.767] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:112:0)
[07:14:09.793] Build status: STARTED
[07:14:09.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:113:0) after 7m57s
[07:22:07.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:113:0)
[07:22:07.132] Build status: STARTED
[07:22:07.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:114:0) after 7m57s
[07:30:04.258] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:114:0)
[07:30:04.433] Build status: STARTED
[07:30:04.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:115:0) after 1m12s
[07:31:16.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:115:0)
[07:31:16.507] Build status: STARTED
[07:31:16.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:116:0) after 2m11s
[07:33:27.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:116:0)
[07:33:27.674] Build status: STARTED
[07:33:27.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:117:0) after 8m23s
[07:41:50.705] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:117:0)
[07:41:50.726] Build status: STARTED
[07:41:50.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:118:0) after 5m57s
[07:47:47.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:118:0)
[07:47:48.011] Build status: STARTED
[07:47:48.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:119:0) after 6m47s
[07:54:35.091] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:119:0)
[07:54:35.112] Build status: STARTED
[07:54:35.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:120:0) after 9m51s
[08:04:26.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:120:0)
[08:04:26.245] Build status: STARTED
[08:04:26.245] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:121:0) after 7m1s
[08:11:27.376] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:121:0)
[08:11:27.433] Build status: STARTED
[08:11:27.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:122:0) after 5m34s
[08:17:01.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:122:0)
[08:17:01.516] Build status: STARTED
[08:17:01.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:123:0) after 7m14s
[08:24:15.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:123:0)
[08:24:15.742] Build status: STARTED
[08:24:15.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:124:0) after 8m43s
[08:32:58.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:124:0)
[08:32:58.893] Build status: STARTED
[08:32:58.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:125:0) after 2m16s
[08:35:15.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:125:0)
[08:35:15.100] Build status: STARTED
[08:35:15.100] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:126:0) after 6m23s
[08:41:38.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:126:0)
[08:41:38.242] Build status: STARTED
[08:41:38.242] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:127:0) after 6m47s
[08:48:25.305] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:127:0)
[08:48:25.330] Build status: STARTED
[08:48:25.330] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:128:0) after 3m31s
[08:51:56.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:128:0)
[08:51:56.608] Build status: STARTED
[08:51:56.608] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:129:0) after 4m18s
[08:56:14.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:129:0)
[08:56:14.707] Build status: STARTED
[08:56:14.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:130:0) after 8m25s
[09:04:39.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:130:0)
[09:04:39.872] Build status: STARTED
[09:04:39.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:131:0) after 8m3s
[09:12:43.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:131:0)
[09:12:43.033] Build status: STARTED
[09:12:43.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:132:0) after 9m34s
[09:22:17.117] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:132:0)
[09:22:17.157] Build status: STARTED
[09:22:17.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:133:0) after 8m56s
[09:31:13.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:133:0)
[09:31:13.443] Build status: STARTED
[09:31:13.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:134:0) after 3m16s
[09:34:29.536] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:134:0)
[09:34:29.666] Build status: STARTED
[09:34:29.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8921424698820477888:135:0) after 3m2s
[09:35:38.249] Received PubSub notification, asking Buildbucket for the build status
[09:35:38.269] Build:
{
"id": "8755994636818331745",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1979,
"createdBy": "project:chromium",
"createTime": "2024-02-15T20:43:42.483589332Z",
"startTime": "2024-02-15T21:00:01.148745Z",
"endTime": "2024-02-16T09:35:37.564688Z",
"updateTime": "2024-02-16T09:35:37.564688Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fd76d3de34a0704f55fd77623a431fb177892027",
"ref": "refs/heads/main"
}
}
}
[09:35:38.270] Invocation finished in 12h51m57.079971217s with status FAILED