[20:54:17.051] New invocation is queued and will start shortly
[20:54:18.600] Starting the invocation (attempt 1)
[20:54:18.637] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/16f7de1fdbba162e647789b1e581e59e0ea24254"
[20:54:18.637] Popped gitiles commit info from properties and tags
[20:54:18.637] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:54:18.637] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:54:18.638] Buildbucket request:
{
"requestId": "8925953880398412576",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "16f7de1fdbba162e647789b1e581e59e0ea24254",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925953880398412576"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:54:19.246] Scheduled build:
{
"id": "8760523818004518465",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1879,
"createdBy": "project:chromium",
"createTime": "2023-12-27T20:54:18.711369820Z",
"updateTime": "2023-12-27T20:54:18.711369820Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "16f7de1fdbba162e647789b1e581e59e0ea24254",
"ref": "refs/heads/main"
}
}
}
[20:54:19.246] Task URL: https://cr-buildbucket.appspot.com/build/8760523818004518465
[20:54:19.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:2:0) after 2m2s
[20:54:19.429] Received PubSub notification, asking Buildbucket for the build status
[20:54:19.494] Build status: SCHEDULED
[20:54:21.282] Received PubSub notification, asking Buildbucket for the build status
[20:54:21.307] Build status: STARTED
[20:56:21.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:2:0)
[20:56:21.287] Build status: STARTED
[20:56:21.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:5:0) after 5m55s
[21:02:16.622] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:5:0)
[21:02:16.676] Build status: STARTED
[21:02:16.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:6:0) after 8m3s
[21:10:19.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:6:0)
[21:10:19.758] Build status: STARTED
[21:10:19.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:7:0) after 1m2s
[21:11:21.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:7:0)
[21:11:21.912] Build status: STARTED
[21:11:21.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:8:0) after 5m32s
[21:16:54.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:8:0)
[21:16:54.051] Build status: STARTED
[21:16:54.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:9:0) after 7m43s
[21:24:37.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:9:0)
[21:24:37.120] Build status: STARTED
[21:24:37.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:10:0) after 6m14s
[21:30:51.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:10:0)
[21:30:51.320] Build status: STARTED
[21:30:51.320] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:11:0) after 9m39s
[21:40:30.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:11:0)
[21:40:30.358] Build status: STARTED
[21:40:30.358] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:12:0) after 2m41s
[21:43:11.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:12:0)
[21:43:11.527] Build status: STARTED
[21:43:11.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:13:0) after 6m28s
[21:49:39.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:13:0)
[21:49:39.641] Build status: STARTED
[21:49:39.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:14:0) after 5m47s
[21:55:26.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:14:0)
[21:55:26.717] Build status: STARTED
[21:55:26.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:15:0) after 6m27s
[22:01:53.767] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:15:0)
[22:01:53.792] Build status: STARTED
[22:01:53.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:16:0) after 9m12s
[22:11:05.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:16:0)
[22:11:05.880] Build status: STARTED
[22:11:05.880] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:17:0) after 3m58s
[22:15:04.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:17:0)
[22:15:04.123] Build status: STARTED
[22:15:04.123] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:18:0) after 7m52s
[22:22:56.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:18:0)
[22:22:56.258] Build status: STARTED
[22:22:56.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:19:0) after 5m0s
[22:27:56.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:19:0)
[22:27:56.444] Build status: STARTED
[22:27:56.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:20:0) after 5m47s
[22:33:43.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:20:0)
[22:33:43.537] Build status: STARTED
[22:33:43.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:21:0) after 3m37s
[22:37:20.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:21:0)
[22:37:20.827] Build status: STARTED
[22:37:20.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:22:0) after 4m5s
[22:41:25.853] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:22:0)
[22:41:25.872] Build status: STARTED
[22:41:25.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:23:0) after 7m57s
[22:49:23.091] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:23:0)
[22:49:23.127] Build status: STARTED
[22:49:23.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:24:0) after 2m52s
[22:52:15.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:24:0)
[22:52:15.305] Build status: STARTED
[22:52:15.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:25:0) after 3m19s
[22:55:34.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:25:0)
[22:55:34.387] Build status: STARTED
[22:55:34.387] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:26:0) after 5m16s
[23:00:50.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:26:0)
[23:00:50.487] Build status: STARTED
[23:00:50.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:27:0) after 4m59s
[23:05:49.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:27:0)
[23:05:49.553] Build status: STARTED
[23:05:49.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:28:0) after 7m13s
[23:13:02.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:28:0)
[23:13:02.619] Build status: STARTED
[23:13:02.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:29:0) after 4m58s
[23:18:00.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:29:0)
[23:18:00.669] Build status: STARTED
[23:18:00.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:30:0) after 5m33s
[23:23:33.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:30:0)
[23:23:33.958] Build status: STARTED
[23:23:33.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:31:0) after 8m24s
[23:31:58.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:31:0)
[23:31:58.189] Build status: STARTED
[23:31:58.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:32:0) after 8m44s
[23:40:42.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:32:0)
[23:40:42.275] Build status: STARTED
[23:40:42.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:33:0) after 6m45s
[23:47:27.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:33:0)
[23:47:27.460] Build status: STARTED
[23:47:27.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:34:0) after 9m13s
[23:56:40.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:34:0)
[23:56:40.563] Build status: STARTED
[23:56:40.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:35:0) after 1m19s
[23:57:59.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:35:0)
[23:57:59.703] Build status: STARTED
[23:57:59.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:36:0) after 8m46s
[00:06:45.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:36:0)
[00:06:45.764] Build status: STARTED
[00:06:45.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:37:0) after 3m30s
[00:10:15.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:37:0)
[00:10:15.842] Build status: STARTED
[00:10:15.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:38:0) after 1m6s
[00:11:21.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:38:0)
[00:11:21.891] Build status: STARTED
[00:11:21.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:39:0) after 4m59s
[00:16:20.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:39:0)
[00:16:21.036] Build status: STARTED
[00:16:21.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:40:0) after 9m58s
[00:26:19.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:40:0)
[00:26:19.183] Build status: STARTED
[00:26:19.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:41:0) after 4m57s
[00:31:16.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:41:0)
[00:31:16.219] Build status: STARTED
[00:31:16.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:42:0) after 6m0s
[00:37:16.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:42:0)
[00:37:16.387] Build status: STARTED
[00:37:16.387] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:43:0) after 8m25s
[00:45:41.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:43:0)
[00:45:41.472] Build status: STARTED
[00:45:41.472] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:44:0) after 3m14s
[00:48:55.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:44:0)
[00:48:55.542] Build status: STARTED
[00:48:55.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:45:0) after 1m8s
[00:50:03.574] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:45:0)
[00:50:03.606] Build status: STARTED
[00:50:03.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:46:0) after 3m57s
[00:54:00.731] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:46:0)
[00:54:00.804] Build status: STARTED
[00:54:00.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:47:0) after 5m56s
[00:59:56.836] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:47:0)
[00:59:56.863] Build status: STARTED
[00:59:56.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:48:0) after 2m23s
[01:02:20.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:48:0)
[01:02:20.258] Build status: STARTED
[01:02:20.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:49:0) after 1m12s
[01:03:32.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:49:0)
[01:03:32.293] Build status: STARTED
[01:03:32.293] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:50:0) after 4m7s
[01:07:39.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:50:0)
[01:07:39.544] Build status: STARTED
[01:07:39.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:51:0) after 1m45s
[01:09:24.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:51:0)
[01:09:24.608] Build status: STARTED
[01:09:24.608] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:52:0) after 7m14s
[01:16:38.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:52:0)
[01:16:38.925] Build status: STARTED
[01:16:38.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:53:0) after 4m30s
[01:21:09.078] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:53:0)
[01:21:09.111] Build status: STARTED
[01:21:09.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:54:0) after 6m41s
[01:27:50.243] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:54:0)
[01:27:50.263] Build status: STARTED
[01:27:50.263] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:55:0) after 9m19s
[01:37:09.282] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:55:0)
[01:37:09.333] Build status: STARTED
[01:37:09.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:56:0) after 2m6s
[01:39:15.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:56:0)
[01:39:15.519] Build status: STARTED
[01:39:15.519] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:57:0) after 7m47s
[01:47:02.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:57:0)
[01:47:02.598] Build status: STARTED
[01:47:02.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:58:0) after 3m46s
[01:50:48.623] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:58:0)
[01:50:48.760] Build status: STARTED
[01:50:48.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:59:0) after 8m58s
[01:59:46.784] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:59:0)
[01:59:46.833] Build status: STARTED
[01:59:46.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:60:0) after 1m30s
[02:01:16.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:60:0)
[02:01:16.970] Build status: STARTED
[02:01:16.970] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:61:0) after 4m1s
[02:05:18.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:61:0)
[02:05:18.232] Build status: STARTED
[02:05:18.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:62:0) after 1m18s
[02:06:36.408] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:62:0)
[02:06:36.520] Build status: STARTED
[02:06:36.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:63:0) after 5m5s
[02:11:41.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:63:0)
[02:11:41.579] Build status: STARTED
[02:11:41.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:64:0) after 7m26s
[02:19:07.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:64:0)
[02:19:07.627] Build status: STARTED
[02:19:07.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:65:0) after 5m51s
[02:24:58.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:65:0)
[02:24:58.911] Build status: STARTED
[02:24:58.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:66:0) after 7m21s
[02:32:20.168] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:66:0)
[02:32:20.196] Build status: STARTED
[02:32:20.196] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:67:0) after 9m5s
[02:41:25.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:67:0)
[02:41:25.247] Build status: STARTED
[02:41:25.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:68:0) after 5m36s
[02:47:01.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:68:0)
[02:47:01.310] Build status: STARTED
[02:47:01.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:69:0) after 2m47s
[02:49:48.336] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:69:0)
[02:49:48.355] Build status: STARTED
[02:49:48.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:70:0) after 7m10s
[02:56:58.714] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:70:0)
[02:56:58.736] Build status: STARTED
[02:56:58.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:71:0) after 9m30s
[03:06:28.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:71:0)
[03:06:28.798] Build status: STARTED
[03:06:28.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:72:0) after 6m17s
[03:12:45.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:72:0)
[03:12:45.849] Build status: STARTED
[03:12:45.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:73:0) after 7m28s
[03:20:13.869] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:73:0)
[03:20:14.008] Build status: STARTED
[03:20:14.008] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:74:0) after 2m57s
[03:23:11.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:74:0)
[03:23:11.151] Build status: STARTED
[03:23:11.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:75:0) after 2m19s
[03:25:30.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:75:0)
[03:25:30.198] Build status: STARTED
[03:25:30.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:76:0) after 9m29s
[03:34:59.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:76:0)
[03:34:59.303] Build status: STARTED
[03:34:59.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:77:0) after 4m6s
[03:39:05.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:77:0)
[03:39:05.548] Build status: STARTED
[03:39:05.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:78:0) after 2m8s
[03:41:13.679] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:78:0)
[03:41:13.748] Build status: STARTED
[03:41:13.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:79:0) after 8m11s
[03:49:24.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:79:0)
[03:49:24.949] Build status: STARTED
[03:49:24.949] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:80:0) after 9m47s
[03:59:12.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:80:0)
[03:59:12.238] Build status: STARTED
[03:59:12.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:81:0) after 3m43s
[04:02:55.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:81:0)
[04:02:55.477] Build status: STARTED
[04:02:55.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:82:0) after 7m48s
[04:10:43.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:82:0)
[04:10:43.717] Build status: STARTED
[04:10:43.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:83:0) after 5m2s
[04:15:45.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:83:0)
[04:15:45.792] Build status: STARTED
[04:15:45.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:84:0) after 8m45s
[04:24:30.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:84:0)
[04:24:30.847] Build status: STARTED
[04:24:30.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:85:0) after 5m32s
[04:30:02.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:85:0)
[04:30:02.892] Build status: STARTED
[04:30:02.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:86:0) after 7m33s
[04:37:35.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:86:0)
[04:37:35.952] Build status: STARTED
[04:37:35.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:87:0) after 2m23s
[04:39:59.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:87:0)
[04:39:59.037] Build status: STARTED
[04:39:59.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:88:0) after 5m49s
[04:45:48.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:88:0)
[04:45:48.168] Build status: STARTED
[04:45:48.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:89:0) after 2m3s
[04:47:51.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:89:0)
[04:47:51.264] Build status: STARTED
[04:47:51.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:90:0) after 4m8s
[04:51:59.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:90:0)
[04:51:59.313] Build status: STARTED
[04:51:59.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:91:0) after 3m55s
[04:55:54.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:91:0)
[04:55:54.407] Build status: STARTED
[04:55:54.407] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:92:0) after 6m5s
[05:01:59.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:92:0)
[05:01:59.548] Build status: STARTED
[05:01:59.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:93:0) after 9m29s
[05:11:28.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:93:0)
[05:11:28.841] Build status: STARTED
[05:11:28.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:94:0) after 6m44s
[05:18:12.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:94:0)
[05:18:12.893] Build status: STARTED
[05:18:12.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:95:0) after 4m42s
[05:22:54.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:95:0)
[05:22:54.937] Build status: STARTED
[05:22:54.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:96:0) after 1m0s
[05:23:54.960] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:96:0)
[05:23:54.978] Build status: STARTED
[05:23:54.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:97:0) after 4m19s
[05:28:13.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:97:0)
[05:28:14.014] Build status: STARTED
[05:28:14.014] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:98:0) after 6m15s
[05:34:29.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:98:0)
[05:34:29.264] Build status: STARTED
[05:34:29.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:99:0) after 7m27s
[05:41:56.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:99:0)
[05:41:56.312] Build status: STARTED
[05:41:56.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:100:0) after 2m7s
[05:44:03.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:100:0)
[05:44:03.473] Build status: STARTED
[05:44:03.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:101:0) after 4m33s
[05:48:36.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:101:0)
[05:48:36.665] Build status: STARTED
[05:48:36.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:102:0) after 8m3s
[05:56:39.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:102:0)
[05:56:39.699] Build status: STARTED
[05:56:39.699] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:103:0) after 9m48s
[06:06:27.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:103:0)
[06:06:27.948] Build status: STARTED
[06:06:27.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:104:0) after 9m13s
[06:15:41.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:104:0)
[06:15:41.104] Build status: STARTED
[06:15:41.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:105:0) after 3m17s
[06:18:58.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:105:0)
[06:18:58.149] Build status: STARTED
[06:18:58.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:106:0) after 4m58s
[06:23:56.461] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:106:0)
[06:23:56.484] Build status: STARTED
[06:23:56.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:107:0) after 5m1s
[06:28:57.656] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:107:0)
[06:28:57.675] Build status: STARTED
[06:28:57.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:108:0) after 7m52s
[06:36:49.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:108:0)
[06:36:49.719] Build status: STARTED
[06:36:49.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:109:0) after 1m26s
[06:38:15.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:109:0)
[06:38:15.770] Build status: STARTED
[06:38:15.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:110:0) after 6m5s
[06:44:20.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:110:0)
[06:44:20.844] Build status: STARTED
[06:44:20.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:111:0) after 6m37s
[06:50:57.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:111:0)
[06:50:57.897] Build status: STARTED
[06:50:57.897] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:112:0) after 6m49s
[06:57:46.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:112:0)
[06:57:46.949] Build status: STARTED
[06:57:46.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:113:0) after 8m24s
[07:06:11.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:113:0)
[07:06:11.076] Build status: STARTED
[07:06:11.076] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:114:0) after 4m36s
[07:10:47.094] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:114:0)
[07:10:47.112] Build status: STARTED
[07:10:47.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:115:0) after 9m25s
[07:20:12.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:115:0)
[07:20:12.255] Build status: STARTED
[07:20:12.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:116:0) after 4m6s
[07:24:18.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:116:0)
[07:24:18.357] Build status: STARTED
[07:24:18.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:117:0) after 2m0s
[07:26:18.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:117:0)
[07:26:18.471] Build status: STARTED
[07:26:18.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:118:0) after 3m48s
[07:30:06.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:118:0)
[07:30:06.645] Build status: STARTED
[07:30:06.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:119:0) after 4m54s
[07:35:00.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:119:0)
[07:35:00.944] Build status: STARTED
[07:35:00.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:120:0) after 4m34s
[07:39:35.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:120:0)
[07:39:35.349] Build status: STARTED
[07:39:35.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:121:0) after 5m10s
[07:44:45.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:121:0)
[07:44:45.385] Build status: STARTED
[07:44:45.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:122:0) after 7m14s
[07:51:59.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:122:0)
[07:51:59.590] Build status: STARTED
[07:51:59.590] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:123:0) after 4m29s
[07:56:28.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:123:0)
[07:56:28.720] Build status: STARTED
[07:56:28.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:124:0) after 7m59s
[08:04:27.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:124:0)
[08:04:27.821] Build status: STARTED
[08:04:27.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:125:0) after 7m14s
[08:11:41.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:125:0)
[08:11:41.865] Build status: STARTED
[08:11:41.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:126:0) after 9m19s
[08:21:00.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:126:0)
[08:21:01.003] Build status: STARTED
[08:21:01.003] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:127:0) after 8m57s
[08:29:58.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:127:0)
[08:29:58.079] Build status: STARTED
[08:29:58.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:128:0) after 1m53s
[08:31:51.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:128:0)
[08:31:51.385] Build status: STARTED
[08:31:51.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:129:0) after 9m26s
[08:41:17.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:129:0)
[08:41:17.496] Build status: STARTED
[08:41:17.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:130:0) after 2m15s
[08:43:32.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:130:0)
[08:43:32.540] Build status: STARTED
[08:43:32.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:131:0) after 7m51s
[08:51:23.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:131:0)
[08:51:23.799] Build status: STARTED
[08:51:23.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:132:0) after 4m44s
[08:56:07.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:132:0)
[08:56:07.885] Build status: STARTED
[08:56:07.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:133:0) after 1m55s
[08:58:02.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:133:0)
[08:58:02.944] Build status: STARTED
[08:58:02.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:134:0) after 6m26s
[09:04:28.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:134:0)
[09:04:29.032] Build status: STARTED
[09:04:29.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:135:0) after 7m47s
[09:12:16.235] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:135:0)
[09:12:16.346] Build status: STARTED
[09:12:16.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925953880398412576:136:0) after 6m53s
[09:15:29.942] Received PubSub notification, asking Buildbucket for the build status
[09:15:29.961] Build:
{
"id": "8760523818004518465",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1879,
"createdBy": "project:chromium",
"createTime": "2023-12-27T20:54:18.711369820Z",
"startTime": "2023-12-27T20:54:20.548999Z",
"endTime": "2023-12-28T09:15:19.068253Z",
"updateTime": "2023-12-28T09:15:19.068253Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "16f7de1fdbba162e647789b1e581e59e0ea24254",
"ref": "refs/heads/main"
}
}
}
[09:15:29.961] Invocation finished in 12h21m12.916071701s with status FAILED