[20:49:48.587] New invocation is queued and will start shortly
[20:49:49.706] Starting the invocation (attempt 1)
[20:49:49.745] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7831dd03d200ef1fefbd0814c92ba5101f558328"
[20:49:49.745] Popped gitiles commit info from properties and tags
[20:49:49.745] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:49:49.745] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:49:49.746] Buildbucket request:
{
"requestId": "8922602074147526208",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7831dd03d200ef1fefbd0814c92ba5101f558328",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922602074147526208"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:49:51.455] Scheduled build:
{
"id": "8757172012044494449",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1954,
"createdBy": "project:chromium",
"createTime": "2024-02-02T20:49:49.969529900Z",
"updateTime": "2024-02-02T20:49:49.969529900Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7831dd03d200ef1fefbd0814c92ba5101f558328",
"ref": "refs/heads/main"
}
}
}
[20:49:51.455] Task URL: https://cr-buildbucket.appspot.com/build/8757172012044494449
[20:49:51.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:2:0) after 5m16s
[20:49:53.521] Received PubSub notification, asking Buildbucket for the build status
[20:49:53.547] Build status: SCHEDULED
[20:50:54.310] Received PubSub notification, asking Buildbucket for the build status
[20:50:54.336] Build status: STARTED
[20:55:07.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:2:0)
[20:55:07.509] Build status: STARTED
[20:55:07.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:5:0) after 3m9s
[20:58:16.544] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:5:0)
[20:58:16.570] Build status: STARTED
[20:58:16.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:6:0) after 8m7s
[21:06:23.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:6:0)
[21:06:23.686] Build status: STARTED
[21:06:23.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:7:0) after 2m17s
[21:08:40.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:7:0)
[21:08:40.749] Build status: STARTED
[21:08:40.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:8:0) after 1m58s
[21:10:38.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:8:0)
[21:10:38.812] Build status: STARTED
[21:10:38.812] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:9:0) after 8m40s
[21:19:18.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:9:0)
[21:19:18.929] Build status: STARTED
[21:19:18.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:10:0) after 6m12s
[21:25:30.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:10:0)
[21:25:30.998] Build status: STARTED
[21:25:30.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:11:0) after 6m41s
[21:32:12.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:11:0)
[21:32:12.092] Build status: STARTED
[21:32:12.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:12:0) after 8m50s
[21:41:02.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:12:0)
[21:41:02.156] Build status: STARTED
[21:41:02.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:13:0) after 6m33s
[21:47:35.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:13:0)
[21:47:35.319] Build status: STARTED
[21:47:35.319] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:14:0) after 9m16s
[21:56:51.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:14:0)
[21:56:51.466] Build status: STARTED
[21:56:51.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:15:0) after 9m14s
[22:06:05.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:15:0)
[22:06:05.646] Build status: STARTED
[22:06:05.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:16:0) after 2m43s
[22:08:48.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:16:0)
[22:08:48.961] Build status: STARTED
[22:08:48.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:17:0) after 1m50s
[22:10:39.120] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:17:0)
[22:10:39.146] Build status: STARTED
[22:10:39.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:18:0) after 4m32s
[22:15:11.150] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:18:0)
[22:15:11.220] Build status: STARTED
[22:15:11.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:19:0) after 1m44s
[22:16:55.282] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:19:0)
[22:16:55.308] Build status: STARTED
[22:16:55.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:20:0) after 3m17s
[22:20:12.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:20:0)
[22:20:12.354] Build status: STARTED
[22:20:12.354] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:21:0) after 9m8s
[22:29:20.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:21:0)
[22:29:20.502] Build status: STARTED
[22:29:20.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:22:0) after 1m36s
[22:30:56.646] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:22:0)
[22:30:56.687] Build status: STARTED
[22:30:56.687] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:23:0) after 2m25s
[22:33:21.683] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:23:0)
[22:33:21.706] Build status: STARTED
[22:33:21.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:24:0) after 3m9s
[22:36:30.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:24:0)
[22:36:30.802] Build status: STARTED
[22:36:30.802] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:25:0) after 8m6s
[22:44:36.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:25:0)
[22:44:36.813] Build status: STARTED
[22:44:36.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:26:0) after 9m41s
[22:54:17.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:26:0)
[22:54:17.831] Build status: STARTED
[22:54:17.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:27:0) after 4m39s
[22:58:56.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:27:0)
[22:58:57.006] Build status: STARTED
[22:58:57.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:28:0) after 5m35s
[23:04:32.488] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:28:0)
[23:04:32.531] Build status: STARTED
[23:04:32.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:29:0) after 8m55s
[23:13:28.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:29:0)
[23:13:28.027] Build status: STARTED
[23:13:28.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:30:0) after 6m29s
[23:19:57.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:30:0)
[23:19:57.131] Build status: STARTED
[23:19:57.131] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:31:0) after 3m40s
[23:23:37.220] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:31:0)
[23:23:37.257] Build status: STARTED
[23:23:37.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:32:0) after 3m36s
[23:27:13.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:32:0)
[23:27:13.334] Build status: STARTED
[23:27:13.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:33:0) after 5m47s
[23:33:00.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:33:0)
[23:33:00.493] Build status: STARTED
[23:33:00.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:34:0) after 9m32s
[23:42:32.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:34:0)
[23:42:32.874] Build status: STARTED
[23:42:32.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:35:0) after 5m30s
[23:48:02.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:35:0)
[23:48:02.930] Build status: STARTED
[23:48:02.930] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:36:0) after 9m2s
[23:57:04.960] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:36:0)
[23:57:04.987] Build status: STARTED
[23:57:04.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:37:0) after 2m20s
[23:59:25.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:37:0)
[23:59:25.031] Build status: STARTED
[23:59:25.031] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:38:0) after 9m51s
[00:09:16.344] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:38:0)
[00:09:16.366] Build status: STARTED
[00:09:16.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:39:0) after 3m2s
[00:12:18.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:39:0)
[00:12:18.437] Build status: STARTED
[00:12:18.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:40:0) after 2m42s
[00:15:00.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:40:0)
[00:15:00.572] Build status: STARTED
[00:15:00.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:41:0) after 2m7s
[00:17:07.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:41:0)
[00:17:07.666] Build status: STARTED
[00:17:07.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:42:0) after 4m30s
[00:21:37.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:42:0)
[00:21:37.895] Build status: STARTED
[00:21:37.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:43:0) after 2m25s
[00:24:02.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:43:0)
[00:24:02.979] Build status: STARTED
[00:24:02.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:44:0) after 3m31s
[00:27:34.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:44:0)
[00:27:35.020] Build status: STARTED
[00:27:35.021] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:45:0) after 1m27s
[00:29:02.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:45:0)
[00:29:02.124] Build status: STARTED
[00:29:02.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:46:0) after 1m1s
[00:30:03.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:46:0)
[00:30:03.219] Build status: STARTED
[00:30:03.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:47:0) after 7m55s
[00:37:58.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:47:0)
[00:37:58.260] Build status: STARTED
[00:37:58.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:48:0) after 2m12s
[00:40:10.282] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:48:0)
[00:40:10.299] Build status: STARTED
[00:40:10.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:49:0) after 1m6s
[00:41:16.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:49:0)
[00:41:16.368] Build status: STARTED
[00:41:16.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:50:0) after 3m15s
[00:44:31.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:50:0)
[00:44:31.437] Build status: STARTED
[00:44:31.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:51:0) after 4m6s
[00:48:37.526] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:51:0)
[00:48:37.544] Build status: STARTED
[00:48:37.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:52:0) after 2m54s
[00:51:31.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:52:0)
[00:51:31.810] Build status: STARTED
[00:51:31.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:53:0) after 7m33s
[00:59:04.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:53:0)
[00:59:04.868] Build status: STARTED
[00:59:04.868] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:54:0) after 3m56s
[01:03:00.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:54:0)
[01:03:01.005] Build status: STARTED
[01:03:01.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:55:0) after 9m26s
[01:12:27.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:55:0)
[01:12:27.223] Build status: STARTED
[01:12:27.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:56:0) after 1m15s
[01:13:42.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:56:0)
[01:13:42.278] Build status: STARTED
[01:13:42.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:57:0) after 6m44s
[01:20:26.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:57:0)
[01:20:26.383] Build status: STARTED
[01:20:26.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:58:0) after 7m0s
[01:27:26.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:58:0)
[01:27:26.452] Build status: STARTED
[01:27:26.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:59:0) after 5m13s
[01:32:40.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:59:0)
[01:32:40.122] Build status: STARTED
[01:32:40.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:60:0) after 3m52s
[01:36:32.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:60:0)
[01:36:32.191] Build status: STARTED
[01:36:32.191] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:61:0) after 6m0s
[01:42:32.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:61:0)
[01:42:32.230] Build status: STARTED
[01:42:32.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:62:0) after 3m32s
[01:46:04.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:62:0)
[01:46:04.318] Build status: STARTED
[01:46:04.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:63:0) after 8m11s
[01:54:15.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:63:0)
[01:54:15.366] Build status: STARTED
[01:54:15.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:64:0) after 5m19s
[01:59:35.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:64:0)
[01:59:35.657] Build status: STARTED
[01:59:35.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:65:0) after 5m48s
[02:05:23.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:65:0)
[02:05:23.869] Build status: STARTED
[02:05:23.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:66:0) after 1m49s
[02:07:12.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:66:0)
[02:07:12.998] Build status: STARTED
[02:07:12.998] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:67:0) after 7m21s
[02:14:34.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:67:0)
[02:14:34.088] Build status: STARTED
[02:14:34.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:68:0) after 3m1s
[02:17:35.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:68:0)
[02:17:35.162] Build status: STARTED
[02:17:35.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:69:0) after 8m46s
[02:26:21.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:69:0)
[02:26:21.219] Build status: STARTED
[02:26:21.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:70:0) after 9m52s
[02:36:13.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:70:0)
[02:36:13.260] Build status: STARTED
[02:36:13.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:71:0) after 1m2s
[02:37:15.300] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:71:0)
[02:37:15.322] Build status: STARTED
[02:37:15.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:72:0) after 3m58s
[02:41:13.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:72:0)
[02:41:13.370] Build status: STARTED
[02:41:13.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:73:0) after 3m50s
[02:45:03.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:73:0)
[02:45:03.383] Build status: STARTED
[02:45:03.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:74:0) after 5m36s
[02:50:39.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:74:0)
[02:50:39.481] Build status: STARTED
[02:50:39.481] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:75:0) after 3m11s
[02:53:50.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:75:0)
[02:53:50.524] Build status: STARTED
[02:53:50.524] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:76:0) after 9m27s
[03:03:17.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:76:0)
[03:03:17.658] Build status: STARTED
[03:03:17.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:77:0) after 4m22s
[03:07:39.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:77:0)
[03:07:39.710] Build status: STARTED
[03:07:39.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:78:0) after 9m22s
[03:17:01.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:78:0)
[03:17:01.808] Build status: STARTED
[03:17:01.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:79:0) after 7m53s
[03:24:54.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:79:0)
[03:24:54.910] Build status: STARTED
[03:24:54.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:80:0) after 8m46s
[03:33:40.938] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:80:0)
[03:33:41.022] Build status: STARTED
[03:33:41.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:81:0) after 1m18s
[03:34:59.244] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:81:0)
[03:34:59.273] Build status: STARTED
[03:34:59.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:82:0) after 9m11s
[03:46:52.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:82:0)
[03:46:52.206] Build status: STARTED
[03:46:52.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:83:0) after 9m6s
[03:55:58.258] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:83:0)
[03:55:58.277] Build status: STARTED
[03:55:58.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:84:0) after 6m53s
[04:02:51.691] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:84:0)
[04:02:51.714] Build status: STARTED
[04:02:51.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:85:0) after 8m55s
[04:11:46.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:85:0)
[04:11:46.802] Build status: STARTED
[04:11:46.802] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:86:0) after 7m53s
[04:19:39.880] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:86:0)
[04:19:39.933] Build status: STARTED
[04:19:39.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:87:0) after 1m32s
[04:21:12.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:87:0)
[04:21:12.180] Build status: STARTED
[04:21:12.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:88:0) after 2m26s
[04:23:38.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:88:0)
[04:23:38.239] Build status: STARTED
[04:23:38.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:89:0) after 5m33s
[04:29:11.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:89:0)
[04:29:11.305] Build status: STARTED
[04:29:11.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:90:0) after 9m25s
[04:38:36.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:90:0)
[04:38:36.357] Build status: STARTED
[04:38:36.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:91:0) after 9m19s
[04:47:55.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:91:0)
[04:47:55.659] Build status: STARTED
[04:47:55.660] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:92:0) after 2m22s
[04:50:17.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:92:0)
[04:50:17.939] Build status: STARTED
[04:50:17.939] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:93:0) after 1m53s
[04:52:11.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:93:0)
[04:52:11.083] Build status: STARTED
[04:52:11.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:94:0) after 7m27s
[04:59:38.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:94:0)
[04:59:38.300] Build status: STARTED
[04:59:38.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:95:0) after 9m17s
[05:08:55.448] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:95:0)
[05:08:55.482] Build status: STARTED
[05:08:55.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:96:0) after 9m8s
[05:18:03.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:96:0)
[05:18:03.747] Build status: STARTED
[05:18:03.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:97:0) after 6m18s
[05:24:21.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:97:0)
[05:24:22.024] Build status: STARTED
[05:24:22.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:98:0) after 2m28s
[05:26:50.388] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:98:0)
[05:26:50.453] Build status: STARTED
[05:26:50.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:99:0) after 1m13s
[05:28:03.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:99:0)
[05:28:03.710] Build status: STARTED
[05:28:03.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:100:0) after 8m16s
[05:36:20.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:100:0)
[05:36:20.028] Build status: STARTED
[05:36:20.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:101:0) after 7m18s
[05:43:38.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:101:0)
[05:43:38.072] Build status: STARTED
[05:43:38.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:102:0) after 8m5s
[05:51:43.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:102:0)
[05:51:43.153] Build status: STARTED
[05:51:43.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:103:0) after 5m24s
[05:57:07.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:103:0)
[05:57:07.199] Build status: STARTED
[05:57:07.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:104:0) after 2m1s
[05:59:08.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:104:0)
[05:59:08.347] Build status: STARTED
[05:59:08.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:105:0) after 2m11s
[06:01:19.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:105:0)
[06:01:19.540] Build status: STARTED
[06:01:19.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:106:0) after 8m12s
[06:09:31.656] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:106:0)
[06:09:31.680] Build status: STARTED
[06:09:31.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:107:0) after 3m3s
[06:12:34.786] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:107:0)
[06:12:34.803] Build status: STARTED
[06:12:34.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:108:0) after 5m20s
[06:17:54.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:108:0)
[06:17:54.913] Build status: STARTED
[06:17:54.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:109:0) after 3m17s
[06:21:12.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:109:0)
[06:21:12.043] Build status: STARTED
[06:21:12.043] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:110:0) after 1m38s
[06:22:50.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:110:0)
[06:22:50.136] Build status: STARTED
[06:22:50.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:111:0) after 9m44s
[06:32:34.358] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:111:0)
[06:32:34.390] Build status: STARTED
[06:32:34.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:112:0) after 6m38s
[06:39:12.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:112:0)
[06:39:12.568] Build status: STARTED
[06:39:12.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:113:0) after 7m7s
[06:46:19.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:113:0)
[06:46:19.639] Build status: STARTED
[06:46:19.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:114:0) after 5m45s
[06:52:04.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:114:0)
[06:52:04.721] Build status: STARTED
[06:52:04.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:115:0) after 7m24s
[06:59:28.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:115:0)
[06:59:28.818] Build status: STARTED
[06:59:28.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:116:0) after 9m28s
[07:08:56.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:116:0)
[07:08:57.071] Build status: STARTED
[07:08:57.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:117:0) after 6m25s
[07:15:22.166] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:117:0)
[07:15:22.187] Build status: STARTED
[07:15:22.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:118:0) after 2m38s
[07:18:00.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:118:0)
[07:18:00.422] Build status: STARTED
[07:18:00.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:119:0) after 1m59s
[07:19:59.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:119:0)
[07:19:59.754] Build status: STARTED
[07:19:59.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:120:0) after 6m38s
[07:26:37.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:120:0)
[07:26:37.903] Build status: STARTED
[07:26:37.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:121:0) after 8m18s
[07:34:55.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:121:0)
[07:34:56.097] Build status: STARTED
[07:34:56.097] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:122:0) after 5m32s
[07:40:28.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:122:0)
[07:40:28.368] Build status: STARTED
[07:40:28.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:123:0) after 5m51s
[07:46:19.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:123:0)
[07:46:19.523] Build status: STARTED
[07:46:19.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:124:0) after 8m34s
[07:54:53.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:124:0)
[07:54:53.879] Build status: STARTED
[07:54:53.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:125:0) after 7m20s
[08:02:13.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:125:0)
[08:02:13.999] Build status: STARTED
[08:02:13.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:126:0) after 6m33s
[08:08:47.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:126:0)
[08:08:47.156] Build status: STARTED
[08:08:47.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:127:0) after 2m14s
[08:11:01.334] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:127:0)
[08:11:01.366] Build status: STARTED
[08:11:01.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:128:0) after 4m37s
[08:15:38.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:128:0)
[08:15:38.424] Build status: STARTED
[08:15:38.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:129:0) after 4m59s
[08:20:37.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:129:0)
[08:20:37.640] Build status: STARTED
[08:20:37.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:130:0) after 2m3s
[08:22:40.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:130:0)
[08:22:40.692] Build status: STARTED
[08:22:40.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:131:0) after 2m20s
[08:25:00.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:131:0)
[08:25:00.755] Build status: STARTED
[08:25:00.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:132:0) after 8m30s
[08:33:30.781] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:132:0)
[08:33:30.803] Build status: STARTED
[08:33:30.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:133:0) after 3m46s
[08:37:16.932] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:133:0)
[08:37:16.965] Build status: STARTED
[08:37:16.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:134:0) after 2m4s
[08:39:21.211] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:134:0)
[08:39:21.240] Build status: STARTED
[08:39:21.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:135:0) after 6m48s
[08:46:09.463] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:135:0)
[08:46:09.482] Build status: STARTED
[08:46:09.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:136:0) after 9m23s
[08:55:32.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:136:0)
[08:55:32.585] Build status: STARTED
[08:55:32.585] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:137:0) after 2m47s
[08:58:19.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:137:0)
[08:58:19.646] Build status: STARTED
[08:58:19.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922602074147526208:138:0) after 9m11s
[09:00:35.993] Received PubSub notification, asking Buildbucket for the build status
[09:00:36.083] Build:
{
"id": "8757172012044494449",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1954,
"createdBy": "project:chromium",
"createTime": "2024-02-02T20:49:49.969529900Z",
"startTime": "2024-02-02T20:50:53.397418Z",
"endTime": "2024-02-03T09:00:35.331023Z",
"updateTime": "2024-02-03T09:00:35.331023Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7831dd03d200ef1fefbd0814c92ba5101f558328",
"ref": "refs/heads/main"
}
}
}
[09:00:36.083] Invocation finished in 12h10m47.503770332s with status FAILED