[08:39:02.072] New invocation is queued and will start shortly
[08:39:03.264] Starting the invocation (attempt 1)
[08:39:03.292] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3009350de0a4c7ec9b35d7bb963c521744f55317"
[08:39:03.292] Popped gitiles commit info from properties and tags
[08:39:03.292] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:39:03.294] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:39:03.294] Buildbucket request:
{
"requestId": "8927812077635620768",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3009350de0a4c7ec9b35d7bb963c521744f55317",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8927812077635620768"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:39:03.852] Scheduled build:
{
"id": "8762382015633836881",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1838,
"createdBy": "project:chromium",
"createTime": "2023-12-07T08:39:03.357518506Z",
"updateTime": "2023-12-07T08:39:03.357518506Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3009350de0a4c7ec9b35d7bb963c521744f55317",
"ref": "refs/heads/main"
}
}
}
[08:39:03.852] Task URL: https://cr-buildbucket.appspot.com/build/8762382015633836881
[08:39:03.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:2:0) after 8m0s
[08:39:04.849] Received PubSub notification, asking Buildbucket for the build status
[08:39:04.865] Build status: SCHEDULED
[08:39:05.235] Received PubSub notification, asking Buildbucket for the build status
[08:39:05.259] Build status: STARTED
[08:47:03.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:2:0)
[08:47:03.983] Build status: STARTED
[08:47:03.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:5:0) after 9m51s
[08:56:55.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:5:0)
[08:56:55.103] Build status: STARTED
[08:56:55.103] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:6:0) after 7m53s
[09:04:48.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:6:0)
[09:04:48.876] Build status: STARTED
[09:04:48.877] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:7:0) after 5m27s
[09:10:15.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:7:0)
[09:10:16.015] Build status: STARTED
[09:10:16.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:8:0) after 1m33s
[09:11:49.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:8:0)
[09:11:49.066] Build status: STARTED
[09:11:49.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:9:0) after 8m32s
[09:20:21.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:9:0)
[09:20:21.147] Build status: STARTED
[09:20:21.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:10:0) after 7m31s
[09:27:52.170] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:10:0)
[09:27:52.192] Build status: STARTED
[09:27:52.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:11:0) after 6m32s
[09:34:24.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:11:0)
[09:34:24.295] Build status: STARTED
[09:34:24.295] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:12:0) after 2m8s
[09:36:32.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:12:0)
[09:36:32.717] Build status: STARTED
[09:36:32.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:13:0) after 9m27s
[09:45:59.764] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:13:0)
[09:45:59.784] Build status: STARTED
[09:45:59.784] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:14:0) after 8m37s
[09:54:36.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:14:0)
[09:54:36.979] Build status: STARTED
[09:54:36.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:15:0) after 3m35s
[09:58:12.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:15:0)
[09:58:12.132] Build status: STARTED
[09:58:12.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:16:0) after 2m45s
[10:00:57.175] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:16:0)
[10:00:57.202] Build status: STARTED
[10:00:57.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:17:0) after 2m36s
[10:03:33.748] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:17:0)
[10:03:33.766] Build status: STARTED
[10:03:33.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:18:0) after 1m43s
[10:05:16.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:18:0)
[10:05:16.814] Build status: STARTED
[10:05:16.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:19:0) after 6m6s
[10:11:22.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:19:0)
[10:11:22.932] Build status: STARTED
[10:11:22.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:20:0) after 8m19s
[10:19:42.085] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:20:0)
[10:19:42.127] Build status: STARTED
[10:19:42.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:21:0) after 7m11s
[10:26:53.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:21:0)
[10:26:53.395] Build status: STARTED
[10:26:53.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:22:0) after 6m12s
[10:33:05.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:22:0)
[10:33:05.673] Build status: STARTED
[10:33:05.673] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:23:0) after 8m47s
[10:41:52.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:23:0)
[10:41:52.899] Build status: STARTED
[10:41:52.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:24:0) after 1m33s
[10:43:26.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:24:0)
[10:43:26.383] Build status: STARTED
[10:43:26.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:25:0) after 2m31s
[10:45:57.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:25:0)
[10:45:57.604] Build status: STARTED
[10:45:57.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:26:0) after 1m31s
[10:47:28.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:26:0)
[10:47:28.830] Build status: STARTED
[10:47:28.830] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:27:0) after 9m2s
[10:56:30.961] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:27:0)
[10:56:30.979] Build status: STARTED
[10:56:30.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:28:0) after 8m8s
[11:04:39.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:28:0)
[11:04:39.672] Build status: STARTED
[11:04:39.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:29:0) after 6m9s
[11:10:48.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:29:0)
[11:10:48.924] Build status: STARTED
[11:10:48.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:30:0) after 7m17s
[11:18:06.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:30:0)
[11:18:06.207] Build status: STARTED
[11:18:06.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:31:0) after 2m43s
[11:20:49.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:31:0)
[11:20:49.548] Build status: STARTED
[11:20:49.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:32:0) after 9m34s
[11:30:23.603] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:32:0)
[11:30:23.651] Build status: STARTED
[11:30:23.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:33:0) after 5m55s
[11:36:18.782] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:33:0)
[11:36:18.841] Build status: STARTED
[11:36:18.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:34:0) after 5m44s
[11:42:03.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:34:0)
[11:42:03.310] Build status: STARTED
[11:42:03.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:35:0) after 5m46s
[11:47:49.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:35:0)
[11:47:49.464] Build status: STARTED
[11:47:49.464] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:36:0) after 8m3s
[11:55:52.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:36:0)
[11:55:52.667] Build status: STARTED
[11:55:52.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:37:0) after 9m14s
[12:05:07.070] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:37:0)
[12:05:07.148] Build status: STARTED
[12:05:07.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:38:0) after 3m28s
[12:08:35.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:38:0)
[12:08:35.197] Build status: STARTED
[12:08:35.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:39:0) after 8m34s
[12:17:09.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:39:0)
[12:17:09.457] Build status: STARTED
[12:17:09.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:40:0) after 7m18s
[12:24:27.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:40:0)
[12:24:27.668] Build status: STARTED
[12:24:27.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:41:0) after 5m25s
[12:29:52.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:41:0)
[12:29:52.833] Build status: STARTED
[12:29:52.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:42:0) after 6m27s
[12:36:19.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:42:0)
[12:36:19.909] Build status: STARTED
[12:36:19.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:43:0) after 8m11s
[12:44:30.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:43:0)
[12:44:30.974] Build status: STARTED
[12:44:30.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:44:0) after 8m54s
[12:53:25.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:44:0)
[12:53:25.207] Build status: STARTED
[12:53:25.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:45:0) after 9m2s
[13:02:27.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:45:0)
[13:02:27.276] Build status: STARTED
[13:02:27.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:46:0) after 8m11s
[13:10:38.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:46:0)
[13:10:38.339] Build status: STARTED
[13:10:38.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:47:0) after 5m29s
[13:16:07.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:47:0)
[13:16:07.631] Build status: STARTED
[13:16:07.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:48:0) after 3m51s
[13:19:58.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:48:0)
[13:19:58.691] Build status: STARTED
[13:19:58.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:49:0) after 6m19s
[13:26:17.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:49:0)
[13:26:17.786] Build status: STARTED
[13:26:17.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:50:0) after 4m28s
[13:30:45.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:50:0)
[13:30:45.841] Build status: STARTED
[13:30:45.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:51:0) after 1m25s
[13:32:11.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:51:0)
[13:32:11.217] Build status: STARTED
[13:32:11.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:52:0) after 9m33s
[13:41:44.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:52:0)
[13:41:44.327] Build status: STARTED
[13:41:44.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:53:0) after 8m31s
[13:50:15.441] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:53:0)
[13:50:15.506] Build status: STARTED
[13:50:15.506] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:54:0) after 4m39s
[13:54:54.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:54:0)
[13:54:54.680] Build status: STARTED
[13:54:54.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:55:0) after 6m53s
[14:01:47.735] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:55:0)
[14:01:47.768] Build status: STARTED
[14:01:47.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:56:0) after 5m34s
[14:07:21.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:56:0)
[14:07:21.913] Build status: STARTED
[14:07:21.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:57:0) after 9m32s
[14:16:54.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:57:0)
[14:16:54.130] Build status: STARTED
[14:16:54.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:58:0) after 7m43s
[14:24:37.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:58:0)
[14:24:37.215] Build status: STARTED
[14:24:37.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:59:0) after 8m51s
[14:33:28.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:59:0)
[14:33:28.431] Build status: STARTED
[14:33:28.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:60:0) after 8m4s
[14:41:32.531] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:60:0)
[14:41:32.548] Build status: STARTED
[14:41:32.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:61:0) after 2m30s
[14:44:02.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:61:0)
[14:44:02.970] Build status: STARTED
[14:44:02.970] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:62:0) after 7m19s
[14:51:22.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:62:0)
[14:51:22.162] Build status: STARTED
[14:51:22.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:63:0) after 2m15s
[14:53:37.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:63:0)
[14:53:37.301] Build status: STARTED
[14:53:37.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:64:0) after 6m38s
[15:00:15.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:64:0)
[15:00:15.455] Build status: STARTED
[15:00:15.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:65:0) after 8m4s
[15:08:19.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:65:0)
[15:08:19.493] Build status: STARTED
[15:08:19.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:66:0) after 6m54s
[15:15:13.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:66:0)
[15:15:13.560] Build status: STARTED
[15:15:13.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:67:0) after 2m14s
[15:17:27.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:67:0)
[15:17:27.904] Build status: STARTED
[15:17:27.904] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:68:0) after 9m33s
[15:27:01.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:68:0)
[15:27:01.129] Build status: STARTED
[15:27:01.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:69:0) after 1m27s
[15:28:28.120] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:69:0)
[15:28:28.145] Build status: STARTED
[15:28:28.145] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:70:0) after 6m51s
[15:35:19.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:70:0)
[15:35:19.783] Build status: STARTED
[15:35:19.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:71:0) after 6m56s
[15:42:15.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:71:0)
[15:42:15.884] Build status: STARTED
[15:42:15.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:72:0) after 7m37s
[15:49:53.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:72:0)
[15:49:53.083] Build status: STARTED
[15:49:53.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:73:0) after 1m16s
[15:51:09.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:73:0)
[15:51:09.180] Build status: STARTED
[15:51:09.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:74:0) after 3m13s
[15:54:22.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:74:0)
[15:54:22.336] Build status: STARTED
[15:54:22.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:75:0) after 2m37s
[15:56:59.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:75:0)
[15:56:59.505] Build status: STARTED
[15:56:59.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:76:0) after 7m38s
[16:04:37.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:76:0)
[16:04:37.648] Build status: STARTED
[16:04:37.648] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:77:0) after 8m5s
[16:12:42.696] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:77:0)
[16:12:42.716] Build status: STARTED
[16:12:42.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:78:0) after 4m1s
[16:16:43.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:78:0)
[16:16:43.877] Build status: STARTED
[16:16:43.877] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:79:0) after 8m14s
[16:24:58.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:79:0)
[16:24:58.149] Build status: STARTED
[16:24:58.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:80:0) after 4m55s
[16:29:53.244] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:80:0)
[16:29:53.264] Build status: STARTED
[16:29:53.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:81:0) after 2m33s
[16:32:26.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:81:0)
[16:32:26.873] Build status: STARTED
[16:32:26.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:82:0) after 3m40s
[16:36:07.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:82:0)
[16:36:07.510] Build status: STARTED
[16:36:07.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:83:0) after 1m17s
[16:37:25.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:83:0)
[16:37:25.067] Build status: STARTED
[16:37:25.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:84:0) after 2m49s
[16:40:14.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:84:0)
[16:40:14.400] Build status: STARTED
[16:40:14.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:85:0) after 4m5s
[16:44:19.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:85:0)
[16:44:19.460] Build status: STARTED
[16:44:19.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:86:0) after 7m32s
[16:51:51.488] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:86:0)
[16:51:51.525] Build status: STARTED
[16:51:51.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:87:0) after 1m22s
[16:53:13.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:87:0)
[16:53:13.656] Build status: STARTED
[16:53:13.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:88:0) after 2m12s
[16:55:25.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:88:0)
[16:55:25.708] Build status: STARTED
[16:55:25.708] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:89:0) after 3m34s
[16:58:59.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:89:0)
[16:58:59.809] Build status: STARTED
[16:58:59.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:90:0) after 5m42s
[17:04:41.834] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:90:0)
[17:04:41.863] Build status: STARTED
[17:04:41.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:91:0) after 1m14s
[17:05:55.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:91:0)
[17:05:55.990] Build status: STARTED
[17:05:55.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:92:0) after 2m39s
[17:08:35.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:92:0)
[17:08:35.059] Build status: STARTED
[17:08:35.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:93:0) after 2m38s
[17:11:13.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:93:0)
[17:11:13.166] Build status: STARTED
[17:11:13.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:94:0) after 9m6s
[17:20:19.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:94:0)
[17:20:19.321] Build status: STARTED
[17:20:19.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:95:0) after 5m16s
[17:25:35.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:95:0)
[17:25:35.380] Build status: STARTED
[17:25:35.380] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:96:0) after 5m47s
[17:31:22.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:96:0)
[17:31:22.548] Build status: STARTED
[17:31:22.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:97:0) after 2m1s
[17:33:23.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:97:0)
[17:33:23.785] Build status: STARTED
[17:33:23.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:98:0) after 3m8s
[17:36:31.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:98:0)
[17:36:31.841] Build status: STARTED
[17:36:31.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:99:0) after 3m3s
[17:39:34.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:99:0)
[17:39:34.938] Build status: STARTED
[17:39:34.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:100:0) after 4m49s
[17:44:24.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:100:0)
[17:44:24.039] Build status: STARTED
[17:44:24.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:101:0) after 1m59s
[17:46:23.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:101:0)
[17:46:23.078] Build status: STARTED
[17:46:23.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:102:0) after 5m28s
[17:51:51.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:102:0)
[17:51:51.129] Build status: STARTED
[17:51:51.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:103:0) after 9m21s
[18:01:12.157] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:103:0)
[18:01:12.204] Build status: STARTED
[18:01:12.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:104:0) after 3m48s
[18:05:00.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:104:0)
[18:05:00.393] Build status: STARTED
[18:05:00.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:105:0) after 2m14s
[18:07:14.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:105:0)
[18:07:14.550] Build status: STARTED
[18:07:14.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:106:0) after 4m0s
[18:11:14.593] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:106:0)
[18:11:14.637] Build status: STARTED
[18:11:14.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:107:0) after 7m23s
[18:18:37.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:107:0)
[18:18:37.854] Build status: STARTED
[18:18:37.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:108:0) after 6m58s
[18:25:35.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:108:0)
[18:25:35.923] Build status: STARTED
[18:25:35.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:109:0) after 9m48s
[18:35:23.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:109:0)
[18:35:23.994] Build status: STARTED
[18:35:23.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:110:0) after 8m47s
[18:44:11.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:110:0)
[18:44:11.102] Build status: STARTED
[18:44:11.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:111:0) after 7m33s
[18:51:44.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:111:0)
[18:51:44.198] Build status: STARTED
[18:51:44.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:112:0) after 6m1s
[18:57:45.258] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:112:0)
[18:57:45.299] Build status: STARTED
[18:57:45.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:113:0) after 4m10s
[19:01:55.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:113:0)
[19:01:55.366] Build status: STARTED
[19:01:55.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:114:0) after 2m10s
[19:04:05.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:114:0)
[19:04:05.514] Build status: STARTED
[19:04:05.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:115:0) after 3m23s
[19:07:28.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:115:0)
[19:07:28.656] Build status: STARTED
[19:07:28.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:116:0) after 7m51s
[19:15:19.758] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:116:0)
[19:15:19.778] Build status: STARTED
[19:15:19.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:117:0) after 8m43s
[19:24:02.810] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:117:0)
[19:24:02.848] Build status: STARTED
[19:24:02.848] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:118:0) after 1m7s
[19:25:09.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:118:0)
[19:25:09.912] Build status: STARTED
[19:25:09.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:119:0) after 7m4s
[19:32:13.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:119:0)
[19:32:14.041] Build status: STARTED
[19:32:14.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:120:0) after 8m23s
[19:40:37.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:120:0)
[19:40:37.085] Build status: STARTED
[19:40:37.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:121:0) after 6m25s
[19:47:02.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:121:0)
[19:47:02.196] Build status: STARTED
[19:47:02.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:122:0) after 5m39s
[19:52:41.244] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:122:0)
[19:52:41.268] Build status: STARTED
[19:52:41.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:123:0) after 8m35s
[20:01:16.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:123:0)
[20:01:16.380] Build status: STARTED
[20:01:16.380] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:124:0) after 6m10s
[20:07:26.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:124:0)
[20:07:26.750] Build status: STARTED
[20:07:26.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:125:0) after 3m41s
[20:11:07.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:125:0)
[20:11:07.800] Build status: STARTED
[20:11:07.800] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:126:0) after 5m1s
[20:16:08.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:126:0)
[20:16:08.888] Build status: STARTED
[20:16:08.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:127:0) after 1m50s
[20:17:58.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:127:0)
[20:17:58.996] Build status: STARTED
[20:17:58.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:128:0) after 9m27s
[20:27:26.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:128:0)
[20:27:26.163] Build status: STARTED
[20:27:26.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:129:0) after 3m36s
[20:31:02.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:129:0)
[20:31:02.201] Build status: STARTED
[20:31:02.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:130:0) after 2m40s
[20:33:42.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:130:0)
[20:33:42.276] Build status: STARTED
[20:33:42.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:131:0) after 8m52s
[20:42:34.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:131:0)
[20:42:34.374] Build status: STARTED
[20:42:34.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:132:0) after 1m43s
[20:44:17.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:132:0)
[20:44:17.452] Build status: STARTED
[20:44:17.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:133:0) after 7m48s
[20:52:05.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:133:0)
[20:52:05.566] Build status: STARTED
[20:52:05.566] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:134:0) after 1m55s
[20:54:00.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:134:0)
[20:54:00.691] Build status: STARTED
[20:54:00.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:135:0) after 2m17s
[20:56:17.685] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:135:0)
[20:56:17.707] Build status: STARTED
[20:56:17.707] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927812077635620768:136:0) after 8m55s
[20:58:48.244] Received PubSub notification, asking Buildbucket for the build status
[20:58:48.261] Build:
{
"id": "8762382015633836881",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1838,
"createdBy": "project:chromium",
"createTime": "2023-12-07T08:39:03.357518506Z",
"startTime": "2023-12-07T08:39:04.625246Z",
"endTime": "2023-12-07T20:58:46.761587Z",
"updateTime": "2023-12-07T20:58:46.761587Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3009350de0a4c7ec9b35d7bb963c521744f55317",
"ref": "refs/heads/main"
}
}
}
[20:58:48.261] Invocation finished in 12h19m46.196010467s with status FAILED