[17:51:56.411] New invocation is queued and will start shortly
[17:51:57.570] Starting the invocation (attempt 1)
[17:51:57.599] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f15dda6363506cad2a0f9b8207701e23980a9ba1"
[17:51:57.599] Popped gitiles commit info from properties and tags
[17:51:57.599] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:51:57.600] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:51:57.600] Buildbucket request:
{
"requestId": "8929679828112021488",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f15dda6363506cad2a0f9b8207701e23980a9ba1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8929679828112021488"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:51:58.217] Scheduled build:
{
"id": "8764249766146750929",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1798,
"createdBy": "project:chromium",
"createTime": "2023-11-16T17:51:57.664180285Z",
"updateTime": "2023-11-16T17:51:57.664180285Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f15dda6363506cad2a0f9b8207701e23980a9ba1",
"ref": "refs/heads/main"
}
}
}
[17:51:58.217] Task URL: https://cr-buildbucket.appspot.com/build/8764249766146750929
[17:51:58.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:2:0) after 8m58s
[17:51:59.121] Received PubSub notification, asking Buildbucket for the build status
[17:51:59.142] Build status: SCHEDULED
[17:51:59.777] Received PubSub notification, asking Buildbucket for the build status
[17:51:59.801] Build status: STARTED
[18:00:56.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:2:0)
[18:00:56.236] Build status: STARTED
[18:00:56.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:5:0) after 9m47s
[18:10:43.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:5:0)
[18:10:43.382] Build status: STARTED
[18:10:43.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:6:0) after 3m17s
[18:14:00.430] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:6:0)
[18:14:00.452] Build status: STARTED
[18:14:00.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:7:0) after 4m40s
[18:18:40.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:7:0)
[18:18:40.521] Build status: STARTED
[18:18:40.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:8:0) after 6m30s
[18:25:10.554] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:8:0)
[18:25:10.577] Build status: STARTED
[18:25:10.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:9:0) after 8m20s
[18:33:30.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:9:0)
[18:33:30.637] Build status: STARTED
[18:33:30.637] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:10:0) after 9m10s
[18:42:40.668] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:10:0)
[18:42:40.691] Build status: STARTED
[18:42:40.691] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:11:0) after 2m44s
[18:45:24.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:11:0)
[18:45:24.753] Build status: STARTED
[18:45:24.753] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:12:0) after 7m0s
[18:52:24.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:12:0)
[18:52:24.846] Build status: STARTED
[18:52:24.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:13:0) after 4m14s
[18:56:38.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:13:0)
[18:56:38.915] Build status: STARTED
[18:56:38.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:14:0) after 7m54s
[19:04:32.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:14:0)
[19:04:33.045] Build status: STARTED
[19:04:33.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:15:0) after 2m0s
[19:06:33.117] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:15:0)
[19:06:33.137] Build status: STARTED
[19:06:33.137] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:16:0) after 7m43s
[19:14:16.168] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:16:0)
[19:14:16.204] Build status: STARTED
[19:14:16.204] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:17:0) after 2m19s
[19:16:35.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:17:0)
[19:16:35.276] Build status: STARTED
[19:16:35.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:18:0) after 8m40s
[19:25:15.393] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:18:0)
[19:25:15.431] Build status: STARTED
[19:25:15.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:19:0) after 2m6s
[19:27:21.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:19:0)
[19:27:21.570] Build status: STARTED
[19:27:21.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:20:0) after 7m27s
[19:34:48.691] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:20:0)
[19:34:48.777] Build status: STARTED
[19:34:48.777] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:21:0) after 9m11s
[19:43:59.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:21:0)
[19:43:59.844] Build status: STARTED
[19:43:59.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:22:0) after 3m10s
[19:47:09.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:22:0)
[19:47:10.137] Build status: STARTED
[19:47:10.137] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:23:0) after 8m5s
[19:55:15.314] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:23:0)
[19:55:15.340] Build status: STARTED
[19:55:15.340] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:24:0) after 9m36s
[20:04:51.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:24:0)
[20:04:52.014] Build status: STARTED
[20:04:52.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:25:0) after 8m4s
[20:12:56.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:25:0)
[20:12:56.113] Build status: STARTED
[20:12:56.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:26:0) after 5m54s
[20:18:50.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:26:0)
[20:18:50.215] Build status: STARTED
[20:18:50.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:27:0) after 3m43s
[20:22:33.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:27:0)
[20:22:33.213] Build status: STARTED
[20:22:33.213] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:28:0) after 5m52s
[20:28:25.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:28:0)
[20:28:25.296] Build status: STARTED
[20:28:25.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:29:0) after 5m26s
[20:33:51.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:29:0)
[20:33:51.344] Build status: STARTED
[20:33:51.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:30:0) after 3m13s
[20:37:04.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:30:0)
[20:37:04.387] Build status: STARTED
[20:37:04.387] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:31:0) after 7m27s
[20:44:31.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:31:0)
[20:44:31.476] Build status: STARTED
[20:44:31.476] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:32:0) after 3m46s
[20:48:17.503] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:32:0)
[20:48:17.536] Build status: STARTED
[20:48:17.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:33:0) after 5m36s
[20:53:53.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:33:0)
[20:53:53.548] Build status: STARTED
[20:53:53.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:34:0) after 5m14s
[20:59:07.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:34:0)
[20:59:07.597] Build status: STARTED
[20:59:07.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:35:0) after 7m5s
[21:06:12.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:35:0)
[21:06:12.706] Build status: STARTED
[21:06:12.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:36:0) after 8m44s
[21:14:56.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:36:0)
[21:14:56.892] Build status: STARTED
[21:14:56.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:37:0) after 5m38s
[21:20:34.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:37:0)
[21:20:34.932] Build status: STARTED
[21:20:34.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:38:0) after 2m11s
[21:22:45.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:38:0)
[21:22:45.978] Build status: STARTED
[21:22:45.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:39:0) after 6m25s
[21:29:11.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:39:0)
[21:29:11.052] Build status: STARTED
[21:29:11.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:40:0) after 1m52s
[21:31:03.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:40:0)
[21:31:03.105] Build status: STARTED
[21:31:03.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:41:0) after 5m13s
[21:36:16.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:41:0)
[21:36:16.343] Build status: STARTED
[21:36:16.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:42:0) after 8m7s
[21:44:23.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:42:0)
[21:44:23.587] Build status: STARTED
[21:44:23.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:43:0) after 8m9s
[21:52:32.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:43:0)
[21:52:32.680] Build status: STARTED
[21:52:32.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:44:0) after 9m40s
[22:02:12.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:44:0)
[22:02:12.804] Build status: STARTED
[22:02:12.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:45:0) after 8m6s
[22:10:18.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:45:0)
[22:10:18.862] Build status: STARTED
[22:10:18.862] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:46:0) after 6m12s
[22:16:31.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:46:0)
[22:16:31.147] Build status: STARTED
[22:16:31.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:47:0) after 1m5s
[22:17:36.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:47:0)
[22:17:36.195] Build status: STARTED
[22:17:36.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:48:0) after 9m55s
[22:27:31.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:48:0)
[22:27:31.282] Build status: STARTED
[22:27:31.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:49:0) after 6m15s
[22:33:46.263] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:49:0)
[22:33:46.289] Build status: STARTED
[22:33:46.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:50:0) after 3m24s
[22:37:10.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:50:0)
[22:37:10.349] Build status: STARTED
[22:37:10.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:51:0) after 7m1s
[22:44:11.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:51:0)
[22:44:11.413] Build status: STARTED
[22:44:11.413] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:52:0) after 3m52s
[22:48:04.074] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:52:0)
[22:48:04.100] Build status: STARTED
[22:48:04.100] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:53:0) after 2m11s
[22:50:15.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:53:0)
[22:50:15.181] Build status: STARTED
[22:50:15.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:54:0) after 2m51s
[22:53:06.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:54:0)
[22:53:06.230] Build status: STARTED
[22:53:06.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:55:0) after 3m33s
[22:56:39.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:55:0)
[22:56:39.277] Build status: STARTED
[22:56:39.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:56:0) after 2m54s
[22:59:33.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:56:0)
[22:59:33.343] Build status: STARTED
[22:59:33.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:57:0) after 6m31s
[23:06:04.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:57:0)
[23:06:04.611] Build status: STARTED
[23:06:04.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:58:0) after 7m9s
[23:13:14.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:58:0)
[23:13:14.275] Build status: STARTED
[23:13:14.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:59:0) after 5m17s
[23:18:31.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:59:0)
[23:18:31.374] Build status: STARTED
[23:18:31.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:60:0) after 2m13s
[23:20:44.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:60:0)
[23:20:44.443] Build status: STARTED
[23:20:44.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:61:0) after 4m32s
[23:25:16.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:61:0)
[23:25:16.584] Build status: STARTED
[23:25:16.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:62:0) after 7m20s
[23:32:36.807] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:62:0)
[23:32:36.829] Build status: STARTED
[23:32:36.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:63:0) after 7m30s
[23:40:06.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:63:0)
[23:40:06.951] Build status: STARTED
[23:40:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:64:0) after 2m24s
[23:42:30.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:64:0)
[23:42:31.011] Build status: STARTED
[23:42:31.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:65:0) after 7m28s
[23:49:59.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:65:0)
[23:49:59.072] Build status: STARTED
[23:49:59.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:66:0) after 9m11s
[23:59:10.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:66:0)
[23:59:10.198] Build status: STARTED
[23:59:10.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:67:0) after 7m26s
[00:06:36.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:67:0)
[00:06:36.246] Build status: STARTED
[00:06:36.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:68:0) after 7m54s
[00:14:30.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:68:0)
[00:14:30.374] Build status: STARTED
[00:14:30.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:69:0) after 4m32s
[00:19:02.472] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:69:0)
[00:19:02.495] Build status: STARTED
[00:19:02.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:70:0) after 5m29s
[00:24:31.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:70:0)
[00:24:31.588] Build status: STARTED
[00:24:31.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:71:0) after 5m53s
[00:30:24.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:71:0)
[00:30:24.846] Build status: STARTED
[00:30:24.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:72:0) after 9m54s
[00:40:18.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:72:0)
[00:40:18.991] Build status: STARTED
[00:40:18.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:73:0) after 6m52s
[00:47:11.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:73:0)
[00:47:11.434] Build status: STARTED
[00:47:11.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:74:0) after 8m33s
[00:55:44.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:74:0)
[00:55:44.514] Build status: STARTED
[00:55:44.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:75:0) after 1m6s
[00:56:50.536] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:75:0)
[00:56:50.562] Build status: STARTED
[00:56:50.562] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:76:0) after 3m28s
[01:00:18.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:76:0)
[01:00:19.083] Build status: STARTED
[01:00:19.083] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:77:0) after 5m14s
[01:05:33.281] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:77:0)
[01:05:33.302] Build status: STARTED
[01:05:33.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:78:0) after 8m43s
[01:14:16.526] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:78:0)
[01:14:16.545] Build status: STARTED
[01:14:16.545] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:79:0) after 6m57s
[01:21:13.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:79:0)
[01:21:13.710] Build status: STARTED
[01:21:13.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:80:0) after 1m33s
[01:22:46.938] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:80:0)
[01:22:46.959] Build status: STARTED
[01:22:46.959] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:81:0) after 9m21s
[01:32:08.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:81:0)
[01:32:08.771] Build status: STARTED
[01:32:08.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:82:0) after 5m2s
[01:37:10.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:82:0)
[01:37:10.871] Build status: STARTED
[01:37:10.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:83:0) after 1m41s
[01:38:52.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:83:0)
[01:38:52.072] Build status: STARTED
[01:38:52.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:84:0) after 9m47s
[01:48:39.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:84:0)
[01:48:39.532] Build status: STARTED
[01:48:39.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:85:0) after 3m0s
[01:51:39.556] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:85:0)
[01:51:39.592] Build status: STARTED
[01:51:39.592] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:86:0) after 5m7s
[01:56:47.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:86:0)
[01:56:47.596] Build status: STARTED
[01:56:47.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:87:0) after 2m59s
[01:59:46.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:87:0)
[01:59:46.762] Build status: STARTED
[01:59:46.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:88:0) after 4m39s
[02:04:26.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:88:0)
[02:04:26.075] Build status: STARTED
[02:04:26.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:89:0) after 7m1s
[02:11:27.196] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:89:0)
[02:11:27.233] Build status: STARTED
[02:11:27.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:90:0) after 9m45s
[02:21:12.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:90:0)
[02:21:12.420] Build status: STARTED
[02:21:12.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:91:0) after 4m8s
[02:25:20.565] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:91:0)
[02:25:20.591] Build status: STARTED
[02:25:20.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:92:0) after 5m32s
[02:30:52.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:92:0)
[02:30:52.798] Build status: STARTED
[02:30:52.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:93:0) after 1m22s
[02:32:14.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:93:0)
[02:32:14.854] Build status: STARTED
[02:32:14.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:94:0) after 4m19s
[02:36:33.912] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:94:0)
[02:36:33.933] Build status: STARTED
[02:36:33.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:95:0) after 9m49s
[02:46:23.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:95:0)
[02:46:23.250] Build status: STARTED
[02:46:23.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:96:0) after 4m28s
[02:50:51.332] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:96:0)
[02:50:51.362] Build status: STARTED
[02:50:51.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:97:0) after 6m56s
[02:57:47.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:97:0)
[02:57:47.535] Build status: STARTED
[02:57:47.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:98:0) after 3m35s
[03:01:22.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:98:0)
[03:01:22.654] Build status: STARTED
[03:01:22.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:99:0) after 8m19s
[03:09:41.685] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:99:0)
[03:09:41.717] Build status: STARTED
[03:09:41.717] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:100:0) after 5m57s
[03:15:38.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:100:0)
[03:15:38.932] Build status: STARTED
[03:15:38.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:101:0) after 4m14s
[03:19:53.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:101:0)
[03:19:53.106] Build status: STARTED
[03:19:53.106] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:102:0) after 9m7s
[03:29:00.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:102:0)
[03:29:00.236] Build status: STARTED
[03:29:00.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:103:0) after 6m42s
[03:35:42.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:103:0)
[03:35:42.326] Build status: STARTED
[03:35:42.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:104:0) after 7m42s
[03:43:24.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:104:0)
[03:43:24.662] Build status: STARTED
[03:43:24.663] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:105:0) after 1m35s
[03:44:59.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:105:0)
[03:44:59.764] Build status: STARTED
[03:44:59.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:106:0) after 4m37s
[03:49:37.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:106:0)
[03:49:37.230] Build status: STARTED
[03:49:37.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:107:0) after 3m13s
[03:52:50.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:107:0)
[03:52:50.375] Build status: STARTED
[03:52:50.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:108:0) after 5m56s
[03:58:47.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:108:0)
[03:58:47.044] Build status: STARTED
[03:58:47.044] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:109:0) after 2m57s
[04:01:44.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:109:0)
[04:01:44.173] Build status: STARTED
[04:01:44.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:110:0) after 3m7s
[04:04:51.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:110:0)
[04:04:51.332] Build status: STARTED
[04:04:51.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:111:0) after 1m19s
[04:06:10.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:111:0)
[04:06:10.570] Build status: STARTED
[04:06:10.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:112:0) after 7m49s
[04:13:59.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:112:0)
[04:13:59.783] Build status: STARTED
[04:13:59.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:113:0) after 7m50s
[04:21:49.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:113:0)
[04:21:49.930] Build status: STARTED
[04:21:49.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:114:0) after 4m44s
[04:26:34.188] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:114:0)
[04:26:34.207] Build status: STARTED
[04:26:34.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:115:0) after 4m10s
[04:30:44.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:115:0)
[04:30:44.534] Build status: STARTED
[04:30:44.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:116:0) after 4m48s
[04:35:32.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:116:0)
[04:35:32.683] Build status: STARTED
[04:35:32.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:117:0) after 1m39s
[04:37:11.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:117:0)
[04:37:11.737] Build status: STARTED
[04:37:11.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:118:0) after 6m22s
[04:43:33.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:118:0)
[04:43:33.843] Build status: STARTED
[04:43:33.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:119:0) after 9m51s
[04:53:24.912] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:119:0)
[04:53:24.932] Build status: STARTED
[04:53:24.932] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:120:0) after 8m34s
[05:01:58.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:120:0)
[05:01:58.986] Build status: STARTED
[05:01:58.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:121:0) after 5m12s
[05:07:11.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:121:0)
[05:07:11.317] Build status: STARTED
[05:07:11.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:122:0) after 3m43s
[05:10:54.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:122:0)
[05:10:54.421] Build status: STARTED
[05:10:54.421] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:123:0) after 7m11s
[05:18:05.488] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:123:0)
[05:18:05.510] Build status: STARTED
[05:18:05.510] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:124:0) after 9m35s
[05:27:40.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:124:0)
[05:27:40.560] Build status: STARTED
[05:27:40.560] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:125:0) after 8m0s
[05:35:40.793] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:125:0)
[05:35:40.825] Build status: STARTED
[05:35:40.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:126:0) after 5m9s
[05:40:49.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:126:0)
[05:40:49.930] Build status: STARTED
[05:40:49.930] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:127:0) after 4m21s
[05:45:11.002] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:127:0)
[05:45:11.024] Build status: STARTED
[05:45:11.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:128:0) after 6m17s
[05:51:28.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:128:0)
[05:51:28.078] Build status: STARTED
[05:51:28.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:129:0) after 8m40s
[06:00:08.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:129:0)
[06:00:08.239] Build status: STARTED
[06:00:08.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:130:0) after 2m22s
[06:02:30.263] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:130:0)
[06:02:30.293] Build status: STARTED
[06:02:30.293] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:131:0) after 8m34s
[06:11:04.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:131:0)
[06:11:04.347] Build status: STARTED
[06:11:04.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8929679828112021488:132:0) after 5m45s
[06:16:31.002] Received PubSub notification, asking Buildbucket for the build status
[06:16:31.032] Build:
{
"id": "8764249766146750929",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1798,
"createdBy": "project:chromium",
"createTime": "2023-11-16T17:51:57.664180285Z",
"startTime": "2023-11-16T17:51:58.999850Z",
"endTime": "2023-11-17T06:16:29.493287Z",
"updateTime": "2023-11-17T06:16:29.493287Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f15dda6363506cad2a0f9b8207701e23980a9ba1",
"ref": "refs/heads/main"
}
}
}
[06:16:31.032] Invocation finished in 12h24m34.626149207s with status FAILED