[12:51:25.690] New invocation is queued and will start shortly
[12:51:26.879] Starting the invocation (attempt 1)
[12:51:26.910] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f0c50e616de38d73e197b8e84ac120450b7f763a"
[12:51:26.910] Popped gitiles commit info from properties and tags
[12:51:26.910] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:51:26.910] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:51:26.910] Buildbucket request:
{
"requestId": "8923447544024756336",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0c50e616de38d73e197b8e84ac120450b7f763a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923447544024756336"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:51:27.727] Scheduled build:
{
"id": "8758017481948422305",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1935,
"createdBy": "project:chromium",
"createTime": "2024-01-24T12:51:27.036034391Z",
"updateTime": "2024-01-24T12:51:27.036034391Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0c50e616de38d73e197b8e84ac120450b7f763a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:51:27.727] Task URL: https://cr-buildbucket.appspot.com/build/8758017481948422305
[12:51:27.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:2:0) after 6m1s
[12:51:28.720] Received PubSub notification, asking Buildbucket for the build status
[12:51:28.746] Build status: SCHEDULED
[12:51:33.059] Received PubSub notification, asking Buildbucket for the build status
[12:51:33.089] Build status: STARTED
[12:57:29.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:2:0)
[12:57:29.048] Build status: STARTED
[12:57:29.048] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:5:0) after 4m42s
[13:02:11.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:5:0)
[13:02:11.105] Build status: STARTED
[13:02:11.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:6:0) after 6m52s
[13:09:03.305] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:6:0)
[13:09:03.334] Build status: STARTED
[13:09:03.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:7:0) after 1m46s
[13:10:49.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:7:0)
[13:10:49.820] Build status: STARTED
[13:10:49.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:8:0) after 1m11s
[13:12:01.014] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:8:0)
[13:12:01.037] Build status: STARTED
[13:12:01.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:9:0) after 6m33s
[13:18:34.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:9:0)
[13:18:34.237] Build status: STARTED
[13:18:34.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:10:0) after 7m33s
[13:26:07.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:10:0)
[13:26:07.495] Build status: STARTED
[13:26:07.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:11:0) after 8m30s
[13:34:37.863] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:11:0)
[13:34:37.903] Build status: STARTED
[13:34:37.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:12:0) after 5m37s
[13:40:14.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:12:0)
[13:40:14.992] Build status: STARTED
[13:40:14.992] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:13:0) after 8m35s
[13:48:50.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:13:0)
[13:48:50.269] Build status: STARTED
[13:48:50.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:14:0) after 1m47s
[13:50:37.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:14:0)
[13:50:37.423] Build status: STARTED
[13:50:37.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:15:0) after 4m6s
[13:54:43.718] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:15:0)
[13:54:43.731] Build status: STARTED
[13:54:43.731] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:16:0) after 1m26s
[13:56:09.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:16:0)
[13:56:09.804] Build status: STARTED
[13:56:09.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:17:0) after 8m45s
[14:04:55.372] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:17:0)
[14:04:55.392] Build status: STARTED
[14:04:55.392] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:18:0) after 7m0s
[14:11:55.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:18:0)
[14:11:55.757] Build status: STARTED
[14:11:55.757] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:19:0) after 5m52s
[14:17:47.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:19:0)
[14:17:47.873] Build status: STARTED
[14:17:47.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:20:0) after 6m50s
[14:24:37.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:20:0)
[14:24:37.983] Build status: STARTED
[14:24:37.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:21:0) after 1m16s
[14:25:54.055] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:21:0)
[14:25:54.092] Build status: STARTED
[14:25:54.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:22:0) after 3m43s
[14:29:37.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:22:0)
[14:29:37.364] Build status: STARTED
[14:29:37.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:23:0) after 7m13s
[14:36:50.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:23:0)
[14:36:50.539] Build status: STARTED
[14:36:50.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:24:0) after 8m28s
[14:45:18.706] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:24:0)
[14:45:18.724] Build status: STARTED
[14:45:18.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:25:0) after 1m34s
[14:46:53.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:25:0)
[14:46:53.147] Build status: STARTED
[14:46:53.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:26:0) after 3m45s
[14:50:38.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:26:0)
[14:50:38.213] Build status: STARTED
[14:50:38.213] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:27:0) after 5m46s
[14:56:24.235] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:27:0)
[14:56:24.260] Build status: STARTED
[14:56:24.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:28:0) after 6m43s
[15:03:07.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:28:0)
[15:03:07.396] Build status: STARTED
[15:03:07.396] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:29:0) after 2m59s
[15:06:06.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:29:0)
[15:06:06.451] Build status: STARTED
[15:06:06.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:30:0) after 1m25s
[15:07:31.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:30:0)
[15:07:31.631] Build status: STARTED
[15:07:31.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:31:0) after 8m0s
[15:15:31.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:31:0)
[15:15:31.690] Build status: STARTED
[15:15:31.690] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:32:0) after 5m13s
[15:20:44.716] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:32:0)
[15:20:44.737] Build status: STARTED
[15:20:44.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:33:0) after 4m13s
[15:24:58.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:33:0)
[15:24:58.396] Build status: STARTED
[15:24:58.396] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:34:0) after 9m0s
[15:33:58.637] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:34:0)
[15:33:58.675] Build status: STARTED
[15:33:58.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:35:0) after 3m6s
[15:37:05.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:35:0)
[15:37:05.369] Build status: STARTED
[15:37:05.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:36:0) after 2m6s
[15:39:11.454] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:36:0)
[15:39:11.521] Build status: STARTED
[15:39:11.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:37:0) after 6m0s
[15:45:11.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:37:0)
[15:45:11.588] Build status: STARTED
[15:45:11.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:38:0) after 6m25s
[15:51:36.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:38:0)
[15:51:36.658] Build status: STARTED
[15:51:36.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:39:0) after 5m58s
[15:57:34.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:39:0)
[15:57:34.755] Build status: STARTED
[15:57:34.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:40:0) after 5m12s
[16:02:47.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:40:0)
[16:02:47.102] Build status: STARTED
[16:02:47.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:41:0) after 6m15s
[16:09:02.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:41:0)
[16:09:02.180] Build status: STARTED
[16:09:02.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:42:0) after 3m26s
[16:12:28.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:42:0)
[16:12:28.357] Build status: STARTED
[16:12:28.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:43:0) after 8m40s
[16:21:08.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:43:0)
[16:21:08.433] Build status: STARTED
[16:21:08.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:44:0) after 5m29s
[16:26:38.061] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:44:0)
[16:26:38.092] Build status: STARTED
[16:26:38.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:45:0) after 1m47s
[16:28:25.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:45:0)
[16:28:25.431] Build status: STARTED
[16:28:25.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:46:0) after 6m47s
[16:35:12.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:46:0)
[16:35:12.804] Build status: STARTED
[16:35:12.804] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:47:0) after 7m57s
[16:43:09.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:47:0)
[16:43:09.897] Build status: STARTED
[16:43:09.897] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:48:0) after 9m42s
[16:52:52.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:48:0)
[16:52:52.036] Build status: STARTED
[16:52:52.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:49:0) after 5m25s
[16:58:17.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:49:0)
[16:58:17.095] Build status: STARTED
[16:58:17.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:50:0) after 6m27s
[17:04:44.124] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:50:0)
[17:04:44.189] Build status: STARTED
[17:04:44.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:51:0) after 6m34s
[17:11:18.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:51:0)
[17:11:18.245] Build status: STARTED
[17:11:18.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:52:0) after 8m8s
[17:19:26.306] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:52:0)
[17:19:26.324] Build status: STARTED
[17:19:26.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:53:0) after 1m41s
[17:21:07.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:53:0)
[17:21:07.494] Build status: STARTED
[17:21:07.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:54:0) after 5m1s
[17:26:08.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:54:0)
[17:26:08.544] Build status: STARTED
[17:26:08.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:55:0) after 6m13s
[17:32:21.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:55:0)
[17:32:21.958] Build status: STARTED
[17:32:21.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:56:0) after 8m15s
[17:40:37.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:56:0)
[17:40:37.175] Build status: STARTED
[17:40:37.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:57:0) after 4m18s
[17:44:55.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:57:0)
[17:44:55.331] Build status: STARTED
[17:44:55.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:58:0) after 7m8s
[17:52:03.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:58:0)
[17:52:03.406] Build status: STARTED
[17:52:03.406] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:59:0) after 2m23s
[17:54:26.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:59:0)
[17:54:26.526] Build status: STARTED
[17:54:26.526] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:60:0) after 4m5s
[17:58:31.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:60:0)
[17:58:31.814] Build status: STARTED
[17:58:31.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:61:0) after 9m13s
[18:07:45.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:61:0)
[18:07:45.315] Build status: STARTED
[18:07:45.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:62:0) after 7m5s
[18:14:50.414] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:62:0)
[18:14:50.438] Build status: STARTED
[18:14:50.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:63:0) after 4m54s
[18:19:44.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:63:0)
[18:19:44.529] Build status: STARTED
[18:19:44.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:64:0) after 1m48s
[18:21:32.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:64:0)
[18:21:32.616] Build status: STARTED
[18:21:32.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:65:0) after 2m16s
[18:23:48.705] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:65:0)
[18:23:48.733] Build status: STARTED
[18:23:48.733] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:66:0) after 1m33s
[18:25:21.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:66:0)
[18:25:21.807] Build status: STARTED
[18:25:21.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:67:0) after 1m44s
[18:27:05.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:67:0)
[18:27:05.894] Build status: STARTED
[18:27:05.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:68:0) after 9m45s
[18:36:50.926] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:68:0)
[18:36:50.948] Build status: STARTED
[18:36:50.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:69:0) after 5m20s
[18:42:10.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:69:0)
[18:42:10.996] Build status: STARTED
[18:42:10.997] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:70:0) after 4m53s
[18:47:04.026] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:70:0)
[18:47:04.081] Build status: STARTED
[18:47:04.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:71:0) after 4m16s
[18:51:20.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:71:0)
[18:51:20.142] Build status: STARTED
[18:51:20.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:72:0) after 6m29s
[18:57:49.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:72:0)
[18:57:49.323] Build status: STARTED
[18:57:49.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:73:0) after 7m44s
[19:05:33.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:73:0)
[19:05:33.373] Build status: STARTED
[19:05:33.373] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:74:0) after 6m25s
[19:11:58.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:74:0)
[19:11:58.446] Build status: STARTED
[19:11:58.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:75:0) after 2m37s
[19:14:35.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:75:0)
[19:14:35.489] Build status: STARTED
[19:14:35.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:76:0) after 5m32s
[19:20:07.519] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:76:0)
[19:20:07.544] Build status: STARTED
[19:20:07.544] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:77:0) after 9m14s
[19:29:21.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:77:0)
[19:29:21.697] Build status: STARTED
[19:29:21.698] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:78:0) after 4m15s
[19:33:36.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:78:0)
[19:33:36.748] Build status: STARTED
[19:33:36.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:79:0) after 5m58s
[19:39:34.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:79:0)
[19:39:34.910] Build status: STARTED
[19:39:34.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:80:0) after 2m22s
[19:41:57.203] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:80:0)
[19:41:57.241] Build status: STARTED
[19:41:57.242] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:81:0) after 4m4s
[19:46:01.662] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:81:0)
[19:46:01.683] Build status: STARTED
[19:46:01.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:82:0) after 2m9s
[19:48:10.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:82:0)
[19:48:11.050] Build status: STARTED
[19:48:11.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:83:0) after 2m23s
[19:50:34.070] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:83:0)
[19:50:34.092] Build status: STARTED
[19:50:34.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:84:0) after 2m20s
[19:52:54.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:84:0)
[19:52:54.160] Build status: STARTED
[19:52:54.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:85:0) after 3m0s
[19:55:54.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:85:0)
[19:55:54.355] Build status: STARTED
[19:55:54.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:86:0) after 8m26s
[20:04:20.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:86:0)
[20:04:20.539] Build status: STARTED
[20:04:20.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:87:0) after 3m45s
[20:08:05.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:87:0)
[20:08:05.664] Build status: STARTED
[20:08:05.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:88:0) after 9m52s
[20:17:57.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:88:0)
[20:17:57.836] Build status: STARTED
[20:17:57.836] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:89:0) after 7m47s
[20:25:44.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:89:0)
[20:25:44.994] Build status: STARTED
[20:25:44.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:90:0) after 1m3s
[20:26:47.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:90:0)
[20:26:48.067] Build status: STARTED
[20:26:48.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:91:0) after 8m15s
[20:35:03.090] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:91:0)
[20:35:03.109] Build status: STARTED
[20:35:03.109] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:92:0) after 7m6s
[20:42:09.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:92:0)
[20:42:09.152] Build status: STARTED
[20:42:09.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:93:0) after 8m47s
[20:50:56.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:93:0)
[20:50:56.205] Build status: STARTED
[20:50:56.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:94:0) after 5m29s
[20:56:25.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:94:0)
[20:56:25.272] Build status: STARTED
[20:56:25.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:95:0) after 2m2s
[20:58:27.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:95:0)
[20:58:27.412] Build status: STARTED
[20:58:27.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:96:0) after 7m49s
[21:06:16.445] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:96:0)
[21:06:16.469] Build status: STARTED
[21:06:16.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:97:0) after 1m39s
[21:07:55.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:97:0)
[21:07:55.546] Build status: STARTED
[21:07:55.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:98:0) after 6m37s
[21:14:32.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:98:0)
[21:14:32.667] Build status: STARTED
[21:14:32.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:99:0) after 7m56s
[21:22:28.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:99:0)
[21:22:28.719] Build status: STARTED
[21:22:28.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:100:0) after 7m22s
[21:29:50.819] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:100:0)
[21:29:50.837] Build status: STARTED
[21:29:50.837] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:101:0) after 2m31s
[21:32:21.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:101:0)
[21:32:21.892] Build status: STARTED
[21:32:21.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:102:0) after 1m10s
[21:33:31.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:102:0)
[21:33:31.944] Build status: STARTED
[21:33:31.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:103:0) after 7m59s
[21:41:31.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:103:0)
[21:41:31.053] Build status: STARTED
[21:41:31.053] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:104:0) after 6m19s
[21:47:50.078] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:104:0)
[21:47:50.114] Build status: STARTED
[21:47:50.114] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:105:0) after 1m37s
[21:49:27.140] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:105:0)
[21:49:27.279] Build status: STARTED
[21:49:27.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:106:0) after 6m27s
[21:55:54.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:106:0)
[21:55:54.512] Build status: STARTED
[21:55:54.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:107:0) after 9m49s
[22:05:43.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:107:0)
[22:05:43.742] Build status: STARTED
[22:05:43.742] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:108:0) after 9m39s
[22:15:22.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:108:0)
[22:15:22.830] Build status: STARTED
[22:15:22.830] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:109:0) after 1m32s
[22:16:54.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:109:0)
[22:16:54.912] Build status: STARTED
[22:16:54.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:110:0) after 5m18s
[22:22:12.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:110:0)
[22:22:13.030] Build status: STARTED
[22:22:13.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:111:0) after 8m41s
[22:30:54.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:111:0)
[22:30:54.122] Build status: STARTED
[22:30:54.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:112:0) after 3m52s
[22:34:46.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:112:0)
[22:34:46.183] Build status: STARTED
[22:34:46.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:113:0) after 1m21s
[22:36:07.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:113:0)
[22:36:07.321] Build status: STARTED
[22:36:07.321] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:114:0) after 4m7s
[22:40:14.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:114:0)
[22:40:14.341] Build status: STARTED
[22:40:14.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:115:0) after 8m49s
[22:49:03.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:115:0)
[22:49:03.439] Build status: STARTED
[22:49:03.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:116:0) after 4m15s
[22:53:18.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:116:0)
[22:53:18.532] Build status: STARTED
[22:53:18.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:117:0) after 2m21s
[22:55:39.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:117:0)
[22:55:39.719] Build status: STARTED
[22:55:39.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:118:0) after 6m7s
[23:01:46.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:118:0)
[23:01:46.782] Build status: STARTED
[23:01:46.782] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:119:0) after 1m41s
[23:03:27.837] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:119:0)
[23:03:27.858] Build status: STARTED
[23:03:27.858] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:120:0) after 8m52s
[23:12:19.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:120:0)
[23:12:19.915] Build status: STARTED
[23:12:19.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:121:0) after 1m42s
[23:14:01.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:121:0)
[23:14:02.011] Build status: STARTED
[23:14:02.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:122:0) after 7m27s
[23:21:29.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:122:0)
[23:21:29.240] Build status: STARTED
[23:21:29.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:123:0) after 1m29s
[23:22:58.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:123:0)
[23:22:58.381] Build status: STARTED
[23:22:58.381] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:124:0) after 7m58s
[23:30:56.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:124:0)
[23:30:56.386] Build status: STARTED
[23:30:56.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:125:0) after 6m32s
[23:37:28.417] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:125:0)
[23:37:28.435] Build status: STARTED
[23:37:28.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:126:0) after 2m47s
[23:40:15.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:126:0)
[23:40:15.505] Build status: STARTED
[23:40:15.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:127:0) after 7m55s
[23:48:10.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:127:0)
[23:48:10.592] Build status: STARTED
[23:48:10.592] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:128:0) after 2m21s
[23:50:31.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:128:0)
[23:50:31.608] Build status: STARTED
[23:50:31.608] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:129:0) after 1m25s
[23:51:56.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:129:0)
[23:51:56.666] Build status: STARTED
[23:51:56.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:130:0) after 8m14s
[00:00:10.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:130:0)
[00:00:10.769] Build status: STARTED
[00:00:10.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:131:0) after 7m35s
[00:07:45.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:131:0)
[00:07:45.831] Build status: STARTED
[00:07:45.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:132:0) after 2m43s
[00:10:28.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:132:0)
[00:10:28.849] Build status: STARTED
[00:10:28.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:133:0) after 5m43s
[00:16:11.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:133:0)
[00:16:11.892] Build status: STARTED
[00:16:11.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:134:0) after 3m54s
[00:20:05.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:134:0)
[00:20:05.924] Build status: STARTED
[00:20:05.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:135:0) after 4m24s
[00:24:29.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:135:0)
[00:24:29.984] Build status: STARTED
[00:24:29.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:136:0) after 6m59s
[00:31:28.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:136:0)
[00:31:29.121] Build status: STARTED
[00:31:29.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:137:0) after 7m30s
[00:38:59.150] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:137:0)
[00:38:59.168] Build status: STARTED
[00:38:59.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:138:0) after 4m43s
[00:43:42.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:138:0)
[00:43:42.398] Build status: STARTED
[00:43:42.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:139:0) after 7m47s
[00:51:29.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:139:0)
[00:51:29.499] Build status: STARTED
[00:51:29.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:140:0) after 4m50s
[00:56:19.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:140:0)
[00:56:19.532] Build status: STARTED
[00:56:19.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8923447544024756336:141:0) after 5m4s
[00:56:42.612] Received PubSub notification, asking Buildbucket for the build status
[00:56:42.638] Build:
{
"id": "8758017481948422305",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1935,
"createdBy": "project:chromium",
"createTime": "2024-01-24T12:51:27.036034391Z",
"startTime": "2024-01-24T12:51:32.481988Z",
"endTime": "2024-01-25T00:56:41.972578Z",
"updateTime": "2024-01-25T00:56:41.972578Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f0c50e616de38d73e197b8e84ac120450b7f763a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:56:42.638] Invocation finished in 12h5m16.965609256s with status FAILED