[11:21:07.215] New invocation is queued and will start shortly
[11:21:08.452] Starting the invocation (attempt 1)
[11:21:08.486] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/30755042c575808394945c5bc6bd3ce882ed9989"
[11:21:08.486] Popped gitiles commit info from properties and tags
[11:21:08.486] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:21:08.486] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:21:08.486] Buildbucket request:
{
"requestId": "8926171134687839776",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30755042c575808394945c5bc6bd3ce882ed9989",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8926171134687839776"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:21:09.165] Scheduled build:
{
"id": "8760741072608362033",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1874,
"createdBy": "project:chromium",
"createTime": "2023-12-25T11:21:08.576379116Z",
"updateTime": "2023-12-25T11:21:08.576379116Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30755042c575808394945c5bc6bd3ce882ed9989",
"ref": "refs/heads/main"
}
}
}
[11:21:09.165] Task URL: https://cr-buildbucket.appspot.com/build/8760741072608362033
[11:21:09.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:2:0) after 7m37s
[11:21:10.415] Received PubSub notification, asking Buildbucket for the build status
[11:21:10.434] Build status: STARTED
[11:21:11.747] Received PubSub notification, asking Buildbucket for the build status
[11:21:11.765] Build status: STARTED
[11:28:46.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:2:0)
[11:28:46.243] Build status: STARTED
[11:28:46.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:5:0) after 1m44s
[11:30:30.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:5:0)
[11:30:30.278] Build status: STARTED
[11:30:30.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:6:0) after 8m37s
[11:39:07.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:6:0)
[11:39:07.312] Build status: STARTED
[11:39:07.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:7:0) after 9m5s
[11:48:12.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:7:0)
[11:48:12.366] Build status: STARTED
[11:48:12.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:8:0) after 3m36s
[11:51:48.632] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:8:0)
[11:51:48.653] Build status: STARTED
[11:51:48.653] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:9:0) after 7m58s
[11:59:46.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:9:0)
[11:59:46.798] Build status: STARTED
[11:59:46.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:10:0) after 7m3s
[12:06:49.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:10:0)
[12:06:49.867] Build status: STARTED
[12:06:49.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:11:0) after 6m26s
[12:13:15.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:11:0)
[12:13:15.923] Build status: STARTED
[12:13:15.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:12:0) after 5m29s
[12:18:44.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:12:0)
[12:18:44.958] Build status: STARTED
[12:18:44.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:13:0) after 8m10s
[12:26:55.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:13:0)
[12:26:55.037] Build status: STARTED
[12:26:55.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:14:0) after 3m38s
[12:30:33.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:14:0)
[12:30:33.174] Build status: STARTED
[12:30:33.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:15:0) after 8m16s
[12:38:49.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:15:0)
[12:38:49.209] Build status: STARTED
[12:38:49.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:16:0) after 8m27s
[12:47:16.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:16:0)
[12:47:16.501] Build status: STARTED
[12:47:16.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:17:0) after 2m19s
[12:49:35.650] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:17:0)
[12:49:35.668] Build status: STARTED
[12:49:35.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:18:0) after 1m47s
[12:51:22.819] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:18:0)
[12:51:22.841] Build status: STARTED
[12:51:22.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:19:0) after 8m45s
[13:00:07.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:19:0)
[13:00:07.895] Build status: STARTED
[13:00:07.895] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:20:0) after 4m6s
[13:04:13.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:20:0)
[13:04:13.941] Build status: STARTED
[13:04:13.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:21:0) after 2m22s
[13:06:35.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:21:0)
[13:06:35.974] Build status: STARTED
[13:06:35.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:22:0) after 6m58s
[13:13:34.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:22:0)
[13:13:34.033] Build status: STARTED
[13:13:34.033] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:23:0) after 1m33s
[13:15:07.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:23:0)
[13:15:07.373] Build status: STARTED
[13:15:07.373] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:24:0) after 2m57s
[13:18:04.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:24:0)
[13:18:04.411] Build status: STARTED
[13:18:04.411] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:25:0) after 7m34s
[13:25:38.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:25:0)
[13:25:38.471] Build status: STARTED
[13:25:38.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:26:0) after 5m50s
[13:31:28.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:26:0)
[13:31:28.551] Build status: STARTED
[13:31:28.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:27:0) after 4m44s
[13:36:12.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:27:0)
[13:36:12.587] Build status: STARTED
[13:36:12.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:28:0) after 4m11s
[13:40:23.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:28:0)
[13:40:23.891] Build status: STARTED
[13:40:23.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:29:0) after 5m56s
[13:46:20.150] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:29:0)
[13:46:20.177] Build status: STARTED
[13:46:20.177] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:30:0) after 6m34s
[13:52:54.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:30:0)
[13:52:54.258] Build status: STARTED
[13:52:54.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:31:0) after 2m12s
[13:55:06.272] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:31:0)
[13:55:06.524] Build status: STARTED
[13:55:06.524] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:32:0) after 8m46s
[14:03:52.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:32:0)
[14:03:52.575] Build status: STARTED
[14:03:52.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:33:0) after 7m17s
[14:11:09.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:33:0)
[14:11:09.623] Build status: STARTED
[14:11:09.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:34:0) after 9m24s
[14:20:33.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:34:0)
[14:20:33.828] Build status: STARTED
[14:20:33.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:35:0) after 6m3s
[14:26:36.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:35:0)
[14:26:37.016] Build status: STARTED
[14:26:37.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:36:0) after 2m41s
[14:29:18.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:36:0)
[14:29:18.149] Build status: STARTED
[14:29:18.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:37:0) after 2m43s
[14:32:01.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:37:0)
[14:32:01.257] Build status: STARTED
[14:32:01.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:38:0) after 8m40s
[14:40:41.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:38:0)
[14:40:41.404] Build status: STARTED
[14:40:41.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:39:0) after 3m18s
[14:43:59.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:39:0)
[14:43:59.503] Build status: STARTED
[14:43:59.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:40:0) after 8m59s
[14:52:58.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:40:0)
[14:52:58.638] Build status: STARTED
[14:52:58.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:41:0) after 1m18s
[14:54:16.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:41:0)
[14:54:16.752] Build status: STARTED
[14:54:16.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:42:0) after 5m32s
[14:59:48.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:42:0)
[14:59:48.790] Build status: STARTED
[14:59:48.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:43:0) after 6m1s
[15:05:49.807] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:43:0)
[15:05:49.846] Build status: STARTED
[15:05:49.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:44:0) after 8m10s
[15:13:59.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:44:0)
[15:14:00.036] Build status: STARTED
[15:14:00.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:45:0) after 8m0s
[15:22:00.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:45:0)
[15:22:00.106] Build status: STARTED
[15:22:00.106] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:46:0) after 7m38s
[15:29:38.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:46:0)
[15:29:38.310] Build status: STARTED
[15:29:38.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:47:0) after 1m46s
[15:31:24.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:47:0)
[15:31:24.443] Build status: STARTED
[15:31:24.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:48:0) after 7m2s
[15:38:26.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:48:0)
[15:38:26.501] Build status: STARTED
[15:38:26.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:49:0) after 5m5s
[15:43:31.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:49:0)
[15:43:31.551] Build status: STARTED
[15:43:31.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:50:0) after 7m49s
[15:51:20.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:50:0)
[15:51:20.864] Build status: STARTED
[15:51:20.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:51:0) after 5m48s
[15:57:08.927] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:51:0)
[15:57:08.978] Build status: STARTED
[15:57:08.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:52:0) after 7m32s
[16:04:41.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:52:0)
[16:04:41.027] Build status: STARTED
[16:04:41.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:53:0) after 7m12s
[16:11:53.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:53:0)
[16:11:53.118] Build status: STARTED
[16:11:53.118] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:54:0) after 1m0s
[16:12:53.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:54:0)
[16:12:53.457] Build status: STARTED
[16:12:53.458] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:55:0) after 7m38s
[16:20:31.483] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:55:0)
[16:20:31.531] Build status: STARTED
[16:20:31.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:56:0) after 9m27s
[16:29:58.549] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:56:0)
[16:29:58.570] Build status: STARTED
[16:29:58.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:57:0) after 5m9s
[16:35:07.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:57:0)
[16:35:07.623] Build status: STARTED
[16:35:07.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:58:0) after 7m21s
[16:42:28.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:58:0)
[16:42:28.744] Build status: STARTED
[16:42:28.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:59:0) after 3m6s
[16:45:34.788] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:59:0)
[16:45:34.808] Build status: STARTED
[16:45:34.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:60:0) after 7m31s
[16:53:05.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:60:0)
[16:53:05.948] Build status: STARTED
[16:53:05.949] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:61:0) after 7m24s
[17:00:30.094] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:61:0)
[17:00:30.133] Build status: STARTED
[17:00:30.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:62:0) after 1m40s
[17:02:10.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:62:0)
[17:02:10.184] Build status: STARTED
[17:02:10.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:63:0) after 4m19s
[17:06:29.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:63:0)
[17:06:29.233] Build status: STARTED
[17:06:29.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:64:0) after 9m53s
[17:16:22.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:64:0)
[17:16:22.409] Build status: STARTED
[17:16:22.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:65:0) after 6m47s
[17:23:09.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:65:0)
[17:23:09.795] Build status: STARTED
[17:23:09.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:66:0) after 3m44s
[17:26:54.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:66:0)
[17:26:54.893] Build status: STARTED
[17:26:54.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:67:0) after 1m50s
[17:28:44.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:67:0)
[17:28:44.934] Build status: STARTED
[17:28:44.934] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:68:0) after 6m48s
[17:35:32.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:68:0)
[17:35:32.980] Build status: STARTED
[17:35:32.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:69:0) after 1m54s
[17:37:27.010] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:69:0)
[17:37:27.052] Build status: STARTED
[17:37:27.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:70:0) after 2m32s
[17:39:59.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:70:0)
[17:39:59.141] Build status: STARTED
[17:39:59.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:71:0) after 6m54s
[17:46:53.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:71:0)
[17:46:53.184] Build status: STARTED
[17:46:53.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:72:0) after 7m40s
[17:54:33.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:72:0)
[17:54:33.218] Build status: STARTED
[17:54:33.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:73:0) after 2m17s
[17:56:50.356] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:73:0)
[17:56:50.378] Build status: STARTED
[17:56:50.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:74:0) after 2m5s
[17:58:55.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:74:0)
[17:58:55.500] Build status: STARTED
[17:58:55.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:75:0) after 9m18s
[18:08:13.758] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:75:0)
[18:08:13.776] Build status: STARTED
[18:08:13.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:76:0) after 6m17s
[18:14:30.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:76:0)
[18:14:30.925] Build status: STARTED
[18:14:30.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:77:0) after 1m26s
[18:15:56.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:77:0)
[18:15:56.969] Build status: STARTED
[18:15:56.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:78:0) after 1m33s
[18:17:29.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:78:0)
[18:17:30.013] Build status: STARTED
[18:17:30.013] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:79:0) after 5m31s
[18:23:01.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:79:0)
[18:23:01.068] Build status: STARTED
[18:23:01.068] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:80:0) after 2m33s
[18:25:34.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:80:0)
[18:25:34.111] Build status: STARTED
[18:25:34.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:81:0) after 3m31s
[18:29:05.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:81:0)
[18:29:05.250] Build status: STARTED
[18:29:05.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:82:0) after 5m46s
[18:34:51.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:82:0)
[18:34:51.293] Build status: STARTED
[18:34:51.293] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:83:0) after 3m12s
[18:38:03.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:83:0)
[18:38:03.423] Build status: STARTED
[18:38:03.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:84:0) after 1m53s
[18:39:56.472] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:84:0)
[18:39:56.498] Build status: STARTED
[18:39:56.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:85:0) after 7m14s
[18:47:10.509] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:85:0)
[18:47:10.529] Build status: STARTED
[18:47:10.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:86:0) after 6m29s
[18:53:39.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:86:0)
[18:53:39.738] Build status: STARTED
[18:53:39.739] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:87:0) after 3m26s
[18:57:06.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:87:0)
[18:57:06.104] Build status: STARTED
[18:57:06.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:88:0) after 8m25s
[19:05:31.123] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:88:0)
[19:05:31.270] Build status: STARTED
[19:05:31.271] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:89:0) after 6m27s
[19:11:58.379] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:89:0)
[19:11:58.398] Build status: STARTED
[19:11:58.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:90:0) after 4m9s
[19:16:07.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:90:0)
[19:16:07.437] Build status: STARTED
[19:16:07.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:91:0) after 4m48s
[19:20:55.462] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:91:0)
[19:20:55.478] Build status: STARTED
[19:20:55.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:92:0) after 6m13s
[19:27:08.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:92:0)
[19:27:08.625] Build status: STARTED
[19:27:08.625] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:93:0) after 9m39s
[19:36:47.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:93:0)
[19:36:47.692] Build status: STARTED
[19:36:47.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:94:0) after 2m40s
[19:39:27.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:94:0)
[19:39:27.829] Build status: STARTED
[19:39:27.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:95:0) after 6m19s
[19:45:46.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:95:0)
[19:45:46.862] Build status: STARTED
[19:45:46.862] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:96:0) after 4m16s
[19:50:02.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:96:0)
[19:50:02.910] Build status: STARTED
[19:50:02.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:97:0) after 3m24s
[19:53:27.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:97:0)
[19:53:27.051] Build status: STARTED
[19:53:27.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:98:0) after 8m27s
[20:01:54.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:98:0)
[20:01:54.091] Build status: STARTED
[20:01:54.091] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:99:0) after 8m2s
[20:09:56.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:99:0)
[20:09:56.128] Build status: STARTED
[20:09:56.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:100:0) after 7m12s
[20:17:08.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:100:0)
[20:17:08.277] Build status: STARTED
[20:17:08.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:101:0) after 3m0s
[20:20:08.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:101:0)
[20:20:08.329] Build status: STARTED
[20:20:08.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:102:0) after 5m55s
[20:26:03.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:102:0)
[20:26:03.437] Build status: STARTED
[20:26:03.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:103:0) after 9m0s
[20:35:03.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:103:0)
[20:35:03.517] Build status: STARTED
[20:35:03.517] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:104:0) after 8m22s
[20:43:25.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:104:0)
[20:43:25.549] Build status: STARTED
[20:43:25.549] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:105:0) after 7m47s
[20:51:12.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:105:0)
[20:51:12.623] Build status: STARTED
[20:51:12.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:106:0) after 5m30s
[20:56:43.001] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:106:0)
[20:56:43.020] Build status: STARTED
[20:56:43.020] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:107:0) after 7m11s
[21:03:54.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:107:0)
[21:03:54.224] Build status: STARTED
[21:03:54.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:108:0) after 2m23s
[21:06:17.330] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:108:0)
[21:06:17.355] Build status: STARTED
[21:06:17.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:109:0) after 7m55s
[21:14:12.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:109:0)
[21:14:12.505] Build status: STARTED
[21:14:12.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:110:0) after 5m7s
[21:19:20.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:110:0)
[21:19:20.148] Build status: STARTED
[21:19:20.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:111:0) after 5m54s
[21:25:14.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:111:0)
[21:25:14.467] Build status: STARTED
[21:25:14.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:112:0) after 4m33s
[21:29:47.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:112:0)
[21:29:47.551] Build status: STARTED
[21:29:47.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:113:0) after 2m17s
[21:32:04.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:113:0)
[21:32:04.705] Build status: STARTED
[21:32:04.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:114:0) after 1m53s
[21:33:57.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:114:0)
[21:33:57.779] Build status: STARTED
[21:33:57.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:115:0) after 6m50s
[21:40:47.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:115:0)
[21:40:47.814] Build status: STARTED
[21:40:47.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:116:0) after 5m25s
[21:46:12.835] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:116:0)
[21:46:12.863] Build status: STARTED
[21:46:12.863] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:117:0) after 7m29s
[21:53:42.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:117:0)
[21:53:42.027] Build status: STARTED
[21:53:42.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:118:0) after 6m59s
[22:00:41.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:118:0)
[22:00:41.306] Build status: STARTED
[22:00:41.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:119:0) after 9m14s
[22:09:55.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:119:0)
[22:09:55.561] Build status: STARTED
[22:09:55.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:120:0) after 4m23s
[22:14:18.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:120:0)
[22:14:18.635] Build status: STARTED
[22:14:18.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:121:0) after 9m48s
[22:24:06.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:121:0)
[22:24:06.689] Build status: STARTED
[22:24:06.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:122:0) after 5m33s
[22:29:39.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:122:0)
[22:29:39.760] Build status: STARTED
[22:29:39.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:123:0) after 7m3s
[22:36:42.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:123:0)
[22:36:42.907] Build status: STARTED
[22:36:42.907] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:124:0) after 9m49s
[22:46:31.925] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:124:0)
[22:46:31.951] Build status: STARTED
[22:46:31.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:125:0) after 4m9s
[22:50:40.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:125:0)
[22:50:40.987] Build status: STARTED
[22:50:40.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:126:0) after 2m18s
[22:52:59.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:126:0)
[22:52:59.064] Build status: STARTED
[22:52:59.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:127:0) after 5m57s
[22:58:56.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:127:0)
[22:58:56.135] Build status: STARTED
[22:58:56.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:128:0) after 3m52s
[23:02:48.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:128:0)
[23:02:48.264] Build status: STARTED
[23:02:48.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:129:0) after 5m5s
[23:07:53.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:129:0)
[23:07:53.312] Build status: STARTED
[23:07:53.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:130:0) after 6m4s
[23:13:57.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:130:0)
[23:13:57.581] Build status: STARTED
[23:13:57.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:131:0) after 8m47s
[23:22:44.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:131:0)
[23:22:44.835] Build status: STARTED
[23:22:44.835] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:132:0) after 7m26s
[23:30:11.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:132:0)
[23:30:11.056] Build status: STARTED
[23:30:11.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:133:0) after 3m11s
[23:33:22.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:133:0)
[23:33:22.142] Build status: STARTED
[23:33:22.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:134:0) after 6m35s
[23:39:57.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:134:0)
[23:39:57.259] Build status: STARTED
[23:39:57.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8926171134687839776:135:0) after 3m38s
[23:40:48.406] Received PubSub notification, asking Buildbucket for the build status
[23:40:48.429] Build:
{
"id": "8760741072608362033",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1874,
"createdBy": "project:chromium",
"createTime": "2023-12-25T11:21:08.576379116Z",
"startTime": "2023-12-25T11:21:09.866306Z",
"endTime": "2023-12-25T23:40:47.657982Z",
"updateTime": "2023-12-25T23:40:47.657982Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "30755042c575808394945c5bc6bd3ce882ed9989",
"ref": "refs/heads/main"
}
}
}
[23:40:48.429] Invocation finished in 12h19m41.219687167s with status FAILED