[10:39:32.224] New invocation is queued and will start shortly
[10:39:33.243] Starting the invocation (attempt 1)
[10:39:33.271] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a30919480f610f53894a16ec50e13ebda40c8645"
[10:39:33.271] Popped gitiles commit info from properties and tags
[10:39:33.271] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:39:33.272] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:39:33.272] Buildbucket request:
{
"requestId": "8925086587284729440",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a30919480f610f53894a16ec50e13ebda40c8645",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8925086587284729440"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:39:34.000] Scheduled build:
{
"id": "8759656525330465585",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1899,
"createdBy": "project:chromium",
"createTime": "2024-01-06T10:39:33.459099864Z",
"updateTime": "2024-01-06T10:39:33.459099864Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a30919480f610f53894a16ec50e13ebda40c8645",
"ref": "refs/heads/main"
}
}
}
[10:39:34.000] Task URL: https://cr-buildbucket.appspot.com/build/8759656525330465585
[10:39:34.000] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:2:0) after 5m42s
[10:39:34.984] Received PubSub notification, asking Buildbucket for the build status
[10:39:35.030] Build status: STARTED
[10:39:35.229] Received PubSub notification, asking Buildbucket for the build status
[10:39:35.253] Build status: STARTED
[10:45:16.117] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:2:0)
[10:45:16.140] Build status: STARTED
[10:45:16.140] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:5:0) after 9m42s
[10:54:58.175] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:5:0)
[10:54:58.198] Build status: STARTED
[10:54:58.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:6:0) after 5m33s
[11:00:31.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:6:0)
[11:00:31.305] Build status: STARTED
[11:00:31.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:7:0) after 2m49s
[11:03:20.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:7:0)
[11:03:20.427] Build status: STARTED
[11:03:20.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:8:0) after 8m23s
[11:11:43.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:8:0)
[11:11:43.594] Build status: STARTED
[11:11:43.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:9:0) after 2m18s
[11:14:01.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:9:0)
[11:14:01.834] Build status: STARTED
[11:14:01.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:10:0) after 9m23s
[11:23:24.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:10:0)
[11:23:25.096] Build status: STARTED
[11:23:25.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:11:0) after 5m57s
[11:29:22.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:11:0)
[11:29:22.681] Build status: STARTED
[11:29:22.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:12:0) after 1m49s
[11:31:12.050] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:12:0)
[11:31:12.116] Build status: STARTED
[11:31:12.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:13:0) after 2m26s
[11:33:39.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:13:0)
[11:33:39.239] Build status: STARTED
[11:33:39.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:14:0) after 1m30s
[11:35:09.271] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:14:0)
[11:35:09.385] Build status: STARTED
[11:35:09.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:15:0) after 7m31s
[11:42:40.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:15:0)
[11:42:40.555] Build status: STARTED
[11:42:40.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:16:0) after 9m7s
[11:51:47.574] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:16:0)
[11:51:47.594] Build status: STARTED
[11:51:47.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:17:0) after 1m5s
[11:52:53.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:17:0)
[11:52:53.241] Build status: STARTED
[11:52:53.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:18:0) after 5m53s
[11:58:46.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:18:0)
[11:58:46.813] Build status: STARTED
[11:58:46.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:19:0) after 4m26s
[12:03:13.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:19:0)
[12:03:13.709] Build status: STARTED
[12:03:13.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:20:0) after 2m17s
[12:05:30.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:20:0)
[12:05:30.737] Build status: STARTED
[12:05:30.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:21:0) after 3m49s
[12:09:19.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:21:0)
[12:09:19.798] Build status: STARTED
[12:09:19.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:22:0) after 6m30s
[12:15:50.342] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:22:0)
[12:15:50.359] Build status: STARTED
[12:15:50.360] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:23:0) after 8m52s
[12:24:42.372] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:23:0)
[12:24:42.485] Build status: STARTED
[12:24:42.485] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:24:0) after 7m15s
[12:31:57.921] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:24:0)
[12:31:58.002] Build status: STARTED
[12:31:58.002] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:25:0) after 7m48s
[12:39:46.022] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:25:0)
[12:39:46.039] Build status: STARTED
[12:39:46.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:26:0) after 7m39s
[12:47:25.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:26:0)
[12:47:25.094] Build status: STARTED
[12:47:25.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:27:0) after 2m51s
[12:50:16.232] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:27:0)
[12:50:16.272] Build status: STARTED
[12:50:16.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:28:0) after 8m44s
[12:59:00.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:28:0)
[12:59:00.558] Build status: STARTED
[12:59:00.558] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:29:0) after 4m3s
[13:03:03.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:29:0)
[13:03:03.606] Build status: STARTED
[13:03:03.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:30:0) after 9m8s
[13:12:11.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:30:0)
[13:12:11.903] Build status: STARTED
[13:12:11.904] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:31:0) after 3m19s
[13:15:31.642] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:31:0)
[13:15:31.669] Build status: STARTED
[13:15:31.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:32:0) after 3m44s
[13:19:15.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:32:0)
[13:19:15.808] Build status: STARTED
[13:19:15.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:33:0) after 7m11s
[13:26:26.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:33:0)
[13:26:26.858] Build status: STARTED
[13:26:26.858] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:34:0) after 7m40s
[13:34:06.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:34:0)
[13:34:07.005] Build status: STARTED
[13:34:07.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:35:0) after 5m58s
[13:40:05.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:35:0)
[13:40:05.055] Build status: STARTED
[13:40:05.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:36:0) after 8m33s
[13:48:38.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:36:0)
[13:48:38.174] Build status: STARTED
[13:48:38.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:37:0) after 7m6s
[13:55:44.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:37:0)
[13:55:44.262] Build status: STARTED
[13:55:44.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:38:0) after 9m46s
[14:05:30.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:38:0)
[14:05:30.322] Build status: STARTED
[14:05:30.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:39:0) after 1m30s
[14:07:00.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:39:0)
[14:07:00.368] Build status: STARTED
[14:07:00.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:40:0) after 3m34s
[14:10:34.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:40:0)
[14:10:34.615] Build status: STARTED
[14:10:34.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:41:0) after 1m58s
[14:12:33.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:41:0)
[14:12:33.135] Build status: STARTED
[14:12:33.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:42:0) after 4m46s
[14:17:19.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:42:0)
[14:17:19.292] Build status: STARTED
[14:17:19.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:43:0) after 2m31s
[14:19:50.308] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:43:0)
[14:19:50.331] Build status: STARTED
[14:19:50.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:44:0) after 3m59s
[14:23:49.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:44:0)
[14:23:49.556] Build status: STARTED
[14:23:49.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:45:0) after 4m54s
[14:28:43.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:45:0)
[14:28:43.606] Build status: STARTED
[14:28:43.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:46:0) after 2m37s
[14:31:20.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:46:0)
[14:31:21.018] Build status: STARTED
[14:31:21.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:47:0) after 5m23s
[14:36:44.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:47:0)
[14:36:44.422] Build status: STARTED
[14:36:44.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:48:0) after 7m52s
[14:44:36.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:48:0)
[14:44:36.617] Build status: STARTED
[14:44:36.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:49:0) after 3m23s
[14:47:59.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:49:0)
[14:47:59.670] Build status: STARTED
[14:47:59.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:50:0) after 5m30s
[14:53:29.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:50:0)
[14:53:29.755] Build status: STARTED
[14:53:29.755] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:51:0) after 2m41s
[14:56:10.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:51:0)
[14:56:10.840] Build status: STARTED
[14:56:10.840] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:52:0) after 7m51s
[15:04:01.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:52:0)
[15:04:01.910] Build status: STARTED
[15:04:01.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:53:0) after 5m56s
[15:09:57.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:53:0)
[15:09:57.961] Build status: STARTED
[15:09:57.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:54:0) after 6m38s
[15:16:35.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:54:0)
[15:16:36.046] Build status: STARTED
[15:16:36.046] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:55:0) after 5m0s
[15:21:36.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:55:0)
[15:21:36.235] Build status: STARTED
[15:21:36.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:56:0) after 6m12s
[15:27:49.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:56:0)
[15:27:49.126] Build status: STARTED
[15:27:49.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:57:0) after 8m42s
[15:36:31.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:57:0)
[15:36:31.201] Build status: STARTED
[15:36:31.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:58:0) after 5m28s
[15:41:59.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:58:0)
[15:41:59.306] Build status: STARTED
[15:41:59.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:59:0) after 4m56s
[15:46:55.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:59:0)
[15:46:55.346] Build status: STARTED
[15:46:55.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:60:0) after 3m46s
[15:50:41.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:60:0)
[15:50:41.511] Build status: STARTED
[15:50:41.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:61:0) after 5m40s
[15:56:21.572] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:61:0)
[15:56:21.640] Build status: STARTED
[15:56:21.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:62:0) after 9m56s
[16:06:17.705] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:62:0)
[16:06:17.727] Build status: STARTED
[16:06:17.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:63:0) after 4m8s
[16:10:26.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:63:0)
[16:10:26.190] Build status: STARTED
[16:10:26.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:64:0) after 1m11s
[16:11:37.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:64:0)
[16:11:37.229] Build status: STARTED
[16:11:37.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:65:0) after 8m16s
[16:19:53.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:65:0)
[16:19:53.279] Build status: STARTED
[16:19:53.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:66:0) after 8m41s
[16:28:34.685] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:66:0)
[16:28:34.706] Build status: STARTED
[16:28:34.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:67:0) after 7m55s
[16:36:29.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:67:0)
[16:36:29.745] Build status: STARTED
[16:36:29.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:68:0) after 8m56s
[16:45:25.944] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:68:0)
[16:45:25.972] Build status: STARTED
[16:45:25.972] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:69:0) after 8m7s
[16:53:33.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:69:0)
[16:53:33.041] Build status: STARTED
[16:53:33.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:70:0) after 1m32s
[16:55:05.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:70:0)
[16:55:05.129] Build status: STARTED
[16:55:05.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:71:0) after 9m28s
[17:04:33.168] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:71:0)
[17:04:33.199] Build status: STARTED
[17:04:33.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:72:0) after 8m4s
[17:12:37.642] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:72:0)
[17:12:37.659] Build status: STARTED
[17:12:37.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:73:0) after 3m30s
[17:16:07.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:73:0)
[17:16:07.939] Build status: STARTED
[17:16:07.939] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:74:0) after 2m13s
[17:18:20.999] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:74:0)
[17:18:21.024] Build status: STARTED
[17:18:21.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:75:0) after 1m28s
[17:19:49.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:75:0)
[17:19:49.483] Build status: STARTED
[17:19:49.484] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:76:0) after 8m0s
[17:27:49.566] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:76:0)
[17:27:49.591] Build status: STARTED
[17:27:49.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:77:0) after 7m58s
[17:35:47.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:77:0)
[17:35:47.643] Build status: STARTED
[17:35:47.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:78:0) after 9m28s
[17:45:15.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:78:0)
[17:45:15.727] Build status: STARTED
[17:45:15.727] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:79:0) after 9m57s
[17:55:12.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:79:0)
[17:55:12.801] Build status: STARTED
[17:55:12.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:80:0) after 5m27s
[18:00:39.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:80:0)
[18:00:40.014] Build status: STARTED
[18:00:40.014] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:81:0) after 4m4s
[18:04:44.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:81:0)
[18:04:44.281] Build status: STARTED
[18:04:44.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:82:0) after 3m36s
[18:08:20.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:82:0)
[18:08:20.620] Build status: STARTED
[18:08:20.620] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:83:0) after 4m12s
[18:12:32.654] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:83:0)
[18:12:32.683] Build status: STARTED
[18:12:32.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:84:0) after 2m17s
[18:14:49.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:84:0)
[18:14:49.747] Build status: STARTED
[18:14:49.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:85:0) after 6m33s
[18:21:23.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:85:0)
[18:21:23.595] Build status: STARTED
[18:21:23.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:86:0) after 5m53s
[18:27:16.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:86:0)
[18:27:16.637] Build status: STARTED
[18:27:16.637] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:87:0) after 8m33s
[18:35:49.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:87:0)
[18:35:49.676] Build status: STARTED
[18:35:49.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:88:0) after 2m56s
[18:38:45.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:88:0)
[18:38:45.779] Build status: STARTED
[18:38:45.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:89:0) after 9m49s
[18:48:34.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:89:0)
[18:48:34.779] Build status: STARTED
[18:48:34.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:90:0) after 5m47s
[18:54:21.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:90:0)
[18:54:21.822] Build status: STARTED
[18:54:21.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:91:0) after 4m3s
[18:58:24.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:91:0)
[18:58:24.867] Build status: STARTED
[18:58:24.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:92:0) after 4m48s
[19:03:12.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:92:0)
[19:03:12.910] Build status: STARTED
[19:03:12.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:93:0) after 3m17s
[19:06:29.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:93:0)
[19:06:30.055] Build status: STARTED
[19:06:30.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:94:0) after 3m37s
[19:10:07.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:94:0)
[19:10:07.171] Build status: STARTED
[19:10:07.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:95:0) after 9m7s
[19:19:14.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:95:0)
[19:19:14.372] Build status: STARTED
[19:19:14.372] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:96:0) after 6m12s
[19:25:26.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:96:0)
[19:25:26.433] Build status: STARTED
[19:25:26.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:97:0) after 9m7s
[19:34:33.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:97:0)
[19:34:33.614] Build status: STARTED
[19:34:33.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:98:0) after 3m47s
[19:38:20.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:98:0)
[19:38:20.682] Build status: STARTED
[19:38:20.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:99:0) after 4m22s
[19:42:42.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:99:0)
[19:42:42.739] Build status: STARTED
[19:42:42.739] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:100:0) after 3m24s
[19:46:06.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:100:0)
[19:46:06.791] Build status: STARTED
[19:46:06.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:101:0) after 9m52s
[19:55:58.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:101:0)
[19:55:58.878] Build status: STARTED
[19:55:58.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:102:0) after 8m57s
[20:04:56.078] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:102:0)
[20:04:56.097] Build status: STARTED
[20:04:56.097] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:103:0) after 2m16s
[20:07:12.140] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:103:0)
[20:07:12.185] Build status: STARTED
[20:07:12.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:104:0) after 9m6s
[20:16:18.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:104:0)
[20:16:18.224] Build status: STARTED
[20:16:18.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:105:0) after 7m30s
[20:23:48.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:105:0)
[20:23:48.281] Build status: STARTED
[20:23:48.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:106:0) after 9m58s
[20:33:46.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:106:0)
[20:33:46.466] Build status: STARTED
[20:33:46.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:107:0) after 1m8s
[20:34:54.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:107:0)
[20:34:54.541] Build status: STARTED
[20:34:54.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:108:0) after 6m11s
[20:41:05.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:108:0)
[20:41:05.602] Build status: STARTED
[20:41:05.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:109:0) after 6m32s
[20:47:37.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:109:0)
[20:47:37.857] Build status: STARTED
[20:47:37.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:110:0) after 4m24s
[20:52:01.880] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:110:0)
[20:52:02.039] Build status: STARTED
[20:52:02.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:111:0) after 4m8s
[20:56:10.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:111:0)
[20:56:10.081] Build status: STARTED
[20:56:10.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:112:0) after 1m35s
[20:57:45.100] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:112:0)
[20:57:45.118] Build status: STARTED
[20:57:45.118] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:113:0) after 2m20s
[21:00:05.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:113:0)
[21:00:05.277] Build status: STARTED
[21:00:05.277] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:114:0) after 2m53s
[21:02:58.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:114:0)
[21:02:58.332] Build status: STARTED
[21:02:58.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:115:0) after 5m53s
[21:08:51.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:115:0)
[21:08:51.351] Build status: STARTED
[21:08:51.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:116:0) after 9m24s
[21:18:15.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:116:0)
[21:18:15.462] Build status: STARTED
[21:18:15.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:117:0) after 4m47s
[21:23:02.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:117:0)
[21:23:02.528] Build status: STARTED
[21:23:02.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:118:0) after 5m22s
[21:28:24.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:118:0)
[21:28:24.608] Build status: STARTED
[21:28:24.608] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:119:0) after 4m9s
[21:32:33.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:119:0)
[21:32:33.677] Build status: STARTED
[21:32:33.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:120:0) after 9m56s
[21:42:29.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:120:0)
[21:42:29.770] Build status: STARTED
[21:42:29.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:121:0) after 8m15s
[21:50:44.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:121:0)
[21:50:44.817] Build status: STARTED
[21:50:44.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:122:0) after 5m12s
[21:55:56.898] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:122:0)
[21:55:56.929] Build status: STARTED
[21:55:56.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:123:0) after 6m9s
[22:02:06.051] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:123:0)
[22:02:06.096] Build status: STARTED
[22:02:06.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:124:0) after 1m11s
[22:03:17.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:124:0)
[22:03:17.184] Build status: STARTED
[22:03:17.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:125:0) after 1m17s
[22:04:34.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:125:0)
[22:04:34.274] Build status: STARTED
[22:04:34.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:126:0) after 5m3s
[22:09:37.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:126:0)
[22:09:37.973] Build status: STARTED
[22:09:37.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:127:0) after 2m49s
[22:12:26.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:127:0)
[22:12:27.056] Build status: STARTED
[22:12:27.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:128:0) after 3m56s
[22:16:23.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:128:0)
[22:16:23.111] Build status: STARTED
[22:16:23.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:129:0) after 6m43s
[22:23:06.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:129:0)
[22:23:06.203] Build status: STARTED
[22:23:06.203] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:130:0) after 7m3s
[22:30:09.228] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:130:0)
[22:30:09.248] Build status: STARTED
[22:30:09.248] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:131:0) after 3m52s
[22:34:01.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:131:0)
[22:34:01.313] Build status: STARTED
[22:34:01.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:132:0) after 3m9s
[22:37:10.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:132:0)
[22:37:10.361] Build status: STARTED
[22:37:10.361] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:133:0) after 3m49s
[22:40:59.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:133:0)
[22:40:59.462] Build status: STARTED
[22:40:59.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:134:0) after 5m17s
[22:46:16.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:134:0)
[22:46:16.502] Build status: STARTED
[22:46:16.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8925086587284729440:135:0) after 6m2s
[22:46:43.988] Received PubSub notification, asking Buildbucket for the build status
[22:46:44.011] Build:
{
"id": "8759656525330465585",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1899,
"createdBy": "project:chromium",
"createTime": "2024-01-06T10:39:33.459099864Z",
"startTime": "2024-01-06T10:39:34.601895Z",
"endTime": "2024-01-06T22:46:43.430074Z",
"updateTime": "2024-01-06T22:46:43.430074Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a30919480f610f53894a16ec50e13ebda40c8645",
"ref": "refs/heads/main"
}
}
}
[22:46:44.011] Invocation finished in 12h7m11.799523722s with status FAILED