[09:24:16.787] New invocation is queued and will start shortly
[09:24:17.947] Starting the invocation (attempt 1)
[09:24:17.975] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fc264b436ebbb5bd688d783636fd025f7bee2754"
[09:24:17.975] Popped gitiles commit info from properties and tags
[09:24:17.975] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:24:17.975] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:24:17.975] Buildbucket request:
{
"requestId": "8935781764094269552",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc264b436ebbb5bd688d783636fd025f7bee2754",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935781764094269552"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:24:18.536] Scheduled build:
{
"id": "8770351702128440577",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1661,
"createdBy": "project:chromium",
"createTime": "2023-09-10T09:24:18.038794673Z",
"updateTime": "2023-09-10T09:24:18.038794673Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc264b436ebbb5bd688d783636fd025f7bee2754",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:24:18.536] Task URL: https://cr-buildbucket.appspot.com/build/8770351702128440577
[09:24:18.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:2:0) after 1m48s
[09:24:19.185] Received PubSub notification, asking Buildbucket for the build status
[09:24:19.218] Build status: SCHEDULED
[09:25:02.402] Received PubSub notification, asking Buildbucket for the build status
[09:25:02.419] Build status: STARTED
[09:26:06.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:2:0)
[09:26:06.616] Build status: STARTED
[09:26:06.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:5:0) after 6m17s
[09:32:23.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:5:0)
[09:32:23.649] Build status: STARTED
[09:32:23.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:6:0) after 3m26s
[09:35:49.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:6:0)
[09:35:49.896] Build status: STARTED
[09:35:49.896] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:7:0) after 4m9s
[09:39:58.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:7:0)
[09:39:58.948] Build status: STARTED
[09:39:58.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:8:0) after 9m16s
[09:49:14.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:8:0)
[09:49:15.039] Build status: STARTED
[09:49:15.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:9:0) after 3m49s
[09:53:04.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:9:0)
[09:53:04.093] Build status: STARTED
[09:53:04.093] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:10:0) after 8m39s
[10:01:43.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:10:0)
[10:01:43.160] Build status: STARTED
[10:01:43.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:11:0) after 4m9s
[10:05:52.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:11:0)
[10:05:52.333] Build status: STARTED
[10:05:52.334] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:12:0) after 5m15s
[10:11:07.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:12:0)
[10:11:07.383] Build status: STARTED
[10:11:07.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:13:0) after 8m31s
[10:19:38.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:13:0)
[10:19:38.438] Build status: STARTED
[10:19:38.438] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:14:0) after 1m56s
[10:21:34.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:14:0)
[10:21:34.541] Build status: STARTED
[10:21:34.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:15:0) after 8m0s
[10:29:34.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:15:0)
[10:29:34.728] Build status: STARTED
[10:29:34.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:16:0) after 9m13s
[10:38:47.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:16:0)
[10:38:48.018] Build status: STARTED
[10:38:48.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:17:0) after 7m49s
[10:46:37.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:17:0)
[10:46:37.169] Build status: STARTED
[10:46:37.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:18:0) after 4m15s
[10:50:52.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:18:0)
[10:50:52.326] Build status: STARTED
[10:50:52.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:19:0) after 3m4s
[10:53:56.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:19:0)
[10:53:56.497] Build status: STARTED
[10:53:56.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:20:0) after 2m10s
[10:56:06.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:20:0)
[10:56:06.539] Build status: STARTED
[10:56:06.539] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:21:0) after 4m1s
[11:00:07.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:21:0)
[11:00:07.803] Build status: STARTED
[11:00:07.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:22:0) after 2m19s
[11:02:26.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:22:0)
[11:02:26.918] Build status: STARTED
[11:02:26.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:23:0) after 1m25s
[11:03:51.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:23:0)
[11:03:51.977] Build status: STARTED
[11:03:51.977] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:24:0) after 8m16s
[11:12:07.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:24:0)
[11:12:08.015] Build status: STARTED
[11:12:08.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:25:0) after 1m44s
[11:13:52.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:25:0)
[11:13:52.057] Build status: STARTED
[11:13:52.057] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:26:0) after 5m30s
[11:19:22.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:26:0)
[11:19:22.115] Build status: STARTED
[11:19:22.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:27:0) after 2m29s
[11:21:51.132] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:27:0)
[11:21:51.158] Build status: STARTED
[11:21:51.158] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:28:0) after 2m59s
[11:24:50.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:28:0)
[11:24:50.192] Build status: STARTED
[11:24:50.192] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:29:0) after 7m23s
[11:32:13.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:29:0)
[11:32:13.235] Build status: STARTED
[11:32:13.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:30:0) after 2m45s
[11:34:58.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:30:0)
[11:34:58.286] Build status: STARTED
[11:34:58.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:31:0) after 6m13s
[11:41:11.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:31:0)
[11:41:11.323] Build status: STARTED
[11:41:11.323] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:32:0) after 9m21s
[11:50:32.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:32:0)
[11:50:32.350] Build status: STARTED
[11:50:32.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:33:0) after 1m8s
[11:51:40.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:33:0)
[11:51:40.444] Build status: STARTED
[11:51:40.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:34:0) after 4m59s
[11:56:39.461] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:34:0)
[11:56:39.501] Build status: STARTED
[11:56:39.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:35:0) after 3m31s
[12:00:10.561] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:35:0)
[12:00:10.597] Build status: STARTED
[12:00:10.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:36:0) after 1m28s
[12:01:38.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:36:0)
[12:01:38.639] Build status: STARTED
[12:01:38.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:37:0) after 5m11s
[12:06:49.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:37:0)
[12:06:49.679] Build status: STARTED
[12:06:49.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:38:0) after 8m6s
[12:14:55.719] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:38:0)
[12:14:55.740] Build status: STARTED
[12:14:55.740] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:39:0) after 7m2s
[12:21:57.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:39:0)
[12:21:57.874] Build status: STARTED
[12:21:57.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:40:0) after 1m47s
[12:23:44.982] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:40:0)
[12:23:45.072] Build status: STARTED
[12:23:45.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:41:0) after 6m23s
[12:30:08.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:41:0)
[12:30:08.236] Build status: STARTED
[12:30:08.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:42:0) after 5m41s
[12:35:49.258] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:42:0)
[12:35:49.339] Build status: STARTED
[12:35:49.339] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:43:0) after 8m17s
[12:44:06.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:43:0)
[12:44:06.748] Build status: STARTED
[12:44:06.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:44:0) after 8m29s
[12:52:35.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:44:0)
[12:52:35.787] Build status: STARTED
[12:52:35.787] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:45:0) after 1m6s
[12:53:42.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:45:0)
[12:53:42.154] Build status: STARTED
[12:53:42.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:46:0) after 8m59s
[13:02:41.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:46:0)
[13:02:41.275] Build status: STARTED
[13:02:41.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:47:0) after 5m35s
[13:08:16.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:47:0)
[13:08:16.616] Build status: STARTED
[13:08:16.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:48:0) after 6m44s
[13:15:00.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:48:0)
[13:15:00.665] Build status: STARTED
[13:15:00.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:49:0) after 4m7s
[13:19:07.760] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:49:0)
[13:19:07.779] Build status: STARTED
[13:19:07.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:50:0) after 5m49s
[13:24:56.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:50:0)
[13:24:56.820] Build status: STARTED
[13:24:56.820] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:51:0) after 4m45s
[13:29:41.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:51:0)
[13:29:41.859] Build status: STARTED
[13:29:41.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:52:0) after 8m51s
[13:38:32.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:52:0)
[13:38:32.905] Build status: STARTED
[13:38:32.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:53:0) after 8m57s
[13:47:30.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:53:0)
[13:47:30.084] Build status: STARTED
[13:47:30.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:54:0) after 2m46s
[13:50:16.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:54:0)
[13:50:16.227] Build status: STARTED
[13:50:16.227] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:55:0) after 8m31s
[13:58:47.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:55:0)
[13:58:47.258] Build status: STARTED
[13:58:47.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:56:0) after 1m49s
[14:00:36.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:56:0)
[14:00:36.303] Build status: STARTED
[14:00:36.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:57:0) after 6m50s
[14:07:26.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:57:0)
[14:07:26.344] Build status: STARTED
[14:07:26.345] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:58:0) after 2m42s
[14:10:08.367] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:58:0)
[14:10:08.385] Build status: STARTED
[14:10:08.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:59:0) after 2m27s
[14:12:35.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:59:0)
[14:12:35.444] Build status: STARTED
[14:12:35.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:60:0) after 9m16s
[14:21:51.517] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:60:0)
[14:21:51.543] Build status: STARTED
[14:21:51.543] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:61:0) after 6m17s
[14:28:08.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:61:0)
[14:28:08.580] Build status: STARTED
[14:28:08.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:62:0) after 3m14s
[14:31:22.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:62:0)
[14:31:22.622] Build status: STARTED
[14:31:22.622] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:63:0) after 8m58s
[14:40:20.655] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:63:0)
[14:40:20.672] Build status: STARTED
[14:40:20.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:64:0) after 9m32s
[14:49:52.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:64:0)
[14:49:52.807] Build status: STARTED
[14:49:52.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:65:0) after 3m17s
[14:53:09.925] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:65:0)
[14:53:09.945] Build status: STARTED
[14:53:09.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:66:0) after 8m15s
[15:01:24.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:66:0)
[15:01:24.991] Build status: STARTED
[15:01:24.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:67:0) after 7m34s
[15:08:59.011] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:67:0)
[15:08:59.037] Build status: STARTED
[15:08:59.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:68:0) after 2m25s
[15:11:24.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:68:0)
[15:11:24.193] Build status: STARTED
[15:11:24.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:69:0) after 1m11s
[15:12:35.208] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:69:0)
[15:12:35.250] Build status: STARTED
[15:12:35.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:70:0) after 5m13s
[15:17:48.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:70:0)
[15:17:48.313] Build status: STARTED
[15:17:48.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:71:0) after 9m37s
[15:27:25.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:71:0)
[15:27:25.451] Build status: STARTED
[15:27:25.451] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:72:0) after 7m41s
[15:35:06.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:72:0)
[15:35:06.668] Build status: STARTED
[15:35:06.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:73:0) after 9m9s
[15:44:15.804] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:73:0)
[15:44:15.831] Build status: STARTED
[15:44:15.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:74:0) after 7m39s
[15:51:54.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:74:0)
[15:51:54.873] Build status: STARTED
[15:51:54.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:75:0) after 1m36s
[15:53:30.923] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:75:0)
[15:53:31.018] Build status: STARTED
[15:53:31.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:76:0) after 4m23s
[15:57:54.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:76:0)
[15:57:54.079] Build status: STARTED
[15:57:54.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:77:0) after 4m44s
[16:02:38.099] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:77:0)
[16:02:38.121] Build status: STARTED
[16:02:38.122] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:78:0) after 1m54s
[16:04:32.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:78:0)
[16:04:32.167] Build status: STARTED
[16:04:32.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:79:0) after 6m46s
[16:11:18.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:79:0)
[16:11:18.502] Build status: STARTED
[16:11:18.502] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:80:0) after 5m36s
[16:16:54.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:80:0)
[16:16:54.554] Build status: STARTED
[16:16:54.554] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:81:0) after 1m31s
[16:18:25.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:81:0)
[16:18:25.610] Build status: STARTED
[16:18:25.610] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:82:0) after 9m37s
[16:28:02.621] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:82:0)
[16:28:02.641] Build status: STARTED
[16:28:02.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:83:0) after 1m2s
[16:29:04.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:83:0)
[16:29:04.771] Build status: STARTED
[16:29:04.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:84:0) after 9m50s
[16:38:54.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:84:0)
[16:38:54.962] Build status: STARTED
[16:38:54.962] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:85:0) after 1m1s
[16:39:55.979] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:85:0)
[16:39:55.999] Build status: STARTED
[16:39:55.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:86:0) after 5m26s
[16:45:22.166] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:86:0)
[16:45:22.316] Build status: STARTED
[16:45:22.316] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:87:0) after 7m33s
[16:52:55.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:87:0)
[16:52:55.374] Build status: STARTED
[16:52:55.374] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:88:0) after 4m23s
[16:57:18.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:88:0)
[16:57:18.520] Build status: STARTED
[16:57:18.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:89:0) after 5m44s
[17:03:02.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:89:0)
[17:03:02.644] Build status: STARTED
[17:03:02.644] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:90:0) after 7m22s
[17:10:24.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:90:0)
[17:10:24.737] Build status: STARTED
[17:10:24.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:91:0) after 5m47s
[17:16:11.774] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:91:0)
[17:16:11.792] Build status: STARTED
[17:16:11.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:92:0) after 2m53s
[17:19:04.843] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:92:0)
[17:19:04.944] Build status: STARTED
[17:19:04.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:93:0) after 2m3s
[17:21:07.963] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:93:0)
[17:21:07.983] Build status: STARTED
[17:21:07.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:94:0) after 9m20s
[17:30:28.156] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:94:0)
[17:30:28.186] Build status: STARTED
[17:30:28.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:95:0) after 6m57s
[17:37:25.451] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:95:0)
[17:37:25.474] Build status: STARTED
[17:37:25.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:96:0) after 2m24s
[17:39:49.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:96:0)
[17:39:49.728] Build status: STARTED
[17:39:49.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:97:0) after 4m50s
[17:44:39.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:97:0)
[17:44:39.768] Build status: STARTED
[17:44:39.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:98:0) after 6m7s
[17:50:47.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:98:0)
[17:50:47.064] Build status: STARTED
[17:50:47.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:99:0) after 5m11s
[17:55:58.090] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:99:0)
[17:55:58.112] Build status: STARTED
[17:55:58.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:100:0) after 7m37s
[18:03:35.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:100:0)
[18:03:35.307] Build status: STARTED
[18:03:35.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:101:0) after 2m2s
[18:05:37.352] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:101:0)
[18:05:37.458] Build status: STARTED
[18:05:37.458] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:102:0) after 7m22s
[18:12:59.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:102:0)
[18:12:59.744] Build status: STARTED
[18:12:59.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:103:0) after 9m49s
[18:22:48.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:103:0)
[18:22:48.801] Build status: STARTED
[18:22:48.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:104:0) after 5m4s
[18:27:52.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:104:0)
[18:27:52.909] Build status: STARTED
[18:27:52.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:105:0) after 3m14s
[18:31:07.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:105:0)
[18:31:07.034] Build status: STARTED
[18:31:07.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:106:0) after 4m59s
[18:36:06.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:106:0)
[18:36:06.154] Build status: STARTED
[18:36:06.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:107:0) after 7m4s
[18:43:10.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:107:0)
[18:43:10.376] Build status: STARTED
[18:43:10.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:108:0) after 4m8s
[18:47:18.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:108:0)
[18:47:18.532] Build status: STARTED
[18:47:18.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:109:0) after 6m1s
[18:53:19.519] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:109:0)
[18:53:19.552] Build status: STARTED
[18:53:19.552] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:110:0) after 3m17s
[18:56:36.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:110:0)
[18:56:36.680] Build status: STARTED
[18:56:36.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:111:0) after 7m47s
[19:04:23.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:111:0)
[19:04:23.725] Build status: STARTED
[19:04:23.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:112:0) after 9m5s
[19:13:28.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:112:0)
[19:13:28.774] Build status: STARTED
[19:13:28.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:113:0) after 7m12s
[19:20:40.798] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:113:0)
[19:20:40.848] Build status: STARTED
[19:20:40.848] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:114:0) after 3m37s
[19:24:18.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:114:0)
[19:24:18.093] Build status: STARTED
[19:24:18.093] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:115:0) after 5m10s
[19:29:28.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:115:0)
[19:29:28.147] Build status: STARTED
[19:29:28.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:116:0) after 7m16s
[19:36:44.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:116:0)
[19:36:44.269] Build status: STARTED
[19:36:44.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:117:0) after 4m46s
[19:41:30.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:117:0)
[19:41:30.316] Build status: STARTED
[19:41:30.316] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:118:0) after 8m32s
[19:50:02.331] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:118:0)
[19:50:02.349] Build status: STARTED
[19:50:02.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:119:0) after 9m49s
[19:59:51.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:119:0)
[19:59:51.417] Build status: STARTED
[19:59:51.417] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:120:0) after 9m48s
[20:09:39.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:120:0)
[20:09:39.641] Build status: STARTED
[20:09:39.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:121:0) after 5m28s
[20:15:07.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:121:0)
[20:15:07.793] Build status: STARTED
[20:15:07.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:122:0) after 9m56s
[20:25:03.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:122:0)
[20:25:03.848] Build status: STARTED
[20:25:03.848] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:123:0) after 2m34s
[20:27:37.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:123:0)
[20:27:37.926] Build status: STARTED
[20:27:37.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:124:0) after 5m25s
[20:33:02.999] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:124:0)
[20:33:03.026] Build status: STARTED
[20:33:03.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:125:0) after 2m37s
[20:35:40.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:125:0)
[20:35:40.080] Build status: STARTED
[20:35:40.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:126:0) after 5m44s
[20:41:24.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:126:0)
[20:41:24.383] Build status: STARTED
[20:41:24.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:127:0) after 3m9s
[20:44:33.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:127:0)
[20:44:33.576] Build status: STARTED
[20:44:33.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:128:0) after 4m13s
[20:48:46.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:128:0)
[20:48:46.614] Build status: STARTED
[20:48:46.614] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:129:0) after 2m5s
[20:50:51.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:129:0)
[20:50:52.010] Build status: STARTED
[20:50:52.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:130:0) after 2m0s
[20:52:52.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:130:0)
[20:52:52.048] Build status: STARTED
[20:52:52.048] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:131:0) after 2m58s
[20:55:50.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:131:0)
[20:55:50.185] Build status: STARTED
[20:55:50.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:132:0) after 8m22s
[21:04:12.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:132:0)
[21:04:12.333] Build status: STARTED
[21:04:12.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:133:0) after 8m22s
[21:12:34.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:133:0)
[21:12:34.487] Build status: STARTED
[21:12:34.487] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:134:0) after 1m21s
[21:13:55.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:134:0)
[21:13:55.536] Build status: STARTED
[21:13:55.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:135:0) after 3m28s
[21:17:23.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:135:0)
[21:17:23.584] Build status: STARTED
[21:17:23.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:136:0) after 6m47s
[21:24:10.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:136:0)
[21:24:10.799] Build status: STARTED
[21:24:10.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935781764094269552:137:0) after 5m51s
[21:25:17.432] Received PubSub notification, asking Buildbucket for the build status
[21:25:17.493] Build:
{
"id": "8770351702128440577",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1661,
"createdBy": "project:chromium",
"createTime": "2023-09-10T09:24:18.038794673Z",
"startTime": "2023-09-10T09:25:01.794902Z",
"endTime": "2023-09-10T21:25:16.835689755Z",
"updateTime": "2023-09-10T21:25:16.835689755Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc264b436ebbb5bd688d783636fd025f7bee2754",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:25:17.493] Invocation finished in 12h1m0.714092981s with status FAILED