[05:38:56.392] New invocation is queued and will start shortly
[05:38:57.527] Starting the invocation (attempt 1)
[05:38:57.561] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d2708e4527d206dd3413d04a9ecf1638c6922a02"
[05:38:57.562] Popped gitiles commit info from properties and tags
[05:38:57.562] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:38:57.562] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:38:57.562] Buildbucket request:
{
"requestId": "8883612088618093456",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2708e4527d206dd3413d04a9ecf1638c6922a02",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8883612088618093456"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:38:58.184] Scheduled build:
{
"id": "8718182026545913953",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3250,
"createdBy": "project:chromium",
"createTime": "2025-04-08T05:38:57.736436435Z",
"updateTime": "2025-04-08T05:38:57.736436435Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2708e4527d206dd3413d04a9ecf1638c6922a02",
"ref": "refs/heads/main"
}
}
}
[05:38:58.184] Task URL: https://cr-buildbucket.appspot.com/build/8718182026545913953
[05:38:58.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:2:0) after 8m13s
[05:38:59.169] Received PubSub notification, asking Buildbucket for the build status
[05:38:59.188] Build status: SCHEDULED
[05:39:03.046] Received PubSub notification, asking Buildbucket for the build status
[05:39:03.077] Build status: STARTED
[05:47:11.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:2:0)
[05:47:11.908] Build status: STARTED
[05:47:11.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:5:0) after 2m6s
[05:49:17.932] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:5:0)
[05:49:17.956] Build status: STARTED
[05:49:17.956] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:6:0) after 3m3s
[05:52:21.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:6:0)
[05:52:21.063] Build status: STARTED
[05:52:21.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:7:0) after 5m0s
[05:57:21.087] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:7:0)
[05:57:21.104] Build status: STARTED
[05:57:21.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:8:0) after 4m49s
[06:02:10.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:8:0)
[06:02:10.169] Build status: STARTED
[06:02:10.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:9:0) after 5m39s
[06:07:49.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:9:0)
[06:07:49.229] Build status: STARTED
[06:07:49.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:10:0) after 4m33s
[06:12:22.312] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:10:0)
[06:12:22.336] Build status: STARTED
[06:12:22.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:11:0) after 4m54s
[06:17:16.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:11:0)
[06:17:16.441] Build status: STARTED
[06:17:16.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:12:0) after 1m28s
[06:18:44.524] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:12:0)
[06:18:44.634] Build status: STARTED
[06:18:44.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:13:0) after 8m7s
[06:26:51.686] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:13:0)
[06:26:51.722] Build status: STARTED
[06:26:51.722] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:14:0) after 8m46s
[06:35:37.861] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:14:0)
[06:35:37.885] Build status: STARTED
[06:35:37.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:15:0) after 3m59s
[06:39:37.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:15:0)
[06:39:37.223] Build status: STARTED
[06:39:37.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:16:0) after 2m14s
[06:41:51.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:16:0)
[06:41:51.592] Build status: STARTED
[06:41:51.592] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:17:0) after 4m39s
[06:46:30.667] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:17:0)
[06:46:30.685] Build status: STARTED
[06:46:30.685] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:18:0) after 7m58s
[06:54:28.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:18:0)
[06:54:28.844] Build status: STARTED
[06:54:28.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:19:0) after 2m24s
[06:56:53.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:19:0)
[06:56:53.619] Build status: STARTED
[06:56:53.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:20:0) after 5m28s
[07:02:21.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:20:0)
[07:02:21.989] Build status: STARTED
[07:02:21.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:21:0) after 5m1s
[07:07:23.024] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:21:0)
[07:07:23.050] Build status: STARTED
[07:07:23.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:22:0) after 1m36s
[07:08:59.176] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:22:0)
[07:08:59.212] Build status: STARTED
[07:08:59.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:23:0) after 8m20s
[07:17:19.272] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:23:0)
[07:17:19.300] Build status: STARTED
[07:17:19.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:24:0) after 1m24s
[07:18:43.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:24:0)
[07:18:43.358] Build status: STARTED
[07:18:43.358] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:25:0) after 7m24s
[07:26:07.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:25:0)
[07:26:07.442] Build status: STARTED
[07:26:07.442] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:26:0) after 3m3s
[07:29:10.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:26:0)
[07:29:10.531] Build status: STARTED
[07:29:10.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:27:0) after 5m46s
[07:34:56.577] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:27:0)
[07:34:56.638] Build status: STARTED
[07:34:56.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:28:0) after 3m11s
[07:38:07.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:28:0)
[07:38:07.702] Build status: STARTED
[07:38:07.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:29:0) after 8m39s
[07:46:46.719] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:29:0)
[07:46:46.735] Build status: STARTED
[07:46:46.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:30:0) after 2m24s
[07:49:10.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:30:0)
[07:49:10.778] Build status: STARTED
[07:49:10.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:31:0) after 6m53s
[07:56:03.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:31:0)
[07:56:03.910] Build status: STARTED
[07:56:03.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:32:0) after 2m18s
[07:58:21.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:32:0)
[07:58:21.968] Build status: STARTED
[07:58:21.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:33:0) after 7m3s
[08:05:24.978] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:33:0)
[08:05:24.993] Build status: STARTED
[08:05:24.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:34:0) after 5m48s
[08:11:13.372] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:34:0)
[08:11:13.395] Build status: STARTED
[08:11:13.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:35:0) after 1m32s
[08:12:45.651] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:35:0)
[08:12:45.668] Build status: STARTED
[08:12:45.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:36:0) after 1m52s
[08:14:37.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:36:0)
[08:14:37.704] Build status: STARTED
[08:14:37.704] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:37:0) after 9m24s
[08:24:01.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:37:0)
[08:24:01.762] Build status: STARTED
[08:24:01.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:38:0) after 1m12s
[08:25:13.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:38:0)
[08:25:13.838] Build status: STARTED
[08:25:13.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:39:0) after 4m46s
[08:29:59.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:39:0)
[08:29:59.865] Build status: STARTED
[08:29:59.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:40:0) after 2m13s
[08:32:13.038] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:40:0)
[08:32:13.134] Build status: STARTED
[08:32:13.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:41:0) after 3m17s
[08:35:30.131] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:41:0)
[08:35:30.224] Build status: STARTED
[08:35:30.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:42:0) after 5m57s
[08:41:27.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:42:0)
[08:41:27.275] Build status: STARTED
[08:41:27.275] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:43:0) after 2m28s
[08:43:55.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:43:0)
[08:43:55.486] Build status: STARTED
[08:43:55.486] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:44:0) after 9m6s
[08:53:01.522] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:44:0)
[08:53:01.621] Build status: STARTED
[08:53:01.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:45:0) after 9m8s
[09:02:09.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:45:0)
[09:02:09.665] Build status: STARTED
[09:02:09.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:46:0) after 8m50s
[09:10:59.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:46:0)
[09:10:59.720] Build status: STARTED
[09:10:59.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:47:0) after 7m32s
[09:18:31.863] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:47:0)
[09:18:31.880] Build status: STARTED
[09:18:31.880] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:48:0) after 8m52s
[09:27:23.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:48:0)
[09:27:23.964] Build status: STARTED
[09:27:23.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:49:0) after 7m33s
[09:34:57.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:49:0)
[09:34:57.166] Build status: STARTED
[09:34:57.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:50:0) after 1m35s
[09:36:32.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:50:0)
[09:36:32.214] Build status: STARTED
[09:36:32.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:51:0) after 2m25s
[09:38:57.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:51:0)
[09:38:57.336] Build status: STARTED
[09:38:57.337] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:52:0) after 7m57s
[09:46:54.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:52:0)
[09:46:54.431] Build status: STARTED
[09:46:54.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:53:0) after 6m40s
[09:53:34.464] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:53:0)
[09:53:34.494] Build status: STARTED
[09:53:34.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:54:0) after 3m43s
[09:57:17.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:54:0)
[09:57:17.603] Build status: STARTED
[09:57:17.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:55:0) after 4m12s
[10:01:29.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:55:0)
[10:01:29.634] Build status: STARTED
[10:01:29.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:56:0) after 7m9s
[10:08:38.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:56:0)
[10:08:38.718] Build status: STARTED
[10:08:38.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:57:0) after 6m8s
[10:14:46.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:57:0)
[10:14:46.935] Build status: STARTED
[10:14:46.935] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:58:0) after 9m2s
[10:23:48.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:58:0)
[10:23:48.991] Build status: STARTED
[10:23:48.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:59:0) after 5m38s
[10:29:27.085] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:59:0)
[10:29:27.102] Build status: STARTED
[10:29:27.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:60:0) after 3m15s
[10:32:42.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:60:0)
[10:32:42.150] Build status: STARTED
[10:32:42.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:61:0) after 4m0s
[10:36:42.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:61:0)
[10:36:42.209] Build status: STARTED
[10:36:42.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:62:0) after 4m38s
[10:41:20.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:62:0)
[10:41:20.242] Build status: STARTED
[10:41:20.242] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:63:0) after 7m31s
[10:48:51.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:63:0)
[10:48:51.370] Build status: STARTED
[10:48:51.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:64:0) after 5m41s
[10:54:32.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:64:0)
[10:54:32.494] Build status: STARTED
[10:54:32.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:65:0) after 4m28s
[10:59:00.662] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:65:0)
[10:59:00.678] Build status: STARTED
[10:59:00.678] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:66:0) after 1m57s
[11:00:57.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:66:0)
[11:00:58.014] Build status: STARTED
[11:00:58.014] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:67:0) after 1m20s
[11:02:18.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:67:0)
[11:02:18.127] Build status: STARTED
[11:02:18.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:68:0) after 6m17s
[11:08:35.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:68:0)
[11:08:35.138] Build status: STARTED
[11:08:35.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:69:0) after 9m16s
[11:17:51.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:69:0)
[11:17:51.230] Build status: STARTED
[11:17:51.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:70:0) after 5m35s
[11:23:26.258] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:70:0)
[11:23:26.284] Build status: STARTED
[11:23:26.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:71:0) after 3m57s
[11:27:23.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:71:0)
[11:27:23.329] Build status: STARTED
[11:27:23.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:72:0) after 9m58s
[11:37:21.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:72:0)
[11:37:21.385] Build status: STARTED
[11:37:21.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:73:0) after 3m37s
[11:40:58.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:73:0)
[11:40:58.443] Build status: STARTED
[11:40:58.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:74:0) after 8m7s
[11:49:05.519] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:74:0)
[11:49:05.541] Build status: STARTED
[11:49:05.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:75:0) after 9m28s
[11:58:33.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:75:0)
[11:58:33.603] Build status: STARTED
[11:58:33.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:76:0) after 8m21s
[12:06:54.642] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:76:0)
[12:06:54.661] Build status: STARTED
[12:06:54.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:77:0) after 8m13s
[12:15:07.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:77:0)
[12:15:07.730] Build status: STARTED
[12:15:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:78:0) after 8m19s
[12:23:26.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:78:0)
[12:23:26.789] Build status: STARTED
[12:23:26.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:79:0) after 8m14s
[12:31:41.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:79:0)
[12:31:41.163] Build status: STARTED
[12:31:41.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:80:0) after 9m41s
[12:41:22.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:80:0)
[12:41:22.252] Build status: STARTED
[12:41:22.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:81:0) after 1m11s
[12:42:33.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:81:0)
[12:42:33.556] Build status: STARTED
[12:42:33.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:82:0) after 6m33s
[12:49:06.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:82:0)
[12:49:06.629] Build status: STARTED
[12:49:06.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:83:0) after 7m32s
[12:56:39.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:83:0)
[12:56:39.650] Build status: STARTED
[12:56:39.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:84:0) after 6m43s
[13:03:22.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:84:0)
[13:03:22.879] Build status: STARTED
[13:03:22.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:85:0) after 6m50s
[13:10:12.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:85:0)
[13:10:12.927] Build status: STARTED
[13:10:12.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:86:0) after 4m46s
[13:14:58.950] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:86:0)
[13:14:58.976] Build status: STARTED
[13:14:58.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:87:0) after 9m54s
[13:24:53.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:87:0)
[13:24:53.077] Build status: STARTED
[13:24:53.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:88:0) after 3m10s
[13:28:03.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:88:0)
[13:28:03.125] Build status: STARTED
[13:28:03.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:89:0) after 9m54s
[13:37:57.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:89:0)
[13:37:57.189] Build status: STARTED
[13:37:57.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:90:0) after 5m57s
[13:43:54.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:90:0)
[13:43:54.288] Build status: STARTED
[13:43:54.288] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:91:0) after 1m51s
[13:45:45.313] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:91:0)
[13:45:45.327] Build status: STARTED
[13:45:45.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:92:0) after 5m46s
[13:51:31.323] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:92:0)
[13:51:31.348] Build status: STARTED
[13:51:31.348] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:93:0) after 6m26s
[13:57:57.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:93:0)
[13:57:57.402] Build status: STARTED
[13:57:57.402] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:94:0) after 9m48s
[14:07:45.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:94:0)
[14:07:45.630] Build status: STARTED
[14:07:45.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:95:0) after 3m35s
[14:11:20.655] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:95:0)
[14:11:20.693] Build status: STARTED
[14:11:20.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:96:0) after 9m0s
[14:20:20.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:96:0)
[14:20:20.812] Build status: STARTED
[14:20:20.812] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:97:0) after 4m56s
[14:25:16.846] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:97:0)
[14:25:16.864] Build status: STARTED
[14:25:16.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:98:0) after 4m9s
[14:29:25.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:98:0)
[14:29:25.903] Build status: STARTED
[14:29:25.904] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:99:0) after 4m36s
[14:34:02.021] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:99:0)
[14:34:02.041] Build status: STARTED
[14:34:02.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:100:0) after 6m41s
[14:40:43.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:100:0)
[14:40:43.236] Build status: STARTED
[14:40:43.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:101:0) after 4m42s
[14:45:25.293] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:101:0)
[14:45:25.404] Build status: STARTED
[14:45:25.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:102:0) after 3m28s
[14:48:53.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:102:0)
[14:48:53.598] Build status: STARTED
[14:48:53.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:103:0) after 3m22s
[14:52:15.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:103:0)
[14:52:15.656] Build status: STARTED
[14:52:15.656] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:104:0) after 1m22s
[14:53:37.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:104:0)
[14:53:37.702] Build status: STARTED
[14:53:37.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:105:0) after 5m57s
[14:59:34.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:105:0)
[14:59:34.799] Build status: STARTED
[14:59:34.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:106:0) after 2m44s
[15:02:18.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:106:0)
[15:02:18.906] Build status: STARTED
[15:02:18.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:107:0) after 8m1s
[15:10:19.961] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:107:0)
[15:10:19.983] Build status: STARTED
[15:10:19.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:108:0) after 7m25s
[15:17:45.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:108:0)
[15:17:45.079] Build status: STARTED
[15:17:45.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:109:0) after 8m31s
[15:26:16.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:109:0)
[15:26:16.184] Build status: STARTED
[15:26:16.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:110:0) after 6m26s
[15:32:42.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:110:0)
[15:32:42.250] Build status: STARTED
[15:32:42.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:111:0) after 9m23s
[15:42:05.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:111:0)
[15:42:05.287] Build status: STARTED
[15:42:05.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:112:0) after 9m42s
[15:51:47.383] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:112:0)
[15:51:47.399] Build status: STARTED
[15:51:47.399] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:113:0) after 5m53s
[15:57:40.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:113:0)
[15:57:40.551] Build status: STARTED
[15:57:40.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:114:0) after 4m3s
[16:01:43.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:114:0)
[16:01:43.638] Build status: STARTED
[16:01:43.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:115:0) after 2m0s
[16:03:43.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:115:0)
[16:03:43.732] Build status: STARTED
[16:03:43.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:116:0) after 4m25s
[16:08:08.762] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:116:0)
[16:08:08.781] Build status: STARTED
[16:08:08.781] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:117:0) after 3m29s
[16:11:37.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:117:0)
[16:11:37.970] Build status: STARTED
[16:11:37.970] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:118:0) after 9m45s
[16:21:22.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:118:0)
[16:21:23.019] Build status: STARTED
[16:21:23.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:119:0) after 8m6s
[16:29:29.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:119:0)
[16:29:29.063] Build status: STARTED
[16:29:29.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:120:0) after 4m9s
[16:33:38.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:120:0)
[16:33:38.205] Build status: STARTED
[16:33:38.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:121:0) after 3m8s
[16:36:46.266] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:121:0)
[16:36:46.285] Build status: STARTED
[16:36:46.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:122:0) after 2m41s
[16:39:27.365] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:122:0)
[16:39:27.397] Build status: STARTED
[16:39:27.397] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:123:0) after 7m20s
[16:46:47.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:123:0)
[16:46:47.511] Build status: STARTED
[16:46:47.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:124:0) after 6m33s
[16:53:20.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:124:0)
[16:53:20.679] Build status: STARTED
[16:53:20.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:125:0) after 3m32s
[16:56:52.759] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:125:0)
[16:56:52.785] Build status: STARTED
[16:56:52.785] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:126:0) after 6m58s
[17:03:50.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:126:0)
[17:03:50.799] Build status: STARTED
[17:03:50.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:127:0) after 7m54s
[17:11:44.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:127:0)
[17:11:44.911] Build status: STARTED
[17:11:44.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:128:0) after 3m51s
[17:15:36.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:128:0)
[17:15:36.050] Build status: STARTED
[17:15:36.050] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:129:0) after 2m20s
[17:17:56.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:129:0)
[17:17:56.116] Build status: STARTED
[17:17:56.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:130:0) after 7m5s
[17:25:01.140] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:130:0)
[17:25:01.159] Build status: STARTED
[17:25:01.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:131:0) after 9m47s
[17:34:48.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:131:0)
[17:34:48.233] Build status: STARTED
[17:34:48.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8883612088618093456:132:0) after 9m21s
[17:40:40.898] Received PubSub notification, asking Buildbucket for the build status
[17:40:40.923] Build:
{
"id": "8718182026545913953",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3250,
"createdBy": "project:chromium",
"createTime": "2025-04-08T05:38:57.736436435Z",
"startTime": "2025-04-08T05:39:02.777045057Z",
"endTime": "2025-04-08T17:40:40.030916882Z",
"updateTime": "2025-04-08T17:40:40.030916882Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d2708e4527d206dd3413d04a9ecf1638c6922a02",
"ref": "refs/heads/main"
}
}
}
[17:40:40.923] Invocation finished in 12h1m44.546576131s with status FAILED