[10:02:31.191] New invocation is queued and will start shortly
[10:02:32.245] Starting the invocation (attempt 1)
[10:02:32.287] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/eb78f6c171696cdcb36aeff50d64b081166d57d4"
[10:02:32.287] Popped gitiles commit info from properties and tags
[10:02:32.287] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:02:32.287] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:02:32.288] Buildbucket request:
{
"requestId": "8881602372338028816",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eb78f6c171696cdcb36aeff50d64b081166d57d4",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8881602372338028816"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:02:32.877] Scheduled build:
{
"id": "8716172310467283521",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3294,
"createdBy": "project:chromium",
"createTime": "2025-04-30T10:02:32.344474573Z",
"updateTime": "2025-04-30T10:02:32.344474573Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eb78f6c171696cdcb36aeff50d64b081166d57d4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[10:02:32.877] Task URL: https://cr-buildbucket.appspot.com/build/8716172310467283521
[10:02:32.877] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:2:0) after 3m17s
[10:02:34.226] Received PubSub notification, asking Buildbucket for the build status
[10:02:34.250] Build status: SCHEDULED
[10:02:38.460] Received PubSub notification, asking Buildbucket for the build status
[10:02:38.487] Build status: STARTED
[10:05:50.047] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:2:0)
[10:05:50.082] Build status: STARTED
[10:05:50.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:5:0) after 5m52s
[10:11:42.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:5:0)
[10:11:42.279] Build status: STARTED
[10:11:42.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:6:0) after 8m2s
[10:19:44.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:6:0)
[10:19:44.335] Build status: STARTED
[10:19:44.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:7:0) after 1m58s
[10:21:42.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:7:0)
[10:21:42.408] Build status: STARTED
[10:21:42.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:8:0) after 7m30s
[10:29:12.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:8:0)
[10:29:12.522] Build status: STARTED
[10:29:12.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:9:0) after 8m49s
[10:38:01.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:9:0)
[10:38:01.589] Build status: STARTED
[10:38:01.589] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:10:0) after 1m38s
[10:39:39.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:10:0)
[10:39:39.661] Build status: STARTED
[10:39:39.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:11:0) after 4m39s
[10:44:19.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:11:0)
[10:44:19.128] Build status: STARTED
[10:44:19.128] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:12:0) after 3m4s
[10:47:23.456] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:12:0)
[10:47:23.474] Build status: STARTED
[10:47:23.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:13:0) after 7m27s
[10:54:50.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:13:0)
[10:54:50.527] Build status: STARTED
[10:54:50.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:14:0) after 9m54s
[11:04:44.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:14:0)
[11:04:44.976] Build status: STARTED
[11:04:44.976] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:15:0) after 4m19s
[11:09:04.047] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:15:0)
[11:09:04.075] Build status: STARTED
[11:09:04.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:16:0) after 7m15s
[11:16:19.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:16:0)
[11:16:19.132] Build status: STARTED
[11:16:19.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:17:0) after 6m30s
[11:22:49.215] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:17:0)
[11:22:49.238] Build status: STARTED
[11:22:49.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:18:0) after 1m55s
[11:24:44.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:18:0)
[11:24:44.466] Build status: STARTED
[11:24:44.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:19:0) after 5m43s
[11:30:27.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:19:0)
[11:30:27.692] Build status: STARTED
[11:30:27.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:20:0) after 5m16s
[11:35:43.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:20:0)
[11:35:43.748] Build status: STARTED
[11:35:43.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:21:0) after 2m45s
[11:38:28.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:21:0)
[11:38:28.797] Build status: STARTED
[11:38:28.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:22:0) after 8m35s
[11:47:03.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:22:0)
[11:47:03.920] Build status: STARTED
[11:47:03.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:23:0) after 1m55s
[11:48:58.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:23:0)
[11:48:58.973] Build status: STARTED
[11:48:58.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:24:0) after 6m19s
[11:55:18.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:24:0)
[11:55:18.067] Build status: STARTED
[11:55:18.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:25:0) after 7m18s
[12:02:36.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:25:0)
[12:02:36.170] Build status: STARTED
[12:02:36.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:26:0) after 8m5s
[12:10:41.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:26:0)
[12:10:41.284] Build status: STARTED
[12:10:41.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:27:0) after 8m50s
[12:19:32.030] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:27:0)
[12:19:32.052] Build status: STARTED
[12:19:32.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:28:0) after 8m1s
[12:27:33.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:28:0)
[12:27:33.100] Build status: STARTED
[12:27:33.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:29:0) after 4m59s
[12:32:32.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:29:0)
[12:32:32.186] Build status: STARTED
[12:32:32.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:30:0) after 5m49s
[12:38:21.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:30:0)
[12:38:21.287] Build status: STARTED
[12:38:21.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:31:0) after 1m37s
[12:39:58.307] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:31:0)
[12:39:58.326] Build status: STARTED
[12:39:58.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:32:0) after 3m29s
[12:43:27.367] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:32:0)
[12:43:27.384] Build status: STARTED
[12:43:27.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:33:0) after 9m5s
[12:52:32.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:33:0)
[12:52:32.676] Build status: STARTED
[12:52:32.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:34:0) after 7m7s
[12:59:39.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:34:0)
[12:59:39.898] Build status: STARTED
[12:59:39.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:35:0) after 9m13s
[13:08:52.926] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:35:0)
[13:08:52.942] Build status: STARTED
[13:08:52.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:36:0) after 3m5s
[13:11:57.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:36:0)
[13:11:57.990] Build status: STARTED
[13:11:57.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:37:0) after 1m23s
[13:13:21.026] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:37:0)
[13:13:21.041] Build status: STARTED
[13:13:21.041] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:38:0) after 6m36s
[13:19:57.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:38:0)
[13:19:57.119] Build status: STARTED
[13:19:57.119] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:39:0) after 6m54s
[13:26:51.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:39:0)
[13:26:51.318] Build status: STARTED
[13:26:51.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:40:0) after 5m16s
[13:32:07.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:40:0)
[13:32:07.369] Build status: STARTED
[13:32:07.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:41:0) after 5m20s
[13:37:27.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:41:0)
[13:37:27.415] Build status: STARTED
[13:37:27.415] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:42:0) after 8m3s
[13:45:30.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:42:0)
[13:45:30.469] Build status: STARTED
[13:45:30.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:43:0) after 1m3s
[13:46:33.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:43:0)
[13:46:33.506] Build status: STARTED
[13:46:33.506] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:44:0) after 3m29s
[13:50:02.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:44:0)
[13:50:02.632] Build status: STARTED
[13:50:02.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:45:0) after 3m14s
[13:53:16.655] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:45:0)
[13:53:16.669] Build status: STARTED
[13:53:16.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:46:0) after 4m28s
[13:57:44.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:46:0)
[13:57:44.713] Build status: STARTED
[13:57:44.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:47:0) after 2m15s
[13:59:59.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:47:0)
[13:59:59.759] Build status: STARTED
[13:59:59.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:48:0) after 8m3s
[14:08:02.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:48:0)
[14:08:02.910] Build status: STARTED
[14:08:02.910] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:49:0) after 7m36s
[14:15:39.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:49:0)
[14:15:39.035] Build status: STARTED
[14:15:39.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:50:0) after 9m43s
[14:25:22.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:50:0)
[14:25:22.167] Build status: STARTED
[14:25:22.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:51:0) after 7m37s
[14:32:59.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:51:0)
[14:32:59.233] Build status: STARTED
[14:32:59.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:52:0) after 9m42s
[14:42:41.383] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:52:0)
[14:42:41.403] Build status: STARTED
[14:42:41.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:53:0) after 9m58s
[14:52:39.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:53:0)
[14:52:39.454] Build status: STARTED
[14:52:39.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:54:0) after 2m29s
[14:55:08.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:54:0)
[14:55:08.500] Build status: STARTED
[14:55:08.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:55:0) after 6m20s
[15:01:28.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:55:0)
[15:01:28.574] Build status: STARTED
[15:01:28.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:56:0) after 7m37s
[15:09:05.623] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:56:0)
[15:09:05.641] Build status: STARTED
[15:09:05.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:57:0) after 9m52s
[15:18:57.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:57:0)
[15:18:57.649] Build status: STARTED
[15:18:57.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:58:0) after 7m4s
[15:26:01.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:58:0)
[15:26:01.754] Build status: STARTED
[15:26:01.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:59:0) after 9m13s
[15:35:14.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:59:0)
[15:35:14.834] Build status: STARTED
[15:35:14.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:60:0) after 3m8s
[15:38:22.900] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:60:0)
[15:38:22.923] Build status: STARTED
[15:38:22.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:61:0) after 9m26s
[15:47:48.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:61:0)
[15:47:48.972] Build status: STARTED
[15:47:48.972] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:62:0) after 1m59s
[15:49:47.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:62:0)
[15:49:48.117] Build status: STARTED
[15:49:48.117] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:63:0) after 8m47s
[15:58:35.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:63:0)
[15:58:35.299] Build status: STARTED
[15:58:35.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:64:0) after 4m10s
[16:02:45.390] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:64:0)
[16:02:45.425] Build status: STARTED
[16:02:45.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:65:0) after 9m48s
[16:12:33.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:65:0)
[16:12:33.514] Build status: STARTED
[16:12:33.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:66:0) after 4m50s
[16:17:23.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:66:0)
[16:17:23.586] Build status: STARTED
[16:17:23.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:67:0) after 3m23s
[16:20:46.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:67:0)
[16:20:46.629] Build status: STARTED
[16:20:46.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:68:0) after 5m55s
[16:26:41.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:68:0)
[16:26:41.700] Build status: STARTED
[16:26:41.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:69:0) after 7m29s
[16:34:10.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:69:0)
[16:34:10.810] Build status: STARTED
[16:34:10.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:70:0) after 7m16s
[16:41:26.885] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:70:0)
[16:41:26.906] Build status: STARTED
[16:41:26.907] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:71:0) after 8m18s
[16:49:44.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:71:0)
[16:49:44.992] Build status: STARTED
[16:49:44.992] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:72:0) after 2m31s
[16:52:16.067] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:72:0)
[16:52:16.100] Build status: STARTED
[16:52:16.100] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:73:0) after 8m8s
[17:00:24.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:73:0)
[17:00:24.191] Build status: STARTED
[17:00:24.191] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:74:0) after 1m52s
[17:02:16.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:74:0)
[17:02:16.297] Build status: STARTED
[17:02:16.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:75:0) after 4m53s
[17:07:09.350] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:75:0)
[17:07:09.509] Build status: STARTED
[17:07:09.509] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:76:0) after 8m3s
[17:15:12.592] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:76:0)
[17:15:12.667] Build status: STARTED
[17:15:12.667] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:77:0) after 2m47s
[17:17:59.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:77:0)
[17:17:59.728] Build status: STARTED
[17:17:59.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:78:0) after 3m8s
[17:21:07.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:78:0)
[17:21:07.823] Build status: STARTED
[17:21:07.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:79:0) after 4m34s
[17:25:41.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:79:0)
[17:25:41.926] Build status: STARTED
[17:25:41.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:80:0) after 7m51s
[17:33:33.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:80:0)
[17:33:33.160] Build status: STARTED
[17:33:33.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:81:0) after 8m3s
[17:41:36.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:81:0)
[17:41:36.215] Build status: STARTED
[17:41:36.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:82:0) after 4m25s
[17:46:01.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:82:0)
[17:46:01.269] Build status: STARTED
[17:46:01.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:83:0) after 6m9s
[17:52:10.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:83:0)
[17:52:10.420] Build status: STARTED
[17:52:10.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:84:0) after 4m31s
[17:56:41.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:84:0)
[17:56:41.583] Build status: STARTED
[17:56:41.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:85:0) after 2m25s
[17:59:06.716] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:85:0)
[17:59:06.746] Build status: STARTED
[17:59:06.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:86:0) after 4m0s
[18:03:06.923] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:86:0)
[18:03:06.951] Build status: STARTED
[18:03:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:87:0) after 4m19s
[18:07:26.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:87:0)
[18:07:26.056] Build status: STARTED
[18:07:26.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:88:0) after 6m2s
[18:13:28.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:88:0)
[18:13:28.186] Build status: STARTED
[18:13:28.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:89:0) after 1m2s
[18:14:30.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:89:0)
[18:14:30.232] Build status: STARTED
[18:14:30.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:90:0) after 7m53s
[18:22:23.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:90:0)
[18:22:23.238] Build status: STARTED
[18:22:23.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:91:0) after 9m9s
[18:31:32.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:91:0)
[18:31:32.302] Build status: STARTED
[18:31:32.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:92:0) after 4m19s
[18:35:51.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:92:0)
[18:35:51.449] Build status: STARTED
[18:35:51.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:93:0) after 5m22s
[18:41:13.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:93:0)
[18:41:13.499] Build status: STARTED
[18:41:13.499] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:94:0) after 2m32s
[18:43:45.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:94:0)
[18:43:45.595] Build status: STARTED
[18:43:45.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:95:0) after 3m55s
[18:47:40.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:95:0)
[18:47:40.693] Build status: STARTED
[18:47:40.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:96:0) after 4m57s
[18:52:37.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:96:0)
[18:52:37.786] Build status: STARTED
[18:52:37.786] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:97:0) after 8m11s
[19:00:48.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:97:0)
[19:00:48.891] Build status: STARTED
[19:00:48.891] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:98:0) after 8m16s
[19:09:04.881] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:98:0)
[19:09:04.903] Build status: STARTED
[19:09:04.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:99:0) after 5m18s
[19:14:22.995] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:99:0)
[19:14:23.047] Build status: STARTED
[19:14:23.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:100:0) after 8m44s
[19:23:07.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:100:0)
[19:23:07.232] Build status: STARTED
[19:23:07.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:101:0) after 8m11s
[19:31:18.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:101:0)
[19:31:18.307] Build status: STARTED
[19:31:18.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:102:0) after 4m52s
[19:36:10.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:102:0)
[19:36:10.435] Build status: STARTED
[19:36:10.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:103:0) after 2m51s
[19:39:01.460] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:103:0)
[19:39:01.556] Build status: STARTED
[19:39:01.556] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:104:0) after 4m18s
[19:43:19.568] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:104:0)
[19:43:19.592] Build status: STARTED
[19:43:19.592] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:105:0) after 9m35s
[19:52:54.623] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:105:0)
[19:52:54.951] Build status: STARTED
[19:52:54.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:106:0) after 6m9s
[19:59:04.011] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:106:0)
[19:59:04.080] Build status: STARTED
[19:59:04.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:107:0) after 1m17s
[20:00:21.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:107:0)
[20:00:21.180] Build status: STARTED
[20:00:21.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:108:0) after 7m52s
[20:08:13.207] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:108:0)
[20:08:13.272] Build status: STARTED
[20:08:13.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:109:0) after 8m52s
[20:17:05.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:109:0)
[20:17:05.473] Build status: STARTED
[20:17:05.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:110:0) after 2m40s
[20:19:45.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:110:0)
[20:19:45.570] Build status: STARTED
[20:19:45.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:111:0) after 3m50s
[20:23:35.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:111:0)
[20:23:35.684] Build status: STARTED
[20:23:35.684] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:112:0) after 6m58s
[20:30:33.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:112:0)
[20:30:33.742] Build status: STARTED
[20:30:33.742] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:113:0) after 4m6s
[20:34:39.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:113:0)
[20:34:39.850] Build status: STARTED
[20:34:39.850] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:114:0) after 5m40s
[20:40:19.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:114:0)
[20:40:19.900] Build status: STARTED
[20:40:19.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:115:0) after 7m38s
[20:47:57.930] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:115:0)
[20:47:57.954] Build status: STARTED
[20:47:57.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:116:0) after 3m16s
[20:51:14.033] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:116:0)
[20:51:14.088] Build status: STARTED
[20:51:14.089] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:117:0) after 2m17s
[20:53:31.112] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:117:0)
[20:53:31.130] Build status: STARTED
[20:53:31.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:118:0) after 7m37s
[21:01:08.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:118:0)
[21:01:08.182] Build status: STARTED
[21:01:08.182] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:119:0) after 5m39s
[21:06:47.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:119:0)
[21:06:47.253] Build status: STARTED
[21:06:47.253] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:120:0) after 8m8s
[21:14:55.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:120:0)
[21:14:55.298] Build status: STARTED
[21:14:55.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:121:0) after 1m1s
[21:15:56.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:121:0)
[21:15:56.488] Build status: STARTED
[21:15:56.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:122:0) after 2m13s
[21:18:09.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:122:0)
[21:18:09.602] Build status: STARTED
[21:18:09.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:123:0) after 5m24s
[21:23:33.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:123:0)
[21:23:33.650] Build status: STARTED
[21:23:33.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:124:0) after 2m41s
[21:26:14.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:124:0)
[21:26:14.705] Build status: STARTED
[21:26:14.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:125:0) after 6m10s
[21:32:24.744] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:125:0)
[21:32:24.763] Build status: STARTED
[21:32:24.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:126:0) after 6m33s
[21:38:57.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:126:0)
[21:38:57.915] Build status: STARTED
[21:38:57.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:127:0) after 1m55s
[21:40:53.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:127:0)
[21:40:53.141] Build status: STARTED
[21:40:53.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:128:0) after 9m56s
[21:50:49.168] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:128:0)
[21:50:49.186] Build status: STARTED
[21:50:49.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:129:0) after 1m58s
[21:52:47.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:129:0)
[21:52:47.256] Build status: STARTED
[21:52:47.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:130:0) after 3m35s
[21:56:22.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:130:0)
[21:56:22.492] Build status: STARTED
[21:56:22.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:131:0) after 3m26s
[21:59:48.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:131:0)
[21:59:48.511] Build status: STARTED
[21:59:48.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:132:0) after 1m8s
[22:00:56.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:132:0)
[22:00:56.682] Build status: STARTED
[22:00:56.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:133:0) after 3m25s
[22:04:21.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:133:0)
[22:04:21.760] Build status: STARTED
[22:04:21.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:134:0) after 3m23s
[22:07:44.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:134:0)
[22:07:44.808] Build status: STARTED
[22:07:44.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:135:0) after 1m25s
[22:09:09.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:135:0)
[22:09:09.920] Build status: STARTED
[22:09:09.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881602372338028816:136:0) after 5m24s
[22:13:21.760] Received PubSub notification, asking Buildbucket for the build status
[22:13:21.778] Build:
{
"id": "8716172310467283521",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3294,
"createdBy": "project:chromium",
"createTime": "2025-04-30T10:02:32.344474573Z",
"startTime": "2025-04-30T10:02:37.774237943Z",
"endTime": "2025-04-30T22:13:21.425332154Z",
"updateTime": "2025-04-30T22:13:21.425332154Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "eb78f6c171696cdcb36aeff50d64b081166d57d4",
"ref": "refs/heads/main"
}
},
"canary": true
}
[22:13:21.778] Invocation finished in 12h10m50.602128602s with status FAILED