[13:47:09.244] New invocation is queued and will start shortly
[13:47:10.687] Starting the invocation (attempt 1)
[13:47:10.710] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/23ebe6cb6e5f0dec9ccfd7eb9aa07807309a877d"
[13:47:10.710] Popped gitiles commit info from properties and tags
[13:47:10.710] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:47:10.717] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:47:10.717] Buildbucket request:
{
"requestId": "8880229285078253776",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23ebe6cb6e5f0dec9ccfd7eb9aa07807309a877d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8880229285078253776"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:47:11.240] Scheduled build:
{
"id": "8714799222801610241",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3324,
"createdBy": "project:chromium",
"createTime": "2025-05-15T13:47:10.784214609Z",
"updateTime": "2025-05-15T13:47:10.784214609Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23ebe6cb6e5f0dec9ccfd7eb9aa07807309a877d",
"ref": "refs/heads/main"
}
}
}
[13:47:11.240] Task URL: https://cr-buildbucket.appspot.com/build/8714799222801610241
[13:47:11.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:2:0) after 6m26s
[13:47:12.223] Received PubSub notification, asking Buildbucket for the build status
[13:47:12.271] Build status: SCHEDULED
[13:47:18.010] Received PubSub notification, asking Buildbucket for the build status
[13:47:18.039] Build status: STARTED
[13:53:37.319] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:2:0)
[13:53:37.383] Build status: STARTED
[13:53:37.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:5:0) after 2m2s
[13:55:39.413] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:5:0)
[13:55:39.440] Build status: STARTED
[13:55:39.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:6:0) after 8m8s
[14:03:47.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:6:0)
[14:03:47.633] Build status: STARTED
[14:03:47.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:7:0) after 3m11s
[14:06:58.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:7:0)
[14:06:58.692] Build status: STARTED
[14:06:58.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:8:0) after 1m31s
[14:08:29.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:8:0)
[14:08:29.741] Build status: STARTED
[14:08:29.741] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:9:0) after 2m9s
[14:10:38.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:9:0)
[14:10:38.776] Build status: STARTED
[14:10:38.776] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:10:0) after 5m32s
[14:16:10.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:10:0)
[14:16:10.871] Build status: STARTED
[14:16:10.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:11:0) after 7m30s
[14:23:40.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:11:0)
[14:23:40.925] Build status: STARTED
[14:23:40.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:12:0) after 2m49s
[14:26:29.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:12:0)
[14:26:29.979] Build status: STARTED
[14:26:29.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:13:0) after 4m52s
[14:31:22.061] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:13:0)
[14:31:22.129] Build status: STARTED
[14:31:22.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:14:0) after 3m28s
[14:34:50.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:14:0)
[14:34:50.207] Build status: STARTED
[14:34:50.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:15:0) after 7m1s
[14:41:51.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:15:0)
[14:41:51.463] Build status: STARTED
[14:41:51.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:16:0) after 3m29s
[14:45:20.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:16:0)
[14:45:20.514] Build status: STARTED
[14:45:20.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:17:0) after 3m47s
[14:49:07.662] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:17:0)
[14:49:07.682] Build status: STARTED
[14:49:07.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:18:0) after 2m4s
[14:51:11.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:18:0)
[14:51:11.720] Build status: STARTED
[14:51:11.720] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:19:0) after 7m21s
[14:58:32.783] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:19:0)
[14:58:32.808] Build status: STARTED
[14:58:32.808] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:20:0) after 2m35s
[15:01:08.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:20:0)
[15:01:08.125] Build status: STARTED
[15:01:08.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:21:0) after 4m4s
[15:05:12.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:21:0)
[15:05:12.288] Build status: STARTED
[15:05:12.288] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:22:0) after 5m38s
[15:10:50.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:22:0)
[15:10:50.371] Build status: STARTED
[15:10:50.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:23:0) after 6m49s
[15:17:39.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:23:0)
[15:17:39.429] Build status: STARTED
[15:17:39.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:24:0) after 7m39s
[15:25:18.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:24:0)
[15:25:18.471] Build status: STARTED
[15:25:18.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:25:0) after 4m23s
[15:29:41.497] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:25:0)
[15:29:41.519] Build status: STARTED
[15:29:41.519] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:26:0) after 3m16s
[15:32:57.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:26:0)
[15:32:57.702] Build status: STARTED
[15:32:57.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:27:0) after 3m29s
[15:36:26.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:27:0)
[15:36:26.854] Build status: STARTED
[15:36:26.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:28:0) after 7m24s
[15:43:50.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:28:0)
[15:43:50.938] Build status: STARTED
[15:43:50.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:29:0) after 9m52s
[15:53:42.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:29:0)
[15:53:42.963] Build status: STARTED
[15:53:42.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:30:0) after 8m46s
[16:02:29.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:30:0)
[16:02:29.056] Build status: STARTED
[16:02:29.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:31:0) after 9m24s
[16:11:53.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:31:0)
[16:11:53.111] Build status: STARTED
[16:11:53.111] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:32:0) after 4m50s
[16:16:43.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:32:0)
[16:16:43.146] Build status: STARTED
[16:16:43.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:33:0) after 9m4s
[16:25:47.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:33:0)
[16:25:47.445] Build status: STARTED
[16:25:47.445] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:34:0) after 6m12s
[16:31:59.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:34:0)
[16:31:59.531] Build status: STARTED
[16:31:59.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:35:0) after 4m46s
[16:36:45.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:35:0)
[16:36:45.591] Build status: STARTED
[16:36:45.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:36:0) after 5m23s
[16:42:08.571] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:36:0)
[16:42:09.626] Build status: STARTED
[16:42:09.626] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:37:0) after 1m15s
[16:43:24.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:37:0)
[16:43:24.747] Build status: STARTED
[16:43:24.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:38:0) after 6m57s
[16:50:21.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:38:0)
[16:50:21.792] Build status: STARTED
[16:50:21.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:39:0) after 6m58s
[16:57:19.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:39:0)
[16:57:19.875] Build status: STARTED
[16:57:19.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:40:0) after 1m1s
[16:58:20.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:40:0)
[16:58:20.978] Build status: STARTED
[16:58:20.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:41:0) after 7m24s
[17:05:45.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:41:0)
[17:05:45.117] Build status: STARTED
[17:05:45.117] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:42:0) after 6m17s
[17:12:02.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:42:0)
[17:12:02.179] Build status: STARTED
[17:12:02.179] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:43:0) after 9m49s
[17:21:51.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:43:0)
[17:21:51.296] Build status: STARTED
[17:21:51.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:44:0) after 6m10s
[17:28:01.329] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:44:0)
[17:28:01.414] Build status: STARTED
[17:28:01.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:45:0) after 7m12s
[17:35:13.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:45:0)
[17:35:13.489] Build status: STARTED
[17:35:13.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:46:0) after 2m42s
[17:37:55.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:46:0)
[17:37:55.548] Build status: STARTED
[17:37:55.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:47:0) after 3m39s
[17:41:34.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:47:0)
[17:41:34.643] Build status: STARTED
[17:41:34.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:48:0) after 9m2s
[17:50:36.681] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:48:0)
[17:50:36.706] Build status: STARTED
[17:50:36.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:49:0) after 1m26s
[17:52:02.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:49:0)
[17:52:02.908] Build status: STARTED
[17:52:02.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:50:0) after 7m36s
[17:59:39.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:50:0)
[17:59:39.066] Build status: STARTED
[17:59:39.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:51:0) after 6m27s
[18:06:06.120] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:51:0)
[18:06:06.141] Build status: STARTED
[18:06:06.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:52:0) after 7m28s
[18:13:34.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:52:0)
[18:13:34.181] Build status: STARTED
[18:13:34.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:53:0) after 7m0s
[18:20:34.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:53:0)
[18:20:34.399] Build status: STARTED
[18:20:34.399] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:54:0) after 3m36s
[18:24:10.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:54:0)
[18:24:10.454] Build status: STARTED
[18:24:10.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:55:0) after 1m22s
[18:25:32.485] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:55:0)
[18:25:32.506] Build status: STARTED
[18:25:32.506] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:56:0) after 9m23s
[18:34:55.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:56:0)
[18:34:55.552] Build status: STARTED
[18:34:55.552] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:57:0) after 7m11s
[18:42:06.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:57:0)
[18:42:06.671] Build status: STARTED
[18:42:06.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:58:0) after 7m14s
[18:49:20.707] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:58:0)
[18:49:20.725] Build status: STARTED
[18:49:20.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:59:0) after 8m14s
[18:57:34.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:59:0)
[18:57:34.948] Build status: STARTED
[18:57:34.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:60:0) after 2m35s
[19:00:09.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:60:0)
[19:00:09.993] Build status: STARTED
[19:00:09.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:61:0) after 8m30s
[19:08:40.108] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:61:0)
[19:08:40.143] Build status: STARTED
[19:08:40.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:62:0) after 3m45s
[19:12:25.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:62:0)
[19:12:25.268] Build status: STARTED
[19:12:25.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:63:0) after 3m17s
[19:15:42.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:63:0)
[19:15:42.289] Build status: STARTED
[19:15:42.290] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:64:0) after 1m11s
[19:16:53.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:64:0)
[19:16:53.342] Build status: STARTED
[19:16:53.342] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:65:0) after 4m34s
[19:21:27.367] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:65:0)
[19:21:29.552] Build status: STARTED
[19:21:29.552] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:66:0) after 5m11s
[19:26:40.631] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:66:0)
[19:26:40.649] Build status: STARTED
[19:26:40.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:67:0) after 3m51s
[19:30:31.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:67:0)
[19:30:31.758] Build status: STARTED
[19:30:31.758] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:68:0) after 9m7s
[19:39:38.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:68:0)
[19:39:38.825] Build status: STARTED
[19:39:38.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:69:0) after 4m46s
[19:44:24.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:69:0)
[19:44:24.865] Build status: STARTED
[19:44:24.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:70:0) after 4m2s
[19:48:26.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:70:0)
[19:48:26.933] Build status: STARTED
[19:48:26.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:71:0) after 8m29s
[19:56:55.958] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:71:0)
[19:56:55.975] Build status: STARTED
[19:56:55.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:72:0) after 1m3s
[19:57:59.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:72:0)
[19:57:59.056] Build status: STARTED
[19:57:59.056] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:73:0) after 2m39s
[20:00:38.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:73:0)
[20:00:38.170] Build status: STARTED
[20:00:38.170] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:74:0) after 9m51s
[20:10:29.325] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:74:0)
[20:10:29.346] Build status: STARTED
[20:10:29.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:75:0) after 9m45s
[20:20:14.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:75:0)
[20:20:14.473] Build status: STARTED
[20:20:14.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:76:0) after 2m58s
[20:23:12.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:76:0)
[20:23:12.607] Build status: STARTED
[20:23:12.607] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:77:0) after 7m3s
[20:30:15.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:77:0)
[20:30:15.723] Build status: STARTED
[20:30:15.723] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:78:0) after 5m35s
[20:35:50.753] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:78:0)
[20:35:50.773] Build status: STARTED
[20:35:50.773] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:79:0) after 1m49s
[20:37:39.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:79:0)
[20:37:39.818] Build status: STARTED
[20:37:39.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:80:0) after 5m20s
[20:42:59.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:80:0)
[20:42:59.859] Build status: STARTED
[20:42:59.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:81:0) after 3m22s
[20:46:21.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:81:0)
[20:46:21.905] Build status: STARTED
[20:46:21.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:82:0) after 4m2s
[20:50:23.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:82:0)
[20:50:23.991] Build status: STARTED
[20:50:23.992] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:83:0) after 9m6s
[20:59:30.027] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:83:0)
[20:59:30.044] Build status: STARTED
[20:59:30.044] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:84:0) after 7m59s
[21:07:29.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:84:0)
[21:07:29.113] Build status: STARTED
[21:07:29.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:85:0) after 7m13s
[21:14:42.259] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:85:0)
[21:14:42.284] Build status: STARTED
[21:14:42.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:86:0) after 4m32s
[21:19:14.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:86:0)
[21:19:14.413] Build status: STARTED
[21:19:14.413] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:87:0) after 9m32s
[21:28:46.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:87:0)
[21:28:46.473] Build status: STARTED
[21:28:46.473] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:88:0) after 4m21s
[21:33:07.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:88:0)
[21:33:07.706] Build status: STARTED
[21:33:07.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:89:0) after 3m23s
[21:36:30.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:89:0)
[21:36:30.779] Build status: STARTED
[21:36:30.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:90:0) after 7m43s
[21:44:13.835] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:90:0)
[21:44:13.856] Build status: STARTED
[21:44:13.856] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:91:0) after 1m28s
[21:45:41.891] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:91:0)
[21:45:41.915] Build status: STARTED
[21:45:41.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:92:0) after 5m26s
[21:51:07.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:92:0)
[21:51:08.005] Build status: STARTED
[21:51:08.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:93:0) after 4m17s
[21:55:25.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:93:0)
[21:55:25.189] Build status: STARTED
[21:55:25.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:94:0) after 8m21s
[22:03:46.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:94:0)
[22:03:46.289] Build status: STARTED
[22:03:46.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:95:0) after 6m32s
[22:10:18.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:95:0)
[22:10:18.371] Build status: STARTED
[22:10:18.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:96:0) after 9m43s
[22:20:01.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:96:0)
[22:20:01.456] Build status: STARTED
[22:20:01.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:97:0) after 5m17s
[22:25:18.537] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:97:0)
[22:25:18.558] Build status: STARTED
[22:25:18.558] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:98:0) after 1m58s
[22:27:16.607] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:98:0)
[22:27:16.649] Build status: STARTED
[22:27:16.649] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:99:0) after 3m30s
[22:30:46.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:99:0)
[22:30:46.775] Build status: STARTED
[22:30:46.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:100:0) after 4m12s
[22:34:58.801] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:100:0)
[22:34:58.826] Build status: STARTED
[22:34:58.826] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:101:0) after 7m50s
[22:42:49.049] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:101:0)
[22:42:49.101] Build status: STARTED
[22:42:49.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:102:0) after 3m26s
[22:46:15.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:102:0)
[22:46:15.207] Build status: STARTED
[22:46:15.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:103:0) after 4m24s
[22:50:39.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:103:0)
[22:50:39.211] Build status: STARTED
[22:50:39.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:104:0) after 5m5s
[22:55:44.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:104:0)
[22:55:44.279] Build status: STARTED
[22:55:44.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:105:0) after 1m12s
[22:56:56.307] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:105:0)
[22:56:56.378] Build status: STARTED
[22:56:56.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:106:0) after 6m6s
[23:03:02.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:106:0)
[23:03:02.423] Build status: STARTED
[23:03:02.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:107:0) after 7m49s
[23:10:51.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:107:0)
[23:10:51.469] Build status: STARTED
[23:10:51.469] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:108:0) after 5m6s
[23:15:57.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:108:0)
[23:15:57.493] Build status: STARTED
[23:15:57.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:109:0) after 1m35s
[23:17:32.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:109:0)
[23:17:32.587] Build status: STARTED
[23:17:32.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:110:0) after 1m52s
[23:19:24.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:110:0)
[23:19:24.631] Build status: STARTED
[23:19:24.631] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:111:0) after 9m28s
[23:28:52.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:111:0)
[23:28:52.744] Build status: STARTED
[23:28:52.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:112:0) after 5m23s
[23:34:15.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:112:0)
[23:34:15.809] Build status: STARTED
[23:34:15.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:113:0) after 5m15s
[23:39:30.898] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:113:0)
[23:39:30.959] Build status: STARTED
[23:39:30.959] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:114:0) after 1m18s
[23:40:49.041] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:114:0)
[23:40:49.077] Build status: STARTED
[23:40:49.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:115:0) after 1m9s
[23:41:58.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:115:0)
[23:41:58.237] Build status: STARTED
[23:41:58.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:116:0) after 1m14s
[23:43:12.306] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:116:0)
[23:43:12.322] Build status: STARTED
[23:43:12.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:117:0) after 2m38s
[23:45:50.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:117:0)
[23:45:50.367] Build status: STARTED
[23:45:50.367] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:118:0) after 1m32s
[23:47:22.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:118:0)
[23:47:22.523] Build status: STARTED
[23:47:22.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:119:0) after 6m57s
[23:54:19.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:119:0)
[23:54:19.725] Build status: STARTED
[23:54:19.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:120:0) after 2m21s
[23:56:40.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:120:0)
[23:56:40.801] Build status: STARTED
[23:56:40.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:121:0) after 9m12s
[00:05:52.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:121:0)
[00:05:52.958] Build status: STARTED
[00:05:52.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:122:0) after 3m54s
[00:09:46.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:122:0)
[00:09:47.007] Build status: STARTED
[00:09:47.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:123:0) after 7m32s
[00:17:19.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:123:0)
[00:17:19.063] Build status: STARTED
[00:17:19.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:124:0) after 9m7s
[00:26:26.094] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:124:0)
[00:26:26.126] Build status: STARTED
[00:26:26.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:125:0) after 1m34s
[00:28:00.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:125:0)
[00:28:00.171] Build status: STARTED
[00:28:00.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:126:0) after 9m40s
[00:37:40.252] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:126:0)
[00:37:40.272] Build status: STARTED
[00:37:40.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:127:0) after 9m8s
[00:46:48.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:127:0)
[00:46:48.371] Build status: STARTED
[00:46:48.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:128:0) after 4m31s
[00:51:19.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:128:0)
[00:51:19.366] Build status: STARTED
[00:51:19.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:129:0) after 5m54s
[00:57:13.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:129:0)
[00:57:13.414] Build status: STARTED
[00:57:13.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:130:0) after 4m48s
[01:02:01.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:130:0)
[01:02:01.475] Build status: STARTED
[01:02:01.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:131:0) after 6m31s
[01:08:32.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:131:0)
[01:08:32.521] Build status: STARTED
[01:08:32.521] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:132:0) after 1m57s
[01:10:29.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:132:0)
[01:10:29.621] Build status: STARTED
[01:10:29.621] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:133:0) after 9m40s
[01:20:09.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:133:0)
[01:20:09.669] Build status: STARTED
[01:20:09.670] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:134:0) after 2m50s
[01:22:59.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:134:0)
[01:22:59.770] Build status: STARTED
[01:22:59.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:135:0) after 5m45s
[01:28:44.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:135:0)
[01:28:44.915] Build status: STARTED
[01:28:44.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:136:0) after 4m2s
[01:32:46.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:136:0)
[01:32:47.059] Build status: STARTED
[01:32:47.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:137:0) after 2m51s
[01:35:38.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:137:0)
[01:35:38.130] Build status: STARTED
[01:35:38.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:138:0) after 8m37s
[01:44:15.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:138:0)
[01:44:15.238] Build status: STARTED
[01:44:15.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8880229285078253776:139:0) after 5m48s
[01:49:13.874] Received PubSub notification, asking Buildbucket for the build status
[01:49:13.909] Build:
{
"id": "8714799222801610241",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3324,
"createdBy": "project:chromium",
"createTime": "2025-05-15T13:47:10.784214609Z",
"startTime": "2025-05-15T13:47:17.814372388Z",
"endTime": "2025-05-16T01:49:13.439122038Z",
"updateTime": "2025-05-16T01:49:13.439122038Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "23ebe6cb6e5f0dec9ccfd7eb9aa07807309a877d",
"ref": "refs/heads/main"
}
}
}
[01:49:13.909] Invocation finished in 12h2m4.679389624s with status FAILED