[09:39:43.243] New invocation is queued and will start shortly
[09:39:44.332] Starting the invocation (attempt 1)
[09:39:44.353] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2da86857e9b589996c929dd2f4ccb8df0e344392"
[09:39:44.353] Popped gitiles commit info from properties and tags
[09:39:44.353] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:39:44.353] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:39:44.353] Buildbucket request:
{
"requestId": "8878704703803657632",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2da86857e9b589996c929dd2f4ccb8df0e344392",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8878704703803657632"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:39:44.899] Scheduled build:
{
"id": "8713274641939435473",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3378,
"createdBy": "project:chromium",
"createTime": "2025-06-01T09:39:44.396530396Z",
"updateTime": "2025-06-01T09:39:44.396530396Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2da86857e9b589996c929dd2f4ccb8df0e344392",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:39:44.899] Task URL: https://cr-buildbucket.appspot.com/build/8713274641939435473
[09:39:44.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:2:0) after 2m2s
[09:39:45.867] Received PubSub notification, asking Buildbucket for the build status
[09:39:45.890] Build status: SCHEDULED
[09:41:46.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:2:0)
[09:41:46.979] Build status: SCHEDULED
[09:41:46.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:4:0) after 9m27s
[09:43:06.455] Received PubSub notification, asking Buildbucket for the build status
[09:43:06.526] Build status: STARTED
[09:51:13.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:4:0)
[09:51:14.025] Build status: STARTED
[09:51:14.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:6:0) after 5m23s
[09:56:37.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:6:0)
[09:56:37.064] Build status: STARTED
[09:56:37.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:7:0) after 9m36s
[10:06:13.178] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:7:0)
[10:06:13.211] Build status: STARTED
[10:06:13.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:8:0) after 5m20s
[10:11:33.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:8:0)
[10:11:33.250] Build status: STARTED
[10:11:33.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:9:0) after 1m52s
[10:13:25.380] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:9:0)
[10:13:25.398] Build status: STARTED
[10:13:25.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:10:0) after 5m20s
[10:18:45.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:10:0)
[10:18:45.455] Build status: STARTED
[10:18:45.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:11:0) after 6m30s
[10:25:15.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:11:0)
[10:25:15.512] Build status: STARTED
[10:25:15.512] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:12:0) after 4m25s
[10:29:40.569] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:12:0)
[10:29:40.593] Build status: STARTED
[10:29:40.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:13:0) after 6m18s
[10:35:58.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:13:0)
[10:35:58.919] Build status: STARTED
[10:35:58.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:14:0) after 6m36s
[10:42:34.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:14:0)
[10:42:34.943] Build status: STARTED
[10:42:34.943] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:15:0) after 3m49s
[10:46:24.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:15:0)
[10:46:24.161] Build status: STARTED
[10:46:24.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:16:0) after 1m15s
[10:47:39.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:16:0)
[10:47:39.315] Build status: STARTED
[10:47:39.315] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:17:0) after 4m53s
[10:52:32.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:17:0)
[10:52:32.403] Build status: STARTED
[10:52:32.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:18:0) after 3m37s
[10:56:09.424] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:18:0)
[10:56:09.444] Build status: STARTED
[10:56:09.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:19:0) after 1m44s
[10:57:53.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:19:0)
[10:57:53.739] Build status: STARTED
[10:57:53.739] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:20:0) after 8m50s
[11:06:43.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:20:0)
[11:06:43.892] Build status: STARTED
[11:06:43.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:21:0) after 3m6s
[11:09:49.976] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:21:0)
[11:09:50.047] Build status: STARTED
[11:09:50.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:22:0) after 1m32s
[11:11:22.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:22:0)
[11:11:22.290] Build status: STARTED
[11:11:22.290] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:23:0) after 8m54s
[11:20:16.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:23:0)
[11:20:16.524] Build status: STARTED
[11:20:16.524] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:24:0) after 3m9s
[11:23:25.549] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:24:0)
[11:23:25.569] Build status: STARTED
[11:23:25.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:25:0) after 7m38s
[11:31:03.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:25:0)
[11:31:03.961] Build status: STARTED
[11:31:03.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:26:0) after 2m55s
[11:33:58.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:26:0)
[11:33:59.024] Build status: STARTED
[11:33:59.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:27:0) after 2m40s
[11:36:39.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:27:0)
[11:36:39.167] Build status: STARTED
[11:36:39.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:28:0) after 9m57s
[11:46:36.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:28:0)
[11:46:36.245] Build status: STARTED
[11:46:36.245] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:29:0) after 3m56s
[11:50:32.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:29:0)
[11:50:32.390] Build status: STARTED
[11:50:32.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:30:0) after 5m33s
[11:56:05.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:30:0)
[11:56:05.462] Build status: STARTED
[11:56:05.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:31:0) after 8m40s
[12:04:45.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:31:0)
[12:04:45.546] Build status: STARTED
[12:04:45.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:32:0) after 2m27s
[12:07:12.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:32:0)
[12:07:12.870] Build status: STARTED
[12:07:12.870] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:33:0) after 2m7s
[12:09:19.889] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:33:0)
[12:09:19.937] Build status: STARTED
[12:09:19.937] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:34:0) after 7m47s
[12:17:07.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:34:0)
[12:17:07.160] Build status: STARTED
[12:17:07.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:35:0) after 7m49s
[12:24:56.143] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:35:0)
[12:24:56.173] Build status: STARTED
[12:24:56.173] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:36:0) after 5m13s
[12:30:09.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:36:0)
[12:30:09.279] Build status: STARTED
[12:30:09.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:37:0) after 6m53s
[12:37:02.359] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:37:0)
[12:37:02.384] Build status: STARTED
[12:37:02.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:38:0) after 6m58s
[12:44:00.398] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:38:0)
[12:44:00.416] Build status: STARTED
[12:44:00.416] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:39:0) after 1m21s
[12:45:21.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:39:0)
[12:45:21.470] Build status: STARTED
[12:45:21.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:40:0) after 6m45s
[12:52:06.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:40:0)
[12:52:06.533] Build status: STARTED
[12:52:06.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:41:0) after 3m42s
[12:55:48.664] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:41:0)
[12:55:48.745] Build status: STARTED
[12:55:48.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:42:0) after 8m27s
[13:04:15.758] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:42:0)
[13:04:15.782] Build status: STARTED
[13:04:15.782] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:43:0) after 9m42s
[13:13:57.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:43:0)
[13:13:57.898] Build status: STARTED
[13:13:57.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:44:0) after 8m58s
[13:22:56.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:44:0)
[13:22:56.489] Build status: STARTED
[13:22:56.489] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:45:0) after 2m3s
[13:24:59.510] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:45:0)
[13:24:59.552] Build status: STARTED
[13:24:59.552] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:46:0) after 1m17s
[13:26:16.574] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:46:0)
[13:26:16.598] Build status: STARTED
[13:26:16.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:47:0) after 4m32s
[13:30:48.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:47:0)
[13:30:48.807] Build status: STARTED
[13:30:48.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:48:0) after 9m23s
[13:40:12.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:48:0)
[13:40:12.113] Build status: STARTED
[13:40:12.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:49:0) after 5m31s
[13:45:43.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:49:0)
[13:45:43.209] Build status: STARTED
[13:45:43.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:50:0) after 5m17s
[13:51:00.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:50:0)
[13:51:00.301] Build status: STARTED
[13:51:00.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:51:0) after 7m6s
[13:58:06.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:51:0)
[13:58:06.351] Build status: STARTED
[13:58:06.352] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:52:0) after 2m57s
[14:01:03.373] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:52:0)
[14:01:03.470] Build status: STARTED
[14:01:03.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:53:0) after 6m33s
[14:07:36.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:53:0)
[14:07:36.709] Build status: STARTED
[14:07:36.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:54:0) after 4m3s
[14:11:39.863] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:54:0)
[14:11:39.879] Build status: STARTED
[14:11:39.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:55:0) after 2m33s
[14:14:12.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:55:0)
[14:14:13.006] Build status: STARTED
[14:14:13.006] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:56:0) after 5m24s
[14:19:37.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:56:0)
[14:19:37.082] Build status: STARTED
[14:19:37.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:57:0) after 8m31s
[14:28:08.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:57:0)
[14:28:08.314] Build status: STARTED
[14:28:08.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:58:0) after 2m5s
[14:30:13.444] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:58:0)
[14:30:13.464] Build status: STARTED
[14:30:13.464] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:59:0) after 1m31s
[14:31:44.694] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:59:0)
[14:31:44.719] Build status: STARTED
[14:31:44.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:60:0) after 6m45s
[14:38:29.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:60:0)
[14:38:29.892] Build status: STARTED
[14:38:29.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:61:0) after 7m11s
[14:45:40.937] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:61:0)
[14:45:40.964] Build status: STARTED
[14:45:40.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:62:0) after 2m43s
[14:48:23.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:62:0)
[14:48:24.038] Build status: STARTED
[14:48:24.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:63:0) after 6m37s
[14:55:01.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:63:0)
[14:55:01.090] Build status: STARTED
[14:55:01.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:64:0) after 2m19s
[14:57:20.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:64:0)
[14:57:20.390] Build status: STARTED
[14:57:20.390] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:65:0) after 9m2s
[15:06:22.420] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:65:0)
[15:06:22.445] Build status: STARTED
[15:06:22.445] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:66:0) after 1m56s
[15:08:18.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:66:0)
[15:08:18.853] Build status: STARTED
[15:08:18.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:67:0) after 6m24s
[15:14:43.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:67:0)
[15:14:43.067] Build status: STARTED
[15:14:43.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:68:0) after 4m25s
[15:19:08.088] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:68:0)
[15:19:08.224] Build status: STARTED
[15:19:08.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:69:0) after 4m16s
[15:23:24.441] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:69:0)
[15:23:24.455] Build status: STARTED
[15:23:24.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:70:0) after 9m24s
[15:32:48.471] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:70:0)
[15:32:48.488] Build status: STARTED
[15:32:48.488] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:71:0) after 7m31s
[15:40:19.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:71:0)
[15:40:19.636] Build status: STARTED
[15:40:19.636] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:72:0) after 9m32s
[15:49:51.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:72:0)
[15:49:52.004] Build status: STARTED
[15:49:52.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:73:0) after 1m13s
[15:51:05.026] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:73:0)
[15:51:05.044] Build status: STARTED
[15:51:05.044] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:74:0) after 9m46s
[16:00:51.112] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:74:0)
[16:00:51.144] Build status: STARTED
[16:00:51.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:75:0) after 2m12s
[16:03:03.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:75:0)
[16:03:03.428] Build status: STARTED
[16:03:03.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:76:0) after 2m39s
[16:05:42.461] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:76:0)
[16:05:42.479] Build status: STARTED
[16:05:42.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:77:0) after 9m50s
[16:15:32.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:77:0)
[16:15:32.597] Build status: STARTED
[16:15:32.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:78:0) after 1m13s
[16:16:45.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:78:0)
[16:16:45.668] Build status: STARTED
[16:16:45.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:79:0) after 1m12s
[16:17:57.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:79:0)
[16:17:57.739] Build status: STARTED
[16:17:57.739] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:80:0) after 9m52s
[16:27:49.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:80:0)
[16:27:49.775] Build status: STARTED
[16:27:49.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:81:0) after 5m32s
[16:33:21.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:81:0)
[16:33:21.846] Build status: STARTED
[16:33:21.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:82:0) after 5m34s
[16:38:56.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:82:0)
[16:38:56.064] Build status: STARTED
[16:38:56.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:83:0) after 8m14s
[16:47:10.091] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:83:0)
[16:47:10.112] Build status: STARTED
[16:47:10.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:84:0) after 1m46s
[16:48:56.101] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:84:0)
[16:48:56.121] Build status: STARTED
[16:48:56.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:85:0) after 4m19s
[16:53:15.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:85:0)
[16:53:15.160] Build status: STARTED
[16:53:15.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:86:0) after 1m21s
[16:54:36.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:86:0)
[16:54:36.267] Build status: STARTED
[16:54:36.267] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:87:0) after 4m38s
[16:59:14.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:87:0)
[16:59:14.672] Build status: STARTED
[16:59:14.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:88:0) after 1m36s
[17:00:51.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:88:0)
[17:00:51.102] Build status: STARTED
[17:00:51.102] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:89:0) after 9m46s
[17:10:37.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:89:0)
[17:10:37.140] Build status: STARTED
[17:10:37.140] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:90:0) after 9m15s
[17:19:52.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:90:0)
[17:19:52.187] Build status: STARTED
[17:19:52.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:91:0) after 3m42s
[17:23:34.347] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:91:0)
[17:23:34.368] Build status: STARTED
[17:23:34.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:92:0) after 6m35s
[17:30:09.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:92:0)
[17:30:09.416] Build status: STARTED
[17:30:09.416] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:93:0) after 7m27s
[17:37:36.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:93:0)
[17:37:36.559] Build status: STARTED
[17:37:36.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:94:0) after 4m12s
[17:41:48.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:94:0)
[17:41:48.721] Build status: STARTED
[17:41:48.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:95:0) after 1m27s
[17:43:15.815] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:95:0)
[17:43:15.870] Build status: STARTED
[17:43:15.870] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:96:0) after 3m32s
[17:46:47.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:96:0)
[17:46:47.987] Build status: STARTED
[17:46:47.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:97:0) after 7m46s
[17:54:34.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:97:0)
[17:54:34.105] Build status: STARTED
[17:54:34.105] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:98:0) after 2m10s
[17:56:44.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:98:0)
[17:56:44.158] Build status: STARTED
[17:56:44.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:99:0) after 3m1s
[17:59:45.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:99:0)
[17:59:45.200] Build status: STARTED
[17:59:45.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:100:0) after 2m19s
[18:02:04.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:100:0)
[18:02:04.257] Build status: STARTED
[18:02:04.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:101:0) after 4m59s
[18:07:03.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:101:0)
[18:07:03.302] Build status: STARTED
[18:07:03.302] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:102:0) after 1m8s
[18:08:11.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:102:0)
[18:08:11.398] Build status: STARTED
[18:08:11.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:103:0) after 2m16s
[18:10:27.417] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:103:0)
[18:10:27.430] Build status: STARTED
[18:10:27.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:104:0) after 3m39s
[18:14:06.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:104:0)
[18:14:06.515] Build status: STARTED
[18:14:06.515] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:105:0) after 3m34s
[18:17:40.725] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:105:0)
[18:17:40.743] Build status: STARTED
[18:17:40.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:106:0) after 2m36s
[18:20:16.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:106:0)
[18:20:16.883] Build status: STARTED
[18:20:16.883] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:107:0) after 9m17s
[18:29:33.908] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:107:0)
[18:29:33.927] Build status: STARTED
[18:29:33.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:108:0) after 3m30s
[18:33:03.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:108:0)
[18:33:03.973] Build status: STARTED
[18:33:03.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:109:0) after 8m43s
[18:41:47.071] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:109:0)
[18:41:47.093] Build status: STARTED
[18:41:47.093] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:110:0) after 7m0s
[18:48:47.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:110:0)
[18:48:47.462] Build status: STARTED
[18:48:47.462] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:111:0) after 5m21s
[18:54:08.486] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:111:0)
[18:54:08.505] Build status: STARTED
[18:54:08.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:112:0) after 3m34s
[18:57:42.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:112:0)
[18:57:42.576] Build status: STARTED
[18:57:42.576] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:113:0) after 6m41s
[19:04:23.810] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:113:0)
[19:04:23.865] Build status: STARTED
[19:04:23.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:114:0) after 6m48s
[19:11:12.112] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:114:0)
[19:11:12.134] Build status: STARTED
[19:11:12.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:115:0) after 7m11s
[19:18:23.156] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:115:0)
[19:18:23.187] Build status: STARTED
[19:18:23.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:116:0) after 2m53s
[19:21:16.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:116:0)
[19:21:16.264] Build status: STARTED
[19:21:16.264] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:117:0) after 8m20s
[19:29:36.368] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:117:0)
[19:29:36.383] Build status: STARTED
[19:29:36.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:118:0) after 3m46s
[19:33:22.383] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:118:0)
[19:33:22.401] Build status: STARTED
[19:33:22.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:119:0) after 8m49s
[19:42:11.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:119:0)
[19:42:11.433] Build status: STARTED
[19:42:11.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:120:0) after 7m40s
[19:49:51.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:120:0)
[19:49:51.470] Build status: STARTED
[19:49:51.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:121:0) after 1m9s
[19:51:00.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:121:0)
[19:51:00.571] Build status: STARTED
[19:51:00.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:122:0) after 8m16s
[19:59:16.604] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:122:0)
[19:59:16.627] Build status: STARTED
[19:59:16.627] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:123:0) after 8m41s
[20:07:57.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:123:0)
[20:07:57.671] Build status: STARTED
[20:07:57.671] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:124:0) after 2m48s
[20:10:45.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:124:0)
[20:10:45.718] Build status: STARTED
[20:10:45.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:125:0) after 9m16s
[20:20:01.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:125:0)
[20:20:01.927] Build status: STARTED
[20:20:01.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:126:0) after 4m50s
[20:24:52.149] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:126:0)
[20:24:52.169] Build status: STARTED
[20:24:52.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:127:0) after 4m50s
[20:29:42.451] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:127:0)
[20:29:42.466] Build status: STARTED
[20:29:42.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:128:0) after 7m36s
[20:37:18.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:128:0)
[20:37:19.240] Build status: STARTED
[20:37:19.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:129:0) after 7m45s
[20:45:04.263] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:129:0)
[20:45:04.285] Build status: STARTED
[20:45:04.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:130:0) after 1m21s
[20:46:25.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:130:0)
[20:46:25.318] Build status: STARTED
[20:46:25.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:131:0) after 8m20s
[20:54:45.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:131:0)
[20:54:45.369] Build status: STARTED
[20:54:45.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:132:0) after 5m36s
[21:00:21.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:132:0)
[21:00:21.533] Build status: STARTED
[21:00:21.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:133:0) after 1m15s
[21:01:36.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:133:0)
[21:01:36.572] Build status: STARTED
[21:01:36.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:134:0) after 9m22s
[21:10:58.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:134:0)
[21:10:58.745] Build status: STARTED
[21:10:58.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:135:0) after 4m40s
[21:15:38.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:135:0)
[21:15:38.917] Build status: STARTED
[21:15:38.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:136:0) after 2m41s
[21:18:20.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:136:0)
[21:18:20.023] Build status: STARTED
[21:18:20.023] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:137:0) after 1m1s
[21:19:21.350] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:137:0)
[21:19:21.371] Build status: STARTED
[21:19:21.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:138:0) after 9m57s
[21:29:18.396] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:138:0)
[21:29:18.422] Build status: STARTED
[21:29:18.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:139:0) after 9m37s
[21:38:55.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:139:0)
[21:38:55.575] Build status: STARTED
[21:38:55.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8878704703803657632:140:0) after 9m44s
[21:44:31.166] Received PubSub notification, asking Buildbucket for the build status
[21:44:31.184] Build:
{
"id": "8713274641939435473",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3378,
"createdBy": "project:chromium",
"createTime": "2025-06-01T09:39:44.396530396Z",
"startTime": "2025-06-01T09:42:53.920756018Z",
"endTime": "2025-06-01T21:44:29.657274220Z",
"updateTime": "2025-06-01T21:44:29.657274220Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2da86857e9b589996c929dd2f4ccb8df0e344392",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:44:31.184] Invocation finished in 12h4m47.949476863s with status FAILED