[13:16:10.900] New invocation is queued and will start shortly
[13:16:12.144] Starting the invocation (attempt 1)
[13:16:12.171] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f893102cb0f1fe22b0c3f1bf3196d30c6f9e393a"
[13:16:12.171] Popped gitiles commit info from properties and tags
[13:16:12.171] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:16:12.171] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:16:12.171] Buildbucket request:
{
"requestId": "8886754215265343008",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f893102cb0f1fe22b0c3f1bf3196d30c6f9e393a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886754215265343008"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:16:12.655] Scheduled build:
{
"id": "8721324153201208721",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3181,
"createdBy": "project:chromium",
"createTime": "2025-03-04T13:16:12.246278646Z",
"updateTime": "2025-03-04T13:16:12.246278646Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f893102cb0f1fe22b0c3f1bf3196d30c6f9e393a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:16:12.655] Task URL: https://cr-buildbucket.appspot.com/build/8721324153201208721
[13:16:12.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:2:0) after 2m1s
[13:16:13.653] Received PubSub notification, asking Buildbucket for the build status
[13:16:13.681] Build status: SCHEDULED
[13:16:17.877] Received PubSub notification, asking Buildbucket for the build status
[13:16:17.902] Build status: STARTED
[13:18:13.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:2:0)
[13:18:13.775] Build status: STARTED
[13:18:13.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:5:0) after 5m2s
[13:23:15.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:5:0)
[13:23:15.790] Build status: STARTED
[13:23:15.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:6:0) after 1m19s
[13:24:34.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:6:0)
[13:24:34.898] Build status: STARTED
[13:24:34.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:7:0) after 6m34s
[13:31:08.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:7:0)
[13:31:09.020] Build status: STARTED
[13:31:09.020] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:8:0) after 9m5s
[13:40:14.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:8:0)
[13:40:14.087] Build status: STARTED
[13:40:14.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:9:0) after 4m27s
[13:44:41.081] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:9:0)
[13:44:41.116] Build status: STARTED
[13:44:41.116] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:10:0) after 4m15s
[13:48:56.143] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:10:0)
[13:48:56.165] Build status: STARTED
[13:48:56.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:11:0) after 2m43s
[13:51:39.393] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:11:0)
[13:51:39.414] Build status: STARTED
[13:51:39.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:12:0) after 6m52s
[13:58:31.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:12:0)
[13:58:31.418] Build status: STARTED
[13:58:31.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:13:0) after 9m53s
[14:08:24.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:13:0)
[14:08:24.470] Build status: STARTED
[14:08:24.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:14:0) after 3m5s
[14:11:29.530] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:14:0)
[14:11:29.546] Build status: STARTED
[14:11:29.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:15:0) after 4m6s
[14:15:35.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:15:0)
[14:15:35.548] Build status: STARTED
[14:15:35.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:16:0) after 4m24s
[14:19:59.576] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:16:0)
[14:19:59.592] Build status: STARTED
[14:19:59.592] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:17:0) after 4m20s
[14:24:19.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:17:0)
[14:24:19.700] Build status: STARTED
[14:24:19.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:18:0) after 3m0s
[14:27:19.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:18:0)
[14:27:19.749] Build status: STARTED
[14:27:19.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:19:0) after 4m47s
[14:32:06.795] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:19:0)
[14:32:06.827] Build status: STARTED
[14:32:06.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:20:0) after 3m5s
[14:35:11.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:20:0)
[14:35:11.876] Build status: STARTED
[14:35:11.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:21:0) after 7m6s
[14:42:18.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:21:0)
[14:42:18.335] Build status: STARTED
[14:42:18.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:22:0) after 5m46s
[14:48:04.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:22:0)
[14:48:04.385] Build status: STARTED
[14:48:04.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:23:0) after 2m29s
[14:50:33.375] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:23:0)
[14:50:33.394] Build status: STARTED
[14:50:33.394] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:24:0) after 2m53s
[14:53:26.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:24:0)
[14:53:26.446] Build status: STARTED
[14:53:26.446] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:25:0) after 8m35s
[15:02:01.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:25:0)
[15:02:01.463] Build status: STARTED
[15:02:01.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:26:0) after 5m40s
[15:07:41.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:26:0)
[15:07:41.517] Build status: STARTED
[15:07:41.518] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:27:0) after 1m54s
[15:09:35.544] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:27:0)
[15:09:35.565] Build status: STARTED
[15:09:35.566] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:28:0) after 2m58s
[15:12:33.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:28:0)
[15:12:33.629] Build status: STARTED
[15:12:33.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:29:0) after 4m49s
[15:17:22.659] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:29:0)
[15:17:22.679] Build status: STARTED
[15:17:22.679] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:30:0) after 9m46s
[15:27:08.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:30:0)
[15:27:08.846] Build status: STARTED
[15:27:08.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:31:0) after 7m37s
[15:34:45.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:31:0)
[15:34:45.899] Build status: STARTED
[15:34:45.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:32:0) after 4m58s
[15:39:43.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:32:0)
[15:39:43.892] Build status: STARTED
[15:39:43.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:33:0) after 4m12s
[15:43:55.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:33:0)
[15:43:55.930] Build status: STARTED
[15:43:55.930] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:34:0) after 2m30s
[15:46:25.909] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:34:0)
[15:46:25.975] Build status: STARTED
[15:46:25.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:35:0) after 5m38s
[15:52:03.995] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:35:0)
[15:52:04.038] Build status: STARTED
[15:52:04.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:36:0) after 8m0s
[16:00:04.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:36:0)
[16:00:04.084] Build status: STARTED
[16:00:04.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:37:0) after 6m48s
[16:06:52.106] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:37:0)
[16:06:52.126] Build status: STARTED
[16:06:52.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:38:0) after 9m5s
[16:15:57.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:38:0)
[16:15:57.168] Build status: STARTED
[16:15:57.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:39:0) after 3m34s
[16:19:31.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:39:0)
[16:19:31.208] Build status: STARTED
[16:19:31.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:40:0) after 7m23s
[16:26:54.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:40:0)
[16:26:54.286] Build status: STARTED
[16:26:54.286] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:41:0) after 8m5s
[16:34:59.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:41:0)
[16:34:59.331] Build status: STARTED
[16:34:59.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:42:0) after 6m21s
[16:41:20.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:42:0)
[16:41:20.476] Build status: STARTED
[16:41:20.476] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:43:0) after 4m58s
[16:46:18.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:43:0)
[16:46:18.570] Build status: STARTED
[16:46:18.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:44:0) after 4m5s
[16:50:23.670] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:44:0)
[16:50:23.686] Build status: STARTED
[16:50:23.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:45:0) after 1m15s
[16:51:38.713] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:45:0)
[16:51:38.900] Build status: STARTED
[16:51:38.900] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:46:0) after 1m51s
[16:53:29.906] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:46:0)
[16:53:29.936] Build status: STARTED
[16:53:29.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:47:0) after 4m3s
[16:57:32.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:47:0)
[16:57:32.970] Build status: STARTED
[16:57:32.970] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:48:0) after 7m43s
[17:05:16.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:48:0)
[17:05:16.094] Build status: STARTED
[17:05:16.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:49:0) after 5m14s
[17:10:30.121] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:49:0)
[17:10:30.147] Build status: STARTED
[17:10:30.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:50:0) after 2m27s
[17:12:57.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:50:0)
[17:12:57.187] Build status: STARTED
[17:12:57.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:51:0) after 1m6s
[17:14:03.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:51:0)
[17:14:03.247] Build status: STARTED
[17:14:03.248] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:52:0) after 5m55s
[17:19:58.369] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:52:0)
[17:19:58.386] Build status: STARTED
[17:19:58.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:53:0) after 2m7s
[17:22:05.369] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:53:0)
[17:22:05.389] Build status: STARTED
[17:22:05.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:54:0) after 1m58s
[17:24:03.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:54:0)
[17:24:03.427] Build status: STARTED
[17:24:03.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:55:0) after 8m48s
[17:32:51.507] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:55:0)
[17:32:51.532] Build status: STARTED
[17:32:51.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:56:0) after 6m27s
[17:39:18.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:56:0)
[17:39:18.579] Build status: STARTED
[17:39:18.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:57:0) after 8m3s
[17:47:21.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:57:0)
[17:47:21.607] Build status: STARTED
[17:47:21.607] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:58:0) after 7m39s
[17:55:00.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:58:0)
[17:55:00.786] Build status: STARTED
[17:55:00.787] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:59:0) after 5m15s
[18:00:15.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:59:0)
[18:00:15.839] Build status: STARTED
[18:00:15.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:60:0) after 8m43s
[18:08:58.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:60:0)
[18:08:58.873] Build status: STARTED
[18:08:58.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:61:0) after 4m8s
[18:13:06.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:61:0)
[18:13:06.974] Build status: STARTED
[18:13:06.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:62:0) after 7m2s
[18:20:08.960] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:62:0)
[18:20:08.980] Build status: STARTED
[18:20:08.980] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:63:0) after 5m27s
[18:25:35.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:63:0)
[18:25:35.991] Build status: STARTED
[18:25:35.991] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:64:0) after 8m7s
[18:33:43.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:64:0)
[18:33:43.036] Build status: STARTED
[18:33:43.036] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:65:0) after 2m55s
[18:36:38.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:65:0)
[18:36:38.154] Build status: STARTED
[18:36:38.154] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:66:0) after 5m19s
[18:41:57.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:66:0)
[18:41:57.198] Build status: STARTED
[18:41:57.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:67:0) after 8m42s
[18:50:39.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:67:0)
[18:50:39.325] Build status: STARTED
[18:50:39.325] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:68:0) after 8m18s
[18:58:57.356] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:68:0)
[18:58:57.380] Build status: STARTED
[18:58:57.380] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:69:0) after 1m29s
[19:00:26.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:69:0)
[19:00:26.429] Build status: STARTED
[19:00:26.429] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:70:0) after 3m55s
[19:04:21.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:70:0)
[19:04:21.466] Build status: STARTED
[19:04:21.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:71:0) after 3m21s
[19:07:42.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:71:0)
[19:07:42.710] Build status: STARTED
[19:07:42.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:72:0) after 4m29s
[19:12:11.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:72:0)
[19:12:11.763] Build status: STARTED
[19:12:11.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:73:0) after 4m50s
[19:17:01.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:73:0)
[19:17:01.872] Build status: STARTED
[19:17:01.872] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:74:0) after 9m40s
[19:26:41.907] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:74:0)
[19:26:41.969] Build status: STARTED
[19:26:41.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:75:0) after 6m37s
[19:33:18.992] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:75:0)
[19:33:19.010] Build status: STARTED
[19:33:19.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:76:0) after 6m28s
[19:39:47.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:76:0)
[19:39:47.045] Build status: STARTED
[19:39:47.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:77:0) after 3m1s
[19:42:48.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:77:0)
[19:42:48.194] Build status: STARTED
[19:42:48.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:78:0) after 3m59s
[19:46:47.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:78:0)
[19:46:47.218] Build status: STARTED
[19:46:47.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:79:0) after 1m11s
[19:47:58.743] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:79:0)
[19:47:58.821] Build status: STARTED
[19:47:58.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:80:0) after 1m8s
[19:49:06.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:80:0)
[19:49:06.951] Build status: STARTED
[19:49:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:81:0) after 3m55s
[19:53:02.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:81:0)
[19:53:02.028] Build status: STARTED
[19:53:02.028] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:82:0) after 9m39s
[20:02:41.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:82:0)
[20:02:41.129] Build status: STARTED
[20:02:41.129] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:83:0) after 8m51s
[20:11:32.257] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:83:0)
[20:11:32.290] Build status: STARTED
[20:11:32.291] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:84:0) after 8m57s
[20:20:29.404] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:84:0)
[20:20:29.421] Build status: STARTED
[20:20:29.421] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:85:0) after 4m0s
[20:24:29.444] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:85:0)
[20:24:29.516] Build status: STARTED
[20:24:29.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:86:0) after 5m30s
[20:29:59.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:86:0)
[20:29:59.551] Build status: STARTED
[20:29:59.551] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:87:0) after 9m25s
[20:39:24.606] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:87:0)
[20:39:24.745] Build status: STARTED
[20:39:24.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:88:0) after 2m43s
[20:42:07.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:88:0)
[20:42:07.790] Build status: STARTED
[20:42:07.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:89:0) after 2m59s
[20:45:06.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:89:0)
[20:45:06.919] Build status: STARTED
[20:45:06.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:90:0) after 6m19s
[20:51:25.995] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:90:0)
[20:51:26.094] Build status: STARTED
[20:51:26.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:91:0) after 5m32s
[20:56:58.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:91:0)
[20:56:58.215] Build status: STARTED
[20:56:58.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:92:0) after 9m21s
[21:06:19.253] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:92:0)
[21:06:19.270] Build status: STARTED
[21:06:19.270] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:93:0) after 7m28s
[21:13:47.292] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:93:0)
[21:13:47.316] Build status: STARTED
[21:13:47.316] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:94:0) after 3m28s
[21:17:15.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:94:0)
[21:17:15.497] Build status: STARTED
[21:17:15.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:95:0) after 1m21s
[21:18:36.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:95:0)
[21:18:36.571] Build status: STARTED
[21:18:36.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:96:0) after 5m13s
[21:23:49.602] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:96:0)
[21:23:49.620] Build status: STARTED
[21:23:49.620] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:97:0) after 5m55s
[21:29:44.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:97:0)
[21:29:44.680] Build status: STARTED
[21:29:44.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:98:0) after 5m5s
[21:34:49.822] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:98:0)
[21:34:49.841] Build status: STARTED
[21:34:49.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:99:0) after 1m3s
[21:35:52.880] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:99:0)
[21:35:52.908] Build status: STARTED
[21:35:52.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:100:0) after 6m30s
[21:42:23.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:100:0)
[21:42:23.307] Build status: STARTED
[21:42:23.307] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:101:0) after 5m42s
[21:48:05.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:101:0)
[21:48:05.664] Build status: STARTED
[21:48:05.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:102:0) after 1m28s
[21:49:33.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:102:0)
[21:49:33.734] Build status: STARTED
[21:49:33.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:103:0) after 9m34s
[21:59:07.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:103:0)
[21:59:07.774] Build status: STARTED
[21:59:07.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:104:0) after 8m11s
[22:07:18.902] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:104:0)
[22:07:18.924] Build status: STARTED
[22:07:18.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:105:0) after 7m43s
[22:15:01.990] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:105:0)
[22:15:02.009] Build status: STARTED
[22:15:02.009] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:106:0) after 2m14s
[22:17:16.014] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:106:0)
[22:17:16.040] Build status: STARTED
[22:17:16.040] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:107:0) after 5m52s
[22:23:08.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:107:0)
[22:23:08.139] Build status: STARTED
[22:23:08.139] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:108:0) after 9m11s
[22:32:19.165] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:108:0)
[22:32:19.181] Build status: STARTED
[22:32:19.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:109:0) after 6m6s
[22:38:25.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:109:0)
[22:38:25.250] Build status: STARTED
[22:38:25.250] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:110:0) after 3m55s
[22:42:20.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:110:0)
[22:42:20.571] Build status: STARTED
[22:42:20.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:111:0) after 7m12s
[22:49:32.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:111:0)
[22:49:32.669] Build status: STARTED
[22:49:32.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:112:0) after 9m25s
[22:58:57.751] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:112:0)
[22:58:57.789] Build status: STARTED
[22:58:57.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:113:0) after 7m7s
[23:06:04.835] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:113:0)
[23:06:04.854] Build status: STARTED
[23:06:04.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:114:0) after 7m49s
[23:13:53.899] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:114:0)
[23:13:53.916] Build status: STARTED
[23:13:53.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:115:0) after 4m9s
[23:18:02.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:115:0)
[23:18:03.018] Build status: STARTED
[23:18:03.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:116:0) after 4m44s
[23:22:47.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:116:0)
[23:22:47.062] Build status: STARTED
[23:22:47.062] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:117:0) after 7m5s
[23:29:52.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:117:0)
[23:29:52.231] Build status: STARTED
[23:29:52.231] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:118:0) after 7m13s
[23:37:05.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:118:0)
[23:37:05.287] Build status: STARTED
[23:37:05.287] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:119:0) after 1m51s
[23:38:56.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:119:0)
[23:38:56.366] Build status: STARTED
[23:38:56.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:120:0) after 9m14s
[23:48:10.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:120:0)
[23:48:10.440] Build status: STARTED
[23:48:10.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:121:0) after 9m4s
[23:57:14.496] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:121:0)
[23:57:14.518] Build status: STARTED
[23:57:14.518] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:122:0) after 1m38s
[23:58:52.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:122:0)
[23:58:52.570] Build status: STARTED
[23:58:52.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:123:0) after 6m32s
[00:05:24.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:123:0)
[00:05:24.829] Build status: STARTED
[00:05:24.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:124:0) after 7m12s
[00:12:36.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:124:0)
[00:12:36.973] Build status: STARTED
[00:12:36.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:125:0) after 3m24s
[00:16:01.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:125:0)
[00:16:01.032] Build status: STARTED
[00:16:01.032] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:126:0) after 1m59s
[00:18:00.071] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:126:0)
[00:18:00.094] Build status: STARTED
[00:18:00.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:127:0) after 9m23s
[00:27:23.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:127:0)
[00:27:23.139] Build status: STARTED
[00:27:23.139] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:128:0) after 9m58s
[00:37:21.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:128:0)
[00:37:21.241] Build status: STARTED
[00:37:21.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:129:0) after 3m21s
[00:40:42.441] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:129:0)
[00:40:42.459] Build status: STARTED
[00:40:42.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:130:0) after 7m22s
[00:48:04.535] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:130:0)
[00:48:04.557] Build status: STARTED
[00:48:04.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:131:0) after 8m38s
[00:56:42.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:131:0)
[00:56:42.650] Build status: STARTED
[00:56:42.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:132:0) after 1m34s
[00:58:16.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:132:0)
[00:58:16.797] Build status: STARTED
[00:58:16.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:133:0) after 8m45s
[01:07:01.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:133:0)
[01:07:01.987] Build status: STARTED
[01:07:01.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:134:0) after 3m31s
[01:10:33.014] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:134:0)
[01:10:33.038] Build status: STARTED
[01:10:33.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:135:0) after 1m26s
[01:11:59.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:135:0)
[01:11:59.127] Build status: STARTED
[01:11:59.127] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8886754215265343008:136:0) after 6m41s
[01:18:03.272] Received PubSub notification, asking Buildbucket for the build status
[01:18:03.306] Build:
{
"id": "8721324153201208721",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3181,
"createdBy": "project:chromium",
"createTime": "2025-03-04T13:16:12.246278646Z",
"startTime": "2025-03-04T13:16:17.673756993Z",
"endTime": "2025-03-05T01:18:02.845899800Z",
"updateTime": "2025-03-05T01:18:02.845899800Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f893102cb0f1fe22b0c3f1bf3196d30c6f9e393a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:18:03.306] Invocation finished in 12h1m52.411930112s with status FAILED