[21:23:14.120] New invocation is queued and will start shortly
[21:23:15.206] Starting the invocation (attempt 1)
[21:23:15.231] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0d8c85fa2116504c23ceda10473d27e7ad332c22"
[21:23:15.231] Popped gitiles commit info from properties and tags
[21:23:15.231] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:23:15.233] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:23:15.233] Buildbucket request:
{
"requestId": "8881921933284422368",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d8c85fa2116504c23ceda10473d27e7ad332c22",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8881921933284422368"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:23:15.674] Scheduled build:
{
"id": "8716491871410587537",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3287,
"createdBy": "project:chromium",
"createTime": "2025-04-26T21:23:15.279170357Z",
"updateTime": "2025-04-26T21:23:15.279170357Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d8c85fa2116504c23ceda10473d27e7ad332c22",
"ref": "refs/heads/main"
}
}
}
[21:23:15.674] Task URL: https://cr-buildbucket.appspot.com/build/8716491871410587537
[21:23:15.674] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:2:0) after 4m41s
[21:23:26.973] Received PubSub notification, asking Buildbucket for the build status
[21:23:27.002] Build status: SCHEDULED
[21:26:27.457] Received PubSub notification, asking Buildbucket for the build status
[21:26:27.483] Build status: STARTED
[21:27:56.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:2:0)
[21:27:56.964] Build status: STARTED
[21:27:56.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:5:0) after 6m44s
[21:34:40.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:5:0)
[21:34:40.999] Build status: STARTED
[21:34:40.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:6:0) after 3m16s
[21:37:57.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:6:0)
[21:37:57.306] Build status: STARTED
[21:37:57.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:7:0) after 9m0s
[21:46:57.334] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:7:0)
[21:46:57.362] Build status: STARTED
[21:46:57.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:8:0) after 3m48s
[21:50:45.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:8:0)
[21:50:45.369] Build status: STARTED
[21:50:45.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:9:0) after 9m17s
[22:00:02.457] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:9:0)
[22:00:02.483] Build status: STARTED
[22:00:02.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:10:0) after 1m31s
[22:01:33.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:10:0)
[22:01:33.593] Build status: STARTED
[22:01:33.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:11:0) after 9m55s
[22:11:28.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:11:0)
[22:11:28.639] Build status: STARTED
[22:11:28.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:12:0) after 7m7s
[22:18:35.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:12:0)
[22:18:35.681] Build status: STARTED
[22:18:35.681] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:13:0) after 1m2s
[22:19:37.959] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:13:0)
[22:19:37.996] Build status: STARTED
[22:19:37.996] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:14:0) after 8m59s
[22:28:37.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:14:0)
[22:28:37.032] Build status: STARTED
[22:28:37.032] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:15:0) after 2m27s
[22:31:04.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:15:0)
[22:31:04.147] Build status: STARTED
[22:31:04.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:16:0) after 4m5s
[22:35:09.199] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:16:0)
[22:35:09.229] Build status: STARTED
[22:35:09.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:17:0) after 8m43s
[22:43:52.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:17:0)
[22:43:52.225] Build status: STARTED
[22:43:52.225] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:18:0) after 6m35s
[22:50:27.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:18:0)
[22:50:27.269] Build status: STARTED
[22:50:27.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:19:0) after 9m42s
[23:00:09.297] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:19:0)
[23:00:09.329] Build status: STARTED
[23:00:09.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:20:0) after 5m10s
[23:05:19.348] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:20:0)
[23:05:19.365] Build status: STARTED
[23:05:19.365] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:21:0) after 1m16s
[23:06:35.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:21:0)
[23:06:35.415] Build status: STARTED
[23:06:35.415] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:22:0) after 7m27s
[23:14:02.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:22:0)
[23:14:02.680] Build status: STARTED
[23:14:02.680] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:23:0) after 9m38s
[23:23:40.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:23:0)
[23:23:40.756] Build status: STARTED
[23:23:40.756] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:24:0) after 5m31s
[23:29:11.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:24:0)
[23:29:11.797] Build status: STARTED
[23:29:11.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:25:0) after 2m36s
[23:31:47.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:25:0)
[23:31:47.938] Build status: STARTED
[23:31:47.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:26:0) after 7m47s
[23:39:34.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:26:0)
[23:39:34.973] Build status: STARTED
[23:39:34.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:27:0) after 2m44s
[23:42:19.013] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:27:0)
[23:42:19.180] Build status: STARTED
[23:42:19.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:28:0) after 8m55s
[23:51:14.208] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:28:0)
[23:51:14.227] Build status: STARTED
[23:51:14.227] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:29:0) after 6m0s
[23:57:14.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:29:0)
[23:57:14.271] Build status: STARTED
[23:57:14.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:30:0) after 3m12s
[00:00:26.300] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:30:0)
[00:00:26.326] Build status: STARTED
[00:00:26.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:31:0) after 6m51s
[00:07:17.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:31:0)
[00:07:17.502] Build status: STARTED
[00:07:17.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:32:0) after 4m31s
[00:11:48.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:32:0)
[00:11:48.584] Build status: STARTED
[00:11:48.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:33:0) after 2m46s
[00:14:34.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:33:0)
[00:14:34.688] Build status: STARTED
[00:14:34.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:34:0) after 5m55s
[00:20:29.939] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:34:0)
[00:20:29.954] Build status: STARTED
[00:20:29.954] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:35:0) after 4m57s
[00:25:27.320] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:35:0)
[00:25:27.348] Build status: STARTED
[00:25:27.348] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:36:0) after 3m36s
[00:29:03.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:36:0)
[00:29:03.849] Build status: STARTED
[00:29:03.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:37:0) after 4m17s
[00:33:20.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:37:0)
[00:33:20.936] Build status: STARTED
[00:33:20.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:38:0) after 4m46s
[00:38:07.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:38:0)
[00:38:07.124] Build status: STARTED
[00:38:07.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:39:0) after 4m36s
[00:42:43.141] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:39:0)
[00:42:43.163] Build status: STARTED
[00:42:43.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:40:0) after 5m17s
[00:48:00.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:40:0)
[00:48:00.386] Build status: STARTED
[00:48:00.386] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:41:0) after 8m27s
[00:56:27.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:41:0)
[00:56:27.459] Build status: STARTED
[00:56:27.459] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:42:0) after 5m57s
[01:02:25.069] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:42:0)
[01:02:25.084] Build status: STARTED
[01:02:25.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:43:0) after 8m3s
[01:10:28.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:43:0)
[01:10:28.212] Build status: STARTED
[01:10:28.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:44:0) after 5m36s
[01:16:04.466] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:44:0)
[01:16:04.486] Build status: STARTED
[01:16:04.486] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:45:0) after 5m53s
[01:21:57.546] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:45:0)
[01:21:57.565] Build status: STARTED
[01:21:57.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:46:0) after 2m2s
[01:23:59.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:46:0)
[01:23:59.789] Build status: STARTED
[01:23:59.789] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:47:0) after 8m21s
[01:32:20.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:47:0)
[01:32:20.951] Build status: STARTED
[01:32:20.951] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:48:0) after 3m6s
[01:35:27.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:48:0)
[01:35:27.272] Build status: STARTED
[01:35:27.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:49:0) after 8m27s
[01:43:54.448] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:49:0)
[01:43:54.465] Build status: STARTED
[01:43:54.465] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:50:0) after 3m28s
[01:47:22.517] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:50:0)
[01:47:22.531] Build status: STARTED
[01:47:22.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:51:0) after 3m47s
[01:51:09.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:51:0)
[01:51:09.732] Build status: STARTED
[01:51:09.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:52:0) after 9m23s
[02:00:32.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:52:0)
[02:00:32.817] Build status: STARTED
[02:00:32.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:53:0) after 4m42s
[02:05:14.843] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:53:0)
[02:05:14.862] Build status: STARTED
[02:05:14.862] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:54:0) after 2m27s
[02:07:42.002] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:54:0)
[02:07:42.035] Build status: STARTED
[02:07:42.035] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:55:0) after 9m5s
[02:16:47.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:55:0)
[02:16:47.314] Build status: STARTED
[02:16:47.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:56:0) after 6m30s
[02:23:17.695] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:56:0)
[02:23:17.724] Build status: STARTED
[02:23:17.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:57:0) after 6m1s
[02:29:18.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:57:0)
[02:29:18.818] Build status: STARTED
[02:29:18.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:58:0) after 5m14s
[02:34:32.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:58:0)
[02:34:32.865] Build status: STARTED
[02:34:32.865] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:59:0) after 2m35s
[02:37:07.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:59:0)
[02:37:07.997] Build status: STARTED
[02:37:07.997] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:60:0) after 7m22s
[02:44:30.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:60:0)
[02:44:30.153] Build status: STARTED
[02:44:30.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:61:0) after 8m33s
[02:53:03.175] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:61:0)
[02:53:03.208] Build status: STARTED
[02:53:03.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:62:0) after 3m40s
[02:56:43.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:62:0)
[02:56:43.255] Build status: STARTED
[02:56:43.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:63:0) after 1m20s
[02:58:03.443] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:63:0)
[02:58:03.477] Build status: STARTED
[02:58:03.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:64:0) after 5m38s
[03:03:41.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:64:0)
[03:03:41.568] Build status: STARTED
[03:03:41.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:65:0) after 6m49s
[03:10:30.645] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:65:0)
[03:10:30.664] Build status: STARTED
[03:10:30.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:66:0) after 8m25s
[03:18:55.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:66:0)
[03:18:55.816] Build status: STARTED
[03:18:55.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:67:0) after 1m23s
[03:20:18.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:67:0)
[03:20:18.859] Build status: STARTED
[03:20:18.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:68:0) after 7m26s
[03:27:45.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:68:0)
[03:27:45.279] Build status: STARTED
[03:27:45.279] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:69:0) after 3m24s
[03:31:09.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:69:0)
[03:31:09.634] Build status: STARTED
[03:31:09.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:70:0) after 2m50s
[03:33:59.622] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:70:0)
[03:33:59.643] Build status: STARTED
[03:33:59.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:71:0) after 3m16s
[03:37:15.686] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:71:0)
[03:37:15.716] Build status: STARTED
[03:37:15.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:72:0) after 3m57s
[03:41:12.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:72:0)
[03:41:12.763] Build status: STARTED
[03:41:12.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:73:0) after 3m36s
[03:44:49.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:73:0)
[03:44:49.176] Build status: STARTED
[03:44:49.176] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:74:0) after 1m56s
[03:46:45.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:74:0)
[03:46:45.463] Build status: STARTED
[03:46:45.463] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:75:0) after 2m8s
[03:48:53.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:75:0)
[03:48:53.698] Build status: STARTED
[03:48:53.698] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:76:0) after 5m33s
[03:54:26.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:76:0)
[03:54:26.770] Build status: STARTED
[03:54:26.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:77:0) after 8m31s
[04:02:58.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:77:0)
[04:02:58.289] Build status: STARTED
[04:02:58.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:78:0) after 6m9s
[04:09:08.638] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:78:0)
[04:09:08.669] Build status: STARTED
[04:09:08.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:79:0) after 1m25s
[04:10:35.097] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:79:0)
[04:10:35.114] Build status: STARTED
[04:10:35.114] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:80:0) after 3m40s
[04:14:15.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:80:0)
[04:14:15.150] Build status: STARTED
[04:14:15.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:81:0) after 9m19s
[04:23:34.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:81:0)
[04:23:34.516] Build status: STARTED
[04:23:34.516] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:82:0) after 5m25s
[04:28:59.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:82:0)
[04:28:59.618] Build status: STARTED
[04:28:59.618] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:83:0) after 6m29s
[04:35:28.769] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:83:0)
[04:35:28.783] Build status: STARTED
[04:35:28.783] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:84:0) after 6m14s
[04:41:42.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:84:0)
[04:41:42.832] Build status: STARTED
[04:41:42.832] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:85:0) after 6m14s
[04:47:57.061] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:85:0)
[04:47:57.094] Build status: STARTED
[04:47:57.094] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:86:0) after 3m5s
[04:51:02.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:86:0)
[04:51:02.469] Build status: STARTED
[04:51:02.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:87:0) after 7m5s
[04:58:07.495] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:87:0)
[04:58:07.557] Build status: STARTED
[04:58:07.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:88:0) after 8m38s
[05:06:45.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:88:0)
[05:06:45.657] Build status: STARTED
[05:06:45.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:89:0) after 8m33s
[05:15:18.824] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:89:0)
[05:15:18.838] Build status: STARTED
[05:15:18.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:90:0) after 3m46s
[05:19:05.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:90:0)
[05:19:05.237] Build status: STARTED
[05:19:05.237] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:91:0) after 1m48s
[05:20:53.411] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:91:0)
[05:20:53.428] Build status: STARTED
[05:20:53.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:92:0) after 2m16s
[05:23:09.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:92:0)
[05:23:09.598] Build status: STARTED
[05:23:09.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:93:0) after 7m16s
[05:30:25.577] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:93:0)
[05:30:25.692] Build status: STARTED
[05:30:25.692] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:94:0) after 4m50s
[05:35:15.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:94:0)
[05:35:15.879] Build status: STARTED
[05:35:15.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:95:0) after 2m48s
[05:38:03.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:95:0)
[05:38:03.929] Build status: STARTED
[05:38:03.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:96:0) after 7m14s
[05:45:18.055] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:96:0)
[05:45:18.078] Build status: STARTED
[05:45:18.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:97:0) after 8m16s
[05:53:34.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:97:0)
[05:53:34.130] Build status: STARTED
[05:53:34.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:98:0) after 6m27s
[06:00:01.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:98:0)
[06:00:01.523] Build status: STARTED
[06:00:01.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:99:0) after 7m36s
[06:07:37.528] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:99:0)
[06:07:37.563] Build status: STARTED
[06:07:37.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:100:0) after 9m59s
[06:17:36.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:100:0)
[06:17:36.736] Build status: STARTED
[06:17:36.736] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:101:0) after 1m37s
[06:19:13.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:101:0)
[06:19:13.851] Build status: STARTED
[06:19:13.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:102:0) after 5m49s
[06:25:02.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:102:0)
[06:25:02.978] Build status: STARTED
[06:25:02.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:103:0) after 1m40s
[06:26:43.002] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:103:0)
[06:26:43.145] Build status: STARTED
[06:26:43.145] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:104:0) after 8m12s
[06:34:55.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:104:0)
[06:34:55.332] Build status: STARTED
[06:34:55.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:105:0) after 6m39s
[06:41:34.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:105:0)
[06:41:34.424] Build status: STARTED
[06:41:34.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:106:0) after 9m9s
[06:50:43.644] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:106:0)
[06:50:43.659] Build status: STARTED
[06:50:43.659] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:107:0) after 4m23s
[06:55:06.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:107:0)
[06:55:06.861] Build status: STARTED
[06:55:06.861] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:108:0) after 8m22s
[07:03:29.055] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:108:0)
[07:03:29.074] Build status: STARTED
[07:03:29.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:109:0) after 3m22s
[07:06:51.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:109:0)
[07:06:51.130] Build status: STARTED
[07:06:51.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:110:0) after 1m46s
[07:08:37.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:110:0)
[07:08:37.201] Build status: STARTED
[07:08:37.201] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:111:0) after 1m13s
[07:09:50.253] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:111:0)
[07:09:50.269] Build status: STARTED
[07:09:50.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:112:0) after 5m35s
[07:15:25.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:112:0)
[07:15:25.400] Build status: STARTED
[07:15:25.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:113:0) after 4m36s
[07:20:01.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:113:0)
[07:20:01.496] Build status: STARTED
[07:20:01.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:114:0) after 6m0s
[07:26:01.528] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:114:0)
[07:26:01.550] Build status: STARTED
[07:26:01.550] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:115:0) after 6m41s
[07:32:42.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:115:0)
[07:32:42.597] Build status: STARTED
[07:32:42.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:116:0) after 6m29s
[07:39:11.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:116:0)
[07:39:11.646] Build status: STARTED
[07:39:11.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:117:0) after 5m16s
[07:44:27.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:117:0)
[07:44:27.709] Build status: STARTED
[07:44:27.709] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:118:0) after 1m32s
[07:45:59.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:118:0)
[07:45:59.749] Build status: STARTED
[07:45:59.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:119:0) after 2m13s
[07:48:12.791] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:119:0)
[07:48:12.809] Build status: STARTED
[07:48:12.809] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:120:0) after 5m39s
[07:53:52.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:120:0)
[07:53:52.082] Build status: STARTED
[07:53:52.082] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:121:0) after 3m51s
[07:57:43.206] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:121:0)
[07:57:43.221] Build status: STARTED
[07:57:43.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:122:0) after 3m50s
[08:01:33.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:122:0)
[08:01:33.561] Build status: STARTED
[08:01:33.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:123:0) after 6m40s
[08:08:13.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:123:0)
[08:08:13.602] Build status: STARTED
[08:08:13.602] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:124:0) after 3m40s
[08:11:53.708] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:124:0)
[08:11:53.735] Build status: STARTED
[08:11:53.735] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:125:0) after 6m35s
[08:18:28.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:125:0)
[08:18:29.062] Build status: STARTED
[08:18:29.062] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:126:0) after 3m22s
[08:21:51.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:126:0)
[08:21:51.115] Build status: STARTED
[08:21:51.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:127:0) after 4m31s
[08:26:22.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:127:0)
[08:26:22.218] Build status: STARTED
[08:26:22.218] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:128:0) after 2m20s
[08:28:42.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:128:0)
[08:28:42.321] Build status: STARTED
[08:28:42.321] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:129:0) after 3m11s
[08:31:53.342] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:129:0)
[08:31:53.376] Build status: STARTED
[08:31:53.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:130:0) after 2m45s
[08:34:38.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:130:0)
[08:34:38.417] Build status: STARTED
[08:34:38.417] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:131:0) after 2m21s
[08:36:59.437] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:131:0)
[08:36:59.457] Build status: STARTED
[08:36:59.457] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:132:0) after 8m0s
[08:44:59.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:132:0)
[08:44:59.700] Build status: STARTED
[08:44:59.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:133:0) after 6m22s
[08:51:21.814] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:133:0)
[08:51:21.828] Build status: STARTED
[08:51:21.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:134:0) after 6m50s
[08:58:11.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:134:0)
[08:58:11.879] Build status: STARTED
[08:58:11.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:135:0) after 1m4s
[08:59:16.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:135:0)
[08:59:16.126] Build status: STARTED
[08:59:16.126] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:136:0) after 1m31s
[09:00:47.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:136:0)
[09:00:47.331] Build status: STARTED
[09:00:47.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:137:0) after 7m37s
[09:08:24.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:137:0)
[09:08:24.460] Build status: STARTED
[09:08:24.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:138:0) after 8m6s
[09:16:30.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:138:0)
[09:16:30.518] Build status: STARTED
[09:16:30.518] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:139:0) after 3m27s
[09:19:57.648] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:139:0)
[09:19:57.672] Build status: STARTED
[09:19:57.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8881921933284422368:140:0) after 9m0s
[09:28:02.185] Received PubSub notification, asking Buildbucket for the build status
[09:28:02.203] Build:
{
"id": "8716491871410587537",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3287,
"createdBy": "project:chromium",
"createTime": "2025-04-26T21:23:15.279170357Z",
"startTime": "2025-04-26T21:26:27.219873802Z",
"endTime": "2025-04-27T09:28:01.817956086Z",
"updateTime": "2025-04-27T09:28:01.817956086Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d8c85fa2116504c23ceda10473d27e7ad332c22",
"ref": "refs/heads/main"
}
}
}
[09:28:02.203] Invocation finished in 12h4m48.09395727s with status FAILED