[15:43:44.546] New invocation is queued and will start shortly
[15:43:45.686] Starting the invocation (attempt 1)
[15:43:45.712] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/10e598b3c64732b136107fac0e28a1afff756b90"
[15:43:45.712] Popped gitiles commit info from properties and tags
[15:43:45.712] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:43:45.712] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:43:45.712] Buildbucket request:
{
"requestId": "8884842395266740576",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10e598b3c64732b136107fac0e28a1afff756b90",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8884842395266740576"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:43:46.283] Scheduled build:
{
"id": "8719412333304257777",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3223,
"createdBy": "project:chromium",
"createTime": "2025-03-25T15:43:45.779903243Z",
"updateTime": "2025-03-25T15:43:45.779903243Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10e598b3c64732b136107fac0e28a1afff756b90",
"ref": "refs/heads/main"
}
}
}
[15:43:46.283] Task URL: https://cr-buildbucket.appspot.com/build/8719412333304257777
[15:43:46.283] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:2:0) after 5m3s
[15:43:47.294] Received PubSub notification, asking Buildbucket for the build status
[15:43:47.323] Build status: SCHEDULED
[15:43:55.551] Received PubSub notification, asking Buildbucket for the build status
[15:43:55.602] Build status: STARTED
[15:48:49.341] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:2:0)
[15:48:49.371] Build status: STARTED
[15:48:49.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:5:0) after 5m55s
[15:54:44.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:5:0)
[15:54:44.424] Build status: STARTED
[15:54:44.424] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:6:0) after 2m22s
[15:57:06.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:6:0)
[15:57:06.536] Build status: STARTED
[15:57:06.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:7:0) after 2m36s
[15:59:42.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:7:0)
[15:59:42.652] Build status: STARTED
[15:59:42.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:8:0) after 9m54s
[16:09:36.875] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:8:0)
[16:09:36.921] Build status: STARTED
[16:09:36.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:9:0) after 6m27s
[16:16:03.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:9:0)
[16:16:04.024] Build status: STARTED
[16:16:04.024] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:10:0) after 5m50s
[16:21:54.101] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:10:0)
[16:21:54.124] Build status: STARTED
[16:21:54.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:11:0) after 3m2s
[16:24:56.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:11:0)
[16:24:56.223] Build status: STARTED
[16:24:56.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:12:0) after 9m11s
[16:34:07.334] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:12:0)
[16:34:07.368] Build status: STARTED
[16:34:07.368] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:13:0) after 2m48s
[16:36:55.471] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:13:0)
[16:36:55.490] Build status: STARTED
[16:36:55.490] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:14:0) after 4m25s
[16:41:20.586] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:14:0)
[16:41:20.669] Build status: STARTED
[16:41:20.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:15:0) after 5m6s
[16:46:26.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:15:0)
[16:46:26.816] Build status: STARTED
[16:46:26.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:16:0) after 1m9s
[16:47:35.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:16:0)
[16:47:35.922] Build status: STARTED
[16:47:35.922] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:17:0) after 7m20s
[16:54:55.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:17:0)
[16:54:55.960] Build status: STARTED
[16:54:55.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:18:0) after 5m50s
[17:00:46.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:18:0)
[17:00:46.072] Build status: STARTED
[17:00:46.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:19:0) after 8m32s
[17:09:18.096] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:19:0)
[17:09:18.125] Build status: STARTED
[17:09:18.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:20:0) after 2m11s
[17:11:29.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:20:0)
[17:11:29.206] Build status: STARTED
[17:11:29.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:21:0) after 4m58s
[17:16:27.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:21:0)
[17:16:27.246] Build status: STARTED
[17:16:27.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:22:0) after 5m42s
[17:22:09.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:22:0)
[17:22:09.278] Build status: STARTED
[17:22:09.278] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:23:0) after 5m4s
[17:27:13.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:23:0)
[17:27:13.369] Build status: STARTED
[17:27:13.369] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:24:0) after 1m42s
[17:28:55.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:24:0)
[17:28:55.537] Build status: STARTED
[17:28:55.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:25:0) after 8m41s
[17:37:36.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:25:0)
[17:37:36.600] Build status: STARTED
[17:37:36.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:26:0) after 8m10s
[17:45:46.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:26:0)
[17:45:46.742] Build status: STARTED
[17:45:46.742] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:27:0) after 9m5s
[17:54:51.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:27:0)
[17:54:51.875] Build status: STARTED
[17:54:51.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:28:0) after 5m7s
[17:59:59.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:28:0)
[17:59:59.084] Build status: STARTED
[17:59:59.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:29:0) after 5m38s
[18:05:37.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:29:0)
[18:05:37.165] Build status: STARTED
[18:05:37.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:30:0) after 9m21s
[18:14:58.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:30:0)
[18:14:58.244] Build status: STARTED
[18:14:58.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:31:0) after 7m54s
[18:22:52.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:31:0)
[18:22:52.333] Build status: STARTED
[18:22:52.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:32:0) after 8m5s
[18:30:57.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:32:0)
[18:30:57.379] Build status: STARTED
[18:30:57.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:33:0) after 6m30s
[18:37:27.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:33:0)
[18:37:27.447] Build status: STARTED
[18:37:27.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:34:0) after 5m46s
[18:43:13.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:34:0)
[18:43:13.520] Build status: STARTED
[18:43:13.520] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:35:0) after 1m44s
[18:44:57.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:35:0)
[18:44:57.581] Build status: STARTED
[18:44:57.581] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:36:0) after 4m1s
[18:48:58.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:36:0)
[18:48:58.676] Build status: STARTED
[18:48:58.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:37:0) after 6m16s
[18:55:14.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:37:0)
[18:55:14.741] Build status: STARTED
[18:55:14.741] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:38:0) after 1m48s
[18:57:03.083] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:38:0)
[18:57:03.132] Build status: STARTED
[18:57:03.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:39:0) after 3m52s
[19:00:55.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:39:0)
[19:00:55.540] Build status: STARTED
[19:00:55.540] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:40:0) after 1m1s
[19:01:56.642] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:40:0)
[19:01:56.657] Build status: STARTED
[19:01:56.657] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:41:0) after 2m27s
[19:04:23.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:41:0)
[19:04:23.779] Build status: STARTED
[19:04:23.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:42:0) after 5m0s
[19:09:23.805] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:42:0)
[19:09:23.835] Build status: STARTED
[19:09:23.835] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:43:0) after 2m52s
[19:12:15.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:43:0)
[19:12:16.018] Build status: STARTED
[19:12:16.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:44:0) after 8m56s
[19:21:12.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:44:0)
[19:21:12.309] Build status: STARTED
[19:21:12.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:45:0) after 6m38s
[19:27:50.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:45:0)
[19:27:50.454] Build status: STARTED
[19:27:50.454] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:46:0) after 3m46s
[19:31:36.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:46:0)
[19:31:36.669] Build status: STARTED
[19:31:36.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:47:0) after 4m11s
[19:35:47.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:47:0)
[19:35:47.784] Build status: STARTED
[19:35:47.784] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:48:0) after 6m3s
[19:41:50.811] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:48:0)
[19:41:50.831] Build status: STARTED
[19:41:50.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:49:0) after 1m32s
[19:43:22.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:49:0)
[19:43:22.917] Build status: STARTED
[19:43:22.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:50:0) after 2m43s
[19:46:05.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:50:0)
[19:46:05.990] Build status: STARTED
[19:46:05.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:51:0) after 5m30s
[19:51:36.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:51:0)
[19:51:36.072] Build status: STARTED
[19:51:36.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:52:0) after 9m39s
[20:01:15.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:52:0)
[20:01:15.215] Build status: STARTED
[20:01:15.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:53:0) after 4m13s
[20:05:28.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:53:0)
[20:05:28.266] Build status: STARTED
[20:05:28.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:54:0) after 8m16s
[20:13:44.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:54:0)
[20:13:44.409] Build status: STARTED
[20:13:44.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:55:0) after 8m1s
[20:21:45.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:55:0)
[20:21:45.467] Build status: STARTED
[20:21:45.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:56:0) after 3m56s
[20:25:41.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:56:0)
[20:25:41.616] Build status: STARTED
[20:25:41.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:57:0) after 7m46s
[20:33:27.691] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:57:0)
[20:33:27.710] Build status: STARTED
[20:33:27.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:58:0) after 6m34s
[20:40:01.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:58:0)
[20:40:01.825] Build status: STARTED
[20:40:01.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:59:0) after 4m53s
[20:44:54.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:59:0)
[20:44:54.927] Build status: STARTED
[20:44:54.927] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:60:0) after 1m16s
[20:46:10.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:60:0)
[20:46:11.023] Build status: STARTED
[20:46:11.023] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:61:0) after 5m36s
[20:51:47.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:61:0)
[20:51:47.112] Build status: STARTED
[20:51:47.112] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:62:0) after 5m15s
[20:57:02.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:62:0)
[20:57:02.256] Build status: STARTED
[20:57:02.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:63:0) after 5m41s
[21:02:43.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:63:0)
[21:02:43.453] Build status: STARTED
[21:02:43.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:64:0) after 8m47s
[21:11:30.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:64:0)
[21:11:30.566] Build status: STARTED
[21:11:30.566] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:65:0) after 5m8s
[21:16:38.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:65:0)
[21:16:38.634] Build status: STARTED
[21:16:38.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:66:0) after 3m19s
[21:19:57.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:66:0)
[21:19:57.746] Build status: STARTED
[21:19:57.746] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:67:0) after 7m4s
[21:27:01.791] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:67:0)
[21:27:01.811] Build status: STARTED
[21:27:01.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:68:0) after 4m56s
[21:31:58.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:68:0)
[21:31:58.022] Build status: STARTED
[21:31:58.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:69:0) after 6m26s
[21:38:24.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:69:0)
[21:38:24.095] Build status: STARTED
[21:38:24.095] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:70:0) after 5m16s
[21:43:40.192] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:70:0)
[21:43:40.208] Build status: STARTED
[21:43:40.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:71:0) after 4m21s
[21:48:01.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:71:0)
[21:48:01.300] Build status: STARTED
[21:48:01.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:72:0) after 1m41s
[21:49:42.407] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:72:0)
[21:49:42.478] Build status: STARTED
[21:49:42.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:73:0) after 5m42s
[21:55:24.508] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:73:0)
[21:55:24.535] Build status: STARTED
[21:55:24.535] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:74:0) after 2m57s
[21:58:21.612] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:74:0)
[21:58:21.634] Build status: STARTED
[21:58:21.634] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:75:0) after 4m46s
[22:03:07.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:75:0)
[22:03:07.793] Build status: STARTED
[22:03:07.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:76:0) after 7m24s
[22:10:31.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:76:0)
[22:10:31.843] Build status: STARTED
[22:10:31.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:77:0) after 6m51s
[22:17:22.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:77:0)
[22:17:22.990] Build status: STARTED
[22:17:22.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:78:0) after 7m36s
[22:24:59.085] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:78:0)
[22:24:59.103] Build status: STARTED
[22:24:59.103] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:79:0) after 1m15s
[22:26:14.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:79:0)
[22:26:14.249] Build status: STARTED
[22:26:14.249] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:80:0) after 6m50s
[22:33:04.485] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:80:0)
[22:33:04.501] Build status: STARTED
[22:33:04.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:81:0) after 6m14s
[22:39:18.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:81:0)
[22:39:18.549] Build status: STARTED
[22:39:18.549] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:82:0) after 4m10s
[22:43:28.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:82:0)
[22:43:28.682] Build status: STARTED
[22:43:28.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:83:0) after 9m30s
[22:52:58.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:83:0)
[22:52:58.738] Build status: STARTED
[22:52:58.738] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:84:0) after 2m51s
[22:55:49.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:84:0)
[22:55:49.790] Build status: STARTED
[22:55:49.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:85:0) after 7m2s
[23:02:51.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:85:0)
[23:02:51.839] Build status: STARTED
[23:02:51.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:86:0) after 6m0s
[23:08:51.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:86:0)
[23:08:51.894] Build status: STARTED
[23:08:51.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:87:0) after 1m18s
[23:10:09.929] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:87:0)
[23:10:09.952] Build status: STARTED
[23:10:09.952] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:88:0) after 6m8s
[23:16:18.026] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:88:0)
[23:16:18.044] Build status: STARTED
[23:16:18.044] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:89:0) after 2m43s
[23:19:01.132] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:89:0)
[23:19:01.168] Build status: STARTED
[23:19:01.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:90:0) after 3m23s
[23:22:24.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:90:0)
[23:22:24.205] Build status: STARTED
[23:22:24.205] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:91:0) after 6m16s
[23:28:40.194] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:91:0)
[23:28:40.213] Build status: STARTED
[23:28:40.213] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:92:0) after 2m16s
[23:30:56.248] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:92:0)
[23:30:56.269] Build status: STARTED
[23:30:56.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:93:0) after 7m35s
[23:38:31.351] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:93:0)
[23:38:31.389] Build status: STARTED
[23:38:31.389] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:94:0) after 9m48s
[23:48:19.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:94:0)
[23:48:19.568] Build status: STARTED
[23:48:19.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:95:0) after 1m36s
[23:49:55.590] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:95:0)
[23:49:55.619] Build status: STARTED
[23:49:55.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:96:0) after 3m32s
[23:53:27.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:96:0)
[23:53:27.713] Build status: STARTED
[23:53:27.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:97:0) after 3m16s
[23:56:43.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:97:0)
[23:56:43.764] Build status: STARTED
[23:56:43.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:98:0) after 2m57s
[23:59:40.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:98:0)
[23:59:41.184] Build status: STARTED
[23:59:41.185] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:99:0) after 7m4s
[00:06:45.185] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:99:0)
[00:06:45.481] Build status: STARTED
[00:06:45.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:100:0) after 2m54s
[00:09:39.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:100:0)
[00:09:39.538] Build status: STARTED
[00:09:39.538] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:101:0) after 1m54s
[00:11:33.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:101:0)
[00:11:33.616] Build status: STARTED
[00:11:33.616] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:102:0) after 8m31s
[00:20:04.773] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:102:0)
[00:20:04.790] Build status: STARTED
[00:20:04.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:103:0) after 2m25s
[00:22:29.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:103:0)
[00:22:29.844] Build status: STARTED
[00:22:29.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:104:0) after 8m5s
[00:30:34.850] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:104:0)
[00:30:34.871] Build status: STARTED
[00:30:34.871] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:105:0) after 3m29s
[00:34:04.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:105:0)
[00:34:04.026] Build status: STARTED
[00:34:04.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:106:0) after 7m54s
[00:41:58.077] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:106:0)
[00:41:58.115] Build status: STARTED
[00:41:58.115] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:107:0) after 7m12s
[00:49:10.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:107:0)
[00:49:10.151] Build status: STARTED
[00:49:10.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:108:0) after 9m16s
[00:58:26.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:108:0)
[00:58:26.186] Build status: STARTED
[00:58:26.186] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:109:0) after 1m38s
[01:00:04.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:109:0)
[01:00:04.238] Build status: STARTED
[01:00:04.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:110:0) after 2m21s
[01:02:25.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:110:0)
[01:02:25.282] Build status: STARTED
[01:02:25.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:111:0) after 5m54s
[01:08:19.305] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:111:0)
[01:08:19.326] Build status: STARTED
[01:08:19.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:112:0) after 5m5s
[01:13:24.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:112:0)
[01:13:24.478] Build status: STARTED
[01:13:24.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:113:0) after 8m29s
[01:21:53.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:113:0)
[01:21:53.664] Build status: STARTED
[01:21:53.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:114:0) after 1m45s
[01:23:38.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:114:0)
[01:23:38.821] Build status: STARTED
[01:23:38.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:115:0) after 3m18s
[01:26:56.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:115:0)
[01:26:56.876] Build status: STARTED
[01:26:56.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:116:0) after 7m47s
[01:34:43.968] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:116:0)
[01:34:44.026] Build status: STARTED
[01:34:44.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:117:0) after 5m55s
[01:40:39.040] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:117:0)
[01:40:39.066] Build status: STARTED
[01:40:39.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:118:0) after 8m21s
[01:49:00.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:118:0)
[01:49:00.117] Build status: STARTED
[01:49:00.117] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:119:0) after 2m27s
[01:51:27.158] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:119:0)
[01:51:27.224] Build status: STARTED
[01:51:27.224] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:120:0) after 8m42s
[02:00:09.249] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:120:0)
[02:00:09.282] Build status: STARTED
[02:00:09.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:121:0) after 5m38s
[02:05:47.310] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:121:0)
[02:05:47.327] Build status: STARTED
[02:05:47.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:122:0) after 7m48s
[02:13:35.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:122:0)
[02:13:35.408] Build status: STARTED
[02:13:35.408] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:123:0) after 1m42s
[02:15:17.439] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:123:0)
[02:15:17.456] Build status: STARTED
[02:15:17.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:124:0) after 6m39s
[02:21:56.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:124:0)
[02:21:56.570] Build status: STARTED
[02:21:56.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:125:0) after 6m36s
[02:28:32.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:125:0)
[02:28:32.801] Build status: STARTED
[02:28:32.802] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:126:0) after 1m51s
[02:30:23.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:126:0)
[02:30:23.880] Build status: STARTED
[02:30:23.880] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:127:0) after 6m42s
[02:37:05.900] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:127:0)
[02:37:05.921] Build status: STARTED
[02:37:05.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:128:0) after 6m4s
[02:43:09.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:128:0)
[02:43:09.964] Build status: STARTED
[02:43:09.964] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:129:0) after 7m56s
[02:51:06.025] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:129:0)
[02:51:06.045] Build status: STARTED
[02:51:06.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:130:0) after 2m42s
[02:53:48.071] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:130:0)
[02:53:48.131] Build status: STARTED
[02:53:48.131] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:131:0) after 8m4s
[03:01:52.152] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:131:0)
[03:01:52.169] Build status: STARTED
[03:01:52.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:132:0) after 4m33s
[03:06:25.317] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:132:0)
[03:06:25.338] Build status: STARTED
[03:06:25.338] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:133:0) after 4m7s
[03:10:32.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:133:0)
[03:10:32.383] Build status: STARTED
[03:10:32.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:134:0) after 1m25s
[03:11:57.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:134:0)
[03:11:57.439] Build status: STARTED
[03:11:57.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:135:0) after 8m17s
[03:20:14.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:135:0)
[03:20:14.500] Build status: STARTED
[03:20:14.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:136:0) after 8m53s
[03:29:07.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:136:0)
[03:29:07.675] Build status: STARTED
[03:29:07.675] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:137:0) after 3m3s
[03:32:10.752] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:137:0)
[03:32:10.781] Build status: STARTED
[03:32:10.781] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:138:0) after 8m57s
[03:41:07.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:138:0)
[03:41:07.817] Build status: STARTED
[03:41:07.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8884842395266740576:139:0) after 6m4s
[03:45:35.623] Received PubSub notification, asking Buildbucket for the build status
[03:45:35.639] Build:
{
"id": "8719412333304257777",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3223,
"createdBy": "project:chromium",
"createTime": "2025-03-25T15:43:45.779903243Z",
"startTime": "2025-03-25T15:43:55.274382067Z",
"endTime": "2025-03-26T03:45:35.152849609Z",
"updateTime": "2025-03-26T03:45:35.152849609Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "10e598b3c64732b136107fac0e28a1afff756b90",
"ref": "refs/heads/main"
}
}
}
[03:45:35.639] Invocation finished in 12h1m51.115565232s with status FAILED