[10:46:29.184] New invocation is queued and will start shortly
[10:46:30.291] Starting the invocation (attempt 1)
[10:46:30.327] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f26399a8b4522cd27baea2ec1fa54481e0019317"
[10:46:30.327] Popped gitiles commit info from properties and tags
[10:46:30.327] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:46:30.327] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:46:30.327] Buildbucket request:
{
"requestId": "8943839722127611344",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f26399a8b4522cd27baea2ec1fa54481e0019317",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8943839722127611344"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:46:30.814] Scheduled build:
{
"id": "8778409660134198993",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1488,
"createdBy": "project:chromium",
"createTime": "2023-06-13T10:46:30.445226458Z",
"updateTime": "2023-06-13T10:46:30.445226458Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f26399a8b4522cd27baea2ec1fa54481e0019317",
"ref": "refs/heads/main"
}
}
}
[10:46:30.814] Task URL: https://cr-buildbucket.appspot.com/build/8778409660134198993
[10:46:30.814] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:2:0) after 8m43s
[10:46:59.984] Received PubSub notification, asking Buildbucket for the build status
[10:47:00.002] Build status: STARTED
[10:55:13.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:2:0)
[10:55:13.975] Build status: STARTED
[10:55:13.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:4:0) after 2m5s
[10:57:19.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:4:0)
[10:57:19.531] Build status: STARTED
[10:57:19.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:5:0) after 4m36s
[11:01:55.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:5:0)
[11:01:55.580] Build status: STARTED
[11:01:55.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:6:0) after 6m17s
[11:08:12.613] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:6:0)
[11:08:12.633] Build status: STARTED
[11:08:12.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:7:0) after 9m24s
[11:17:36.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:7:0)
[11:17:36.885] Build status: STARTED
[11:17:36.885] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:8:0) after 8m39s
[11:26:16.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:8:0)
[11:26:16.044] Build status: STARTED
[11:26:16.044] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:9:0) after 1m36s
[11:27:52.238] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:9:0)
[11:27:52.261] Build status: STARTED
[11:27:52.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:10:0) after 2m27s
[11:30:19.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:10:0)
[11:30:19.586] Build status: STARTED
[11:30:19.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:11:0) after 5m7s
[11:35:26.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:11:0)
[11:35:26.638] Build status: STARTED
[11:35:26.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:12:0) after 3m41s
[11:39:07.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:12:0)
[11:39:07.888] Build status: STARTED
[11:39:07.889] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:13:0) after 8m16s
[11:47:23.920] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:13:0)
[11:47:23.938] Build status: STARTED
[11:47:23.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:14:0) after 4m6s
[11:51:30.212] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:14:0)
[11:51:30.229] Build status: STARTED
[11:51:30.229] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:15:0) after 4m48s
[11:56:18.255] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:15:0)
[11:56:18.273] Build status: STARTED
[11:56:18.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:16:0) after 2m45s
[11:59:03.356] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:16:0)
[11:59:03.396] Build status: STARTED
[11:59:03.396] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:17:0) after 8m58s
[12:08:01.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:17:0)
[12:08:01.447] Build status: STARTED
[12:08:01.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:18:0) after 5m59s
[12:14:00.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:18:0)
[12:14:00.505] Build status: STARTED
[12:14:00.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:19:0) after 4m10s
[12:18:10.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:19:0)
[12:18:10.597] Build status: STARTED
[12:18:10.597] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:20:0) after 4m33s
[12:22:43.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:20:0)
[12:22:43.640] Build status: STARTED
[12:22:43.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:21:0) after 5m47s
[12:28:30.816] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:21:0)
[12:28:30.842] Build status: STARTED
[12:28:30.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:22:0) after 8m5s
[12:36:35.871] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:22:0)
[12:36:35.888] Build status: STARTED
[12:36:35.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:23:0) after 6m8s
[12:42:44.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:23:0)
[12:42:44.138] Build status: STARTED
[12:42:44.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:24:0) after 3m8s
[12:45:52.245] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:24:0)
[12:45:52.265] Build status: STARTED
[12:45:52.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:25:0) after 3m3s
[12:48:55.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:25:0)
[12:48:55.471] Build status: STARTED
[12:48:55.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:26:0) after 1m22s
[12:50:17.509] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:26:0)
[12:50:17.529] Build status: STARTED
[12:50:17.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:27:0) after 8m27s
[12:58:44.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:27:0)
[12:58:44.730] Build status: STARTED
[12:58:44.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:28:0) after 4m49s
[13:03:33.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:28:0)
[13:03:33.988] Build status: STARTED
[13:03:33.988] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:29:0) after 1m13s
[13:04:47.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:29:0)
[13:04:47.035] Build status: STARTED
[13:04:47.035] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:30:0) after 9m55s
[13:14:42.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:30:0)
[13:14:42.298] Build status: STARTED
[13:14:42.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:31:0) after 5m14s
[13:19:56.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:31:0)
[13:19:56.498] Build status: STARTED
[13:19:56.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:32:0) after 6m29s
[13:26:25.667] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:32:0)
[13:26:25.689] Build status: STARTED
[13:26:25.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:33:0) after 9m40s
[13:36:05.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:33:0)
[13:36:05.813] Build status: STARTED
[13:36:05.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:34:0) after 5m38s
[13:41:43.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:34:0)
[13:41:43.857] Build status: STARTED
[13:41:43.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:35:0) after 5m53s
[13:47:36.886] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:35:0)
[13:47:36.903] Build status: STARTED
[13:47:36.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:36:0) after 4m57s
[13:52:33.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:36:0)
[13:52:33.973] Build status: STARTED
[13:52:33.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:37:0) after 8m49s
[14:01:23.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:37:0)
[14:01:23.087] Build status: STARTED
[14:01:23.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:38:0) after 6m45s
[14:08:08.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:38:0)
[14:08:08.134] Build status: STARTED
[14:08:08.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:39:0) after 9m58s
[14:18:06.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:39:0)
[14:18:06.217] Build status: STARTED
[14:18:06.217] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:40:0) after 7m43s
[14:25:49.417] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:40:0)
[14:25:49.437] Build status: STARTED
[14:25:49.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:41:0) after 2m18s
[14:28:07.544] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:41:0)
[14:28:07.655] Build status: STARTED
[14:28:07.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:42:0) after 2m48s
[14:30:55.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:42:0)
[14:30:56.022] Build status: STARTED
[14:30:56.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:43:0) after 9m45s
[14:40:41.065] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:43:0)
[14:40:41.103] Build status: STARTED
[14:40:41.103] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:44:0) after 4m57s
[14:45:38.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:44:0)
[14:45:38.160] Build status: STARTED
[14:45:38.160] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:45:0) after 3m26s
[14:49:04.200] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:45:0)
[14:49:04.218] Build status: STARTED
[14:49:04.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:46:0) after 6m41s
[14:55:45.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:46:0)
[14:55:45.341] Build status: STARTED
[14:55:45.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:47:0) after 7m12s
[15:02:57.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:47:0)
[15:02:57.450] Build status: STARTED
[15:02:57.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:48:0) after 7m18s
[15:10:15.549] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:48:0)
[15:10:15.568] Build status: STARTED
[15:10:15.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:49:0) after 2m9s
[15:12:24.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:49:0)
[15:12:24.754] Build status: STARTED
[15:12:24.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:50:0) after 9m10s
[15:21:34.837] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:50:0)
[15:21:34.857] Build status: STARTED
[15:21:34.857] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:51:0) after 5m54s
[15:27:28.854] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:51:0)
[15:27:29.015] Build status: STARTED
[15:27:29.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:52:0) after 6m10s
[15:33:39.093] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:52:0)
[15:33:39.113] Build status: STARTED
[15:33:39.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:53:0) after 3m11s
[15:36:50.136] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:53:0)
[15:36:50.153] Build status: STARTED
[15:36:50.153] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:54:0) after 9m2s
[15:45:52.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:54:0)
[15:45:52.209] Build status: STARTED
[15:45:52.209] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:55:0) after 7m41s
[15:53:33.582] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:55:0)
[15:53:33.607] Build status: STARTED
[15:53:33.607] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:56:0) after 8m52s
[16:02:25.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:56:0)
[16:02:26.015] Build status: STARTED
[16:02:26.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:57:0) after 3m13s
[16:05:40.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:57:0)
[16:05:40.161] Build status: STARTED
[16:05:40.161] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:58:0) after 1m58s
[16:07:38.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:58:0)
[16:07:38.272] Build status: STARTED
[16:07:38.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:59:0) after 1m21s
[16:08:59.943] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:59:0)
[16:08:59.968] Build status: STARTED
[16:08:59.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:60:0) after 8m14s
[16:17:14.471] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:60:0)
[16:17:14.492] Build status: STARTED
[16:17:14.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:61:0) after 4m6s
[16:21:20.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:61:0)
[16:21:20.538] Build status: STARTED
[16:21:20.538] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:62:0) after 5m1s
[16:26:21.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:62:0)
[16:26:21.807] Build status: STARTED
[16:26:21.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:63:0) after 4m6s
[16:30:27.897] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:63:0)
[16:30:27.989] Build status: STARTED
[16:30:27.989] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:64:0) after 7m2s
[16:37:29.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:64:0)
[16:37:30.080] Build status: STARTED
[16:37:30.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:65:0) after 6m24s
[16:43:54.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:65:0)
[16:43:54.243] Build status: STARTED
[16:43:54.243] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:66:0) after 3m38s
[16:47:32.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:66:0)
[16:47:32.309] Build status: STARTED
[16:47:32.309] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:67:0) after 3m5s
[16:50:37.414] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:67:0)
[16:50:37.447] Build status: STARTED
[16:50:37.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:68:0) after 9m36s
[17:00:13.641] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:68:0)
[17:00:13.666] Build status: STARTED
[17:00:13.666] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:69:0) after 5m20s
[17:05:33.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:69:0)
[17:05:33.712] Build status: STARTED
[17:05:33.712] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:70:0) after 1m19s
[17:06:52.888] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:70:0)
[17:06:52.905] Build status: STARTED
[17:06:52.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:71:0) after 6m24s
[17:13:16.932] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:71:0)
[17:13:16.961] Build status: STARTED
[17:13:16.961] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:72:0) after 5m32s
[17:18:49.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:72:0)
[17:18:49.027] Build status: STARTED
[17:18:49.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:73:0) after 7m46s
[17:26:35.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:73:0)
[17:26:35.301] Build status: STARTED
[17:26:35.301] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:74:0) after 4m58s
[17:31:33.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:74:0)
[17:31:33.375] Build status: STARTED
[17:31:33.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:75:0) after 5m24s
[17:36:57.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:75:0)
[17:36:57.524] Build status: STARTED
[17:36:57.524] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:76:0) after 3m17s
[17:40:14.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:76:0)
[17:40:14.605] Build status: STARTED
[17:40:14.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:77:0) after 1m22s
[17:41:37.272] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:77:0)
[17:41:37.310] Build status: STARTED
[17:41:37.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:78:0) after 8m39s
[17:50:16.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:78:0)
[17:50:16.492] Build status: STARTED
[17:50:16.492] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:79:0) after 5m25s
[17:55:41.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:79:0)
[17:55:41.561] Build status: STARTED
[17:55:41.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:80:0) after 2m39s
[17:58:20.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:80:0)
[17:58:20.766] Build status: STARTED
[17:58:20.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:81:0) after 4m24s
[18:02:44.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:81:0)
[18:02:44.851] Build status: STARTED
[18:02:44.851] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:82:0) after 6m38s
[18:09:22.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:82:0)
[18:09:22.946] Build status: STARTED
[18:09:22.946] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:83:0) after 4m18s
[18:13:41.028] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:83:0)
[18:13:41.046] Build status: STARTED
[18:13:41.046] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:84:0) after 2m38s
[18:16:19.140] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:84:0)
[18:16:19.156] Build status: STARTED
[18:16:19.156] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:85:0) after 7m54s
[18:24:13.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:85:0)
[18:24:13.180] Build status: STARTED
[18:24:13.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:86:0) after 6m41s
[18:30:54.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:86:0)
[18:30:54.196] Build status: STARTED
[18:30:54.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:87:0) after 2m26s
[18:33:20.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:87:0)
[18:33:20.258] Build status: STARTED
[18:33:20.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:88:0) after 4m55s
[18:38:15.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:88:0)
[18:38:15.578] Build status: STARTED
[18:38:15.578] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:89:0) after 2m55s
[18:41:10.692] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:89:0)
[18:41:10.716] Build status: STARTED
[18:41:10.716] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:90:0) after 2m20s
[18:43:30.810] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:90:0)
[18:43:30.829] Build status: STARTED
[18:43:30.829] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:91:0) after 9m15s
[18:52:45.970] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:91:0)
[18:52:45.995] Build status: STARTED
[18:52:45.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:92:0) after 2m30s
[18:55:16.058] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:92:0)
[18:55:16.077] Build status: STARTED
[18:55:16.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:93:0) after 3m26s
[18:58:42.156] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:93:0)
[18:58:42.209] Build status: STARTED
[18:58:42.210] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:94:0) after 6m20s
[19:05:02.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:94:0)
[19:05:02.440] Build status: STARTED
[19:05:02.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:95:0) after 8m1s
[19:13:03.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:95:0)
[19:13:03.603] Build status: STARTED
[19:13:03.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:96:0) after 5m7s
[19:18:10.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:96:0)
[19:18:10.652] Build status: STARTED
[19:18:10.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:97:0) after 7m50s
[19:26:00.942] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:97:0)
[19:26:00.959] Build status: STARTED
[19:26:00.959] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:98:0) after 5m1s
[19:31:02.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:98:0)
[19:31:02.642] Build status: STARTED
[19:31:02.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:99:0) after 5m22s
[19:36:24.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:99:0)
[19:36:24.702] Build status: STARTED
[19:36:24.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:100:0) after 5m38s
[19:42:02.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:100:0)
[19:42:02.810] Build status: STARTED
[19:42:02.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:101:0) after 5m28s
[19:47:30.835] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:101:0)
[19:47:30.853] Build status: STARTED
[19:47:30.853] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:102:0) after 7m54s
[19:55:25.251] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:102:0)
[19:55:25.271] Build status: STARTED
[19:55:25.271] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:103:0) after 3m5s
[19:58:30.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:103:0)
[19:58:30.443] Build status: STARTED
[19:58:30.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:104:0) after 7m25s
[20:05:55.480] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:104:0)
[20:05:55.498] Build status: STARTED
[20:05:55.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:105:0) after 4m1s
[20:09:56.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:105:0)
[20:09:56.603] Build status: STARTED
[20:09:56.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:106:0) after 4m23s
[20:14:20.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:106:0)
[20:14:20.233] Build status: STARTED
[20:14:20.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:107:0) after 1m27s
[20:15:47.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:107:0)
[20:15:47.308] Build status: STARTED
[20:15:47.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:108:0) after 3m25s
[20:19:12.402] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:108:0)
[20:19:12.420] Build status: STARTED
[20:19:12.420] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:109:0) after 1m52s
[20:21:04.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:109:0)
[20:21:04.474] Build status: STARTED
[20:21:04.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:110:0) after 9m2s
[20:30:06.511] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:110:0)
[20:30:06.545] Build status: STARTED
[20:30:06.545] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:111:0) after 7m40s
[20:37:46.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:111:0)
[20:37:46.849] Build status: STARTED
[20:37:46.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:112:0) after 1m0s
[20:38:46.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:112:0)
[20:38:46.986] Build status: STARTED
[20:38:46.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:113:0) after 8m22s
[20:47:09.250] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:113:0)
[20:47:09.269] Build status: STARTED
[20:47:09.269] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:114:0) after 4m27s
[20:51:36.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:114:0)
[20:51:36.393] Build status: STARTED
[20:51:36.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:115:0) after 6m3s
[20:57:39.432] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:115:0)
[20:57:39.450] Build status: STARTED
[20:57:39.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:116:0) after 2m34s
[21:00:13.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:116:0)
[21:00:13.527] Build status: STARTED
[21:00:13.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:117:0) after 6m23s
[21:06:36.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:117:0)
[21:06:36.576] Build status: STARTED
[21:06:36.576] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:118:0) after 5m37s
[21:12:13.621] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:118:0)
[21:12:13.650] Build status: STARTED
[21:12:13.650] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:119:0) after 9m55s
[21:22:08.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:119:0)
[21:22:08.917] Build status: STARTED
[21:22:08.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:120:0) after 1m26s
[21:23:35.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:120:0)
[21:23:35.067] Build status: STARTED
[21:23:35.067] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:121:0) after 3m30s
[21:27:05.311] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:121:0)
[21:27:05.328] Build status: STARTED
[21:27:05.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:122:0) after 4m11s
[21:31:17.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:122:0)
[21:31:17.065] Build status: STARTED
[21:31:17.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:123:0) after 7m57s
[21:39:14.107] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:123:0)
[21:39:14.124] Build status: STARTED
[21:39:14.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:124:0) after 5m40s
[21:44:54.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:124:0)
[21:44:54.181] Build status: STARTED
[21:44:54.181] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:125:0) after 4m4s
[21:48:58.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:125:0)
[21:48:58.281] Build status: STARTED
[21:48:58.282] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:126:0) after 1m21s
[21:50:19.633] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:126:0)
[21:50:19.662] Build status: STARTED
[21:50:19.662] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:127:0) after 4m48s
[21:55:07.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:127:0)
[21:55:07.840] Build status: STARTED
[21:55:07.840] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:128:0) after 1m45s
[21:56:53.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:128:0)
[21:56:53.045] Build status: STARTED
[21:56:53.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:129:0) after 7m29s
[22:04:22.301] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:129:0)
[22:04:22.327] Build status: STARTED
[22:04:22.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:130:0) after 9m20s
[22:13:42.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:130:0)
[22:13:42.382] Build status: STARTED
[22:13:42.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:131:0) after 4m56s
[22:18:38.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:131:0)
[22:18:38.425] Build status: STARTED
[22:18:38.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:132:0) after 2m9s
[22:20:47.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:132:0)
[22:20:47.468] Build status: STARTED
[22:20:47.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:133:0) after 8m23s
[22:29:10.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:133:0)
[22:29:10.528] Build status: STARTED
[22:29:10.528] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:134:0) after 2m20s
[22:31:30.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:134:0)
[22:31:30.587] Build status: STARTED
[22:31:30.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:135:0) after 8m23s
[22:39:53.730] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:135:0)
[22:39:53.751] Build status: STARTED
[22:39:53.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:136:0) after 5m16s
[22:45:10.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:136:0)
[22:45:10.359] Build status: STARTED
[22:45:10.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:137:0) after 5m5s
[22:50:15.551] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:137:0)
[22:50:15.606] Build status: STARTED
[22:50:15.606] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:138:0) after 5m10s
[22:55:26.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:138:0)
[22:55:26.107] Build status: STARTED
[22:55:26.107] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:139:0) after 1m29s
[22:56:55.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:139:0)
[22:56:55.220] Build status: STARTED
[22:56:55.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:140:0) after 5m50s
[23:02:45.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:140:0)
[23:02:45.905] Build status: STARTED
[23:02:45.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8943839722127611344:141:0) after 6m23s
[23:03:42.837] Received PubSub notification, asking Buildbucket for the build status
[23:03:42.859] Build:
{
"id": "8778409660134198993",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1488,
"createdBy": "project:chromium",
"createTime": "2023-06-13T10:46:30.445226458Z",
"startTime": "2023-06-13T10:46:59.383503Z",
"endTime": "2023-06-13T23:03:41.937393Z",
"updateTime": "2023-06-13T23:03:41.937393Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f26399a8b4522cd27baea2ec1fa54481e0019317",
"ref": "refs/heads/main"
}
}
}
[23:03:42.859] Invocation finished in 12h17m13.698405267s with status FAILED