[02:02:47.446] New invocation is queued and will start shortly
[02:02:48.552] Starting the invocation (attempt 1)
[02:02:48.585] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0d361b4edc4ceffeb2dd2fdc55e73078ba5e98fb"
[02:02:48.586] Popped gitiles commit info from properties and tags
[02:02:48.586] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:02:48.587] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:02:48.587] Buildbucket request:
{
"requestId": "8927293425344348320",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d361b4edc4ceffeb2dd2fdc55e73078ba5e98fb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8927293425344348320"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:02:49.169] Scheduled build:
{
"id": "8761863363424244977",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1849,
"createdBy": "project:chromium",
"createTime": "2023-12-13T02:02:48.649465196Z",
"updateTime": "2023-12-13T02:02:48.649465196Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d361b4edc4ceffeb2dd2fdc55e73078ba5e98fb",
"ref": "refs/heads/main"
}
}
}
[02:02:49.169] Task URL: https://cr-buildbucket.appspot.com/build/8761863363424244977
[02:02:49.169] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:2:0) after 5m33s
[02:02:50.205] Received PubSub notification, asking Buildbucket for the build status
[02:02:50.227] Build status: SCHEDULED
[02:02:53.886] Received PubSub notification, asking Buildbucket for the build status
[02:02:53.926] Build status: STARTED
[02:08:22.357] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:2:0)
[02:08:22.397] Build status: STARTED
[02:08:22.397] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:5:0) after 4m33s
[02:12:55.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:5:0)
[02:12:55.466] Build status: STARTED
[02:12:55.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:6:0) after 2m7s
[02:15:02.566] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:6:0)
[02:15:02.586] Build status: STARTED
[02:15:02.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:7:0) after 5m10s
[02:20:12.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:7:0)
[02:20:12.831] Build status: STARTED
[02:20:12.831] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:8:0) after 4m6s
[02:24:18.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:8:0)
[02:24:18.969] Build status: STARTED
[02:24:18.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:9:0) after 5m10s
[02:29:29.064] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:9:0)
[02:29:29.090] Build status: STARTED
[02:29:29.090] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:10:0) after 9m16s
[02:38:45.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:10:0)
[02:38:45.179] Build status: STARTED
[02:38:45.179] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:11:0) after 8m21s
[02:47:06.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:11:0)
[02:47:06.276] Build status: STARTED
[02:47:06.276] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:12:0) after 7m42s
[02:54:48.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:12:0)
[02:54:48.409] Build status: STARTED
[02:54:48.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:13:0) after 6m46s
[03:01:34.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:13:0)
[03:01:34.869] Build status: STARTED
[03:01:34.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:14:0) after 1m12s
[03:02:46.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:14:0)
[03:02:47.051] Build status: STARTED
[03:02:47.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:15:0) after 6m27s
[03:09:14.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:15:0)
[03:09:14.165] Build status: STARTED
[03:09:14.165] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:16:0) after 5m34s
[03:14:48.224] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:16:0)
[03:14:48.306] Build status: STARTED
[03:14:48.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:17:0) after 9m24s
[03:24:12.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:17:0)
[03:24:12.493] Build status: STARTED
[03:24:12.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:18:0) after 1m9s
[03:25:21.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:18:0)
[03:25:21.557] Build status: STARTED
[03:25:21.557] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:19:0) after 8m9s
[03:33:30.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:19:0)
[03:33:30.919] Build status: STARTED
[03:33:30.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:20:0) after 4m4s
[03:37:35.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:20:0)
[03:37:35.453] Build status: STARTED
[03:37:35.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:21:0) after 3m36s
[03:41:11.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:21:0)
[03:41:11.523] Build status: STARTED
[03:41:11.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:22:0) after 3m1s
[03:44:12.796] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:22:0)
[03:44:12.816] Build status: STARTED
[03:44:12.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:23:0) after 1m50s
[03:46:02.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:23:0)
[03:46:02.879] Build status: STARTED
[03:46:02.879] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:24:0) after 7m56s
[03:53:59.076] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:24:0)
[03:53:59.136] Build status: STARTED
[03:53:59.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:25:0) after 7m25s
[04:01:24.277] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:25:0)
[04:01:24.298] Build status: STARTED
[04:01:24.298] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:26:0) after 4m23s
[04:05:47.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:26:0)
[04:05:47.349] Build status: STARTED
[04:05:47.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:27:0) after 2m55s
[04:08:42.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:27:0)
[04:08:42.646] Build status: STARTED
[04:08:42.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:28:0) after 9m22s
[04:18:04.700] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:28:0)
[04:18:04.733] Build status: STARTED
[04:18:04.733] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:29:0) after 1m12s
[04:19:16.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:29:0)
[04:19:17.018] Build status: STARTED
[04:19:17.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:30:0) after 2m9s
[04:21:26.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:30:0)
[04:21:26.075] Build status: STARTED
[04:21:26.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:31:0) after 4m33s
[04:25:59.467] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:31:0)
[04:25:59.500] Build status: STARTED
[04:25:59.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:32:0) after 3m8s
[04:29:07.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:32:0)
[04:29:07.543] Build status: STARTED
[04:29:07.543] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:33:0) after 8m41s
[04:37:48.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:33:0)
[04:37:49.014] Build status: STARTED
[04:37:49.014] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:34:0) after 6m58s
[04:44:47.335] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:34:0)
[04:44:47.355] Build status: STARTED
[04:44:47.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:35:0) after 6m31s
[04:51:18.386] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:35:0)
[04:51:18.410] Build status: STARTED
[04:51:18.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:36:0) after 4m25s
[04:55:43.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:36:0)
[04:55:43.577] Build status: STARTED
[04:55:43.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:37:0) after 9m55s
[05:05:38.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:37:0)
[05:05:38.638] Build status: STARTED
[05:05:38.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:38:0) after 3m37s
[05:09:15.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:38:0)
[05:09:15.771] Build status: STARTED
[05:09:15.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:39:0) after 1m53s
[05:11:08.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:39:0)
[05:11:08.892] Build status: STARTED
[05:11:08.892] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:40:0) after 3m1s
[05:14:09.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:40:0)
[05:14:09.968] Build status: STARTED
[05:14:09.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:41:0) after 2m51s
[05:17:01.010] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:41:0)
[05:17:01.035] Build status: STARTED
[05:17:01.035] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:42:0) after 5m9s
[05:22:10.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:42:0)
[05:22:10.125] Build status: STARTED
[05:22:10.125] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:43:0) after 6m32s
[05:28:42.492] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:43:0)
[05:28:42.511] Build status: STARTED
[05:28:42.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:44:0) after 5m36s
[05:34:18.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:44:0)
[05:34:18.568] Build status: STARTED
[05:34:18.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:45:0) after 5m47s
[05:40:05.845] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:45:0)
[05:40:05.870] Build status: STARTED
[05:40:05.870] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:46:0) after 8m27s
[05:48:32.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:46:0)
[05:48:32.938] Build status: STARTED
[05:48:32.938] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:47:0) after 3m25s
[05:51:57.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:47:0)
[05:51:57.983] Build status: STARTED
[05:51:57.983] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:48:0) after 2m33s
[05:54:31.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:48:0)
[05:54:31.034] Build status: STARTED
[05:54:31.035] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:49:0) after 6m34s
[06:01:05.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:49:0)
[06:01:05.080] Build status: STARTED
[06:01:05.080] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:50:0) after 5m51s
[06:06:56.211] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:50:0)
[06:06:56.263] Build status: STARTED
[06:06:56.263] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:51:0) after 8m10s
[06:15:06.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:51:0)
[06:15:06.346] Build status: STARTED
[06:15:06.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:52:0) after 1m54s
[06:17:00.405] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:52:0)
[06:17:00.437] Build status: STARTED
[06:17:00.437] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:53:0) after 3m29s
[06:20:29.514] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:53:0)
[06:20:29.537] Build status: STARTED
[06:20:29.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:54:0) after 9m24s
[06:29:53.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:54:0)
[06:29:53.763] Build status: STARTED
[06:29:53.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:55:0) after 4m30s
[06:34:23.793] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:55:0)
[06:34:23.817] Build status: STARTED
[06:34:23.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:56:0) after 9m29s
[06:43:52.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:56:0)
[06:43:52.967] Build status: STARTED
[06:43:52.967] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:57:0) after 9m11s
[06:53:03.991] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:57:0)
[06:53:04.011] Build status: STARTED
[06:53:04.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:58:0) after 1m29s
[06:54:33.334] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:58:0)
[06:54:33.355] Build status: STARTED
[06:54:33.355] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:59:0) after 5m53s
[07:00:26.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:59:0)
[07:00:26.453] Build status: STARTED
[07:00:26.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:60:0) after 7m49s
[07:08:15.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:60:0)
[07:08:15.569] Build status: STARTED
[07:08:15.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:61:0) after 8m16s
[07:16:31.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:61:0)
[07:16:31.612] Build status: STARTED
[07:16:31.612] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:62:0) after 3m55s
[07:20:26.710] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:62:0)
[07:20:26.745] Build status: STARTED
[07:20:26.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:63:0) after 4m18s
[07:24:44.782] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:63:0)
[07:24:44.802] Build status: STARTED
[07:24:44.802] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:64:0) after 4m41s
[07:29:26.072] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:64:0)
[07:29:26.096] Build status: STARTED
[07:29:26.096] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:65:0) after 6m32s
[07:35:58.137] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:65:0)
[07:35:58.163] Build status: STARTED
[07:35:58.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:66:0) after 9m45s
[07:45:43.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:66:0)
[07:45:43.347] Build status: STARTED
[07:45:43.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:67:0) after 2m15s
[07:47:58.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:67:0)
[07:47:58.400] Build status: STARTED
[07:47:58.400] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:68:0) after 3m57s
[07:51:55.503] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:68:0)
[07:51:55.549] Build status: STARTED
[07:51:55.549] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:69:0) after 3m45s
[07:55:40.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:69:0)
[07:55:40.772] Build status: STARTED
[07:55:40.772] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:70:0) after 4m14s
[07:59:55.183] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:70:0)
[07:59:55.202] Build status: STARTED
[07:59:55.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:71:0) after 1m53s
[08:01:48.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:71:0)
[08:01:48.329] Build status: STARTED
[08:01:48.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:72:0) after 1m36s
[08:03:24.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:72:0)
[08:03:24.403] Build status: STARTED
[08:03:24.403] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:73:0) after 7m2s
[08:10:26.447] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:73:0)
[08:10:26.467] Build status: STARTED
[08:10:26.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:74:0) after 3m31s
[08:13:57.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:74:0)
[08:13:57.527] Build status: STARTED
[08:13:57.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:75:0) after 1m11s
[08:15:08.817] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:75:0)
[08:15:08.839] Build status: STARTED
[08:15:08.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:76:0) after 8m10s
[08:23:18.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:76:0)
[08:23:18.905] Build status: STARTED
[08:23:18.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:77:0) after 5m17s
[08:28:36.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:77:0)
[08:28:36.066] Build status: STARTED
[08:28:36.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:78:0) after 3m47s
[08:32:23.148] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:78:0)
[08:32:23.168] Build status: STARTED
[08:32:23.168] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:79:0) after 4m17s
[08:36:40.189] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:79:0)
[08:36:40.252] Build status: STARTED
[08:36:40.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:80:0) after 6m44s
[08:43:24.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:80:0)
[08:43:24.317] Build status: STARTED
[08:43:24.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:81:0) after 9m16s
[08:52:40.538] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:81:0)
[08:52:40.574] Build status: STARTED
[08:52:40.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:82:0) after 2m15s
[08:54:55.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:82:0)
[08:54:55.974] Build status: STARTED
[08:54:55.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:83:0) after 8m23s
[09:03:19.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:83:0)
[09:03:19.072] Build status: STARTED
[09:03:19.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:84:0) after 2m25s
[09:05:44.160] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:84:0)
[09:05:44.184] Build status: STARTED
[09:05:44.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:85:0) after 3m6s
[09:08:50.617] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:85:0)
[09:08:50.668] Build status: STARTED
[09:08:50.668] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:86:0) after 4m35s
[09:13:25.839] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:86:0)
[09:13:26.020] Build status: STARTED
[09:13:26.020] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:87:0) after 4m58s
[09:18:24.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:87:0)
[09:18:24.620] Build status: STARTED
[09:18:24.620] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:88:0) after 6m43s
[09:25:07.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:88:0)
[09:25:07.688] Build status: STARTED
[09:25:07.688] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:89:0) after 6m13s
[09:31:20.758] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:89:0)
[09:31:20.782] Build status: STARTED
[09:31:20.782] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:90:0) after 7m28s
[09:38:48.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:90:0)
[09:38:48.841] Build status: STARTED
[09:38:48.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:91:0) after 9m28s
[09:48:16.878] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:91:0)
[09:48:17.087] Build status: STARTED
[09:48:17.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:92:0) after 6m7s
[09:54:24.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:92:0)
[09:54:24.235] Build status: STARTED
[09:54:24.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:93:0) after 8m5s
[10:02:29.374] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:93:0)
[10:02:29.393] Build status: STARTED
[10:02:29.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:94:0) after 1m30s
[10:03:59.732] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:94:0)
[10:03:59.759] Build status: STARTED
[10:03:59.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:95:0) after 6m9s
[10:10:08.841] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:95:0)
[10:10:08.858] Build status: STARTED
[10:10:08.858] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:96:0) after 9m6s
[10:19:15.053] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:96:0)
[10:19:15.079] Build status: STARTED
[10:19:15.079] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:97:0) after 5m8s
[10:24:23.435] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:97:0)
[10:24:23.460] Build status: STARTED
[10:24:23.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:98:0) after 4m53s
[10:29:16.618] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:98:0)
[10:29:16.641] Build status: STARTED
[10:29:16.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:99:0) after 3m42s
[10:32:58.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:99:0)
[10:32:58.764] Build status: STARTED
[10:32:58.764] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:100:0) after 6m34s
[10:39:32.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:100:0)
[10:39:32.908] Build status: STARTED
[10:39:32.908] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:101:0) after 8m50s
[10:48:23.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:101:0)
[10:48:23.314] Build status: STARTED
[10:48:23.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:102:0) after 7m27s
[10:55:50.350] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:102:0)
[10:55:50.410] Build status: STARTED
[10:55:50.410] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:103:0) after 3m19s
[10:59:09.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:103:0)
[10:59:09.500] Build status: STARTED
[10:59:09.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:104:0) after 2m45s
[11:01:54.548] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:104:0)
[11:01:54.566] Build status: STARTED
[11:01:54.566] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:105:0) after 6m59s
[11:08:53.720] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:105:0)
[11:08:53.823] Build status: STARTED
[11:08:53.823] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:106:0) after 5m55s
[11:14:48.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:106:0)
[11:14:48.974] Build status: STARTED
[11:14:48.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:107:0) after 3m37s
[11:18:26.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:107:0)
[11:18:26.236] Build status: STARTED
[11:18:26.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:108:0) after 7m14s
[11:25:40.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:108:0)
[11:25:40.827] Build status: STARTED
[11:25:40.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:109:0) after 8m51s
[11:34:32.349] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:109:0)
[11:34:32.382] Build status: STARTED
[11:34:32.382] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:110:0) after 8m50s
[11:43:22.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:110:0)
[11:43:22.477] Build status: STARTED
[11:43:22.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:111:0) after 7m40s
[11:51:02.526] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:111:0)
[11:51:02.573] Build status: STARTED
[11:51:02.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:112:0) after 8m23s
[11:59:25.608] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:112:0)
[11:59:25.638] Build status: STARTED
[11:59:25.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:113:0) after 1m10s
[12:00:35.757] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:113:0)
[12:00:36.532] Build status: STARTED
[12:00:36.532] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:114:0) after 8m54s
[12:09:30.668] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:114:0)
[12:09:30.698] Build status: STARTED
[12:09:30.698] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:115:0) after 7m35s
[12:17:05.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:115:0)
[12:17:05.768] Build status: STARTED
[12:17:05.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:116:0) after 3m52s
[12:20:58.075] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:116:0)
[12:20:58.132] Build status: STARTED
[12:20:58.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:117:0) after 4m59s
[12:25:57.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:117:0)
[12:25:57.215] Build status: STARTED
[12:25:57.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:118:0) after 2m43s
[12:28:40.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:118:0)
[12:28:40.415] Build status: STARTED
[12:28:40.415] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:119:0) after 7m5s
[12:35:45.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:119:0)
[12:35:45.815] Build status: STARTED
[12:35:45.816] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:120:0) after 1m47s
[12:37:32.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:120:0)
[12:37:32.920] Build status: STARTED
[12:37:32.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:121:0) after 9m18s
[12:46:50.969] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:121:0)
[12:46:51.026] Build status: STARTED
[12:46:51.026] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:122:0) after 6m26s
[12:53:17.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:122:0)
[12:53:17.230] Build status: STARTED
[12:53:17.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:123:0) after 8m3s
[13:01:20.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:123:0)
[13:01:20.325] Build status: STARTED
[13:01:20.325] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:124:0) after 1m20s
[13:02:40.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:124:0)
[13:02:40.447] Build status: STARTED
[13:02:40.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:125:0) after 8m35s
[13:11:15.603] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:125:0)
[13:11:15.635] Build status: STARTED
[13:11:15.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:126:0) after 8m54s
[13:20:09.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:126:0)
[13:20:09.864] Build status: STARTED
[13:20:09.864] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:127:0) after 4m2s
[13:24:12.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:127:0)
[13:24:12.527] Build status: STARTED
[13:24:12.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:128:0) after 1m50s
[13:26:02.705] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:128:0)
[13:26:02.796] Build status: STARTED
[13:26:02.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:129:0) after 4m53s
[13:30:55.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:129:0)
[13:30:56.003] Build status: STARTED
[13:30:56.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:130:0) after 5m32s
[13:36:28.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:130:0)
[13:36:28.428] Build status: STARTED
[13:36:28.428] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:131:0) after 5m32s
[13:42:00.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:131:0)
[13:42:00.591] Build status: STARTED
[13:42:00.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:132:0) after 5m23s
[13:47:23.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:132:0)
[13:47:23.711] Build status: STARTED
[13:47:23.711] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:133:0) after 9m40s
[13:57:03.740] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:133:0)
[13:57:03.761] Build status: STARTED
[13:57:03.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:134:0) after 8m33s
[14:05:36.954] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:134:0)
[14:05:37.014] Build status: STARTED
[14:05:37.014] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:135:0) after 3m16s
[14:08:53.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:135:0)
[14:08:53.366] Build status: STARTED
[14:08:53.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:136:0) after 1m4s
[14:09:57.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:136:0)
[14:09:57.795] Build status: STARTED
[14:09:57.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:137:0) after 5m57s
[14:15:54.862] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:137:0)
[14:15:54.898] Build status: STARTED
[14:15:54.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:138:0) after 3m28s
[14:19:22.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:138:0)
[14:19:22.963] Build status: STARTED
[14:19:22.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8927293425344348320:139:0) after 6m33s
[14:21:47.322] Received PubSub notification, asking Buildbucket for the build status
[14:21:47.377] Build:
{
"id": "8761863363424244977",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1849,
"createdBy": "project:chromium",
"createTime": "2023-12-13T02:02:48.649465196Z",
"startTime": "2023-12-13T02:02:52.955578Z",
"endTime": "2023-12-13T14:21:46.606844Z",
"updateTime": "2023-12-13T14:21:46.606844Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d361b4edc4ceffeb2dd2fdc55e73078ba5e98fb",
"ref": "refs/heads/main"
}
}
}
[14:21:47.377] Invocation finished in 12h18m59.942965404s with status FAILED