[00:40:13.227] New invocation is queued and will start shortly
[00:40:15.167] Starting the invocation (attempt 1)
[00:40:15.198] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/49064713a73ae92d8c28164938b97869afd336aa"
[00:40:15.199] Popped gitiles commit info from properties and tags
[00:40:15.199] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:40:15.199] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:40:15.199] Buildbucket request:
{
"requestId": "8924852502127337328",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "49064713a73ae92d8c28164938b97869afd336aa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924852502127337328"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:40:16.016] Scheduled build:
{
"id": "8759422439332369665",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1904,
"createdBy": "project:chromium",
"createTime": "2024-01-09T00:40:15.264048131Z",
"updateTime": "2024-01-09T00:40:15.264048131Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "49064713a73ae92d8c28164938b97869afd336aa",
"ref": "refs/heads/main"
}
}
}
[00:40:16.016] Task URL: https://cr-buildbucket.appspot.com/build/8759422439332369665
[00:40:16.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:2:0) after 3m26s
[00:40:16.945] Received PubSub notification, asking Buildbucket for the build status
[00:40:16.973] Build status: SCHEDULED
[00:40:24.131] Received PubSub notification, asking Buildbucket for the build status
[00:40:24.188] Build status: STARTED
[00:43:42.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:2:0)
[00:43:42.075] Build status: STARTED
[00:43:42.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:5:0) after 2m56s
[00:46:38.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:5:0)
[00:46:38.370] Build status: STARTED
[00:46:38.370] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:6:0) after 9m32s
[00:56:10.409] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:6:0)
[00:56:10.439] Build status: STARTED
[00:56:10.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:7:0) after 1m6s
[00:57:16.536] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:7:0)
[00:57:16.594] Build status: STARTED
[00:57:16.594] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:8:0) after 8m22s
[01:05:38.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:8:0)
[01:05:38.696] Build status: STARTED
[01:05:38.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:9:0) after 3m12s
[01:08:50.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:9:0)
[01:08:50.771] Build status: STARTED
[01:08:50.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:10:0) after 7m37s
[01:16:27.901] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:10:0)
[01:16:27.921] Build status: STARTED
[01:16:27.921] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:11:0) after 2m11s
[01:18:39.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:11:0)
[01:18:39.236] Build status: STARTED
[01:18:39.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:12:0) after 9m45s
[01:28:24.436] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:12:0)
[01:28:24.468] Build status: STARTED
[01:28:24.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:13:0) after 3m24s
[01:31:48.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:13:0)
[01:31:48.563] Build status: STARTED
[01:31:48.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:14:0) after 4m37s
[01:36:25.715] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:14:0)
[01:36:25.792] Build status: STARTED
[01:36:25.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:15:0) after 4m25s
[01:40:50.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:15:0)
[01:40:50.960] Build status: STARTED
[01:40:50.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:16:0) after 9m3s
[01:49:54.129] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:16:0)
[01:49:54.146] Build status: STARTED
[01:49:54.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:17:0) after 2m1s
[01:51:55.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:17:0)
[01:51:55.431] Build status: STARTED
[01:51:55.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:18:0) after 4m8s
[01:56:03.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:18:0)
[01:56:03.754] Build status: STARTED
[01:56:03.754] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:19:0) after 4m6s
[02:00:09.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:19:0)
[02:00:09.946] Build status: STARTED
[02:00:09.946] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:20:0) after 7m39s
[02:07:49.558] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:20:0)
[02:07:49.589] Build status: STARTED
[02:07:49.589] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:21:0) after 6m42s
[02:14:31.800] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:21:0)
[02:14:31.819] Build status: STARTED
[02:14:31.819] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:22:0) after 4m59s
[02:19:30.935] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:22:0)
[02:19:30.999] Build status: STARTED
[02:19:30.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:23:0) after 8m26s
[02:27:57.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:23:0)
[02:27:57.412] Build status: STARTED
[02:27:57.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:24:0) after 4m53s
[02:32:50.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:24:0)
[02:32:50.600] Build status: STARTED
[02:32:50.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:25:0) after 5m1s
[02:37:51.892] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:25:0)
[02:37:51.913] Build status: STARTED
[02:37:51.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:26:0) after 1m10s
[02:39:01.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:26:0)
[02:39:01.969] Build status: STARTED
[02:39:01.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:27:0) after 4m52s
[02:43:54.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:27:0)
[02:43:54.086] Build status: STARTED
[02:43:54.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:28:0) after 6m27s
[02:50:21.134] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:28:0)
[02:50:21.213] Build status: STARTED
[02:50:21.213] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:29:0) after 3m0s
[02:53:21.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:29:0)
[02:53:21.318] Build status: STARTED
[02:53:21.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:30:0) after 6m33s
[02:59:54.653] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:30:0)
[02:59:54.683] Build status: STARTED
[02:59:54.683] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:31:0) after 7m43s
[03:07:38.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:31:0)
[03:07:38.312] Build status: STARTED
[03:07:38.312] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:32:0) after 4m41s
[03:12:19.340] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:32:0)
[03:12:19.423] Build status: STARTED
[03:12:19.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:33:0) after 7m26s
[03:19:45.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:33:0)
[03:19:45.926] Build status: STARTED
[03:19:45.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:34:0) after 4m29s
[03:24:14.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:34:0)
[03:24:14.987] Build status: STARTED
[03:24:14.987] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:35:0) after 4m52s
[03:29:07.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:35:0)
[03:29:07.136] Build status: STARTED
[03:29:07.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:36:0) after 5m0s
[03:34:07.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:36:0)
[03:34:07.917] Build status: STARTED
[03:34:07.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:37:0) after 8m43s
[03:42:51.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:37:0)
[03:42:51.241] Build status: STARTED
[03:42:51.241] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:38:0) after 9m59s
[03:52:50.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:38:0)
[03:52:50.418] Build status: STARTED
[03:52:50.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:39:0) after 7m41s
[04:00:31.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:39:0)
[04:00:31.661] Build status: STARTED
[04:00:31.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:40:0) after 3m48s
[04:04:19.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:40:0)
[04:04:19.780] Build status: STARTED
[04:04:19.780] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:41:0) after 5m52s
[04:10:11.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:41:0)
[04:10:11.822] Build status: STARTED
[04:10:11.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:42:0) after 2m54s
[04:13:05.948] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:42:0)
[04:13:05.969] Build status: STARTED
[04:13:05.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:43:0) after 8m19s
[04:21:24.984] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:43:0)
[04:21:25.005] Build status: STARTED
[04:21:25.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:44:0) after 8m18s
[04:29:43.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:44:0)
[04:29:43.239] Build status: STARTED
[04:29:43.239] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:45:0) after 3m20s
[04:33:03.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:45:0)
[04:33:03.385] Build status: STARTED
[04:33:03.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:46:0) after 6m38s
[04:39:41.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:46:0)
[04:39:41.598] Build status: STARTED
[04:39:41.598] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:47:0) after 3m53s
[04:43:34.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:47:0)
[04:43:34.687] Build status: STARTED
[04:43:34.687] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:48:0) after 4m54s
[04:48:29.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:48:0)
[04:48:29.085] Build status: STARTED
[04:48:29.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:49:0) after 8m8s
[04:56:37.575] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:49:0)
[04:56:37.593] Build status: STARTED
[04:56:37.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:50:0) after 4m59s
[05:01:36.620] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:50:0)
[05:01:36.639] Build status: STARTED
[05:01:36.639] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:51:0) after 2m50s
[05:04:27.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:51:0)
[05:04:27.141] Build status: STARTED
[05:04:27.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:52:0) after 2m45s
[05:07:12.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:52:0)
[05:07:12.788] Build status: STARTED
[05:07:12.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:53:0) after 8m17s
[05:15:29.832] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:53:0)
[05:15:29.852] Build status: STARTED
[05:15:29.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:54:0) after 1m37s
[05:17:06.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:54:0)
[05:17:06.916] Build status: STARTED
[05:17:06.916] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:55:0) after 1m10s
[05:18:16.945] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:55:0)
[05:18:17.010] Build status: STARTED
[05:18:17.010] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:56:0) after 4m40s
[05:22:57.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:56:0)
[05:22:57.061] Build status: STARTED
[05:22:57.061] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:57:0) after 6m12s
[05:29:09.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:57:0)
[05:29:09.138] Build status: STARTED
[05:29:09.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:58:0) after 6m44s
[05:35:53.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:58:0)
[05:35:53.326] Build status: STARTED
[05:35:53.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:59:0) after 6m11s
[05:42:04.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:59:0)
[05:42:04.425] Build status: STARTED
[05:42:04.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:60:0) after 7m56s
[05:50:01.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:60:0)
[05:50:01.071] Build status: STARTED
[05:50:01.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:61:0) after 3m35s
[05:53:36.196] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:61:0)
[05:53:36.215] Build status: STARTED
[05:53:36.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:62:0) after 9m39s
[06:03:15.567] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:62:0)
[06:03:15.595] Build status: STARTED
[06:03:15.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:63:0) after 2m59s
[06:06:15.048] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:63:0)
[06:06:15.119] Build status: STARTED
[06:06:15.119] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:64:0) after 2m51s
[06:09:06.296] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:64:0)
[06:09:06.341] Build status: STARTED
[06:09:06.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:65:0) after 1m56s
[06:11:02.487] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:65:0)
[06:11:02.529] Build status: STARTED
[06:11:02.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:66:0) after 4m13s
[06:15:15.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:66:0)
[06:15:16.231] Build status: STARTED
[06:15:16.231] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:67:0) after 2m1s
[06:17:17.256] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:67:0)
[06:17:17.453] Build status: STARTED
[06:17:17.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:68:0) after 3m56s
[06:21:13.476] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:68:0)
[06:21:13.495] Build status: STARTED
[06:21:13.495] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:69:0) after 3m38s
[06:24:51.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:69:0)
[06:24:51.628] Build status: STARTED
[06:24:51.628] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:70:0) after 7m51s
[06:32:42.679] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:70:0)
[06:32:42.732] Build status: STARTED
[06:32:42.732] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:71:0) after 9m37s
[06:42:19.996] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:71:0)
[06:42:20.016] Build status: STARTED
[06:42:20.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:72:0) after 6m13s
[06:48:33.042] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:72:0)
[06:48:33.066] Build status: STARTED
[06:48:33.066] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:73:0) after 1m48s
[06:50:21.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:73:0)
[06:50:21.251] Build status: STARTED
[06:50:21.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:74:0) after 9m53s
[07:00:14.339] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:74:0)
[07:00:14.371] Build status: STARTED
[07:00:14.371] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:75:0) after 5m40s
[07:05:54.855] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:75:0)
[07:05:54.876] Build status: STARTED
[07:05:54.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:76:0) after 5m26s
[07:11:20.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:76:0)
[07:11:20.930] Build status: STARTED
[07:11:20.930] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:77:0) after 8m35s
[07:19:55.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:77:0)
[07:19:56.071] Build status: STARTED
[07:19:56.071] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:78:0) after 8m36s
[07:28:32.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:78:0)
[07:28:32.132] Build status: STARTED
[07:28:32.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:79:0) after 7m13s
[07:35:45.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:79:0)
[07:35:45.292] Build status: STARTED
[07:35:45.292] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:80:0) after 6m42s
[07:42:27.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:80:0)
[07:42:27.440] Build status: STARTED
[07:42:27.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:81:0) after 3m20s
[07:45:47.467] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:81:0)
[07:45:47.500] Build status: STARTED
[07:45:47.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:82:0) after 4m18s
[07:50:05.559] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:82:0)
[07:50:05.672] Build status: STARTED
[07:50:05.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:83:0) after 7m26s
[07:57:31.698] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:83:0)
[07:57:31.731] Build status: STARTED
[07:57:31.731] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:84:0) after 5m40s
[08:03:11.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:84:0)
[08:03:11.801] Build status: STARTED
[08:03:11.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:85:0) after 6m4s
[08:09:15.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:85:0)
[08:09:15.971] Build status: STARTED
[08:09:15.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:86:0) after 7m18s
[08:16:34.327] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:86:0)
[08:16:34.376] Build status: STARTED
[08:16:34.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:87:0) after 1m44s
[08:18:18.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:87:0)
[08:18:18.444] Build status: STARTED
[08:18:18.444] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:88:0) after 8m0s
[08:26:18.499] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:88:0)
[08:26:18.514] Build status: STARTED
[08:26:18.514] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:89:0) after 8m31s
[08:34:49.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:89:0)
[08:34:49.651] Build status: STARTED
[08:34:49.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:90:0) after 9m38s
[08:44:27.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:90:0)
[08:44:27.811] Build status: STARTED
[08:44:27.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:91:0) after 9m13s
[08:53:40.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:91:0)
[08:53:40.866] Build status: STARTED
[08:53:40.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:92:0) after 7m33s
[09:01:14.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:92:0)
[09:01:14.163] Build status: STARTED
[09:01:14.163] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:93:0) after 3m28s
[09:04:42.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:93:0)
[09:04:42.266] Build status: STARTED
[09:04:42.266] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:94:0) after 3m41s
[09:08:23.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:94:0)
[09:08:23.322] Build status: STARTED
[09:08:23.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:95:0) after 1m7s
[09:09:30.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:95:0)
[09:09:30.376] Build status: STARTED
[09:09:30.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:96:0) after 3m39s
[09:13:10.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:96:0)
[09:13:10.124] Build status: STARTED
[09:13:10.124] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:97:0) after 6m25s
[09:19:35.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:97:0)
[09:19:35.536] Build status: STARTED
[09:19:35.536] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:98:0) after 7m5s
[09:26:40.601] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:98:0)
[09:26:40.638] Build status: STARTED
[09:26:40.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:99:0) after 2m58s
[09:29:38.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:99:0)
[09:29:38.795] Build status: STARTED
[09:29:38.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:100:0) after 9m35s
[09:39:14.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:100:0)
[09:39:14.057] Build status: STARTED
[09:39:14.057] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:101:0) after 8m20s
[09:47:34.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:101:0)
[09:47:34.247] Build status: STARTED
[09:47:34.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:102:0) after 8m11s
[09:55:45.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:102:0)
[09:55:45.646] Build status: STARTED
[09:55:45.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:103:0) after 2m8s
[09:57:54.184] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:103:0)
[09:57:54.207] Build status: STARTED
[09:57:54.207] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:104:0) after 5m2s
[10:02:56.465] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:104:0)
[10:02:56.505] Build status: STARTED
[10:02:56.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:105:0) after 3m11s
[10:06:07.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:105:0)
[10:06:07.560] Build status: STARTED
[10:06:07.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:106:0) after 4m54s
[10:11:01.985] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:106:0)
[10:11:02.012] Build status: STARTED
[10:11:02.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:107:0) after 4m15s
[10:15:17.434] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:107:0)
[10:15:17.452] Build status: STARTED
[10:15:17.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:108:0) after 9m4s
[10:24:21.509] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:108:0)
[10:24:21.530] Build status: STARTED
[10:24:21.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:109:0) after 9m34s
[10:33:55.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:109:0)
[10:33:55.917] Build status: STARTED
[10:33:55.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:110:0) after 4m48s
[10:38:43.946] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:110:0)
[10:38:43.963] Build status: STARTED
[10:38:43.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:111:0) after 2m25s
[10:41:09.029] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:111:0)
[10:41:09.051] Build status: STARTED
[10:41:09.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:112:0) after 3m44s
[10:44:53.529] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:112:0)
[10:44:53.546] Build status: STARTED
[10:44:53.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:113:0) after 5m37s
[10:50:30.585] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:113:0)
[10:50:30.604] Build status: STARTED
[10:50:30.604] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:114:0) after 3m37s
[10:54:07.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:114:0)
[10:54:08.007] Build status: STARTED
[10:54:08.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:115:0) after 3m4s
[10:57:12.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:115:0)
[10:57:12.078] Build status: STARTED
[10:57:12.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:116:0) after 7m49s
[11:05:01.112] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:116:0)
[11:05:01.150] Build status: STARTED
[11:05:01.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:117:0) after 4m53s
[11:09:54.276] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:117:0)
[11:09:54.293] Build status: STARTED
[11:09:54.293] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:118:0) after 5m8s
[11:15:02.392] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:118:0)
[11:15:02.411] Build status: STARTED
[11:15:02.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:119:0) after 5m13s
[11:20:15.440] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:119:0)
[11:20:15.460] Build status: STARTED
[11:20:15.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:120:0) after 2m35s
[11:22:51.041] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:120:0)
[11:22:51.138] Build status: STARTED
[11:22:51.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:121:0) after 5m15s
[11:28:06.425] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:121:0)
[11:28:06.471] Build status: STARTED
[11:28:06.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:122:0) after 5m19s
[11:33:25.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:122:0)
[11:33:25.749] Build status: STARTED
[11:33:25.750] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:123:0) after 3m15s
[11:36:41.098] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:123:0)
[11:36:41.137] Build status: STARTED
[11:36:41.137] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:124:0) after 6m36s
[11:43:17.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:124:0)
[11:43:17.265] Build status: STARTED
[11:43:17.265] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:125:0) after 3m48s
[11:47:05.295] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:125:0)
[11:47:05.314] Build status: STARTED
[11:47:05.314] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:126:0) after 9m5s
[11:56:10.464] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:126:0)
[11:56:10.507] Build status: STARTED
[11:56:10.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:127:0) after 6m42s
[12:02:52.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:127:0)
[12:02:52.623] Build status: STARTED
[12:02:52.624] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:128:0) after 7m49s
[12:10:41.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:128:0)
[12:10:41.845] Build status: STARTED
[12:10:41.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:129:0) after 8m4s
[12:18:45.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:129:0)
[12:18:45.920] Build status: STARTED
[12:18:45.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:130:0) after 9m46s
[12:28:32.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:130:0)
[12:28:32.766] Build status: STARTED
[12:28:32.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:131:0) after 7m27s
[12:35:59.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:131:0)
[12:36:00.146] Build status: STARTED
[12:36:00.146] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:132:0) after 9m46s
[12:45:46.211] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:132:0)
[12:45:46.233] Build status: STARTED
[12:45:46.233] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:133:0) after 2m33s
[12:48:19.589] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:133:0)
[12:48:19.661] Build status: STARTED
[12:48:19.661] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8924852502127337328:134:0) after 6m12s
[12:50:59.400] Received PubSub notification, asking Buildbucket for the build status
[12:50:59.420] Build:
{
"id": "8759422439332369665",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1904,
"createdBy": "project:chromium",
"createTime": "2024-01-09T00:40:15.264048131Z",
"startTime": "2024-01-09T00:40:21.495401Z",
"endTime": "2024-01-09T12:50:58.736341Z",
"updateTime": "2024-01-09T12:50:58.736341Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "49064713a73ae92d8c28164938b97869afd336aa",
"ref": "refs/heads/main"
}
}
}
[12:50:59.420] Invocation finished in 12h10m46.205099358s with status FAILED