[00:00:18.272] New invocation is queued and will start shortly
[00:00:19.459] Starting the invocation (attempt 1)
[00:00:19.497] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0abf2d3374286b0dc842a17e5c3f649557b03c0f"
[00:00:19.497] Popped gitiles commit info from properties and tags
[00:00:19.497] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:00:19.497] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:00:19.497] Buildbucket request:
{
"requestId": "8945420524790656032",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0abf2d3374286b0dc842a17e5c3f649557b03c0f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945420524790656032"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:00:19.918] Scheduled build:
{
"id": "8779990462773408721",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1453,
"createdBy": "project:chromium",
"createTime": "2023-05-27T00:00:19.569094089Z",
"updateTime": "2023-05-27T00:00:19.569094089Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0abf2d3374286b0dc842a17e5c3f649557b03c0f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:00:19.918] Task URL: https://cr-buildbucket.appspot.com/build/8779990462773408721
[00:00:19.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:2:0) after 4m14s
[00:00:50.545] Received PubSub notification, asking Buildbucket for the build status
[00:00:50.576] Build status: STARTED
[00:04:34.007] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:2:0)
[00:04:34.047] Build status: STARTED
[00:04:34.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:4:0) after 2m42s
[00:07:16.384] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:4:0)
[00:07:16.404] Build status: STARTED
[00:07:16.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:5:0) after 1m37s
[00:08:53.519] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:5:0)
[00:08:53.542] Build status: STARTED
[00:08:53.542] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:6:0) after 6m34s
[00:15:27.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:6:0)
[00:15:27.917] Build status: STARTED
[00:15:27.917] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:7:0) after 2m36s
[00:18:03.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:7:0)
[00:18:04.011] Build status: STARTED
[00:18:04.011] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:8:0) after 7m41s
[00:25:45.052] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:8:0)
[00:25:45.081] Build status: STARTED
[00:25:45.081] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:9:0) after 3m35s
[00:29:20.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:9:0)
[00:29:20.187] Build status: STARTED
[00:29:20.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:10:0) after 9m9s
[00:38:29.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:10:0)
[00:38:29.610] Build status: STARTED
[00:38:29.610] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:11:0) after 2m6s
[00:40:35.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:11:0)
[00:40:35.852] Build status: STARTED
[00:40:35.852] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:12:0) after 2m27s
[00:43:03.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:12:0)
[00:43:03.223] Build status: STARTED
[00:43:03.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:13:0) after 9m15s
[00:52:18.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:13:0)
[00:52:18.435] Build status: STARTED
[00:52:18.436] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:14:0) after 6m10s
[00:58:28.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:14:0)
[00:58:28.511] Build status: STARTED
[00:58:28.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:15:0) after 1m39s
[01:00:07.549] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:15:0)
[01:00:07.571] Build status: STARTED
[01:00:07.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:16:0) after 1m6s
[01:01:13.756] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:16:0)
[01:01:13.775] Build status: STARTED
[01:01:13.775] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:17:0) after 1m42s
[01:02:55.834] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:17:0)
[01:02:55.881] Build status: STARTED
[01:02:55.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:18:0) after 9m51s
[01:12:47.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:18:0)
[01:12:47.060] Build status: STARTED
[01:12:47.060] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:19:0) after 9m10s
[01:21:57.084] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:19:0)
[01:21:57.104] Build status: STARTED
[01:21:57.104] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:20:0) after 6m34s
[01:28:31.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:20:0)
[01:28:31.251] Build status: STARTED
[01:28:31.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:21:0) after 6m53s
[01:35:24.610] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:21:0)
[01:35:24.630] Build status: STARTED
[01:35:24.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:22:0) after 8m7s
[01:43:31.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:22:0)
[01:43:31.738] Build status: STARTED
[01:43:31.738] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:23:0) after 9m2s
[01:52:33.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:23:0)
[01:52:33.798] Build status: STARTED
[01:52:33.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:24:0) after 1m13s
[01:53:47.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:24:0)
[01:53:47.350] Build status: STARTED
[01:53:47.350] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:25:0) after 1m58s
[01:55:45.379] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:25:0)
[01:55:45.398] Build status: STARTED
[01:55:45.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:26:0) after 5m39s
[02:01:24.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:26:0)
[02:01:25.018] Build status: STARTED
[02:01:25.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:27:0) after 9m32s
[02:10:57.122] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:27:0)
[02:10:57.193] Build status: STARTED
[02:10:57.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:28:0) after 9m14s
[02:20:11.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:28:0)
[02:20:11.244] Build status: STARTED
[02:20:11.244] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:29:0) after 2m13s
[02:22:24.377] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:29:0)
[02:22:24.398] Build status: STARTED
[02:22:24.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:30:0) after 2m52s
[02:25:16.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:30:0)
[02:25:16.796] Build status: STARTED
[02:25:16.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:31:0) after 6m31s
[02:31:48.073] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:31:0)
[02:31:48.092] Build status: STARTED
[02:31:48.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:32:0) after 3m8s
[02:34:56.166] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:32:0)
[02:34:56.194] Build status: STARTED
[02:34:56.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:33:0) after 3m17s
[02:38:13.412] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:33:0)
[02:38:13.435] Build status: STARTED
[02:38:13.435] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:34:0) after 3m32s
[02:41:45.467] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:34:0)
[02:41:45.546] Build status: STARTED
[02:41:45.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:35:0) after 6m44s
[02:48:29.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:35:0)
[02:48:29.591] Build status: STARTED
[02:48:29.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:36:0) after 7m57s
[02:56:26.693] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:36:0)
[02:56:26.714] Build status: STARTED
[02:56:26.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:37:0) after 9m31s
[03:05:57.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:37:0)
[03:05:57.994] Build status: STARTED
[03:05:57.994] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:38:0) after 5m32s
[03:11:30.031] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:38:0)
[03:11:30.049] Build status: STARTED
[03:11:30.049] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:39:0) after 1m28s
[03:12:58.078] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:39:0)
[03:12:58.135] Build status: STARTED
[03:12:58.135] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:40:0) after 3m1s
[03:15:59.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:40:0)
[03:15:59.434] Build status: STARTED
[03:15:59.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:41:0) after 4m12s
[03:20:11.539] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:41:0)
[03:20:11.564] Build status: STARTED
[03:20:11.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:42:0) after 8m38s
[03:28:49.597] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:42:0)
[03:28:49.615] Build status: STARTED
[03:28:49.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:43:0) after 6m54s
[03:35:43.642] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:43:0)
[03:35:43.677] Build status: STARTED
[03:35:43.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:44:0) after 4m20s
[03:40:03.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:44:0)
[03:40:03.844] Build status: STARTED
[03:40:03.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:45:0) after 9m37s
[03:49:40.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:45:0)
[03:49:40.969] Build status: STARTED
[03:49:40.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:46:0) after 2m46s
[03:52:27.116] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:46:0)
[03:52:27.212] Build status: STARTED
[03:52:27.212] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:47:0) after 9m52s
[04:02:19.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:47:0)
[04:02:19.272] Build status: STARTED
[04:02:19.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:48:0) after 9m3s
[04:11:22.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:48:0)
[04:11:22.328] Build status: STARTED
[04:11:22.328] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:49:0) after 7m53s
[04:19:15.441] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:49:0)
[04:19:15.460] Build status: STARTED
[04:19:15.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:50:0) after 9m13s
[04:28:28.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:50:0)
[04:28:28.548] Build status: STARTED
[04:28:28.548] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:51:0) after 9m23s
[04:37:51.578] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:51:0)
[04:37:51.599] Build status: STARTED
[04:37:51.599] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:52:0) after 7m30s
[04:45:21.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:52:0)
[04:45:21.795] Build status: STARTED
[04:45:21.795] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:53:0) after 1m32s
[04:46:53.952] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:53:0)
[04:46:54.023] Build status: STARTED
[04:46:54.023] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:54:0) after 3m36s
[04:50:30.051] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:54:0)
[04:50:30.069] Build status: STARTED
[04:50:30.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:55:0) after 9m7s
[04:59:37.489] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:55:0)
[04:59:37.507] Build status: STARTED
[04:59:37.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:56:0) after 2m51s
[05:02:28.533] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:56:0)
[05:02:28.555] Build status: STARTED
[05:02:28.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:57:0) after 8m11s
[05:10:39.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:57:0)
[05:10:39.710] Build status: STARTED
[05:10:39.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:58:0) after 2m49s
[05:13:28.690] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:58:0)
[05:13:28.749] Build status: STARTED
[05:13:28.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:59:0) after 8m28s
[05:21:56.776] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:59:0)
[05:21:56.798] Build status: STARTED
[05:21:56.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:60:0) after 4m6s
[05:26:02.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:60:0)
[05:26:02.978] Build status: STARTED
[05:26:02.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:61:0) after 2m30s
[05:28:33.014] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:61:0)
[05:28:33.033] Build status: STARTED
[05:28:33.034] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:62:0) after 1m14s
[05:29:47.060] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:62:0)
[05:29:47.084] Build status: STARTED
[05:29:47.085] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:63:0) after 1m59s
[05:31:46.302] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:63:0)
[05:31:46.344] Build status: STARTED
[05:31:46.344] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:64:0) after 8m38s
[05:40:24.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:64:0)
[05:40:24.609] Build status: STARTED
[05:40:24.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:65:0) after 9m15s
[05:49:39.634] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:65:0)
[05:49:39.700] Build status: STARTED
[05:49:39.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:66:0) after 5m26s
[05:55:05.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:66:0)
[05:55:05.751] Build status: STARTED
[05:55:05.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:67:0) after 5m49s
[06:00:54.775] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:67:0)
[06:00:54.796] Build status: STARTED
[06:00:54.796] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:68:0) after 5m33s
[06:06:27.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:68:0)
[06:06:28.005] Build status: STARTED
[06:06:28.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:69:0) after 7m23s
[06:13:51.076] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:69:0)
[06:13:51.099] Build status: STARTED
[06:13:51.099] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:70:0) after 5m13s
[06:19:04.140] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:70:0)
[06:19:04.166] Build status: STARTED
[06:19:04.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:71:0) after 7m1s
[06:26:05.285] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:71:0)
[06:26:05.326] Build status: STARTED
[06:26:05.326] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:72:0) after 8m3s
[06:34:08.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:72:0)
[06:34:08.523] Build status: STARTED
[06:34:08.523] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:73:0) after 2m8s
[06:36:16.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:73:0)
[06:36:16.728] Build status: STARTED
[06:36:16.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:74:0) after 4m3s
[06:40:19.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:74:0)
[06:40:19.843] Build status: STARTED
[06:40:19.843] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:75:0) after 3m6s
[06:43:25.884] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:75:0)
[06:43:25.905] Build status: STARTED
[06:43:25.905] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:76:0) after 7m17s
[06:50:43.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:76:0)
[06:50:43.150] Build status: STARTED
[06:50:43.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:77:0) after 1m59s
[06:52:42.208] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:77:0)
[06:52:42.259] Build status: STARTED
[06:52:42.259] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:78:0) after 6m38s
[06:59:20.303] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:78:0)
[06:59:20.324] Build status: STARTED
[06:59:20.324] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:79:0) after 5m21s
[07:04:41.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:79:0)
[07:04:41.478] Build status: STARTED
[07:04:41.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:80:0) after 1m29s
[07:06:10.576] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:80:0)
[07:06:10.596] Build status: STARTED
[07:06:10.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:81:0) after 6m17s
[07:12:27.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:81:0)
[07:12:27.740] Build status: STARTED
[07:12:27.740] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:82:0) after 7m38s
[07:20:05.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:82:0)
[07:20:05.901] Build status: STARTED
[07:20:05.901] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:83:0) after 4m44s
[07:24:49.949] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:83:0)
[07:24:49.999] Build status: STARTED
[07:24:49.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:84:0) after 3m35s
[07:28:25.023] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:84:0)
[07:28:25.047] Build status: STARTED
[07:28:25.047] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:85:0) after 5m48s
[07:34:13.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:85:0)
[07:34:13.195] Build status: STARTED
[07:34:13.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:86:0) after 2m54s
[07:37:07.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:86:0)
[07:37:07.260] Build status: STARTED
[07:37:07.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:87:0) after 2m55s
[07:40:02.357] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:87:0)
[07:40:02.377] Build status: STARTED
[07:40:02.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:88:0) after 6m58s
[07:47:00.408] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:88:0)
[07:47:00.439] Build status: STARTED
[07:47:00.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:89:0) after 6m27s
[07:53:27.573] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:89:0)
[07:53:27.591] Build status: STARTED
[07:53:27.591] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:90:0) after 5m41s
[07:59:08.622] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:90:0)
[07:59:08.643] Build status: STARTED
[07:59:08.643] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:91:0) after 4m49s
[08:03:57.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:91:0)
[08:03:57.696] Build status: STARTED
[08:03:57.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:92:0) after 7m52s
[08:11:49.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:92:0)
[08:11:49.743] Build status: STARTED
[08:11:49.743] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:93:0) after 4m38s
[08:16:27.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:93:0)
[08:16:27.818] Build status: STARTED
[08:16:27.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:94:0) after 2m20s
[08:18:47.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:94:0)
[08:18:48.008] Build status: STARTED
[08:18:48.008] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:95:0) after 5m43s
[08:24:31.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:95:0)
[08:24:31.055] Build status: STARTED
[08:24:31.055] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:96:0) after 8m48s
[08:33:19.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:96:0)
[08:33:19.162] Build status: STARTED
[08:33:19.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:97:0) after 8m37s
[08:41:56.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:97:0)
[08:41:56.252] Build status: STARTED
[08:41:56.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:98:0) after 5m58s
[08:47:54.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:98:0)
[08:47:54.297] Build status: STARTED
[08:47:54.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:99:0) after 1m10s
[08:49:04.364] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:99:0)
[08:49:04.494] Build status: STARTED
[08:49:04.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:100:0) after 2m33s
[08:51:37.552] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:100:0)
[08:51:37.572] Build status: STARTED
[08:51:37.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:101:0) after 1m47s
[08:53:24.621] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:101:0)
[08:53:24.644] Build status: STARTED
[08:53:24.644] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:102:0) after 7m47s
[09:01:11.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:102:0)
[09:01:11.706] Build status: STARTED
[09:01:11.706] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:103:0) after 8m29s
[09:09:40.747] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:103:0)
[09:09:40.770] Build status: STARTED
[09:09:40.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:104:0) after 8m14s
[09:17:54.893] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:104:0)
[09:17:54.919] Build status: STARTED
[09:17:54.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:105:0) after 1m6s
[09:19:01.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:105:0)
[09:19:01.166] Build status: STARTED
[09:19:01.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:106:0) after 3m11s
[09:22:12.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:106:0)
[09:22:12.234] Build status: STARTED
[09:22:12.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:107:0) after 9m16s
[09:31:28.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:107:0)
[09:31:28.306] Build status: STARTED
[09:31:28.306] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:108:0) after 4m7s
[09:35:35.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:108:0)
[09:35:35.583] Build status: STARTED
[09:35:35.583] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:109:0) after 1m13s
[09:36:48.625] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:109:0)
[09:36:48.645] Build status: STARTED
[09:36:48.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:110:0) after 7m32s
[09:44:20.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:110:0)
[09:44:20.698] Build status: STARTED
[09:44:20.698] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:111:0) after 2m43s
[09:47:03.727] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:111:0)
[09:47:03.759] Build status: STARTED
[09:47:03.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:112:0) after 1m58s
[09:49:01.782] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:112:0)
[09:49:01.803] Build status: STARTED
[09:49:01.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:113:0) after 1m22s
[09:50:23.830] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:113:0)
[09:50:23.850] Build status: STARTED
[09:50:23.850] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:114:0) after 5m43s
[09:56:06.894] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:114:0)
[09:56:06.965] Build status: STARTED
[09:56:06.965] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:115:0) after 4m53s
[10:00:59.993] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:115:0)
[10:01:00.015] Build status: STARTED
[10:01:00.016] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:116:0) after 1m41s
[10:02:41.045] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:116:0)
[10:02:41.157] Build status: STARTED
[10:02:41.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:117:0) after 9m53s
[10:12:34.220] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:117:0)
[10:12:34.238] Build status: STARTED
[10:12:34.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:118:0) after 7m29s
[10:20:03.371] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:118:0)
[10:20:03.409] Build status: STARTED
[10:20:03.409] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:119:0) after 6m4s
[10:26:07.490] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:119:0)
[10:26:07.529] Build status: STARTED
[10:26:07.529] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:120:0) after 8m18s
[10:34:25.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:120:0)
[10:34:25.577] Build status: STARTED
[10:34:25.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:121:0) after 7m38s
[10:42:03.624] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:121:0)
[10:42:03.642] Build status: STARTED
[10:42:03.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:122:0) after 6m17s
[10:48:20.820] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:122:0)
[10:48:20.839] Build status: STARTED
[10:48:20.839] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:123:0) after 8m17s
[10:56:37.877] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:123:0)
[10:56:37.897] Build status: STARTED
[10:56:37.897] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:124:0) after 4m48s
[11:01:26.017] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:124:0)
[11:01:26.037] Build status: STARTED
[11:01:26.037] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:125:0) after 4m16s
[11:05:42.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:125:0)
[11:05:42.087] Build status: STARTED
[11:05:42.087] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:126:0) after 7m39s
[11:13:21.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:126:0)
[11:13:21.200] Build status: STARTED
[11:13:21.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:127:0) after 4m42s
[11:18:03.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:127:0)
[11:18:03.375] Build status: STARTED
[11:18:03.375] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:128:0) after 2m2s
[11:20:05.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:128:0)
[11:20:05.573] Build status: STARTED
[11:20:05.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:129:0) after 4m24s
[11:24:29.836] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:129:0)
[11:24:29.875] Build status: STARTED
[11:24:29.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:130:0) after 1m55s
[11:26:24.905] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:130:0)
[11:26:24.925] Build status: STARTED
[11:26:24.925] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:131:0) after 7m26s
[11:33:51.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:131:0)
[11:33:51.180] Build status: STARTED
[11:33:51.180] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:132:0) after 7m42s
[11:41:33.615] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:132:0)
[11:41:33.636] Build status: STARTED
[11:41:33.637] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:133:0) after 3m11s
[11:44:44.649] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:133:0)
[11:44:44.676] Build status: STARTED
[11:44:44.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:134:0) after 3m6s
[11:47:50.682] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:134:0)
[11:47:50.713] Build status: STARTED
[11:47:50.713] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:135:0) after 4m29s
[11:52:19.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:135:0)
[11:52:19.913] Build status: STARTED
[11:52:19.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:136:0) after 7m10s
[11:59:30.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:136:0)
[11:59:30.174] Build status: STARTED
[11:59:30.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:137:0) after 1m36s
[12:01:06.442] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:137:0)
[12:01:06.467] Build status: STARTED
[12:01:06.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:138:0) after 2m16s
[12:03:22.895] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:138:0)
[12:03:22.915] Build status: STARTED
[12:03:22.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:139:0) after 7m17s
[12:10:39.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:139:0)
[12:10:40.013] Build status: STARTED
[12:10:40.013] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8945420524790656032:140:0) after 4m38s
[12:14:26.360] Received PubSub notification, asking Buildbucket for the build status
[12:14:26.381] Build:
{
"id": "8779990462773408721",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1453,
"createdBy": "project:chromium",
"createTime": "2023-05-27T00:00:19.569094089Z",
"startTime": "2023-05-27T00:00:47.567007Z",
"endTime": "2023-05-27T12:14:15.443475Z",
"updateTime": "2023-05-27T12:14:15.443475Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0abf2d3374286b0dc842a17e5c3f649557b03c0f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:14:26.381] Invocation finished in 12h14m8.120283423s with status FAILED