[06:03:38.442] New invocation is queued and will start shortly
[06:03:39.572] Starting the invocation (attempt 1)
[06:03:39.605] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7948942fab08f6e94bd6babe0fc494d3ea071db5"
[06:03:39.605] Popped gitiles commit info from properties and tags
[06:03:39.605] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:03:39.605] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:03:39.605] Buildbucket request:
{
"requestId": "8954910347124947120",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7948942fab08f6e94bd6babe0fc494d3ea071db5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8954910347124947120"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:03:40.043] Scheduled build:
{
"id": "8789480285127074273",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1199,
"createdBy": "project:chromium",
"createTime": "2023-02-11T06:03:39.723345572Z",
"updateTime": "2023-02-11T06:03:39.723345572Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7948942fab08f6e94bd6babe0fc494d3ea071db5",
"ref": "refs/heads/main"
}
}
}
[06:03:40.043] Task URL: https://cr-buildbucket.appspot.com/build/8789480285127074273
[06:03:40.043] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:2:0) after 2m9s
[06:03:59.856] Received PubSub notification, asking Buildbucket for the build status
[06:03:59.885] Build status: STARTED
[06:05:49.193] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:2:0)
[06:05:49.216] Build status: STARTED
[06:05:49.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:4:0) after 3m6s
[06:08:55.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:4:0)
[06:08:55.267] Build status: STARTED
[06:08:55.268] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:5:0) after 5m20s
[06:14:15.291] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:5:0)
[06:14:15.342] Build status: STARTED
[06:14:15.342] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:6:0) after 7m48s
[06:22:04.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:6:0)
[06:22:04.426] Build status: STARTED
[06:22:04.426] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:7:0) after 9m36s
[06:31:40.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:7:0)
[06:31:40.575] Build status: STARTED
[06:31:40.575] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:8:0) after 9m15s
[06:40:55.671] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:8:0)
[06:40:55.715] Build status: STARTED
[06:40:55.715] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:9:0) after 9m38s
[06:50:33.809] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:9:0)
[06:50:33.883] Build status: STARTED
[06:50:33.883] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:10:0) after 7m37s
[06:58:11.114] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:10:0)
[06:58:11.152] Build status: STARTED
[06:58:11.152] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:11:0) after 8m24s
[07:06:35.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:11:0)
[07:06:35.216] Build status: STARTED
[07:06:35.216] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:12:0) after 1m6s
[07:07:41.767] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:12:0)
[07:07:41.809] Build status: STARTED
[07:07:41.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:13:0) after 1m50s
[07:09:31.829] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:13:0)
[07:09:31.855] Build status: STARTED
[07:09:31.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:14:0) after 3m18s
[07:12:50.874] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:14:0)
[07:12:50.899] Build status: STARTED
[07:12:50.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:15:0) after 9m18s
[07:22:09.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:15:0)
[07:22:09.335] Build status: STARTED
[07:22:09.335] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:16:0) after 2m7s
[07:24:16.826] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:16:0)
[07:24:16.847] Build status: STARTED
[07:24:16.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:17:0) after 5m45s
[07:30:01.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:17:0)
[07:30:01.945] Build status: STARTED
[07:30:01.945] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:18:0) after 8m51s
[07:38:53.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:18:0)
[07:38:53.157] Build status: STARTED
[07:38:53.157] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:19:0) after 1m19s
[07:40:12.210] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:19:0)
[07:40:12.230] Build status: STARTED
[07:40:12.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:20:0) after 8m39s
[07:48:51.924] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:20:0)
[07:48:51.973] Build status: STARTED
[07:48:51.973] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:21:0) after 2m16s
[07:51:07.997] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:21:0)
[07:51:08.022] Build status: STARTED
[07:51:08.022] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:22:0) after 4m46s
[07:55:54.046] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:22:0)
[07:55:54.078] Build status: STARTED
[07:55:54.078] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:23:0) after 1m22s
[07:57:16.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:23:0)
[07:57:16.143] Build status: STARTED
[07:57:16.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:24:0) after 8m17s
[08:05:33.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:24:0)
[08:05:33.430] Build status: STARTED
[08:05:33.430] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:25:0) after 6m56s
[08:12:29.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:25:0)
[08:12:29.909] Build status: STARTED
[08:12:29.909] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:26:0) after 9m15s
[08:21:44.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:26:0)
[08:21:44.963] Build status: STARTED
[08:21:44.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:27:0) after 5m7s
[08:26:52.056] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:27:0)
[08:26:52.077] Build status: STARTED
[08:26:52.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:28:0) after 7m53s
[08:34:45.100] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:28:0)
[08:34:45.143] Build status: STARTED
[08:34:45.143] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:29:0) after 2m17s
[08:37:02.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:29:0)
[08:37:02.208] Build status: STARTED
[08:37:02.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:30:0) after 4m2s
[08:41:04.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:30:0)
[08:41:04.254] Build status: STARTED
[08:41:04.254] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:31:0) after 6m47s
[08:47:51.397] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:31:0)
[08:47:51.425] Build status: STARTED
[08:47:51.425] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:32:0) after 5m45s
[08:53:36.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:32:0)
[08:53:36.470] Build status: STARTED
[08:53:36.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:33:0) after 8m0s
[09:01:36.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:33:0)
[09:01:36.527] Build status: STARTED
[09:01:36.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:34:0) after 4m24s
[09:06:00.562] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:34:0)
[09:06:00.587] Build status: STARTED
[09:06:00.587] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:35:0) after 4m32s
[09:10:32.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:35:0)
[09:10:32.633] Build status: STARTED
[09:10:32.633] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:36:0) after 3m10s
[09:13:42.660] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:36:0)
[09:13:42.696] Build status: STARTED
[09:13:42.696] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:37:0) after 7m35s
[09:21:17.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:37:0)
[09:21:17.749] Build status: STARTED
[09:21:17.749] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:38:0) after 7m9s
[09:28:26.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:38:0)
[09:28:26.841] Build status: STARTED
[09:28:26.841] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:39:0) after 6m46s
[09:35:12.870] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:39:0)
[09:35:12.894] Build status: STARTED
[09:35:12.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:40:0) after 3m19s
[09:38:31.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:40:0)
[09:38:31.960] Build status: STARTED
[09:38:31.960] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:41:0) after 3m25s
[09:41:57.146] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:41:0)
[09:41:57.164] Build status: STARTED
[09:41:57.164] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:42:0) after 1m26s
[09:43:23.187] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:42:0)
[09:43:23.211] Build status: STARTED
[09:43:23.211] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:43:0) after 8m21s
[09:51:44.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:43:0)
[09:51:44.274] Build status: STARTED
[09:51:44.274] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:44:0) after 1m22s
[09:53:06.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:44:0)
[09:53:06.329] Build status: STARTED
[09:53:06.329] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:45:0) after 7m34s
[10:00:40.362] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:45:0)
[10:00:40.384] Build status: STARTED
[10:00:40.384] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:46:0) after 3m1s
[10:03:41.418] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:46:0)
[10:03:41.443] Build status: STARTED
[10:03:41.443] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:47:0) after 4m33s
[10:08:14.600] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:47:0)
[10:08:14.632] Build status: STARTED
[10:08:14.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:48:0) after 9m3s
[10:17:18.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:48:0)
[10:17:18.258] Build status: STARTED
[10:17:18.258] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:49:0) after 9m13s
[10:26:33.989] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:49:0)
[10:26:34.073] Build status: STARTED
[10:26:34.073] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:50:0) after 5m20s
[10:31:54.102] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:50:0)
[10:31:54.121] Build status: STARTED
[10:31:54.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:51:0) after 4m23s
[10:36:17.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:51:0)
[10:36:17.177] Build status: STARTED
[10:36:17.177] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:52:0) after 7m9s
[10:43:26.202] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:52:0)
[10:43:26.223] Build status: STARTED
[10:43:26.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:53:0) after 7m54s
[10:51:20.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:53:0)
[10:51:20.322] Build status: STARTED
[10:51:20.322] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:54:0) after 4m39s
[10:55:59.355] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:54:0)
[10:55:59.404] Build status: STARTED
[10:55:59.404] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:55:0) after 4m40s
[11:00:39.419] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:55:0)
[11:00:39.450] Build status: STARTED
[11:00:39.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:56:0) after 6m7s
[11:06:46.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:56:0)
[11:06:46.652] Build status: STARTED
[11:06:46.652] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:57:0) after 9m3s
[11:15:49.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:57:0)
[11:15:49.883] Build status: STARTED
[11:15:49.883] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:58:0) after 1m57s
[11:17:47.262] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:58:0)
[11:17:47.299] Build status: STARTED
[11:17:47.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:59:0) after 1m16s
[11:19:03.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:59:0)
[11:19:03.347] Build status: STARTED
[11:19:03.347] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:60:0) after 6m50s
[11:25:53.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:60:0)
[11:25:53.787] Build status: STARTED
[11:25:53.787] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:61:0) after 4m49s
[11:30:42.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:61:0)
[11:30:42.842] Build status: STARTED
[11:30:42.842] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:62:0) after 8m45s
[11:39:28.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:62:0)
[11:39:28.205] Build status: STARTED
[11:39:28.206] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:63:0) after 5m35s
[11:45:03.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:63:0)
[11:45:03.318] Build status: STARTED
[11:45:03.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:64:0) after 3m11s
[11:48:14.452] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:64:0)
[11:48:14.483] Build status: STARTED
[11:48:14.483] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:65:0) after 9m28s
[11:57:42.505] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:65:0)
[11:57:42.555] Build status: STARTED
[11:57:42.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:66:0) after 4m21s
[12:02:03.580] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:66:0)
[12:02:03.609] Build status: STARTED
[12:02:03.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:67:0) after 2m6s
[12:04:09.731] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:67:0)
[12:04:09.752] Build status: STARTED
[12:04:09.752] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:68:0) after 8m49s
[12:12:58.780] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:68:0)
[12:12:58.801] Build status: STARTED
[12:12:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:69:0) after 1m37s
[12:14:36.515] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:69:0)
[12:14:36.538] Build status: STARTED
[12:14:36.538] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:70:0) after 4m51s
[12:19:27.564] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:70:0)
[12:19:27.599] Build status: STARTED
[12:19:27.599] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:71:0) after 7m19s
[12:26:46.903] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:71:0)
[12:26:46.942] Build status: STARTED
[12:26:46.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:72:0) after 3m24s
[12:30:10.971] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:72:0)
[12:30:11.017] Build status: STARTED
[12:30:11.017] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:73:0) after 9m9s
[12:39:20.237] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:73:0)
[12:39:20.263] Build status: STARTED
[12:39:20.263] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:74:0) after 2m2s
[12:41:22.426] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:74:0)
[12:41:22.470] Build status: STARTED
[12:41:22.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:75:0) after 3m7s
[12:44:29.867] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:75:0)
[12:44:29.906] Build status: STARTED
[12:44:29.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:76:0) after 4m40s
[12:49:10.218] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:76:0)
[12:49:10.256] Build status: STARTED
[12:49:10.256] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:77:0) after 5m29s
[12:54:39.622] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:77:0)
[12:54:39.644] Build status: STARTED
[12:54:39.644] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:78:0) after 3m23s
[12:58:02.694] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:78:0)
[12:58:02.728] Build status: STARTED
[12:58:02.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:79:0) after 6m6s
[13:04:08.764] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:79:0)
[13:04:08.793] Build status: STARTED
[13:04:08.793] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:80:0) after 3m50s
[13:07:58.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:80:0)
[13:07:59.004] Build status: STARTED
[13:07:59.004] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:81:0) after 9m53s
[13:17:52.403] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:81:0)
[13:17:52.427] Build status: STARTED
[13:17:52.427] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:82:0) after 4m54s
[13:22:46.459] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:82:0)
[13:22:46.498] Build status: STARTED
[13:22:46.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:83:0) after 6m33s
[13:29:19.523] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:83:0)
[13:29:19.555] Build status: STARTED
[13:29:19.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:84:0) after 7m49s
[13:37:09.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:84:0)
[13:37:09.183] Build status: STARTED
[13:37:09.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:85:0) after 6m38s
[13:43:47.271] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:85:0)
[13:43:47.366] Build status: STARTED
[13:43:47.366] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:86:0) after 1m38s
[13:45:25.391] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:86:0)
[13:45:25.422] Build status: STARTED
[13:45:25.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:87:0) after 4m3s
[13:49:28.915] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:87:0)
[13:49:28.936] Build status: STARTED
[13:49:28.936] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:88:0) after 8m42s
[13:58:11.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:88:0)
[13:58:11.251] Build status: STARTED
[13:58:11.251] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:89:0) after 4m27s
[14:02:38.481] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:89:0)
[14:02:38.503] Build status: STARTED
[14:02:38.503] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:90:0) after 6m4s
[14:08:42.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:90:0)
[14:08:42.561] Build status: STARTED
[14:08:42.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:91:0) after 1m19s
[14:10:01.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:91:0)
[14:10:01.693] Build status: STARTED
[14:10:01.693] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:92:0) after 3m51s
[14:13:52.723] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:92:0)
[14:13:52.747] Build status: STARTED
[14:13:52.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:93:0) after 8m0s
[14:21:52.922] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:93:0)
[14:21:52.999] Build status: STARTED
[14:21:52.999] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:94:0) after 6m20s
[14:28:13.037] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:94:0)
[14:28:13.063] Build status: STARTED
[14:28:13.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:95:0) after 5m22s
[14:33:35.090] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:95:0)
[14:33:35.138] Build status: STARTED
[14:33:35.138] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:96:0) after 5m29s
[14:39:04.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:96:0)
[14:39:04.271] Build status: STARTED
[14:39:04.272] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:97:0) after 2m29s
[14:41:33.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:97:0)
[14:41:33.378] Build status: STARTED
[14:41:33.378] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:98:0) after 1m55s
[14:43:28.410] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:98:0)
[14:43:28.431] Build status: STARTED
[14:43:28.431] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:99:0) after 3m46s
[14:47:14.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:99:0)
[14:47:14.482] Build status: STARTED
[14:47:14.482] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:100:0) after 2m44s
[14:49:58.887] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:100:0)
[14:49:59.070] Build status: STARTED
[14:49:59.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:101:0) after 3m25s
[14:53:24.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:101:0)
[14:53:24.136] Build status: STARTED
[14:53:24.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:102:0) after 8m22s
[15:01:46.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:102:0)
[15:01:46.799] Build status: STARTED
[15:01:46.799] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:103:0) after 7m10s
[15:08:56.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:103:0)
[15:08:56.850] Build status: STARTED
[15:08:56.850] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:104:0) after 3m2s
[15:11:58.838] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:104:0)
[15:11:58.860] Build status: STARTED
[15:11:58.860] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:105:0) after 5m2s
[15:17:00.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:105:0)
[15:17:00.944] Build status: STARTED
[15:17:00.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:106:0) after 3m53s
[15:20:53.927] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:106:0)
[15:20:53.956] Build status: STARTED
[15:20:53.956] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:107:0) after 1m34s
[15:22:28.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:107:0)
[15:22:28.214] Build status: STARTED
[15:22:28.214] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:108:0) after 4m2s
[15:26:30.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:108:0)
[15:26:30.246] Build status: STARTED
[15:26:30.246] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:109:0) after 7m51s
[15:34:21.378] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:109:0)
[15:34:21.455] Build status: STARTED
[15:34:21.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:110:0) after 7m15s
[15:41:36.579] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:110:0)
[15:41:36.603] Build status: STARTED
[15:41:36.603] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:111:0) after 2m56s
[15:44:32.640] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:111:0)
[15:44:32.682] Build status: STARTED
[15:44:32.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:112:0) after 9m5s
[15:53:37.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:112:0)
[15:53:37.838] Build status: STARTED
[15:53:37.838] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:113:0) after 4m15s
[15:57:52.864] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:113:0)
[15:57:52.886] Build status: STARTED
[15:57:52.886] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:114:0) after 2m5s
[15:59:57.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:114:0)
[15:59:57.942] Build status: STARTED
[15:59:57.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:115:0) after 4m2s
[16:03:59.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:115:0)
[16:04:00.018] Build status: STARTED
[16:04:00.018] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:116:0) after 2m45s
[16:06:45.254] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:116:0)
[16:06:45.284] Build status: STARTED
[16:06:45.284] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:117:0) after 9m20s
[16:16:05.354] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:117:0)
[16:16:05.383] Build status: STARTED
[16:16:05.383] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:118:0) after 6m10s
[16:22:15.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:118:0)
[16:22:15.475] Build status: STARTED
[16:22:15.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:119:0) after 1m31s
[16:23:46.560] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:119:0)
[16:23:46.586] Build status: STARTED
[16:23:46.586] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:120:0) after 7m8s
[16:30:54.616] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:120:0)
[16:30:54.638] Build status: STARTED
[16:30:54.638] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:121:0) after 6m12s
[16:37:06.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:121:0)
[16:37:06.654] Build status: STARTED
[16:37:06.654] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:122:0) after 4m34s
[16:41:40.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:122:0)
[16:41:40.728] Build status: STARTED
[16:41:40.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:123:0) after 9m4s
[16:50:44.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:123:0)
[16:50:44.825] Build status: STARTED
[16:50:44.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:124:0) after 1m13s
[16:51:57.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:124:0)
[16:51:57.878] Build status: STARTED
[16:51:57.878] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:125:0) after 5m13s
[16:57:10.904] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:125:0)
[16:57:10.926] Build status: STARTED
[16:57:10.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:126:0) after 3m46s
[17:00:56.961] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:126:0)
[17:00:56.984] Build status: STARTED
[17:00:56.984] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:127:0) after 7m31s
[17:08:28.123] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:127:0)
[17:08:28.159] Build status: STARTED
[17:08:28.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:128:0) after 8m49s
[17:17:17.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:128:0)
[17:17:17.475] Build status: STARTED
[17:17:17.475] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:129:0) after 9m57s
[17:27:14.819] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:129:0)
[17:27:14.847] Build status: STARTED
[17:27:14.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:130:0) after 7m46s
[17:35:00.872] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:130:0)
[17:35:00.893] Build status: STARTED
[17:35:00.893] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8954910347124947120:131:0) after 7m51s
[17:36:27.654] Received PubSub notification, asking Buildbucket for the build status
[17:36:27.676] Build:
{
"id": "8789480285127074273",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1199,
"createdBy": "project:chromium",
"createTime": "2023-02-11T06:03:39.723345572Z",
"startTime": "2023-02-11T06:03:58.953135Z",
"endTime": "2023-02-11T17:36:27.225465643Z",
"updateTime": "2023-02-11T17:36:27.225465643Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7948942fab08f6e94bd6babe0fc494d3ea071db5",
"ref": "refs/heads/main"
}
}
}
[17:36:27.676] Invocation finished in 11h32m49.242083262s with status FAILED