[13:53:14.349] New invocation is queued and will start shortly
[13:53:15.435] Starting the invocation (attempt 1)
[13:53:15.471] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4787fce6c51383f5631643ac3d14cc512d656de6"
[13:53:15.471] Popped gitiles commit info from properties and tags
[13:53:15.471] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:53:15.472] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:53:15.472] Buildbucket request:
{
"requestId": "8922084700716933808",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4787fce6c51383f5631643ac3d14cc512d656de6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922084700716933808"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:53:16.418] Scheduled build:
{
"id": "8756654638753416193",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1965,
"createdBy": "project:chromium",
"createTime": "2024-02-08T13:53:15.589793186Z",
"updateTime": "2024-02-08T13:53:15.589793186Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4787fce6c51383f5631643ac3d14cc512d656de6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:53:16.418] Task URL: https://cr-buildbucket.appspot.com/build/8756654638753416193
[13:53:16.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:2:0) after 7m14s
[13:53:21.315] Received PubSub notification, asking Buildbucket for the build status
[13:53:21.350] Build status: SCHEDULED
[13:55:04.021] Received PubSub notification, asking Buildbucket for the build status
[13:55:04.041] Build status: STARTED
[14:00:30.506] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:2:0)
[14:00:30.561] Build status: STARTED
[14:00:30.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:5:0) after 3m17s
[14:03:47.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:5:0)
[14:03:47.901] Build status: STARTED
[14:03:47.901] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:6:0) after 6m8s
[14:09:56.035] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:6:0)
[14:09:56.077] Build status: STARTED
[14:09:56.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:7:0) after 5m19s
[14:15:15.105] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:7:0)
[14:15:15.132] Build status: STARTED
[14:15:15.132] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:8:0) after 9m8s
[14:24:23.448] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:8:0)
[14:24:23.471] Build status: STARTED
[14:24:23.471] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:9:0) after 5m34s
[14:29:57.576] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:9:0)
[14:29:57.600] Build status: STARTED
[14:29:57.600] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:10:0) after 5m39s
[14:35:37.138] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:10:0)
[14:35:37.183] Build status: STARTED
[14:35:37.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:11:0) after 7m50s
[14:43:27.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:11:0)
[14:43:27.247] Build status: STARTED
[14:43:27.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:12:0) after 4m3s
[14:47:30.283] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:12:0)
[14:47:30.349] Build status: STARTED
[14:47:30.349] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:13:0) after 5m21s
[14:52:51.376] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:13:0)
[14:52:51.414] Build status: STARTED
[14:52:51.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:14:0) after 2m43s
[14:55:34.415] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:14:0)
[14:55:34.439] Build status: STARTED
[14:55:34.439] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:15:0) after 9m18s
[15:04:52.525] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:15:0)
[15:04:52.574] Build status: STARTED
[15:04:52.574] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:16:0) after 3m15s
[15:08:07.703] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:16:0)
[15:08:07.724] Build status: STARTED
[15:08:07.725] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:17:0) after 6m30s
[15:14:37.873] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:17:0)
[15:14:37.899] Build status: STARTED
[15:14:37.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:18:0) after 1m39s
[15:16:17.209] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:18:0)
[15:16:17.273] Build status: STARTED
[15:16:17.273] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:19:0) after 9m1s
[15:25:18.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:19:0)
[15:25:18.380] Build status: STARTED
[15:25:18.380] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:20:0) after 3m49s
[15:29:07.681] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:20:0)
[15:29:07.703] Build status: STARTED
[15:29:07.703] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:21:0) after 8m17s
[15:37:24.981] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:21:0)
[15:37:25.000] Build status: STARTED
[15:37:25.001] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:22:0) after 4m13s
[15:41:38.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:22:0)
[15:41:38.198] Build status: STARTED
[15:41:38.198] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:23:0) after 2m45s
[15:44:23.304] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:23:0)
[15:44:23.333] Build status: STARTED
[15:44:23.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:24:0) after 9m54s
[15:54:17.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:24:0)
[15:54:17.460] Build status: STARTED
[15:54:17.460] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:25:0) after 6m12s
[16:00:29.446] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:25:0)
[16:00:29.465] Build status: STARTED
[16:00:29.465] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:26:0) after 7m53s
[16:08:22.534] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:26:0)
[16:08:22.580] Build status: STARTED
[16:08:22.580] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:27:0) after 9m47s
[16:18:09.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:27:0)
[16:18:09.763] Build status: STARTED
[16:18:09.763] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:28:0) after 8m39s
[16:26:48.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:28:0)
[16:26:48.847] Build status: STARTED
[16:26:48.847] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:29:0) after 1m49s
[16:28:37.923] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:29:0)
[16:28:37.953] Build status: STARTED
[16:28:37.953] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:30:0) after 5m2s
[16:33:39.983] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:30:0)
[16:33:40.007] Build status: STARTED
[16:33:40.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:31:0) after 1m9s
[16:34:49.036] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:31:0)
[16:34:49.059] Build status: STARTED
[16:34:49.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:32:0) after 5m45s
[16:40:34.158] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:32:0)
[16:40:34.188] Build status: STARTED
[16:40:34.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:33:0) after 3m26s
[16:44:00.231] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:33:0)
[16:44:00.299] Build status: STARTED
[16:44:00.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:34:0) after 9m47s
[16:53:47.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:34:0)
[16:53:47.430] Build status: STARTED
[16:53:47.430] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:35:0) after 5m14s
[16:59:01.508] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:35:0)
[16:59:01.527] Build status: STARTED
[16:59:01.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:36:0) after 9m26s
[17:08:27.623] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:36:0)
[17:08:27.714] Build status: STARTED
[17:08:27.714] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:37:0) after 4m26s
[17:12:53.737] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:37:0)
[17:12:53.768] Build status: STARTED
[17:12:53.768] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:38:0) after 9m19s
[17:22:12.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:38:0)
[17:22:12.810] Build status: STARTED
[17:22:12.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:39:0) after 6m9s
[17:28:21.825] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:39:0)
[17:28:21.849] Build status: STARTED
[17:28:21.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:40:0) after 6m23s
[17:34:44.967] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:40:0)
[17:34:44.997] Build status: STARTED
[17:34:44.997] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:41:0) after 4m32s
[17:39:17.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:41:0)
[17:39:17.098] Build status: STARTED
[17:39:17.098] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:42:0) after 3m35s
[17:42:52.128] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:42:0)
[17:42:52.331] Build status: STARTED
[17:42:52.331] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:43:0) after 1m49s
[17:44:41.416] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:43:0)
[17:44:41.434] Build status: STARTED
[17:44:41.434] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:44:0) after 8m6s
[17:52:47.501] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:44:0)
[17:52:47.531] Build status: STARTED
[17:52:47.531] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:45:0) after 8m14s
[18:01:01.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:45:0)
[18:01:01.662] Build status: STARTED
[18:01:01.662] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:46:0) after 1m31s
[18:02:32.742] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:46:0)
[18:02:32.806] Build status: STARTED
[18:02:32.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:47:0) after 1m7s
[18:03:39.844] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:47:0)
[18:03:39.866] Build status: STARTED
[18:03:39.866] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:48:0) after 3m48s
[18:07:27.917] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:48:0)
[18:07:27.963] Build status: STARTED
[18:07:27.963] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:49:0) after 5m39s
[18:13:06.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:49:0)
[18:13:07.017] Build status: STARTED
[18:13:07.017] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:50:0) after 4m33s
[18:17:40.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:50:0)
[18:17:40.070] Build status: STARTED
[18:17:40.070] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:51:0) after 8m14s
[18:25:54.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:51:0)
[18:25:54.133] Build status: STARTED
[18:25:54.133] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:52:0) after 2m14s
[18:28:08.167] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:52:0)
[18:28:08.187] Build status: STARTED
[18:28:08.187] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:53:0) after 6m53s
[18:35:01.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:53:0)
[18:35:01.327] Build status: STARTED
[18:35:01.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:54:0) after 9m38s
[18:44:39.422] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:54:0)
[18:44:39.449] Build status: STARTED
[18:44:39.449] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:55:0) after 2m37s
[18:47:16.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:55:0)
[18:47:16.672] Build status: STARTED
[18:47:16.672] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:56:0) after 7m43s
[18:54:59.688] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:56:0)
[18:54:59.726] Build status: STARTED
[18:54:59.726] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:57:0) after 3m8s
[18:58:07.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:57:0)
[18:58:07.926] Build status: STARTED
[18:58:07.926] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:58:0) after 4m36s
[19:02:44.156] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:58:0)
[19:02:44.183] Build status: STARTED
[19:02:44.183] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:59:0) after 1m34s
[19:04:18.214] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:59:0)
[19:04:18.261] Build status: STARTED
[19:04:18.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:60:0) after 3m23s
[19:07:41.349] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:60:0)
[19:07:41.401] Build status: STARTED
[19:07:41.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:61:0) after 5m38s
[19:13:19.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:61:0)
[19:13:19.452] Build status: STARTED
[19:13:19.452] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:62:0) after 6m9s
[19:19:28.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:62:0)
[19:19:28.496] Build status: STARTED
[19:19:28.496] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:63:0) after 3m34s
[19:23:02.611] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:63:0)
[19:23:02.635] Build status: STARTED
[19:23:02.635] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:64:0) after 8m38s
[19:31:40.675] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:64:0)
[19:31:40.700] Build status: STARTED
[19:31:40.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:65:0) after 8m27s
[19:40:07.696] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:65:0)
[19:40:07.719] Build status: STARTED
[19:40:07.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:66:0) after 7m17s
[19:47:24.739] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:66:0)
[19:47:24.762] Build status: STARTED
[19:47:24.762] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:67:0) after 1m55s
[19:49:19.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:67:0)
[19:49:19.818] Build status: STARTED
[19:49:19.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:68:0) after 2m27s
[19:51:46.890] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:68:0)
[19:51:46.949] Build status: STARTED
[19:51:46.949] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:69:0) after 8m0s
[19:59:47.063] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:69:0)
[19:59:47.091] Build status: STARTED
[19:59:47.091] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:70:0) after 2m3s
[20:01:50.118] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:70:0)
[20:01:50.171] Build status: STARTED
[20:01:50.171] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:71:0) after 9m6s
[20:10:56.275] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:71:0)
[20:10:56.300] Build status: STARTED
[20:10:56.300] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:72:0) after 4m34s
[20:15:30.433] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:72:0)
[20:15:30.454] Build status: STARTED
[20:15:30.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:73:0) after 2m34s
[20:18:04.517] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:73:0)
[20:18:04.541] Build status: STARTED
[20:18:04.541] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:74:0) after 4m41s
[20:22:45.557] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:74:0)
[20:22:45.579] Build status: STARTED
[20:22:45.579] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:75:0) after 1m6s
[20:23:51.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:75:0)
[20:23:51.629] Build status: STARTED
[20:23:51.629] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:76:0) after 7m47s
[20:31:38.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:76:0)
[20:31:38.677] Build status: STARTED
[20:31:38.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:77:0) after 7m8s
[20:38:46.804] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:77:0)
[20:38:46.825] Build status: STARTED
[20:38:46.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:78:0) after 3m54s
[20:42:40.883] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:78:0)
[20:42:40.906] Build status: STARTED
[20:42:40.906] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:79:0) after 9m30s
[20:52:11.032] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:79:0)
[20:52:11.063] Build status: STARTED
[20:52:11.063] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:80:0) after 1m28s
[20:53:39.135] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:80:0)
[20:53:39.159] Build status: STARTED
[20:53:39.159] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:81:0) after 8m37s
[21:02:16.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:81:0)
[21:02:16.184] Build status: STARTED
[21:02:16.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:82:0) after 1m17s
[21:03:33.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:82:0)
[21:03:33.261] Build status: STARTED
[21:03:33.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:83:0) after 2m1s
[21:05:34.267] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:83:0)
[21:05:34.294] Build status: STARTED
[21:05:34.294] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:84:0) after 9m38s
[21:15:12.504] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:84:0)
[21:15:12.534] Build status: STARTED
[21:15:12.534] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:85:0) after 2m23s
[21:17:35.563] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:85:0)
[21:17:35.593] Build status: STARTED
[21:17:35.593] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:86:0) after 7m32s
[21:25:07.626] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:86:0)
[21:25:07.646] Build status: STARTED
[21:25:07.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:87:0) after 4m17s
[21:29:24.689] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:87:0)
[21:29:24.712] Build status: STARTED
[21:29:24.712] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:88:0) after 2m16s
[21:31:40.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:88:0)
[21:31:40.798] Build status: STARTED
[21:31:40.798] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:89:0) after 7m14s
[21:38:54.818] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:89:0)
[21:38:54.912] Build status: STARTED
[21:38:54.912] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:90:0) after 6m28s
[21:45:22.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:90:0)
[21:45:23.072] Build status: STARTED
[21:45:23.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:91:0) after 9m3s
[21:54:26.154] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:91:0)
[21:54:26.175] Build status: STARTED
[21:54:26.175] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:92:0) after 4m59s
[21:59:25.229] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:92:0)
[21:59:25.265] Build status: STARTED
[21:59:25.265] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:93:0) after 1m20s
[22:00:45.298] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:93:0)
[22:00:45.326] Build status: STARTED
[22:00:45.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:94:0) after 1m20s
[22:02:05.363] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:94:0)
[22:02:05.396] Build status: STARTED
[22:02:05.396] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:95:0) after 6m35s
[22:08:40.498] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:95:0)
[22:08:40.522] Build status: STARTED
[22:08:40.522] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:96:0) after 3m17s
[22:11:57.554] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:96:0)
[22:11:57.577] Build status: STARTED
[22:11:57.577] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:97:0) after 4m43s
[22:16:40.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:97:0)
[22:16:40.695] Build status: STARTED
[22:16:40.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:98:0) after 9m6s
[22:25:46.813] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:98:0)
[22:25:46.834] Build status: STARTED
[22:25:46.834] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:99:0) after 6m22s
[22:32:08.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:99:0)
[22:32:08.894] Build status: STARTED
[22:32:08.894] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:100:0) after 6m48s
[22:38:56.955] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:100:0)
[22:38:56.978] Build status: STARTED
[22:38:56.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:101:0) after 9m32s
[22:48:29.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:101:0)
[22:48:29.092] Build status: STARTED
[22:48:29.092] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:102:0) after 6m53s
[22:55:22.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:102:0)
[22:55:22.149] Build status: STARTED
[22:55:22.149] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:103:0) after 8m1s
[23:03:23.181] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:103:0)
[23:03:23.202] Build status: STARTED
[23:03:23.202] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:104:0) after 2m36s
[23:05:59.260] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:104:0)
[23:05:59.297] Build status: STARTED
[23:05:59.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:105:0) after 9m59s
[23:15:58.366] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:105:0)
[23:15:58.440] Build status: STARTED
[23:15:58.440] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:106:0) after 5m33s
[23:21:31.474] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:106:0)
[23:21:31.525] Build status: STARTED
[23:21:31.525] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:107:0) after 5m11s
[23:26:42.619] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:107:0)
[23:26:42.655] Build status: STARTED
[23:26:42.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:108:0) after 4m33s
[23:31:15.677] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:108:0)
[23:31:15.701] Build status: STARTED
[23:31:15.702] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:109:0) after 9m15s
[23:40:30.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:109:0)
[23:40:30.801] Build status: STARTED
[23:40:30.801] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:110:0) after 7m21s
[23:47:51.840] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:110:0)
[23:47:51.858] Build status: STARTED
[23:47:51.858] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:111:0) after 6m18s
[23:54:09.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:111:0)
[23:54:09.933] Build status: STARTED
[23:54:09.933] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:112:0) after 5m38s
[23:59:47.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:112:0)
[23:59:47.990] Build status: STARTED
[23:59:47.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:113:0) after 7m15s
[00:07:03.038] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:113:0)
[00:07:03.065] Build status: STARTED
[00:07:03.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:114:0) after 8m22s
[00:15:25.151] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:114:0)
[00:15:25.188] Build status: STARTED
[00:15:25.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:115:0) after 8m39s
[00:24:04.233] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:115:0)
[00:24:04.261] Build status: STARTED
[00:24:04.261] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:116:0) after 2m8s
[00:26:12.293] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:116:0)
[00:26:12.359] Build status: STARTED
[00:26:12.359] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:117:0) after 1m18s
[00:27:30.509] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:117:0)
[00:27:30.596] Build status: STARTED
[00:27:30.596] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:118:0) after 5m4s
[00:32:34.623] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:118:0)
[00:32:34.640] Build status: STARTED
[00:32:34.640] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:119:0) after 5m30s
[00:38:04.717] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:119:0)
[00:38:04.757] Build status: STARTED
[00:38:04.757] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:120:0) after 7m31s
[00:45:35.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:120:0)
[00:45:35.819] Build status: STARTED
[00:45:35.819] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:121:0) after 6m19s
[00:51:54.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:121:0)
[00:51:54.875] Build status: STARTED
[00:51:54.875] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:122:0) after 7m15s
[00:59:09.914] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:122:0)
[00:59:09.948] Build status: STARTED
[00:59:09.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:123:0) after 5m10s
[01:04:19.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:123:0)
[01:04:20.084] Build status: STARTED
[01:04:20.084] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:124:0) after 6m10s
[01:10:30.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:124:0)
[01:10:30.195] Build status: STARTED
[01:10:30.195] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:125:0) after 7m47s
[01:18:17.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:125:0)
[01:18:17.303] Build status: STARTED
[01:18:17.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:126:0) after 1m20s
[01:19:37.324] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:126:0)
[01:19:37.343] Build status: STARTED
[01:19:37.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:127:0) after 9m51s
[01:29:28.379] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:127:0)
[01:29:28.399] Build status: STARTED
[01:29:28.399] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:128:0) after 5m49s
[01:35:17.472] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:128:0)
[01:35:17.501] Build status: STARTED
[01:35:17.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:129:0) after 2m25s
[01:37:42.549] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:129:0)
[01:37:42.569] Build status: STARTED
[01:37:42.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:130:0) after 3m44s
[01:41:26.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:130:0)
[01:41:26.632] Build status: STARTED
[01:41:26.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:131:0) after 3m45s
[01:45:11.665] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:131:0)
[01:45:11.704] Build status: STARTED
[01:45:11.704] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:132:0) after 6m59s
[01:52:10.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:132:0)
[01:52:10.788] Build status: STARTED
[01:52:10.788] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:133:0) after 7m0s
[01:59:10.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:133:0)
[01:59:10.822] Build status: STARTED
[01:59:10.822] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:134:0) after 7m7s
[02:06:17.895] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:134:0)
[02:06:17.919] Build status: STARTED
[02:06:17.919] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8922084700716933808:135:0) after 7m48s
[02:13:20.641] Received PubSub notification, asking Buildbucket for the build status
[02:13:20.718] Build:
{
"id": "8756654638753416193",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1965,
"createdBy": "project:chromium",
"createTime": "2024-02-08T13:53:15.589793186Z",
"startTime": "2024-02-08T13:54:57.679523Z",
"endTime": "2024-02-09T02:13:20.009436Z",
"updateTime": "2024-02-09T02:13:20.009436Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4787fce6c51383f5631643ac3d14cc512d656de6",
"ref": "refs/heads/main"
}
},
"canary": true
}
[02:13:20.718] Invocation finished in 12h20m6.385324183s with status FAILED