[05:28:33.153] New invocation is queued and will start shortly
[05:28:34.394] Starting the invocation (attempt 1)
[05:28:34.426] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7d933d58ff1fd8ce8a19f2dea5a933a3a23039c1"
[05:28:34.426] Popped gitiles commit info from properties and tags
[05:28:34.426] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:28:34.426] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:28:34.427] Buildbucket request:
{
"requestId": "8894121990228351024",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d933d58ff1fd8ce8a19f2dea5a933a3a23039c1",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8894121990228351024"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:28:34.958] Scheduled build:
{
"id": "8728691928154300753",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3019,
"createdBy": "project:chromium",
"createTime": "2024-12-13T05:28:34.504280267Z",
"updateTime": "2024-12-13T05:28:34.504280267Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d933d58ff1fd8ce8a19f2dea5a933a3a23039c1",
"ref": "refs/heads/main"
}
}
}
[05:28:34.958] Task URL: https://cr-buildbucket.appspot.com/build/8728691928154300753
[05:28:34.958] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:2:0) after 8m59s
[05:28:35.948] Received PubSub notification, asking Buildbucket for the build status
[05:28:35.969] Build status: SCHEDULED
[05:33:45.298] Received PubSub notification, asking Buildbucket for the build status
[05:33:45.324] Build status: STARTED
[05:37:34.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:2:0)
[05:37:34.062] Build status: STARTED
[05:37:34.062] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:5:0) after 6m47s
[05:44:21.086] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:5:0)
[05:44:21.110] Build status: STARTED
[05:44:21.110] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:6:0) after 2m20s
[05:46:41.213] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:6:0)
[05:46:41.232] Build status: STARTED
[05:46:41.232] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:7:0) after 6m51s
[05:53:32.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:7:0)
[05:53:32.343] Build status: STARTED
[05:53:32.343] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:8:0) after 2m45s
[05:56:17.687] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:8:0)
[05:56:17.718] Build status: STARTED
[05:56:17.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:9:0) after 6m10s
[06:02:28.180] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:9:0)
[06:02:28.200] Build status: STARTED
[06:02:28.200] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:10:0) after 1m16s
[06:03:44.269] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:10:0)
[06:03:44.296] Build status: STARTED
[06:03:44.296] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:11:0) after 2m40s
[06:06:24.495] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:11:0)
[06:06:24.565] Build status: STARTED
[06:06:24.565] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:12:0) after 5m4s
[06:11:28.661] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:12:0)
[06:11:28.686] Build status: STARTED
[06:11:28.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:13:0) after 5m33s
[06:17:01.821] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:13:0)
[06:17:01.844] Build status: STARTED
[06:17:01.844] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:14:0) after 8m12s
[06:25:14.130] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:14:0)
[06:25:14.147] Build status: STARTED
[06:25:14.147] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:15:0) after 5m28s
[06:30:42.173] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:15:0)
[06:30:42.260] Build status: STARTED
[06:30:42.260] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:16:0) after 5m52s
[06:36:34.242] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:16:0)
[06:36:34.262] Build status: STARTED
[06:36:34.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:17:0) after 8m55s
[06:45:29.393] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:17:0)
[06:45:29.453] Build status: STARTED
[06:45:29.453] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:18:0) after 6m54s
[06:52:23.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:18:0)
[06:52:23.537] Build status: STARTED
[06:52:23.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:19:0) after 2m21s
[06:54:45.179] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:19:0)
[06:54:45.199] Build status: STARTED
[06:54:45.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:20:0) after 7m32s
[07:02:17.395] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:20:0)
[07:02:17.423] Build status: STARTED
[07:02:17.423] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:21:0) after 7m7s
[07:09:24.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:21:0)
[07:09:24.468] Build status: STARTED
[07:09:24.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:22:0) after 5m5s
[07:14:29.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:22:0)
[07:14:29.533] Build status: STARTED
[07:14:29.533] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:23:0) after 7m33s
[07:22:02.669] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:23:0)
[07:22:02.719] Build status: STARTED
[07:22:02.719] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:24:0) after 3m45s
[07:25:47.847] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:24:0)
[07:25:47.873] Build status: STARTED
[07:25:47.874] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:25:0) after 5m48s
[07:31:36.034] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:25:0)
[07:31:36.051] Build status: STARTED
[07:31:36.051] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:26:0) after 2m56s
[07:34:32.115] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:26:0)
[07:34:32.141] Build status: STARTED
[07:34:32.141] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:27:0) after 6m56s
[07:41:28.270] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:27:0)
[07:41:28.289] Build status: STARTED
[07:41:28.289] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:28:0) after 2m43s
[07:44:11.309] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:28:0)
[07:44:11.332] Build status: STARTED
[07:44:11.332] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:29:0) after 5m49s
[07:50:00.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:29:0)
[07:50:00.406] Build status: STARTED
[07:50:00.407] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:30:0) after 6m1s
[07:56:01.581] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:30:0)
[07:56:01.645] Build status: STARTED
[07:56:01.645] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:31:0) after 8m8s
[08:04:09.684] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:31:0)
[08:04:09.747] Build status: STARTED
[08:04:09.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:32:0) after 3m4s
[08:07:13.778] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:32:0)
[08:07:13.803] Build status: STARTED
[08:07:13.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:33:0) after 1m36s
[08:08:50.006] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:33:0)
[08:08:50.027] Build status: STARTED
[08:08:50.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:34:0) after 8m54s
[08:17:44.201] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:34:0)
[08:17:44.220] Build status: STARTED
[08:17:44.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:35:0) after 4m24s
[08:22:08.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:35:0)
[08:22:08.401] Build status: STARTED
[08:22:08.401] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:36:0) after 1m10s
[08:23:18.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:36:0)
[08:23:18.450] Build status: STARTED
[08:23:18.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:37:0) after 5m18s
[08:28:36.789] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:37:0)
[08:28:36.810] Build status: STARTED
[08:28:36.810] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:38:0) after 6m9s
[08:34:45.934] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:38:0)
[08:34:45.957] Build status: STARTED
[08:34:45.957] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:39:0) after 9m11s
[08:43:57.918] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:39:0)
[08:43:57.940] Build status: STARTED
[08:43:57.941] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:40:0) after 6m7s
[08:50:04.941] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:40:0)
[08:50:04.961] Build status: STARTED
[08:50:04.962] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:41:0) after 4m0s
[08:54:05.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:41:0)
[08:54:05.044] Build status: STARTED
[08:54:05.045] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:42:0) after 8m37s
[09:02:42.079] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:42:0)
[09:02:42.100] Build status: STARTED
[09:02:42.100] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:43:0) after 4m30s
[09:07:12.159] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:43:0)
[09:07:12.177] Build status: STARTED
[09:07:12.177] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:44:0) after 3m57s
[09:11:09.862] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:44:0)
[09:11:09.881] Build status: STARTED
[09:11:09.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:45:0) after 9m30s
[09:20:40.038] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:45:0)
[09:20:40.064] Build status: STARTED
[09:20:40.064] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:46:0) after 1m28s
[09:22:08.126] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:46:0)
[09:22:08.162] Build status: STARTED
[09:22:08.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:47:0) after 8m42s
[09:30:50.191] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:47:0)
[09:30:50.230] Build status: STARTED
[09:30:50.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:48:0) after 1m18s
[09:32:08.451] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:48:0)
[09:32:08.473] Build status: STARTED
[09:32:08.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:49:0) after 6m55s
[09:39:03.502] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:49:0)
[09:39:03.537] Build status: STARTED
[09:39:03.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:50:0) after 4m32s
[09:43:35.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:50:0)
[09:43:35.981] Build status: STARTED
[09:43:35.981] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:51:0) after 4m17s
[09:47:53.016] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:51:0)
[09:47:53.120] Build status: STARTED
[09:47:53.120] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:52:0) after 1m10s
[09:49:03.153] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:52:0)
[09:49:03.174] Build status: STARTED
[09:49:03.174] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:53:0) after 7m44s
[09:56:47.197] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:53:0)
[09:56:47.230] Build status: STARTED
[09:56:47.230] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:54:0) after 3m5s
[09:59:52.227] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:54:0)
[09:59:52.313] Build status: STARTED
[09:59:52.313] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:55:0) after 1m4s
[10:00:56.337] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:55:0)
[10:00:56.360] Build status: STARTED
[10:00:56.360] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:56:0) after 5m22s
[10:06:18.387] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:56:0)
[10:06:18.405] Build status: STARTED
[10:06:18.405] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:57:0) after 3m24s
[10:09:42.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:57:0)
[10:09:42.447] Build status: STARTED
[10:09:42.447] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:58:0) after 2m54s
[10:12:36.545] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:58:0)
[10:12:36.566] Build status: STARTED
[10:12:36.566] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:59:0) after 6m47s
[10:19:23.657] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:59:0)
[10:19:23.677] Build status: STARTED
[10:19:23.677] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:60:0) after 3m47s
[10:23:10.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:60:0)
[10:23:10.979] Build status: STARTED
[10:23:10.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:61:0) after 2m49s
[10:26:00.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:61:0)
[10:26:00.074] Build status: STARTED
[10:26:00.074] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:62:0) after 6m34s
[10:32:34.109] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:62:0)
[10:32:34.140] Build status: STARTED
[10:32:34.142] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:63:0) after 4m20s
[10:36:54.236] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:63:0)
[10:36:54.255] Build status: STARTED
[10:36:54.255] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:64:0) after 7m55s
[10:44:49.453] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:64:0)
[10:44:49.478] Build status: STARTED
[10:44:49.478] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:65:0) after 5m34s
[10:50:23.513] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:65:0)
[10:50:23.615] Build status: STARTED
[10:50:23.615] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:66:0) after 8m51s
[10:59:14.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:66:0)
[10:59:14.623] Build status: STARTED
[10:59:14.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:67:0) after 7m15s
[11:06:29.658] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:67:0)
[11:06:29.721] Build status: STARTED
[11:06:29.721] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:68:0) after 9m58s
[11:16:27.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:68:0)
[11:16:27.797] Build status: STARTED
[11:16:27.797] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:69:0) after 7m52s
[11:24:19.851] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:69:0)
[11:24:19.867] Build status: STARTED
[11:24:19.867] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:70:0) after 7m49s
[11:32:08.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:70:0)
[11:32:08.991] Build status: STARTED
[11:32:09.029] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:71:0) after 1m43s
[11:33:52.196] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:71:0)
[11:33:52.219] Build status: STARTED
[11:33:52.219] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:72:0) after 9m37s
[11:43:29.666] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:72:0)
[11:43:29.686] Build status: STARTED
[11:43:29.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:73:0) after 2m37s
[11:46:06.712] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:73:0)
[11:46:06.737] Build status: STARTED
[11:46:06.737] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:74:0) after 2m9s
[11:48:15.763] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:74:0)
[11:48:15.923] Build status: STARTED
[11:48:15.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:75:0) after 1m57s
[11:50:13.051] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:75:0)
[11:50:13.069] Build status: STARTED
[11:50:13.069] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:76:0) after 4m8s
[11:54:21.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:76:0)
[11:54:21.121] Build status: STARTED
[11:54:21.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:77:0) after 6m2s
[12:00:23.145] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:77:0)
[12:00:23.167] Build status: STARTED
[12:00:23.167] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:78:0) after 4m53s
[12:05:16.198] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:78:0)
[12:05:16.220] Build status: STARTED
[12:05:16.220] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:79:0) after 5m10s
[12:10:26.353] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:79:0)
[12:10:26.385] Build status: STARTED
[12:10:26.385] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:80:0) after 4m46s
[12:15:12.413] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:80:0)
[12:15:12.441] Build status: STARTED
[12:15:12.441] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:81:0) after 5m31s
[12:20:43.473] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:81:0)
[12:20:43.498] Build status: STARTED
[12:20:43.498] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:82:0) after 2m25s
[12:23:08.482] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:82:0)
[12:23:08.526] Build status: STARTED
[12:23:08.527] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:83:0) after 7m27s
[12:30:35.547] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:83:0)
[12:30:35.584] Build status: STARTED
[12:30:35.584] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:84:0) after 5m46s
[12:36:21.635] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:84:0)
[12:36:21.665] Build status: STARTED
[12:36:21.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:85:0) after 6m7s
[12:42:28.716] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:85:0)
[12:42:28.734] Build status: STARTED
[12:42:28.734] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:86:0) after 1m37s
[12:44:05.764] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:86:0)
[12:44:05.791] Build status: STARTED
[12:44:05.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:87:0) after 7m51s
[12:51:56.823] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:87:0)
[12:51:56.845] Build status: STARTED
[12:51:56.845] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:88:0) after 3m55s
[12:55:51.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:88:0)
[12:55:51.928] Build status: STARTED
[12:55:51.928] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:89:0) after 6m19s
[13:02:11.008] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:89:0)
[13:02:11.027] Build status: STARTED
[13:02:11.027] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:90:0) after 6m59s
[13:09:10.310] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:90:0)
[13:09:10.340] Build status: STARTED
[13:09:10.340] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:91:0) after 3m23s
[13:12:33.406] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:91:0)
[13:12:33.422] Build status: STARTED
[13:12:33.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:92:0) after 7m0s
[13:19:33.543] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:92:0)
[13:19:33.561] Build status: STARTED
[13:19:33.561] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:93:0) after 6m20s
[13:25:53.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:93:0)
[13:25:53.995] Build status: STARTED
[13:25:53.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:94:0) after 9m2s
[13:34:56.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:94:0)
[13:34:56.238] Build status: STARTED
[13:34:56.238] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:95:0) after 9m50s
[13:44:46.862] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:95:0)
[13:44:46.884] Build status: STARTED
[13:44:46.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:96:0) after 7m14s
[13:52:01.124] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:96:0)
[13:52:01.147] Build status: STARTED
[13:52:01.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:97:0) after 4m51s
[13:56:52.299] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:97:0)
[13:56:52.317] Build status: STARTED
[13:56:52.317] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:98:0) after 7m24s
[14:04:16.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:98:0)
[14:04:16.511] Build status: STARTED
[14:04:16.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:99:0) after 8m30s
[14:12:46.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:99:0)
[14:12:46.630] Build status: STARTED
[14:12:46.630] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:100:0) after 7m50s
[14:20:36.707] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:100:0)
[14:20:36.729] Build status: STARTED
[14:20:36.729] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:101:0) after 2m23s
[14:22:59.764] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:101:0)
[14:22:59.781] Build status: STARTED
[14:22:59.781] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:102:0) after 2m35s
[14:25:34.856] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:102:0)
[14:25:34.872] Build status: STARTED
[14:25:34.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:103:0) after 2m57s
[14:28:31.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:103:0)
[14:28:31.971] Build status: STARTED
[14:28:31.971] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:104:0) after 9m40s
[14:38:12.000] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:104:0)
[14:38:12.023] Build status: STARTED
[14:38:12.023] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:105:0) after 3m41s
[14:41:53.142] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:105:0)
[14:41:53.162] Build status: STARTED
[14:41:53.162] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:106:0) after 8m38s
[14:50:31.294] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:106:0)
[14:50:31.364] Build status: STARTED
[14:50:31.364] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:107:0) after 6m6s
[14:56:37.381] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:107:0)
[14:56:37.432] Build status: STARTED
[14:56:37.432] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:108:0) after 2m13s
[14:58:50.484] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:108:0)
[14:58:50.569] Build status: STARTED
[14:58:50.569] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:109:0) after 6m1s
[15:04:51.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:109:0)
[15:04:51.624] Build status: STARTED
[15:04:51.624] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:110:0) after 5m15s
[15:10:06.722] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:110:0)
[15:10:06.748] Build status: STARTED
[15:10:06.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:111:0) after 4m24s
[15:14:31.286] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:111:0)
[15:14:31.304] Build status: STARTED
[15:14:31.304] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:112:0) after 3m35s
[15:18:06.369] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:112:0)
[15:18:06.393] Build status: STARTED
[15:18:06.393] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:113:0) after 4m0s
[15:22:06.570] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:113:0)
[15:22:06.588] Build status: STARTED
[15:22:06.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:114:0) after 4m55s
[15:27:01.614] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:114:0)
[15:27:01.641] Build status: STARTED
[15:27:01.641] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:115:0) after 3m23s
[15:30:24.680] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:115:0)
[15:30:24.700] Build status: STARTED
[15:30:24.700] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:116:0) after 4m59s
[15:35:23.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:116:0)
[15:35:23.730] Build status: STARTED
[15:35:23.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:117:0) after 2m59s
[15:38:22.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:117:0)
[15:38:22.846] Build status: STARTED
[15:38:22.846] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:118:0) after 3m38s
[15:42:00.898] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:118:0)
[15:42:00.966] Build status: STARTED
[15:42:00.966] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:119:0) after 8m53s
[15:50:53.998] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:119:0)
[15:50:54.013] Build status: STARTED
[15:50:54.013] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:120:0) after 4m7s
[15:55:01.039] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:120:0)
[15:55:01.059] Build status: STARTED
[15:55:01.059] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:121:0) after 1m44s
[15:56:45.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:121:0)
[15:56:45.188] Build status: STARTED
[15:56:45.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:122:0) after 1m42s
[15:58:27.290] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:122:0)
[15:58:27.310] Build status: STARTED
[15:58:27.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:123:0) after 1m13s
[15:59:40.322] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:123:0)
[15:59:40.341] Build status: STARTED
[15:59:40.341] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:124:0) after 9m5s
[16:08:45.359] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:124:0)
[16:08:45.380] Build status: STARTED
[16:08:45.380] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:125:0) after 1m3s
[16:09:48.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:125:0)
[16:09:48.493] Build status: STARTED
[16:09:48.493] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:126:0) after 2m20s
[16:12:08.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:126:0)
[16:12:08.563] Build status: STARTED
[16:12:08.563] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:127:0) after 7m49s
[16:19:57.595] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:127:0)
[16:19:57.617] Build status: STARTED
[16:19:57.617] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:128:0) after 9m58s
[16:29:55.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:128:0)
[16:29:55.697] Build status: STARTED
[16:29:55.697] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:129:0) after 9m37s
[16:39:32.749] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:129:0)
[16:39:32.767] Build status: STARTED
[16:39:32.767] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:130:0) after 1m22s
[16:40:54.797] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:130:0)
[16:40:54.869] Build status: STARTED
[16:40:54.869] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:131:0) after 3m48s
[16:44:42.911] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:131:0)
[16:44:42.948] Build status: STARTED
[16:44:42.948] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:132:0) after 8m22s
[16:53:05.004] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:132:0)
[16:53:05.136] Build status: STARTED
[16:53:05.136] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:133:0) after 1m47s
[16:54:52.177] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:133:0)
[16:54:52.196] Build status: STARTED
[16:54:52.197] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:134:0) after 1m56s
[16:56:48.222] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:134:0)
[16:56:48.327] Build status: STARTED
[16:56:48.327] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:135:0) after 3m7s
[16:59:55.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:135:0)
[16:59:55.377] Build status: STARTED
[16:59:55.377] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:136:0) after 5m41s
[17:05:36.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:136:0)
[17:05:36.465] Build status: STARTED
[17:05:36.465] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:137:0) after 5m13s
[17:10:49.542] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:137:0)
[17:10:49.564] Build status: STARTED
[17:10:49.564] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:138:0) after 1m51s
[17:12:40.572] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:138:0)
[17:12:40.595] Build status: STARTED
[17:12:40.595] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:139:0) after 4m21s
[17:17:01.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:139:0)
[17:17:01.695] Build status: STARTED
[17:17:01.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:140:0) after 5m27s
[17:22:28.728] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:140:0)
[17:22:28.747] Build status: STARTED
[17:22:28.747] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:141:0) after 7m32s
[17:30:00.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:141:0)
[17:30:00.803] Build status: STARTED
[17:30:00.803] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8894121990228351024:142:0) after 5m43s
[17:34:21.028] Received PubSub notification, asking Buildbucket for the build status
[17:34:21.047] Build:
{
"id": "8728691928154300753",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3019,
"createdBy": "project:chromium",
"createTime": "2024-12-13T05:28:34.504280267Z",
"startTime": "2024-12-13T05:33:43.435153824Z",
"endTime": "2024-12-13T17:34:20.759257177Z",
"updateTime": "2024-12-13T17:34:20.759257177Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7d933d58ff1fd8ce8a19f2dea5a933a3a23039c1",
"ref": "refs/heads/main"
}
}
}
[17:34:21.048] Invocation finished in 12h5m47.904054249s with status FAILED