[01:30:43.477] New invocation is queued and will start shortly
[01:30:44.842] Starting the invocation (attempt 1)
[01:30:44.874] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8f45db42064d54073e676d7b91bb84981e92ab53"
[01:30:44.875] Popped gitiles commit info from properties and tags
[01:30:44.875] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:30:44.875] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:30:44.875] Buildbucket request:
{
"requestId": "8935267975809170192",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f45db42064d54073e676d7b91bb84981e92ab53",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8935267975809170192"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:30:45.658] Scheduled build:
{
"id": "8769837913627141857",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1672,
"createdBy": "project:chromium",
"createTime": "2023-09-16T01:30:44.936177609Z",
"updateTime": "2023-09-16T01:30:44.936177609Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f45db42064d54073e676d7b91bb84981e92ab53",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:30:45.658] Task URL: https://cr-buildbucket.appspot.com/build/8769837913627141857
[01:30:45.658] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:2:0) after 1m51s
[01:30:46.447] Received PubSub notification, asking Buildbucket for the build status
[01:30:46.477] Build status: SCHEDULED
[01:31:07.855] Received PubSub notification, asking Buildbucket for the build status
[01:31:07.885] Build status: STARTED
[01:32:36.808] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:2:0)
[01:32:36.828] Build status: STARTED
[01:32:36.828] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:5:0) after 3m2s
[01:35:38.859] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:5:0)
[01:35:38.898] Build status: STARTED
[01:35:38.898] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:6:0) after 7m43s
[01:43:22.080] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:6:0)
[01:43:22.101] Build status: STARTED
[01:43:22.101] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:7:0) after 6m26s
[01:49:48.361] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:7:0)
[01:49:48.379] Build status: STARTED
[01:49:48.379] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:8:0) after 6m37s
[01:56:25.477] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:8:0)
[01:56:25.500] Build status: STARTED
[01:56:25.500] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:9:0) after 5m25s
[02:01:50.532] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:9:0)
[02:01:50.555] Build status: STARTED
[02:01:50.555] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:10:0) after 9m35s
[02:11:26.085] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:10:0)
[02:11:26.106] Build status: STARTED
[02:11:26.106] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:11:0) after 6m12s
[02:17:38.306] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:11:0)
[02:17:38.350] Build status: STARTED
[02:17:38.351] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:12:0) after 9m43s
[02:27:21.385] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:12:0)
[02:27:21.407] Build status: STARTED
[02:27:21.407] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:13:0) after 9m40s
[02:37:01.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:13:0)
[02:37:01.511] Build status: STARTED
[02:37:01.511] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:14:0) after 3m31s
[02:40:32.639] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:14:0)
[02:40:32.655] Build status: STARTED
[02:40:32.655] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:15:0) after 7m3s
[02:47:35.738] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:15:0)
[02:47:35.759] Build status: STARTED
[02:47:35.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:16:0) after 5m45s
[02:53:20.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:16:0)
[02:53:20.876] Build status: STARTED
[02:53:20.876] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:17:0) after 1m14s
[02:54:34.964] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:17:0)
[02:54:34.982] Build status: STARTED
[02:54:34.982] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:18:0) after 6m32s
[03:01:07.068] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:18:0)
[03:01:07.088] Build status: STARTED
[03:01:07.088] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:19:0) after 5m37s
[03:06:44.113] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:19:0)
[03:06:44.134] Build status: STARTED
[03:06:44.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:20:0) after 1m33s
[03:08:17.171] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:20:0)
[03:08:17.188] Build status: STARTED
[03:08:17.188] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:21:0) after 5m29s
[03:13:46.226] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:21:0)
[03:13:46.252] Build status: STARTED
[03:13:46.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:22:0) after 2m30s
[03:16:16.400] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:22:0)
[03:16:16.508] Build status: STARTED
[03:16:16.508] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:23:0) after 1m59s
[03:18:15.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:23:0)
[03:18:15.990] Build status: STARTED
[03:18:15.990] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:24:0) after 3m49s
[03:22:05.015] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:24:0)
[03:22:05.038] Build status: STARTED
[03:22:05.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:25:0) after 4m13s
[03:26:18.066] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:25:0)
[03:26:18.091] Build status: STARTED
[03:26:18.091] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:26:0) after 3m3s
[03:29:21.161] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:26:0)
[03:29:21.189] Build status: STARTED
[03:29:21.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:27:0) after 7m27s
[03:36:48.223] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:27:0)
[03:36:48.288] Build status: STARTED
[03:36:48.288] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:28:0) after 8m32s
[03:45:20.328] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:28:0)
[03:45:20.346] Build status: STARTED
[03:45:20.346] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:29:0) after 4m20s
[03:49:40.478] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:29:0)
[03:49:40.507] Build status: STARTED
[03:49:40.507] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:30:0) after 8m2s
[03:57:42.643] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:30:0)
[03:57:42.663] Build status: STARTED
[03:57:42.665] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:31:0) after 1m49s
[03:59:31.777] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:31:0)
[03:59:31.805] Build status: STARTED
[03:59:31.805] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:32:0) after 8m44s
[04:08:15.828] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:32:0)
[04:08:15.848] Build status: STARTED
[04:08:15.849] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:33:0) after 1m59s
[04:10:14.987] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:33:0)
[04:10:15.019] Build status: STARTED
[04:10:15.019] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:34:0) after 1m13s
[04:11:28.724] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:34:0)
[04:11:28.748] Build status: STARTED
[04:11:28.748] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:35:0) after 6m59s
[04:18:27.787] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:35:0)
[04:18:27.806] Build status: STARTED
[04:18:27.806] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:36:0) after 8m30s
[04:26:57.879] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:36:0)
[04:26:57.899] Build status: STARTED
[04:26:57.899] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:37:0) after 8m26s
[04:35:23.994] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:37:0)
[04:35:24.012] Build status: STARTED
[04:35:24.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:38:0) after 6m57s
[04:42:21.081] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:38:0)
[04:42:21.236] Build status: STARTED
[04:42:21.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:39:0) after 3m11s
[04:45:32.517] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:39:0)
[04:45:32.553] Build status: STARTED
[04:45:32.553] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:40:0) after 1m10s
[04:46:42.691] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:40:0)
[04:46:42.710] Build status: STARTED
[04:46:42.710] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:41:0) after 7m25s
[04:54:07.806] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:41:0)
[04:54:07.827] Build status: STARTED
[04:54:07.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:42:0) after 9m18s
[05:03:25.957] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:42:0)
[05:03:25.986] Build status: STARTED
[05:03:25.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:43:0) after 1m50s
[05:05:16.186] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:43:0)
[05:05:16.208] Build status: STARTED
[05:05:16.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:44:0) after 6m6s
[05:11:22.394] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:44:0)
[05:11:22.414] Build status: STARTED
[05:11:22.414] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:45:0) after 2m2s
[05:13:24.475] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:45:0)
[05:13:24.497] Build status: STARTED
[05:13:24.497] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:46:0) after 8m37s
[05:22:01.711] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:46:0)
[05:22:01.728] Build status: STARTED
[05:22:01.728] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:47:0) after 1m56s
[05:23:57.799] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:47:0)
[05:23:57.818] Build status: STARTED
[05:23:57.818] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:48:0) after 3m31s
[05:27:28.852] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:48:0)
[05:27:28.911] Build status: STARTED
[05:27:28.911] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:49:0) after 4m47s
[05:32:15.951] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:49:0)
[05:32:15.979] Build status: STARTED
[05:32:15.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:50:0) after 9m29s
[05:41:45.071] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:50:0)
[05:41:45.091] Build status: STARTED
[05:41:45.091] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:51:0) after 9m36s
[05:51:21.127] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:51:0)
[05:51:21.151] Build status: STARTED
[05:51:21.151] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:52:0) after 9m56s
[06:01:17.164] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:52:0)
[06:01:17.184] Build status: STARTED
[06:01:17.184] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:53:0) after 9m4s
[06:10:21.261] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:53:0)
[06:10:21.325] Build status: STARTED
[06:10:21.325] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:54:0) after 2m42s
[06:13:03.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:54:0)
[06:13:03.570] Build status: STARTED
[06:13:03.570] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:55:0) after 1m39s
[06:14:42.672] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:55:0)
[06:14:42.689] Build status: STARTED
[06:14:42.689] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:56:0) after 9m39s
[06:24:21.741] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:56:0)
[06:24:21.761] Build status: STARTED
[06:24:21.761] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:57:0) after 2m32s
[06:26:53.973] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:57:0)
[06:26:54.005] Build status: STARTED
[06:26:54.005] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:58:0) after 5m39s
[06:32:33.162] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:58:0)
[06:32:33.208] Build status: STARTED
[06:32:33.208] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:59:0) after 8m2s
[06:40:35.243] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:59:0)
[06:40:35.262] Build status: STARTED
[06:40:35.262] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:60:0) after 4m42s
[06:45:17.287] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:60:0)
[06:45:17.318] Build status: STARTED
[06:45:17.318] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:61:0) after 5m13s
[06:50:30.343] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:61:0)
[06:50:30.362] Build status: STARTED
[06:50:30.362] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:62:0) after 4m42s
[06:55:12.421] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:62:0)
[06:55:12.501] Build status: STARTED
[06:55:12.501] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:63:0) after 2m40s
[06:57:52.527] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:63:0)
[06:57:52.547] Build status: STARTED
[06:57:52.547] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:64:0) after 2m42s
[07:00:34.697] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:64:0)
[07:00:34.769] Build status: STARTED
[07:00:34.769] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:65:0) after 5m47s
[07:06:21.966] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:65:0)
[07:06:21.995] Build status: STARTED
[07:06:21.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:66:0) after 9m23s
[07:15:45.103] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:66:0)
[07:15:45.121] Build status: STARTED
[07:15:45.121] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:67:0) after 9m9s
[07:24:54.247] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:67:0)
[07:24:54.299] Build status: STARTED
[07:24:54.299] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:68:0) after 4m46s
[07:29:40.631] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:68:0)
[07:29:40.650] Build status: STARTED
[07:29:40.651] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:69:0) after 4m14s
[07:33:54.770] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:69:0)
[07:33:54.792] Build status: STARTED
[07:33:54.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:70:0) after 4m12s
[07:38:06.833] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:70:0)
[07:38:06.854] Build status: STARTED
[07:38:06.854] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:71:0) after 2m11s
[07:40:18.019] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:71:0)
[07:40:18.038] Build status: STARTED
[07:40:18.038] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:72:0) after 2m19s
[07:42:37.204] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:72:0)
[07:42:37.222] Build status: STARTED
[07:42:37.222] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:73:0) after 4m12s
[07:46:49.216] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:73:0)
[07:46:49.240] Build status: STARTED
[07:46:49.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:74:0) after 3m46s
[07:50:35.605] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:74:0)
[07:50:35.646] Build status: STARTED
[07:50:35.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:75:0) after 3m33s
[07:54:08.705] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:75:0)
[07:54:08.724] Build status: STARTED
[07:54:08.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:76:0) after 6m12s
[08:00:20.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:76:0)
[08:00:20.859] Build status: STARTED
[08:00:20.859] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:77:0) after 6m10s
[08:06:30.901] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:77:0)
[08:06:30.924] Build status: STARTED
[08:06:30.924] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:78:0) after 2m24s
[08:08:54.974] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:78:0)
[08:08:54.995] Build status: STARTED
[08:08:54.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:79:0) after 1m54s
[08:10:49.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:79:0)
[08:10:49.139] Build status: STARTED
[08:10:49.139] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:80:0) after 3m23s
[08:14:12.168] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:80:0)
[08:14:12.193] Build status: STARTED
[08:14:12.193] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:81:0) after 8m4s
[08:22:16.265] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:81:0)
[08:22:16.285] Build status: STARTED
[08:22:16.285] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:82:0) after 2m3s
[08:24:19.427] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:82:0)
[08:24:19.467] Build status: STARTED
[08:24:19.467] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:83:0) after 5m46s
[08:30:05.699] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:83:0)
[08:30:05.724] Build status: STARTED
[08:30:05.724] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:84:0) after 1m46s
[08:31:51.754] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:84:0)
[08:31:51.770] Build status: STARTED
[08:31:51.770] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:85:0) after 1m56s
[08:33:47.802] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:85:0)
[08:33:47.827] Build status: STARTED
[08:33:47.827] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:86:0) after 4m2s
[08:37:49.931] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:86:0)
[08:37:49.949] Build status: STARTED
[08:37:49.949] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:87:0) after 8m3s
[08:45:52.986] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:87:0)
[08:45:53.007] Build status: STARTED
[08:45:53.007] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:88:0) after 8m17s
[08:54:10.119] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:88:0)
[08:54:10.139] Build status: STARTED
[08:54:10.139] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:89:0) after 5m56s
[09:00:06.219] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:89:0)
[09:00:06.252] Build status: STARTED
[09:00:06.252] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:90:0) after 2m0s
[09:02:06.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:90:0)
[09:02:06.376] Build status: STARTED
[09:02:06.376] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:91:0) after 6m40s
[09:08:46.413] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:91:0)
[09:08:46.433] Build status: STARTED
[09:08:46.433] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:92:0) after 8m15s
[09:17:01.491] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:92:0)
[09:17:01.513] Build status: STARTED
[09:17:01.513] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:93:0) after 9m21s
[09:26:22.599] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:93:0)
[09:26:22.676] Build status: STARTED
[09:26:22.676] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:94:0) after 3m13s
[09:29:35.704] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:94:0)
[09:29:35.825] Build status: STARTED
[09:29:35.825] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:95:0) after 5m8s
[09:34:43.868] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:95:0)
[09:34:43.979] Build status: STARTED
[09:34:43.979] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:96:0) after 3m27s
[09:38:11.003] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:96:0)
[09:38:11.150] Build status: STARTED
[09:38:11.150] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:97:0) after 1m42s
[09:39:53.174] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:97:0)
[09:39:53.189] Build status: STARTED
[09:39:53.189] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:98:0) after 4m50s
[09:44:43.553] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:98:0)
[09:44:43.571] Build status: STARTED
[09:44:43.571] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:99:0) after 9m1s
[09:53:44.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:99:0)
[09:53:44.623] Build status: STARTED
[09:53:44.623] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:100:0) after 9m13s
[10:02:57.848] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:100:0)
[10:02:57.918] Build status: STARTED
[10:02:57.918] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:101:0) after 6m22s
[10:09:19.953] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:101:0)
[10:09:19.975] Build status: STARTED
[10:09:19.975] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:102:0) after 8m3s
[10:17:23.288] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:102:0)
[10:17:23.310] Build status: STARTED
[10:17:23.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:103:0) after 2m45s
[10:20:08.349] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:103:0)
[10:20:08.387] Build status: STARTED
[10:20:08.387] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:104:0) after 5m40s
[10:25:48.469] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:104:0)
[10:25:48.494] Build status: STARTED
[10:25:48.494] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:105:0) after 3m12s
[10:29:00.521] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:105:0)
[10:29:00.543] Build status: STARTED
[10:29:00.543] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:106:0) after 2m6s
[10:31:06.594] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:106:0)
[10:31:06.730] Build status: STARTED
[10:31:06.730] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:107:0) after 9m35s
[10:40:41.766] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:107:0)
[10:40:41.790] Build status: STARTED
[10:40:41.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:108:0) after 7m48s
[10:48:29.831] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:108:0)
[10:48:29.873] Build status: STARTED
[10:48:29.873] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:109:0) after 8m7s
[10:56:36.988] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:109:0)
[10:56:37.030] Build status: STARTED
[10:56:37.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:110:0) after 4m48s
[11:01:25.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:110:0)
[11:01:25.236] Build status: STARTED
[11:01:25.236] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:111:0) after 7m14s
[11:08:39.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:111:0)
[11:08:39.304] Build status: STARTED
[11:08:39.304] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:112:0) after 6m13s
[11:14:52.346] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:112:0)
[11:14:52.395] Build status: STARTED
[11:14:52.395] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:113:0) after 1m1s
[11:15:53.494] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:113:0)
[11:15:53.519] Build status: STARTED
[11:15:53.519] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:114:0) after 8m0s
[11:23:53.587] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:114:0)
[11:23:53.608] Build status: STARTED
[11:23:53.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:115:0) after 9m49s
[11:33:42.636] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:115:0)
[11:33:42.664] Build status: STARTED
[11:33:42.664] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:116:0) after 7m0s
[11:40:42.781] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:116:0)
[11:40:42.815] Build status: STARTED
[11:40:42.815] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:117:0) after 5m36s
[11:46:19.091] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:117:0)
[11:46:19.118] Build status: STARTED
[11:46:19.118] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:118:0) after 1m32s
[11:47:51.163] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:118:0)
[11:47:51.199] Build status: STARTED
[11:47:51.199] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:119:0) after 4m45s
[11:52:36.225] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:119:0)
[11:52:36.245] Build status: STARTED
[11:52:36.245] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:120:0) after 3m26s
[11:56:02.289] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:120:0)
[11:56:02.308] Build status: STARTED
[11:56:02.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:121:0) after 8m29s
[12:04:31.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:121:0)
[12:04:31.450] Build status: STARTED
[12:04:31.450] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:122:0) after 3m44s
[12:08:15.479] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:122:0)
[12:08:15.505] Build status: STARTED
[12:08:15.505] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:123:0) after 5m16s
[12:13:31.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:123:0)
[12:13:31.568] Build status: STARTED
[12:13:31.568] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:124:0) after 2m43s
[12:16:14.629] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:124:0)
[12:16:14.656] Build status: STARTED
[12:16:14.656] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:125:0) after 9m29s
[12:25:43.701] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:125:0)
[12:25:43.779] Build status: STARTED
[12:25:43.779] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:126:0) after 6m21s
[12:32:04.858] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:126:0)
[12:32:04.888] Build status: STARTED
[12:32:04.888] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:127:0) after 2m50s
[12:34:54.913] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:127:0)
[12:34:54.931] Build status: STARTED
[12:34:54.931] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:128:0) after 1m57s
[12:36:51.961] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:128:0)
[12:36:51.978] Build status: STARTED
[12:36:51.978] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:129:0) after 2m10s
[12:39:02.009] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:129:0)
[12:39:02.030] Build status: STARTED
[12:39:02.030] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:130:0) after 8m41s
[12:47:43.172] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:130:0)
[12:47:43.223] Build status: STARTED
[12:47:43.223] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:131:0) after 3m18s
[12:51:01.376] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:131:0)
[12:51:01.411] Build status: STARTED
[12:51:01.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:132:0) after 5m59s
[12:57:00.448] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:132:0)
[12:57:00.477] Build status: STARTED
[12:57:00.477] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:133:0) after 3m40s
[13:00:40.512] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:133:0)
[13:00:40.530] Build status: STARTED
[13:00:40.530] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:134:0) after 8m14s
[13:08:54.556] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:134:0)
[13:08:54.573] Build status: STARTED
[13:08:54.573] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:135:0) after 4m49s
[13:13:43.726] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:135:0)
[13:13:43.759] Build status: STARTED
[13:13:43.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:136:0) after 1m21s
[13:15:04.965] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:136:0)
[13:15:05.031] Build status: STARTED
[13:15:05.039] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:137:0) after 8m35s
[13:23:40.323] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:137:0)
[13:23:40.468] Build status: STARTED
[13:23:40.468] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:138:0) after 5m17s
[13:28:57.583] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:138:0)
[13:28:57.609] Build status: STARTED
[13:28:57.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:139:0) after 4m6s
[13:33:03.736] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:139:0)
[13:33:03.766] Build status: STARTED
[13:33:03.766] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:140:0) after 6m50s
[13:39:53.793] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:140:0)
[13:39:53.811] Build status: STARTED
[13:39:53.811] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:141:0) after 4m24s
[13:44:17.836] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:141:0)
[13:44:17.969] Build status: STARTED
[13:44:17.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8935267975809170192:142:0) after 7m7s
[13:50:25.081] Received PubSub notification, asking Buildbucket for the build status
[13:50:25.104] Build:
{
"id": "8769837913627141857",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 1672,
"createdBy": "project:chromium",
"createTime": "2023-09-16T01:30:44.936177609Z",
"startTime": "2023-09-16T01:31:06.997904Z",
"endTime": "2023-09-16T13:50:23.584774Z",
"updateTime": "2023-09-16T13:50:23.584774Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8f45db42064d54073e676d7b91bb84981e92ab53",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:50:25.104] Invocation finished in 12h19m41.632671457s with status FAILED