[21:25:22.971] New invocation is queued and will start shortly
[21:25:24.043] Starting the invocation (attempt 1)
[21:25:24.071] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3e97361f34c54b23494cb81a275937723a1a74e6"
[21:25:24.071] Popped gitiles commit info from properties and tags
[21:25:24.071] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:25:24.072] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:25:24.072] Buildbucket request:
{
"requestId": "8891887464479127328",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e97361f34c54b23494cb81a275937723a1a74e6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8891887464479127328"
},
{
"key": "scheduler_job_id",
"value": "chromium/Windows Cross deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:25:24.642] Scheduled build:
{
"id": "8726457402537354705",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3068,
"createdBy": "project:chromium",
"createTime": "2025-01-06T21:25:24.194395105Z",
"updateTime": "2025-01-06T21:25:24.194395105Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e97361f34c54b23494cb81a275937723a1a74e6",
"ref": "refs/heads/main"
}
}
}
[21:25:24.642] Task URL: https://cr-buildbucket.appspot.com/build/8726457402537354705
[21:25:24.642] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:2:0) after 8m16s
[21:25:25.708] Received PubSub notification, asking Buildbucket for the build status
[21:25:25.740] Build status: SCHEDULED
[21:28:31.067] Received PubSub notification, asking Buildbucket for the build status
[21:28:31.098] Build status: STARTED
[21:33:40.673] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:2:0)
[21:33:40.705] Build status: STARTED
[21:33:40.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:5:0) after 6m38s
[21:40:18.785] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:5:0)
[21:40:18.821] Build status: STARTED
[21:40:18.821] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:6:0) after 8m5s
[21:48:23.862] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:6:0)
[21:48:23.902] Build status: STARTED
[21:48:23.902] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:7:0) after 5m59s
[21:54:22.936] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:7:0)
[21:54:22.962] Build status: STARTED
[21:54:22.962] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:8:0) after 5m34s
[21:59:57.044] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:8:0)
[21:59:57.061] Build status: STARTED
[21:59:57.061] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:9:0) after 9m42s
[22:09:39.101] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:9:0)
[22:09:39.336] Build status: STARTED
[22:09:39.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:10:0) after 3m19s
[22:12:58.445] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:10:0)
[22:12:58.466] Build status: STARTED
[22:12:58.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:11:0) after 2m23s
[22:15:21.455] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:11:0)
[22:15:21.474] Build status: STARTED
[22:15:21.474] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:12:0) after 8m35s
[22:23:56.555] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:12:0)
[22:23:56.588] Build status: STARTED
[22:23:56.588] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:13:0) after 9m18s
[22:33:14.596] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:13:0)
[22:33:14.619] Build status: STARTED
[22:33:14.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:14:0) after 6m44s
[22:39:58.706] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:14:0)
[22:39:58.744] Build status: STARTED
[22:39:58.744] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:15:0) after 4m25s
[22:44:23.771] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:15:0)
[22:44:23.855] Build status: STARTED
[22:44:23.855] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:16:0) after 4m56s
[22:49:19.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:16:0)
[22:49:19.986] Build status: STARTED
[22:49:19.986] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:17:0) after 4m46s
[22:54:06.054] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:17:0)
[22:54:06.072] Build status: STARTED
[22:54:06.072] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:18:0) after 5m7s
[22:59:13.100] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:18:0)
[22:59:13.123] Build status: STARTED
[22:59:13.123] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:19:0) after 9m23s
[23:08:36.155] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:19:0)
[23:08:36.226] Build status: STARTED
[23:08:36.226] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:20:0) after 1m18s
[23:09:54.268] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:20:0)
[23:09:54.308] Build status: STARTED
[23:09:54.308] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:21:0) after 7m3s
[23:16:57.383] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:21:0)
[23:16:57.398] Build status: STARTED
[23:16:57.398] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:22:0) after 7m51s
[23:24:48.429] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:22:0)
[23:24:48.625] Build status: STARTED
[23:24:48.625] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:23:0) after 9m27s
[23:34:15.663] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:23:0)
[23:34:15.682] Build status: STARTED
[23:34:15.682] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:24:0) after 8m6s
[23:42:21.768] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:24:0)
[23:42:21.790] Build status: STARTED
[23:42:21.790] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:25:0) after 5m55s
[23:48:16.995] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:25:0)
[23:48:17.015] Build status: STARTED
[23:48:17.015] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:26:0) after 7m54s
[23:56:11.111] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:26:0)
[23:56:11.144] Build status: STARTED
[23:56:11.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:27:0) after 4m55s
[00:01:06.647] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:27:0)
[00:01:06.669] Build status: STARTED
[00:01:06.669] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:28:0) after 6m43s
[00:07:49.676] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:28:0)
[00:07:49.695] Build status: STARTED
[00:07:49.695] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:29:0) after 9m17s
[00:17:06.779] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:29:0)
[00:17:06.868] Build status: STARTED
[00:17:06.868] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:30:0) after 4m35s
[00:21:41.896] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:30:0)
[00:21:41.920] Build status: STARTED
[00:21:41.920] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:31:0) after 8m52s
[00:30:33.956] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:31:0)
[00:30:33.974] Build status: STARTED
[00:30:33.974] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:32:0) after 4m59s
[00:35:33.043] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:32:0)
[00:35:33.065] Build status: STARTED
[00:35:33.065] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:33:0) after 1m38s
[00:37:11.139] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:33:0)
[00:37:11.177] Build status: STARTED
[00:37:11.177] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:34:0) after 2m13s
[00:39:24.264] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:34:0)
[00:39:24.363] Build status: STARTED
[00:39:24.363] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:35:0) after 6m46s
[00:46:10.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:35:0)
[00:46:10.417] Build status: STARTED
[00:46:10.417] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:36:0) after 1m23s
[00:47:33.450] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:36:0)
[00:47:33.466] Build status: STARTED
[00:47:33.466] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:37:0) after 3m0s
[00:50:33.540] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:37:0)
[00:50:33.559] Build status: STARTED
[00:50:33.559] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:38:0) after 1m30s
[00:52:03.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:38:0)
[00:52:03.632] Build status: STARTED
[00:52:03.632] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:39:0) after 8m56s
[01:00:59.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:39:0)
[01:00:59.760] Build status: STARTED
[01:00:59.760] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:40:0) after 4m51s
[01:05:50.842] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:40:0)
[01:05:50.923] Build status: STARTED
[01:05:50.923] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:41:0) after 2m49s
[01:08:39.962] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:41:0)
[01:08:39.995] Build status: STARTED
[01:08:39.995] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:42:0) after 4m38s
[01:13:18.033] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:42:0)
[01:13:18.057] Build status: STARTED
[01:13:18.057] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:43:0) after 6m11s
[01:19:29.092] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:43:0)
[01:19:29.130] Build status: STARTED
[01:19:29.130] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:44:0) after 7m54s
[01:27:23.315] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:44:0)
[01:27:23.333] Build status: STARTED
[01:27:23.333] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:45:0) after 2m52s
[01:30:15.702] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:45:0)
[01:30:15.718] Build status: STARTED
[01:30:15.718] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:46:0) after 2m11s
[01:32:26.761] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:46:0)
[01:32:26.778] Build status: STARTED
[01:32:26.778] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:47:0) after 2m49s
[01:35:15.857] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:47:0)
[01:35:15.877] Build status: STARTED
[01:35:15.877] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:48:0) after 9m37s
[01:44:53.059] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:48:0)
[01:44:53.077] Build status: STARTED
[01:44:53.077] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:49:0) after 3m13s
[01:48:06.117] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:49:0)
[01:48:06.134] Build status: STARTED
[01:48:06.134] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:50:0) after 3m24s
[01:51:30.182] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:50:0)
[01:51:30.221] Build status: STARTED
[01:51:30.221] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:51:0) after 2m56s
[01:54:26.338] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:51:0)
[01:54:26.422] Build status: STARTED
[01:54:26.422] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:52:0) after 2m19s
[01:56:45.588] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:52:0)
[01:56:45.611] Build status: STARTED
[01:56:45.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:53:0) after 1m11s
[01:57:56.791] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:53:0)
[01:57:56.817] Build status: STARTED
[01:57:56.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:54:0) after 7m48s
[02:05:44.865] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:54:0)
[02:05:44.881] Build status: STARTED
[02:05:44.881] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:55:0) after 4m17s
[02:10:01.919] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:55:0)
[02:10:01.944] Build status: STARTED
[02:10:01.944] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:56:0) after 1m7s
[02:11:08.933] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:56:0)
[02:11:08.950] Build status: STARTED
[02:11:08.950] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:57:0) after 2m14s
[02:13:23.012] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:57:0)
[02:13:23.031] Build status: STARTED
[02:13:23.031] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:58:0) after 7m4s
[02:20:27.431] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:58:0)
[02:20:27.448] Build status: STARTED
[02:20:27.448] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:59:0) after 7m36s
[02:28:03.792] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:59:0)
[02:28:03.817] Build status: STARTED
[02:28:03.817] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:60:0) after 3m59s
[02:32:02.849] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:60:0)
[02:32:02.929] Build status: STARTED
[02:32:02.929] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:61:0) after 9m58s
[02:42:01.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:61:0)
[02:42:01.235] Build status: STARTED
[02:42:01.235] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:62:0) after 4m25s
[02:46:26.399] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:62:0)
[02:46:26.456] Build status: STARTED
[02:46:26.456] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:63:0) after 2m4s
[02:48:31.147] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:63:0)
[02:48:31.166] Build status: STARTED
[02:48:31.166] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:64:0) after 5m50s
[02:54:21.195] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:64:0)
[02:54:21.215] Build status: STARTED
[02:54:21.215] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:65:0) after 6m48s
[03:01:09.297] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:65:0)
[03:01:09.311] Build status: STARTED
[03:01:09.311] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:66:0) after 3m45s
[03:04:54.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:66:0)
[03:04:54.504] Build status: STARTED
[03:04:54.504] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:67:0) after 1m48s
[03:06:42.520] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:67:0)
[03:06:42.604] Build status: STARTED
[03:06:42.605] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:68:0) after 9m23s
[03:16:05.628] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:68:0)
[03:16:05.646] Build status: STARTED
[03:16:05.646] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:69:0) after 5m14s
[03:21:19.678] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:69:0)
[03:21:19.704] Build status: STARTED
[03:21:19.705] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:70:0) after 4m41s
[03:26:00.765] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:70:0)
[03:26:00.792] Build status: STARTED
[03:26:00.792] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:71:0) after 7m5s
[03:33:05.947] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:71:0)
[03:33:05.969] Build status: STARTED
[03:33:05.969] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:72:0) after 5m49s
[03:38:54.984] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:72:0)
[03:38:55.011] Build status: STARTED
[03:38:55.012] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:73:0) after 9m0s
[03:47:55.246] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:73:0)
[03:47:55.310] Build status: STARTED
[03:47:55.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:74:0) after 4m1s
[03:51:56.721] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:74:0)
[03:51:56.745] Build status: STARTED
[03:51:56.745] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:75:0) after 3m23s
[03:55:19.772] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:75:0)
[03:55:19.791] Build status: STARTED
[03:55:19.791] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:76:0) after 8m13s
[04:03:32.827] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:76:0)
[04:03:32.913] Build status: STARTED
[04:03:32.913] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:77:0) after 7m50s
[04:11:23.133] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:77:0)
[04:11:23.152] Build status: STARTED
[04:11:23.152] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:78:0) after 6m16s
[04:17:39.175] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:78:0)
[04:17:39.194] Build status: STARTED
[04:17:39.194] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:79:0) after 6m23s
[04:24:02.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:79:0)
[04:24:02.247] Build status: STARTED
[04:24:02.247] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:80:0) after 6m53s
[04:30:55.279] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:80:0)
[04:30:55.297] Build status: STARTED
[04:30:55.297] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:81:0) after 5m31s
[04:36:26.345] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:81:0)
[04:36:26.412] Build status: STARTED
[04:36:26.412] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:82:0) after 5m58s
[04:42:24.449] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:82:0)
[04:42:24.470] Build status: STARTED
[04:42:24.470] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:83:0) after 2m50s
[04:45:14.500] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:83:0)
[04:45:14.537] Build status: STARTED
[04:45:14.537] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:84:0) after 8m48s
[04:54:02.674] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:84:0)
[04:54:02.759] Build status: STARTED
[04:54:02.759] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:85:0) after 6m1s
[05:00:03.794] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:85:0)
[05:00:03.813] Build status: STARTED
[05:00:03.813] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:86:0) after 9m2s
[05:09:05.860] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:86:0)
[05:09:06.052] Build status: STARTED
[05:09:06.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:87:0) after 4m53s
[05:13:59.584] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:87:0)
[05:13:59.611] Build status: STARTED
[05:13:59.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:88:0) after 6m46s
[05:20:45.920] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:88:0)
[05:20:45.947] Build status: STARTED
[05:20:45.947] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:89:0) after 7m16s
[05:28:02.005] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:89:0)
[05:28:02.025] Build status: STARTED
[05:28:02.025] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:90:0) after 1m23s
[05:29:25.217] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:90:0)
[05:29:25.234] Build status: STARTED
[05:29:25.234] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:91:0) after 2m12s
[05:31:37.280] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:91:0)
[05:31:37.353] Build status: STARTED
[05:31:37.353] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:92:0) after 7m21s
[05:38:58.382] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:92:0)
[05:38:58.418] Build status: STARTED
[05:38:58.418] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:93:0) after 6m54s
[05:45:52.598] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:93:0)
[05:45:52.618] Build status: STARTED
[05:45:52.619] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:94:0) after 8m41s
[05:54:33.731] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:94:0)
[05:54:33.750] Build status: STARTED
[05:54:33.751] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:95:0) after 8m6s
[06:02:40.221] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:95:0)
[06:02:40.240] Build status: STARTED
[06:02:40.240] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:96:0) after 8m57s
[06:11:37.240] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:96:0)
[06:11:37.310] Build status: STARTED
[06:11:37.310] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:97:0) after 3m33s
[06:15:10.438] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:97:0)
[06:15:10.455] Build status: STARTED
[06:15:10.455] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:98:0) after 6m3s
[06:21:13.963] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:98:0)
[06:21:13.981] Build status: STARTED
[06:21:13.981] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:99:0) after 5m10s
[06:26:24.095] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:99:0)
[06:26:24.113] Build status: STARTED
[06:26:24.113] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:100:0) after 8m10s
[06:34:34.273] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:100:0)
[06:34:34.303] Build status: STARTED
[06:34:34.303] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:101:0) after 2m5s
[06:36:39.333] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:101:0)
[06:36:39.357] Build status: STARTED
[06:36:39.357] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:102:0) after 1m48s
[06:38:27.493] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:102:0)
[06:38:27.611] Build status: STARTED
[06:38:27.611] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:103:0) after 1m40s
[06:40:07.750] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:103:0)
[06:40:07.771] Build status: STARTED
[06:40:07.771] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:104:0) after 6m20s
[06:46:27.895] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:104:0)
[06:46:27.942] Build status: STARTED
[06:46:27.942] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:105:0) after 1m36s
[06:48:04.316] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:105:0)
[06:48:04.336] Build status: STARTED
[06:48:04.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:106:0) after 5m53s
[06:53:57.550] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:106:0)
[06:53:57.572] Build status: STARTED
[06:53:57.572] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:107:0) after 7m47s
[07:01:44.745] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:107:0)
[07:01:44.774] Build status: STARTED
[07:01:44.774] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:108:0) after 3m24s
[07:05:08.812] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:108:0)
[07:05:08.833] Build status: STARTED
[07:05:08.833] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:109:0) after 6m21s
[07:11:29.876] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:109:0)
[07:11:29.915] Build status: STARTED
[07:11:29.915] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:110:0) after 2m36s
[07:14:06.120] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:110:0)
[07:14:06.139] Build status: STARTED
[07:14:06.139] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:111:0) after 9m50s
[07:23:56.169] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:111:0)
[07:23:56.190] Build status: STARTED
[07:23:56.190] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:112:0) after 1m25s
[07:25:21.230] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:112:0)
[07:25:21.249] Build status: STARTED
[07:25:21.249] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:113:0) after 8m11s
[07:33:32.321] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:113:0)
[07:33:32.336] Build status: STARTED
[07:33:32.336] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:114:0) after 5m27s
[07:38:59.461] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:114:0)
[07:38:59.479] Build status: STARTED
[07:38:59.479] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:115:0) after 4m51s
[07:43:50.518] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:115:0)
[07:43:50.546] Build status: STARTED
[07:43:50.546] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:116:0) after 3m6s
[07:46:56.591] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:116:0)
[07:46:56.609] Build status: STARTED
[07:46:56.609] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:117:0) after 8m47s
[07:55:43.662] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:117:0)
[07:55:43.686] Build status: STARTED
[07:55:43.686] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:118:0) after 8m53s
[08:04:36.755] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:118:0)
[08:04:36.902] Build status: STARTED
[08:04:36.903] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:119:0) after 3m13s
[08:07:49.940] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:119:0)
[08:07:49.968] Build status: STARTED
[08:07:49.968] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:120:0) after 5m7s
[08:12:57.011] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:120:0)
[08:12:57.029] Build status: STARTED
[08:12:57.029] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:121:0) after 1m51s
[08:14:48.057] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:121:0)
[08:14:48.075] Build status: STARTED
[08:14:48.075] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:122:0) after 6m53s
[08:21:41.062] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:122:0)
[08:21:41.086] Build status: STARTED
[08:21:41.086] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:123:0) after 8m32s
[08:30:13.125] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:123:0)
[08:30:13.144] Build status: STARTED
[08:30:13.144] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:124:0) after 2m7s
[08:32:20.239] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:124:0)
[08:32:20.257] Build status: STARTED
[08:32:20.257] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:125:0) after 5m41s
[08:38:01.284] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:125:0)
[08:38:01.305] Build status: STARTED
[08:38:01.305] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:126:0) after 6m50s
[08:44:51.401] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:126:0)
[08:44:51.419] Build status: STARTED
[08:44:51.419] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:127:0) after 2m15s
[08:47:06.790] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:127:0)
[08:47:06.807] Build status: STARTED
[08:47:06.807] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:128:0) after 9m50s
[08:56:56.866] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:128:0)
[08:56:56.884] Build status: STARTED
[08:56:56.884] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:129:0) after 8m26s
[09:05:23.104] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:129:0)
[09:05:23.148] Build status: STARTED
[09:05:23.148] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:130:0) after 8m39s
[09:14:02.734] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:130:0)
[09:14:02.753] Build status: STARTED
[09:14:02.753] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:131:0) after 1m41s
[09:15:43.916] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:131:0)
[09:15:43.935] Build status: STARTED
[09:15:43.935] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:132:0) after 4m30s
[09:20:13.972] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:132:0)
[09:20:13.993] Build status: STARTED
[09:20:13.993] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:133:0) after 9m32s
[09:29:46.033] Handling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:133:0)
[09:29:46.052] Build status: STARTED
[09:29:46.052] Scheduling timer "check-buildbucket-build-status" (chromium/Windows Cross deterministic:8891887464479127328:134:0) after 5m46s
[09:30:32.587] Received PubSub notification, asking Buildbucket for the build status
[09:30:32.611] Build:
{
"id": "8726457402537354705",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Windows Cross deterministic"
},
"number": 3068,
"createdBy": "project:chromium",
"createTime": "2025-01-06T21:25:24.194395105Z",
"startTime": "2025-01-06T21:28:30.766629856Z",
"endTime": "2025-01-07T09:30:32.016438533Z",
"updateTime": "2025-01-07T09:30:32.016438533Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3e97361f34c54b23494cb81a275937723a1a74e6",
"ref": "refs/heads/main"
}
}
}
[09:30:32.611] Invocation finished in 12h5m9.651235931s with status FAILED