[03:34:45.570] New invocation is queued and will start shortly
[03:34:47.586] Starting the invocation (attempt 1)
[03:34:47.613] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cae7d730a2c2d04cb53e85aa9c933d2d8482dab7"
[03:34:47.613] Popped gitiles commit info from properties and tags
[03:34:47.613] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:34:47.613] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:34:47.614] Buildbucket request:
{
"requestId": "8901376906778889616",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cae7d730a2c2d04cb53e85aa9c933d2d8482dab7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8901376906778889616"
},
{
"key": "scheduler_job_id",
"value": "chromium/Win x64 Cross Builder (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:34:48.165] Scheduled build:
{
"id": "8735946843920729809",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 2417,
"createdBy": "project:chromium",
"createTime": "2024-09-24T03:34:47.670761857Z",
"updateTime": "2024-09-24T03:34:47.670761857Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cae7d730a2c2d04cb53e85aa9c933d2d8482dab7",
"ref": "refs/heads/main"
}
}
}
[03:34:48.165] Task URL: https://cr-buildbucket.appspot.com/build/8735946843920729809
[03:34:48.165] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:2:0) after 3m20s
[03:34:49.155] Received PubSub notification, asking Buildbucket for the build status
[03:34:49.179] Build status: SCHEDULED
[03:37:14.000] Received PubSub notification, asking Buildbucket for the build status
[03:37:14.031] Build status: STARTED
[03:38:08.216] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:2:0)
[03:38:08.241] Build status: STARTED
[03:38:08.242] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:5:0) after 7m46s
[03:45:54.359] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:5:0)
[03:45:54.376] Build status: STARTED
[03:45:54.376] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:6:0) after 2m32s
[03:48:26.418] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:6:0)
[03:48:26.445] Build status: STARTED
[03:48:26.446] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:7:0) after 7m45s
[03:56:11.459] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:7:0)
[03:56:11.484] Build status: STARTED
[03:56:11.484] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:8:0) after 4m5s
[04:00:16.595] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:8:0)
[04:00:16.621] Build status: STARTED
[04:00:16.621] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:9:0) after 6m38s
[04:06:54.642] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:9:0)
[04:06:54.712] Build status: STARTED
[04:06:54.712] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:10:0) after 5m51s
[04:12:45.971] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:10:0)
[04:12:45.990] Build status: STARTED
[04:12:45.990] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:11:0) after 2m56s
[04:15:42.141] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:11:0)
[04:15:42.159] Build status: STARTED
[04:15:42.159] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:12:0) after 9m27s
[04:25:09.284] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:12:0)
[04:25:09.302] Build status: STARTED
[04:25:09.302] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:13:0) after 3m34s
[04:28:43.355] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:13:0)
[04:28:43.379] Build status: STARTED
[04:28:43.379] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:14:0) after 8m11s
[04:36:54.574] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:14:0)
[04:36:54.633] Build status: STARTED
[04:36:54.633] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:15:0) after 4m25s
[04:41:19.750] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:15:0)
[04:41:19.772] Build status: STARTED
[04:41:19.772] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:16:0) after 6m20s
[04:47:40.079] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:16:0)
[04:47:40.100] Build status: STARTED
[04:47:40.100] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:17:0) after 5m31s
[04:53:11.119] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:17:0)
[04:53:11.139] Build status: STARTED
[04:53:11.139] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:18:0) after 4m48s
[04:57:59.157] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:18:0)
[04:57:59.177] Build status: STARTED
[04:57:59.177] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:19:0) after 8m9s
[05:06:08.239] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:19:0)
[05:06:08.257] Build status: STARTED
[05:06:08.257] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:20:0) after 8m13s
[05:14:21.284] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:20:0)
[05:14:21.526] Build status: STARTED
[05:14:21.526] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:21:0) after 7m21s
[05:21:42.594] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:21:0)
[05:21:42.620] Build status: STARTED
[05:21:42.620] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:22:0) after 2m22s
[05:24:04.951] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:22:0)
[05:24:04.981] Build status: STARTED
[05:24:04.981] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:23:0) after 2m27s
[05:26:32.178] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:23:0)
[05:26:32.196] Build status: STARTED
[05:26:32.196] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:24:0) after 3m2s
[05:29:34.257] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:24:0)
[05:29:34.273] Build status: STARTED
[05:29:34.273] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:25:0) after 6m3s
[05:35:37.294] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:25:0)
[05:35:37.312] Build status: STARTED
[05:35:37.312] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:26:0) after 9m59s
[05:45:36.329] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:26:0)
[05:45:36.351] Build status: STARTED
[05:45:36.351] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:27:0) after 3m35s
[05:49:11.448] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:27:0)
[05:49:11.468] Build status: STARTED
[05:49:11.468] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:28:0) after 7m45s
[05:56:56.555] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:28:0)
[05:56:56.574] Build status: STARTED
[05:56:56.574] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:29:0) after 9m25s
[06:06:21.784] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:29:0)
[06:06:21.802] Build status: STARTED
[06:06:21.802] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:30:0) after 7m39s
[06:14:00.847] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:30:0)
[06:14:00.887] Build status: STARTED
[06:14:00.887] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:31:0) after 1m19s
[06:15:20.458] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:31:0)
[06:15:20.485] Build status: STARTED
[06:15:20.485] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:32:0) after 2m37s
[06:17:57.516] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:32:0)
[06:17:57.535] Build status: STARTED
[06:17:57.536] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:33:0) after 1m35s
[06:19:32.565] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:33:0)
[06:19:32.587] Build status: STARTED
[06:19:32.587] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:34:0) after 7m30s
[06:27:02.709] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:34:0)
[06:27:02.744] Build status: STARTED
[06:27:02.744] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:35:0) after 8m17s
[06:35:19.897] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:35:0)
[06:35:19.915] Build status: STARTED
[06:35:19.915] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:36:0) after 4m8s
[06:39:28.050] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:36:0)
[06:39:28.073] Build status: STARTED
[06:39:28.073] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:37:0) after 9m15s
[06:48:43.469] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:37:0)
[06:48:43.505] Build status: STARTED
[06:48:43.505] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:38:0) after 6m54s
[06:55:37.561] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:38:0)
[06:55:37.578] Build status: STARTED
[06:55:37.578] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:39:0) after 8m36s
[07:04:13.741] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:39:0)
[07:04:13.770] Build status: STARTED
[07:04:13.770] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:40:0) after 1m58s
[07:06:12.193] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:40:0)
[07:06:12.212] Build status: STARTED
[07:06:12.212] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:41:0) after 1m36s
[07:07:48.228] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:41:0)
[07:07:48.252] Build status: STARTED
[07:07:48.252] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:42:0) after 5m18s
[07:13:06.282] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:42:0)
[07:13:06.308] Build status: STARTED
[07:13:06.308] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:43:0) after 5m57s
[07:19:03.326] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:43:0)
[07:19:03.347] Build status: STARTED
[07:19:03.347] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:44:0) after 1m8s
[07:20:11.368] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:44:0)
[07:20:11.491] Build status: STARTED
[07:20:11.491] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:45:0) after 1m21s
[07:21:32.509] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:45:0)
[07:21:32.653] Build status: STARTED
[07:21:32.653] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:46:0) after 7m32s
[07:29:04.759] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:46:0)
[07:29:04.776] Build status: STARTED
[07:29:04.776] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:47:0) after 8m49s
[07:37:53.801] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:47:0)
[07:37:53.866] Build status: STARTED
[07:37:53.866] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:48:0) after 7m38s
[07:45:32.538] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:48:0)
[07:45:32.554] Build status: STARTED
[07:45:32.554] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:49:0) after 7m9s
[07:52:41.677] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:49:0)
[07:52:41.694] Build status: STARTED
[07:52:41.694] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:50:0) after 9m14s
[08:01:55.720] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:50:0)
[08:01:55.752] Build status: STARTED
[08:01:55.752] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:51:0) after 7m57s
[08:09:52.774] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:51:0)
[08:09:52.799] Build status: STARTED
[08:09:52.799] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:52:0) after 8m49s
[08:18:41.853] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:52:0)
[08:18:41.878] Build status: STARTED
[08:18:41.878] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:53:0) after 2m11s
[08:20:52.903] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:53:0)
[08:20:52.947] Build status: STARTED
[08:20:52.947] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:54:0) after 3m1s
[08:23:54.764] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:54:0)
[08:23:54.783] Build status: STARTED
[08:23:54.783] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:55:0) after 7m12s
[08:31:06.906] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:55:0)
[08:31:06.979] Build status: STARTED
[08:31:06.979] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:56:0) after 7m37s
[08:38:43.999] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:56:0)
[08:38:44.030] Build status: STARTED
[08:38:44.030] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:57:0) after 6m55s
[08:45:39.112] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:57:0)
[08:45:39.132] Build status: STARTED
[08:45:39.132] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:58:0) after 8m44s
[08:54:23.184] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:58:0)
[08:54:23.202] Build status: STARTED
[08:54:23.202] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:59:0) after 6m20s
[09:00:43.484] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:59:0)
[09:00:43.501] Build status: STARTED
[09:00:43.501] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:60:0) after 5m45s
[09:06:28.490] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:60:0)
[09:06:28.508] Build status: STARTED
[09:06:28.508] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8901376906778889616:61:0) after 4m26s
[09:06:56.182] Received PubSub notification, asking Buildbucket for the build status
[09:06:56.210] Build:
{
"id": "8735946843920729809",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 2417,
"createdBy": "project:chromium",
"createTime": "2024-09-24T03:34:47.670761857Z",
"startTime": "2024-09-24T03:36:39.885686493Z",
"endTime": "2024-09-24T09:06:50.779559923Z",
"updateTime": "2024-09-24T09:06:50.779559923Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cae7d730a2c2d04cb53e85aa9c933d2d8482dab7",
"ref": "refs/heads/main"
}
}
}
[09:06:56.210] Invocation finished in 5h32m10.648350323s with status FAILED