[16:00:28.509] New invocation is queued and will start shortly
[16:00:29.699] Starting the invocation (attempt 1)
[16:00:29.743] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/7f6b0f59b9789285018157ff120abad52b563c2d"
[16:00:29.743] Popped gitiles commit info from properties and tags
[16:00:29.743] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:00:29.744] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:00:29.744] Buildbucket request:
{
"requestId": "8897434320852482864",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7f6b0f59b9789285018157ff120abad52b563c2d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8897434320852482864"
},
{
"key": "scheduler_job_id",
"value": "chromium/Win x64 Cross Builder (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:00:30.436] Scheduled build:
{
"id": "8732004258776086801",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 2635,
"createdBy": "project:chromium",
"createTime": "2024-11-06T16:00:29.863662863Z",
"updateTime": "2024-11-06T16:00:29.863662863Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7f6b0f59b9789285018157ff120abad52b563c2d",
"ref": "refs/heads/main"
}
}
}
[16:00:30.436] Task URL: https://cr-buildbucket.appspot.com/build/8732004258776086801
[16:00:30.436] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:2:0) after 4m4s
[16:00:31.427] Received PubSub notification, asking Buildbucket for the build status
[16:00:31.458] Build status: SCHEDULED
[16:01:45.813] Received PubSub notification, asking Buildbucket for the build status
[16:01:45.833] Build status: STARTED
[16:04:34.459] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:2:0)
[16:04:34.489] Build status: STARTED
[16:04:34.489] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:5:0) after 2m3s
[16:06:37.573] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:5:0)
[16:06:37.600] Build status: STARTED
[16:06:37.602] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:6:0) after 5m25s
[16:12:02.623] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:6:0)
[16:12:02.652] Build status: STARTED
[16:12:02.652] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:7:0) after 6m53s
[16:18:55.684] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:7:0)
[16:18:55.766] Build status: STARTED
[16:18:55.766] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:8:0) after 4m27s
[16:23:22.785] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:8:0)
[16:23:22.824] Build status: STARTED
[16:23:22.824] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:9:0) after 4m6s
[16:27:28.876] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:9:0)
[16:27:28.963] Build status: STARTED
[16:27:28.963] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:10:0) after 8m48s
[16:36:17.072] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:10:0)
[16:36:17.103] Build status: STARTED
[16:36:17.103] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:11:0) after 7m41s
[16:43:58.172] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:11:0)
[16:43:58.215] Build status: STARTED
[16:43:58.215] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:12:0) after 6m11s
[16:50:09.298] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:12:0)
[16:50:09.320] Build status: STARTED
[16:50:09.320] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:13:0) after 7m26s
[16:57:35.440] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:13:0)
[16:57:35.463] Build status: STARTED
[16:57:35.464] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:14:0) after 3m43s
[17:01:18.550] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:14:0)
[17:01:18.571] Build status: STARTED
[17:01:18.572] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:15:0) after 1m8s
[17:02:26.558] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:15:0)
[17:02:26.581] Build status: STARTED
[17:02:26.581] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:16:0) after 4m51s
[17:07:17.560] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:16:0)
[17:07:17.612] Build status: STARTED
[17:07:17.612] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:17:0) after 3m51s
[17:11:08.632] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:17:0)
[17:11:08.666] Build status: STARTED
[17:11:08.666] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:18:0) after 8m42s
[17:19:50.739] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:18:0)
[17:19:50.760] Build status: STARTED
[17:19:50.760] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:19:0) after 7m53s
[17:27:43.910] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:19:0)
[17:27:43.932] Build status: STARTED
[17:27:43.932] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:20:0) after 2m7s
[17:29:50.978] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:20:0)
[17:29:51.005] Build status: STARTED
[17:29:51.005] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:21:0) after 7m19s
[17:37:10.157] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:21:0)
[17:37:10.196] Build status: STARTED
[17:37:10.196] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:22:0) after 6m8s
[17:43:18.218] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:22:0)
[17:43:18.250] Build status: STARTED
[17:43:18.250] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:23:0) after 1m16s
[17:44:34.321] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:23:0)
[17:44:34.432] Build status: STARTED
[17:44:34.432] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:24:0) after 4m34s
[17:49:08.469] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:24:0)
[17:49:08.519] Build status: STARTED
[17:49:08.519] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:25:0) after 2m48s
[17:51:56.539] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:25:0)
[17:51:56.610] Build status: STARTED
[17:51:56.610] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:26:0) after 7m23s
[17:59:19.665] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:26:0)
[17:59:19.684] Build status: STARTED
[17:59:19.684] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:27:0) after 6m25s
[18:05:44.801] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:27:0)
[18:05:44.819] Build status: STARTED
[18:05:44.819] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:28:0) after 2m25s
[18:08:09.894] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:28:0)
[18:08:09.933] Build status: STARTED
[18:08:09.933] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:29:0) after 9m25s
[18:17:35.017] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:29:0)
[18:17:35.037] Build status: STARTED
[18:17:35.037] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:30:0) after 1m29s
[18:19:04.257] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:30:0)
[18:19:04.284] Build status: STARTED
[18:19:04.284] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:31:0) after 6m0s
[18:25:04.273] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:31:0)
[18:25:04.368] Build status: STARTED
[18:25:04.368] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:32:0) after 3m19s
[18:28:23.410] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:32:0)
[18:28:23.430] Build status: STARTED
[18:28:23.430] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:33:0) after 5m34s
[18:33:57.457] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:33:0)
[18:33:57.475] Build status: STARTED
[18:33:57.475] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:34:0) after 8m48s
[18:42:45.525] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:34:0)
[18:42:45.561] Build status: STARTED
[18:42:45.561] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:35:0) after 1m35s
[18:44:20.589] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:35:0)
[18:44:20.637] Build status: STARTED
[18:44:20.637] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:36:0) after 7m25s
[18:51:45.663] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:36:0)
[18:51:45.687] Build status: STARTED
[18:51:45.687] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:37:0) after 2m32s
[18:54:17.710] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:37:0)
[18:54:17.734] Build status: STARTED
[18:54:17.734] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:38:0) after 8m30s
[19:02:47.757] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:38:0)
[19:02:47.789] Build status: STARTED
[19:02:47.789] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:39:0) after 3m58s
[19:06:45.818] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:39:0)
[19:06:45.843] Build status: STARTED
[19:06:45.843] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:40:0) after 9m14s
[19:15:59.871] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:40:0)
[19:15:59.905] Build status: STARTED
[19:15:59.905] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:41:0) after 1m33s
[19:17:32.928] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:41:0)
[19:17:32.943] Build status: STARTED
[19:17:32.943] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:42:0) after 2m20s
[19:19:52.972] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:42:0)
[19:19:52.998] Build status: STARTED
[19:19:52.998] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:43:0) after 8m16s
[19:28:09.026] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:43:0)
[19:28:09.107] Build status: STARTED
[19:28:09.107] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:44:0) after 9m41s
[19:37:50.096] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:44:0)
[19:37:50.113] Build status: STARTED
[19:37:50.113] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:45:0) after 7m50s
[19:45:40.143] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:45:0)
[19:45:40.166] Build status: STARTED
[19:45:40.166] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:46:0) after 7m8s
[19:52:48.290] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:46:0)
[19:52:48.396] Build status: STARTED
[19:52:48.396] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:47:0) after 4m49s
[19:57:37.416] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:47:0)
[19:57:37.435] Build status: STARTED
[19:57:37.435] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:48:0) after 8m23s
[20:06:00.457] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:48:0)
[20:06:00.474] Build status: STARTED
[20:06:00.474] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:49:0) after 9m16s
[20:15:16.592] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:49:0)
[20:15:16.612] Build status: STARTED
[20:15:16.612] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:50:0) after 6m42s
[20:21:58.634] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:50:0)
[20:21:58.653] Build status: STARTED
[20:21:58.653] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:51:0) after 5m10s
[20:27:08.666] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:51:0)
[20:27:08.686] Build status: STARTED
[20:27:08.686] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:52:0) after 2m50s
[20:29:58.707] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:52:0)
[20:29:58.772] Build status: STARTED
[20:29:58.772] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:53:0) after 9m35s
[20:39:33.933] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:53:0)
[20:39:34.011] Build status: STARTED
[20:39:34.012] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:54:0) after 2m40s
[20:42:14.105] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:54:0)
[20:42:14.301] Build status: STARTED
[20:42:14.301] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:55:0) after 3m34s
[20:45:48.329] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:55:0)
[20:45:48.349] Build status: STARTED
[20:45:48.349] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:56:0) after 8m49s
[20:54:37.369] Handling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:56:0)
[20:54:37.390] Build status: STARTED
[20:54:37.390] Scheduling timer "check-buildbucket-build-status" (chromium/Win x64 Cross Builder (reclient compare):8897434320852482864:57:0) after 8m9s
[21:02:17.363] Received PubSub notification, asking Buildbucket for the build status
[21:02:17.387] Build:
{
"id": "8732004258776086801",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Win x64 Cross Builder (reclient compare)"
},
"number": 2635,
"createdBy": "project:chromium",
"createTime": "2024-11-06T16:00:29.863662863Z",
"startTime": "2024-11-06T16:01:45.601078918Z",
"endTime": "2024-11-06T21:02:15.972709170Z",
"updateTime": "2024-11-06T21:02:15.972709170Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "7f6b0f59b9789285018157ff120abad52b563c2d",
"ref": "refs/heads/main"
}
}
}
[21:02:17.387] Invocation finished in 5h1m48.888001991s with status FAILED