[12:08:55.194] New invocation is queued and will start shortly
[12:08:56.575] Starting the invocation (attempt 1)
[12:08:56.609] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/08d46388983fd13006523095bcf8cf3f84cb59d9"
[12:08:56.609] Popped gitiles commit info from properties and tags
[12:08:56.609] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[12:08:56.611] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[12:08:56.611] Buildbucket request:
{
"requestId": "8886124268253148992",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "08d46388983fd13006523095bcf8cf3f84cb59d9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886124268253148992"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[12:08:57.123] Scheduled build:
{
"id": "8720694206027481873",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10037,
"createdBy": "project:chromium",
"createTime": "2025-03-11T12:08:56.686470322Z",
"updateTime": "2025-03-11T12:08:56.686470322Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "08d46388983fd13006523095bcf8cf3f84cb59d9",
"ref": "refs/heads/main"
}
}
}
[12:08:57.123] Task URL: https://cr-buildbucket.appspot.com/build/8720694206027481873
[12:08:57.123] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:2:0) after 5m21s
[12:08:58.184] Received PubSub notification, asking Buildbucket for the build status
[12:08:58.222] Build status: SCHEDULED
[12:09:02.633] Received PubSub notification, asking Buildbucket for the build status
[12:09:02.680] Build status: STARTED
[12:14:18.155] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:2:0)
[12:14:18.194] Build status: STARTED
[12:14:18.194] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:5:0) after 1m40s
[12:15:58.237] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:5:0)
[12:15:58.262] Build status: STARTED
[12:15:58.262] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:6:0) after 4m53s
[12:20:51.263] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:6:0)
[12:20:51.294] Build status: STARTED
[12:20:51.294] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:7:0) after 7m37s
[12:28:28.320] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:7:0)
[12:28:28.350] Build status: STARTED
[12:28:28.350] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:8:0) after 1m57s
[12:30:25.377] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:8:0)
[12:30:25.458] Build status: STARTED
[12:30:25.458] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:9:0) after 5m42s
[12:36:07.485] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:9:0)
[12:36:07.517] Build status: STARTED
[12:36:07.517] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:10:0) after 6m41s
[12:42:48.741] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:10:0)
[12:42:48.908] Build status: STARTED
[12:42:48.908] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:11:0) after 5m23s
[12:48:11.931] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:11:0)
[12:48:11.956] Build status: STARTED
[12:48:11.956] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:12:0) after 7m35s
[12:55:46.986] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:12:0)
[12:55:47.196] Build status: STARTED
[12:55:47.196] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:13:0) after 3m41s
[12:59:28.256] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:13:0)
[12:59:28.285] Build status: STARTED
[12:59:28.285] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:14:0) after 3m18s
[13:02:46.312] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:14:0)
[13:02:46.437] Build status: STARTED
[13:02:46.437] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:15:0) after 4m15s
[13:07:01.462] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:15:0)
[13:07:01.486] Build status: STARTED
[13:07:01.486] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:16:0) after 4m50s
[13:11:51.501] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:16:0)
[13:11:51.527] Build status: STARTED
[13:11:51.527] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:17:0) after 3m27s
[13:15:18.547] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:17:0)
[13:15:18.571] Build status: STARTED
[13:15:18.572] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:18:0) after 2m54s
[13:18:12.593] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:18:0)
[13:18:12.618] Build status: STARTED
[13:18:12.618] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:19:0) after 5m20s
[13:23:32.696] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:19:0)
[13:23:32.720] Build status: STARTED
[13:23:32.720] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:20:0) after 1m46s
[13:25:18.747] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:20:0)
[13:25:18.768] Build status: STARTED
[13:25:18.768] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:21:0) after 6m59s
[13:32:17.843] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:21:0)
[13:32:17.870] Build status: STARTED
[13:32:17.870] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:22:0) after 9m6s
[13:41:23.895] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:22:0)
[13:41:23.921] Build status: STARTED
[13:41:23.921] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:23:0) after 7m9s
[13:48:32.946] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:23:0)
[13:48:32.985] Build status: STARTED
[13:48:32.985] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:24:0) after 8m5s
[13:56:38.014] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:24:0)
[13:56:38.030] Build status: STARTED
[13:56:38.030] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:25:0) after 4m6s
[14:00:44.082] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:25:0)
[14:00:44.103] Build status: STARTED
[14:00:44.103] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:26:0) after 9m20s
[14:10:04.125] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:26:0)
[14:10:04.146] Build status: STARTED
[14:10:04.146] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:27:0) after 7m20s
[14:17:24.172] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:27:0)
[14:17:24.196] Build status: STARTED
[14:17:24.196] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:28:0) after 1m13s
[14:18:37.203] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:28:0)
[14:18:37.222] Build status: STARTED
[14:18:37.222] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:29:0) after 4m4s
[14:22:41.227] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:29:0)
[14:22:41.242] Build status: STARTED
[14:22:41.242] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:30:0) after 4m12s
[14:26:53.365] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:30:0)
[14:26:53.390] Build status: STARTED
[14:26:53.390] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:31:0) after 8m8s
[14:35:01.417] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:31:0)
[14:35:01.445] Build status: STARTED
[14:35:01.445] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:32:0) after 6m36s
[14:41:37.514] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:32:0)
[14:41:37.558] Build status: STARTED
[14:41:37.558] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:33:0) after 7m51s
[14:49:28.681] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:33:0)
[14:49:28.696] Build status: STARTED
[14:49:28.696] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:34:0) after 1m3s
[14:50:31.719] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:34:0)
[14:50:31.740] Build status: STARTED
[14:50:31.740] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:35:0) after 8m23s
[14:58:54.812] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:35:0)
[14:58:54.901] Build status: STARTED
[14:58:54.902] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:36:0) after 7m10s
[15:06:05.016] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:36:0)
[15:06:05.034] Build status: STARTED
[15:06:05.034] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:37:0) after 8m37s
[15:14:42.053] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:37:0)
[15:14:42.072] Build status: STARTED
[15:14:42.072] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:38:0) after 8m21s
[15:23:03.266] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:38:0)
[15:23:03.288] Build status: STARTED
[15:23:03.288] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:39:0) after 1m49s
[15:24:52.316] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:39:0)
[15:24:52.349] Build status: STARTED
[15:24:52.349] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:40:0) after 1m27s
[15:26:19.573] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:40:0)
[15:26:19.589] Build status: STARTED
[15:26:19.589] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:41:0) after 8m21s
[15:34:40.653] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:41:0)
[15:34:40.673] Build status: STARTED
[15:34:40.673] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:42:0) after 9m11s
[15:43:51.700] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:42:0)
[15:43:51.725] Build status: STARTED
[15:43:51.725] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:43:0) after 3m13s
[15:47:04.745] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:43:0)
[15:47:04.769] Build status: STARTED
[15:47:04.769] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:44:0) after 4m42s
[15:51:46.839] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:44:0)
[15:51:46.876] Build status: STARTED
[15:51:46.876] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:45:0) after 3m55s
[15:55:41.983] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:45:0)
[15:55:41.999] Build status: STARTED
[15:55:41.999] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:46:0) after 3m25s
[15:59:07.015] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:46:0)
[15:59:07.080] Build status: STARTED
[15:59:07.080] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:47:0) after 7m34s
[16:06:41.193] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:47:0)
[16:06:41.222] Build status: STARTED
[16:06:41.222] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:48:0) after 5m29s
[16:12:10.343] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:48:0)
[16:12:10.378] Build status: STARTED
[16:12:10.378] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:49:0) after 6m20s
[16:18:30.380] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:49:0)
[16:18:30.396] Build status: STARTED
[16:18:30.396] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:50:0) after 3m55s
[16:22:25.475] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:50:0)
[16:22:25.491] Build status: STARTED
[16:22:25.491] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:51:0) after 1m59s
[16:24:24.572] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:51:0)
[16:24:24.724] Build status: STARTED
[16:24:24.724] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:52:0) after 6m7s
[16:30:31.748] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:52:0)
[16:30:31.769] Build status: STARTED
[16:30:31.769] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:53:0) after 1m17s
[16:31:48.848] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:53:0)
[16:31:48.934] Build status: STARTED
[16:31:48.934] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:54:0) after 2m33s
[16:34:21.953] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:54:0)
[16:34:21.968] Build status: STARTED
[16:34:21.968] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:55:0) after 2m48s
[16:37:10.045] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:55:0)
[16:37:10.072] Build status: STARTED
[16:37:10.072] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:56:0) after 1m26s
[16:38:36.135] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:56:0)
[16:38:36.293] Build status: STARTED
[16:38:36.294] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886124268253148992:57:0) after 3m51s
[16:38:42.053] Received PubSub notification, asking Buildbucket for the build status
[16:38:42.078] Build:
{
"id": "8720694206027481873",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10037,
"createdBy": "project:chromium",
"createTime": "2025-03-11T12:08:56.686470322Z",
"startTime": "2025-03-11T12:09:02.379692237Z",
"endTime": "2025-03-11T16:38:41.657402324Z",
"updateTime": "2025-03-11T16:38:41.657402324Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "08d46388983fd13006523095bcf8cf3f84cb59d9",
"ref": "refs/heads/main"
}
}
}
[16:38:42.079] Invocation finished in 4h29m46.898190469s with status FAILED