[13:21:44.231] New invocation is queued and will start shortly
[13:21:45.263] Starting the invocation (attempt 1)
[13:21:45.288] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5ca10a1354fcf1cc5829b2a9e54d80ef30d5f97b"
[13:21:45.288] Popped gitiles commit info from properties and tags
[13:21:45.288] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:21:45.288] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:21:45.288] Buildbucket request:
{
"requestId": "8888384611142779248",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ca10a1354fcf1cc5829b2a9e54d80ef30d5f97b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8888384611142779248"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:21:45.973] Scheduled build:
{
"id": "8722954549317348641",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9615,
"createdBy": "project:chromium",
"createTime": "2025-02-14T13:21:45.344547106Z",
"updateTime": "2025-02-14T13:21:45.344547106Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ca10a1354fcf1cc5829b2a9e54d80ef30d5f97b",
"ref": "refs/heads/main"
}
}
}
[13:21:45.973] Task URL: https://cr-buildbucket.appspot.com/build/8722954549317348641
[13:21:45.973] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:2:0) after 8m21s
[13:21:47.010] Received PubSub notification, asking Buildbucket for the build status
[13:21:47.037] Build status: SCHEDULED
[13:22:54.340] Received PubSub notification, asking Buildbucket for the build status
[13:22:54.373] Build status: STARTED
[13:30:07.121] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:2:0)
[13:30:07.153] Build status: STARTED
[13:30:07.153] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:5:0) after 9m13s
[13:39:20.280] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:5:0)
[13:39:20.313] Build status: STARTED
[13:39:20.313] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:6:0) after 7m33s
[13:46:53.333] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:6:0)
[13:46:53.356] Build status: STARTED
[13:46:53.356] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:7:0) after 6m46s
[13:53:39.377] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:7:0)
[13:53:39.399] Build status: STARTED
[13:53:39.399] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:8:0) after 8m32s
[14:02:11.418] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:8:0)
[14:02:11.451] Build status: STARTED
[14:02:11.451] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:9:0) after 2m4s
[14:04:15.470] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:9:0)
[14:04:15.490] Build status: STARTED
[14:04:15.490] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:10:0) after 2m3s
[14:06:18.507] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:10:0)
[14:06:18.532] Build status: STARTED
[14:06:18.532] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:11:0) after 1m46s
[14:08:04.528] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:11:0)
[14:08:04.574] Build status: STARTED
[14:08:04.574] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:12:0) after 8m15s
[14:16:19.595] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:12:0)
[14:16:19.617] Build status: STARTED
[14:16:19.617] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:13:0) after 9m33s
[14:25:52.692] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:13:0)
[14:25:52.710] Build status: STARTED
[14:25:52.710] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:14:0) after 9m57s
[14:35:49.728] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:14:0)
[14:35:49.810] Build status: STARTED
[14:35:49.810] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:15:0) after 9m52s
[14:45:42.656] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:15:0)
[14:45:42.677] Build status: STARTED
[14:45:42.677] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:16:0) after 4m55s
[14:50:38.046] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:16:0)
[14:50:38.070] Build status: STARTED
[14:50:38.070] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:17:0) after 6m26s
[14:57:04.094] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:17:0)
[14:57:04.196] Build status: STARTED
[14:57:04.196] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:18:0) after 4m50s
[15:01:54.182] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:18:0)
[15:01:54.203] Build status: STARTED
[15:01:54.203] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:19:0) after 5m51s
[15:07:45.628] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:19:0)
[15:07:45.645] Build status: STARTED
[15:07:45.645] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:20:0) after 3m48s
[15:11:33.661] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:20:0)
[15:11:33.687] Build status: STARTED
[15:11:33.687] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:21:0) after 7m1s
[15:18:34.724] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:21:0)
[15:18:34.741] Build status: STARTED
[15:18:34.741] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:22:0) after 2m10s
[15:20:44.763] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:22:0)
[15:20:44.806] Build status: STARTED
[15:20:44.806] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:23:0) after 4m33s
[15:25:17.823] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:23:0)
[15:25:17.869] Build status: STARTED
[15:25:17.869] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:24:0) after 1m20s
[15:26:37.879] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:24:0)
[15:26:37.927] Build status: STARTED
[15:26:37.927] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:25:0) after 9m7s
[15:35:44.986] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:25:0)
[15:35:45.005] Build status: STARTED
[15:35:45.005] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:26:0) after 2m59s
[15:38:44.040] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:26:0)
[15:38:44.065] Build status: STARTED
[15:38:44.065] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:27:0) after 2m41s
[15:41:25.057] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:27:0)
[15:41:25.083] Build status: STARTED
[15:41:25.083] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:28:0) after 2m21s
[15:43:46.209] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:28:0)
[15:43:46.225] Build status: STARTED
[15:43:46.225] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:29:0) after 8m1s
[15:51:47.275] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:29:0)
[15:51:47.307] Build status: STARTED
[15:51:47.307] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:30:0) after 9m37s
[16:01:24.320] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:30:0)
[16:01:24.363] Build status: STARTED
[16:01:24.363] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:31:0) after 9m34s
[16:10:58.441] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:31:0)
[16:10:58.456] Build status: STARTED
[16:10:58.456] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:32:0) after 3m52s
[16:14:50.604] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:32:0)
[16:14:50.675] Build status: STARTED
[16:14:50.675] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:33:0) after 6m31s
[16:21:21.693] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:33:0)
[16:21:21.713] Build status: STARTED
[16:21:21.713] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:34:0) after 4m1s
[16:25:22.738] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:34:0)
[16:25:22.847] Build status: STARTED
[16:25:22.847] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:35:0) after 1m28s
[16:26:50.873] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:35:0)
[16:26:50.895] Build status: STARTED
[16:26:50.895] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:36:0) after 2m1s
[16:28:51.919] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:36:0)
[16:28:51.989] Build status: STARTED
[16:28:51.989] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:37:0) after 3m50s
[16:32:42.009] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:37:0)
[16:32:42.032] Build status: STARTED
[16:32:42.032] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:38:0) after 8m12s
[16:40:54.107] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:38:0)
[16:40:54.130] Build status: STARTED
[16:40:54.130] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:39:0) after 8m6s
[16:49:00.156] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:39:0)
[16:49:00.180] Build status: STARTED
[16:49:00.180] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:40:0) after 5m25s
[16:54:25.194] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:40:0)
[16:54:25.211] Build status: STARTED
[16:54:25.211] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:41:0) after 1m34s
[16:55:59.254] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:41:0)
[16:55:59.357] Build status: STARTED
[16:55:59.357] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:42:0) after 5m12s
[17:01:11.409] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:42:0)
[17:01:11.430] Build status: STARTED
[17:01:11.430] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:43:0) after 2m55s
[17:04:06.453] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:43:0)
[17:04:06.479] Build status: STARTED
[17:04:06.479] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:44:0) after 5m45s
[17:09:51.535] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:44:0)
[17:09:51.554] Build status: STARTED
[17:09:51.554] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:45:0) after 8m24s
[17:18:15.577] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:45:0)
[17:18:15.595] Build status: STARTED
[17:18:15.595] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:46:0) after 1m14s
[17:19:29.615] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:46:0)
[17:19:29.692] Build status: STARTED
[17:19:29.692] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:47:0) after 6m20s
[17:25:49.738] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:47:0)
[17:25:49.754] Build status: STARTED
[17:25:49.754] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:48:0) after 9m52s
[17:35:41.769] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:48:0)
[17:35:41.786] Build status: STARTED
[17:35:41.786] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:49:0) after 6m17s
[17:41:58.940] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:49:0)
[17:41:58.959] Build status: STARTED
[17:41:58.959] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:50:0) after 3m35s
[17:45:33.976] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:50:0)
[17:45:33.995] Build status: STARTED
[17:45:33.995] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:51:0) after 2m22s
[17:47:56.074] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:51:0)
[17:47:56.102] Build status: STARTED
[17:47:56.102] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:52:0) after 6m19s
[17:54:15.179] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:52:0)
[17:54:15.350] Build status: STARTED
[17:54:15.350] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:53:0) after 9m56s
[18:04:11.378] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:53:0)
[18:04:11.412] Build status: STARTED
[18:04:11.412] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:54:0) after 6m6s
[18:10:17.454] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:54:0)
[18:10:17.518] Build status: STARTED
[18:10:17.518] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:55:0) after 4m59s
[18:15:16.568] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:55:0)
[18:15:16.594] Build status: STARTED
[18:15:16.594] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:56:0) after 5m41s
[18:20:57.635] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:56:0)
[18:20:57.651] Build status: STARTED
[18:20:57.651] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8888384611142779248:57:0) after 1m22s
[18:21:05.574] Received PubSub notification, asking Buildbucket for the build status
[18:21:05.593] Build:
{
"id": "8722954549317348641",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9615,
"createdBy": "project:chromium",
"createTime": "2025-02-14T13:21:45.344547106Z",
"startTime": "2025-02-14T13:22:54.114996344Z",
"endTime": "2025-02-14T18:21:05.130775219Z",
"updateTime": "2025-02-14T18:21:05.130775219Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5ca10a1354fcf1cc5829b2a9e54d80ef30d5f97b",
"ref": "refs/heads/main"
}
}
}
[18:21:05.593] Invocation finished in 4h59m21.373436671s with status FAILED