[23:02:26.624] New invocation is queued and will start shortly
[23:02:28.773] Starting the invocation (attempt 1)
[23:02:28.798] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e0793a1f59b680e5cca6944f96278edf971e9d22"
[23:02:28.798] Popped gitiles commit info from properties and tags
[23:02:28.798] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:02:28.798] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:02:28.799] Buildbucket request:
{
"requestId": "8885811361187767600",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0793a1f59b680e5cca6944f96278edf971e9d22",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885811361187767600"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:02:29.532] Scheduled build:
{
"id": "8720381298158733937",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10059,
"createdBy": "project:chromium",
"createTime": "2025-03-14T23:02:28.884487715Z",
"updateTime": "2025-03-14T23:02:28.884487715Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0793a1f59b680e5cca6944f96278edf971e9d22",
"ref": "refs/heads/main"
}
}
}
[23:02:29.532] Task URL: https://cr-buildbucket.appspot.com/build/8720381298158733937
[23:02:29.532] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:2:0) after 2m16s
[23:02:30.551] Received PubSub notification, asking Buildbucket for the build status
[23:02:30.613] Build status: SCHEDULED
[23:03:39.715] Received PubSub notification, asking Buildbucket for the build status
[23:03:39.748] Build status: STARTED
[23:04:45.547] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:2:0)
[23:04:45.643] Build status: STARTED
[23:04:45.643] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:5:0) after 7m32s
[23:12:17.742] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:5:0)
[23:12:17.770] Build status: STARTED
[23:12:17.770] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:6:0) after 1m18s
[23:13:35.742] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:6:0)
[23:13:35.766] Build status: STARTED
[23:13:35.766] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:7:0) after 8m1s
[23:21:36.773] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:7:0)
[23:21:36.808] Build status: STARTED
[23:21:36.808] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:8:0) after 8m35s
[23:30:11.899] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:8:0)
[23:30:11.935] Build status: STARTED
[23:30:11.935] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:9:0) after 3m12s
[23:33:23.964] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:9:0)
[23:33:23.996] Build status: STARTED
[23:33:23.996] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:10:0) after 7m24s
[23:40:48.023] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:10:0)
[23:40:48.048] Build status: STARTED
[23:40:48.048] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:11:0) after 8m5s
[23:48:53.087] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:11:0)
[23:48:53.406] Build status: STARTED
[23:48:53.406] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:12:0) after 1m34s
[23:50:27.523] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:12:0)
[23:50:27.537] Build status: STARTED
[23:50:27.537] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:13:0) after 1m37s
[23:52:04.563] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:13:0)
[23:52:04.589] Build status: STARTED
[23:52:04.589] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:14:0) after 6m54s
[23:58:58.610] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:14:0)
[23:58:58.633] Build status: STARTED
[23:58:58.633] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:15:0) after 2m5s
[00:01:03.652] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:15:0)
[00:01:03.671] Build status: STARTED
[00:01:03.671] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:16:0) after 4m15s
[00:05:18.751] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:16:0)
[00:05:18.782] Build status: STARTED
[00:05:18.782] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:17:0) after 7m3s
[00:12:21.811] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:17:0)
[00:12:21.859] Build status: STARTED
[00:12:21.859] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:18:0) after 6m0s
[00:18:21.883] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:18:0)
[00:18:21.910] Build status: STARTED
[00:18:21.910] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:19:0) after 9m14s
[00:27:35.934] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:19:0)
[00:27:35.960] Build status: STARTED
[00:27:35.960] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:20:0) after 1m11s
[00:28:46.988] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:20:0)
[00:28:47.066] Build status: STARTED
[00:28:47.066] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:21:0) after 5m0s
[00:33:47.095] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:21:0)
[00:33:47.111] Build status: STARTED
[00:33:47.111] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:22:0) after 8m58s
[00:42:45.155] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:22:0)
[00:42:45.175] Build status: STARTED
[00:42:45.175] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:23:0) after 1m44s
[00:44:29.368] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:23:0)
[00:44:29.389] Build status: STARTED
[00:44:29.389] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:24:0) after 4m16s
[00:48:45.422] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:24:0)
[00:48:45.439] Build status: STARTED
[00:48:45.439] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:25:0) after 7m45s
[00:56:30.502] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:25:0)
[00:56:30.564] Build status: STARTED
[00:56:30.564] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:26:0) after 1m42s
[00:58:12.630] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:26:0)
[00:58:12.745] Build status: STARTED
[00:58:12.745] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:27:0) after 5m58s
[01:04:10.790] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:27:0)
[01:04:10.820] Build status: STARTED
[01:04:10.820] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:28:0) after 7m46s
[01:11:56.840] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:28:0)
[01:11:56.855] Build status: STARTED
[01:11:56.856] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:29:0) after 5m7s
[01:17:03.875] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:29:0)
[01:17:03.893] Build status: STARTED
[01:17:03.893] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:30:0) after 6m39s
[01:23:43.046] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:30:0)
[01:23:43.061] Build status: STARTED
[01:23:43.061] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:31:0) after 5m44s
[01:29:27.109] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:31:0)
[01:29:27.127] Build status: STARTED
[01:29:27.127] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:32:0) after 1m54s
[01:31:21.153] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:32:0)
[01:31:21.177] Build status: STARTED
[01:31:21.177] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:33:0) after 1m45s
[01:33:06.203] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:33:0)
[01:33:06.224] Build status: STARTED
[01:33:06.224] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:34:0) after 1m26s
[01:34:32.723] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:34:0)
[01:34:32.739] Build status: STARTED
[01:34:32.739] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:35:0) after 6m10s
[01:40:42.862] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:35:0)
[01:40:42.881] Build status: STARTED
[01:40:42.881] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:36:0) after 9m42s
[01:50:25.239] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:36:0)
[01:50:25.278] Build status: STARTED
[01:50:25.278] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:37:0) after 1m37s
[01:52:02.416] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:37:0)
[01:52:02.432] Build status: STARTED
[01:52:02.432] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:38:0) after 6m11s
[01:58:13.470] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:38:0)
[01:58:13.500] Build status: STARTED
[01:58:13.500] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:39:0) after 6m18s
[02:04:31.495] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:39:0)
[02:04:31.515] Build status: STARTED
[02:04:31.515] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:40:0) after 8m0s
[02:12:31.565] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:40:0)
[02:12:31.582] Build status: STARTED
[02:12:31.582] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:41:0) after 4m55s
[02:17:28.187] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:41:0)
[02:17:28.205] Build status: STARTED
[02:17:28.205] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:42:0) after 4m0s
[02:21:28.318] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:42:0)
[02:21:28.350] Build status: STARTED
[02:21:28.350] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:43:0) after 6m20s
[02:27:48.376] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:43:0)
[02:27:48.445] Build status: STARTED
[02:27:48.445] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:44:0) after 8m30s
[02:36:18.469] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:44:0)
[02:36:18.503] Build status: STARTED
[02:36:18.503] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:45:0) after 3m12s
[02:39:30.543] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:45:0)
[02:39:30.604] Build status: STARTED
[02:39:30.604] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:46:0) after 4m55s
[02:44:25.628] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:46:0)
[02:44:25.646] Build status: STARTED
[02:44:25.646] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:47:0) after 7m12s
[02:51:37.718] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:47:0)
[02:51:37.741] Build status: STARTED
[02:51:37.741] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:48:0) after 6m20s
[02:57:57.873] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:48:0)
[02:57:57.891] Build status: STARTED
[02:57:57.892] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:49:0) after 5m54s
[03:03:51.920] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:49:0)
[03:03:51.949] Build status: STARTED
[03:03:51.949] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:50:0) after 4m22s
[03:08:14.004] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:50:0)
[03:08:14.023] Build status: STARTED
[03:08:14.023] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:51:0) after 4m18s
[03:12:32.097] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:51:0)
[03:12:32.114] Build status: STARTED
[03:12:32.114] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:52:0) after 5m55s
[03:18:27.144] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:52:0)
[03:18:27.216] Build status: STARTED
[03:18:27.216] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885811361187767600:53:0) after 6m49s
[03:23:22.893] Received PubSub notification, asking Buildbucket for the build status
[03:23:22.918] Build:
{
"id": "8720381298158733937",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10059,
"createdBy": "project:chromium",
"createTime": "2025-03-14T23:02:28.884487715Z",
"startTime": "2025-03-14T23:03:39.517324189Z",
"endTime": "2025-03-15T03:23:22.549351068Z",
"updateTime": "2025-03-15T03:23:22.549351068Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e0793a1f59b680e5cca6944f96278edf971e9d22",
"ref": "refs/heads/main"
}
}
}
[03:23:22.918] Invocation finished in 4h20m56.306916843s with status FAILED