[08:42:58.330] New invocation is queued and will start shortly
[08:42:59.398] Starting the invocation (attempt 1)
[08:42:59.419] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/08b5aad019d3196d7080c0708c728e2efd7bf62a"
[08:42:59.420] Popped gitiles commit info from properties and tags
[08:42:59.420] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:42:59.420] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:42:59.420] Buildbucket request:
{
"requestId": "8885865434462299376",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "08b5aad019d3196d7080c0708c728e2efd7bf62a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885865434462299376"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:42:59.908] Scheduled build:
{
"id": "8720435372613693809",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10055,
"createdBy": "project:chromium",
"createTime": "2025-03-14T08:42:59.465820853Z",
"updateTime": "2025-03-14T08:42:59.465820853Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "08b5aad019d3196d7080c0708c728e2efd7bf62a",
"ref": "refs/heads/main"
}
}
}
[08:42:59.908] Task URL: https://cr-buildbucket.appspot.com/build/8720435372613693809
[08:42:59.908] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:2:0) after 8m29s
[08:43:03.659] Received PubSub notification, asking Buildbucket for the build status
[08:43:03.745] Build status: SCHEDULED
[08:44:01.014] Received PubSub notification, asking Buildbucket for the build status
[08:44:01.043] Build status: STARTED
[08:51:28.918] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:2:0)
[08:51:28.958] Build status: STARTED
[08:51:28.958] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:5:0) after 5m10s
[08:56:39.030] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:5:0)
[08:56:39.055] Build status: STARTED
[08:56:39.055] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:6:0) after 1m18s
[08:57:57.734] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:6:0)
[08:57:57.756] Build status: STARTED
[08:57:57.756] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:7:0) after 7m48s
[09:05:45.814] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:7:0)
[09:05:45.832] Build status: STARTED
[09:05:45.832] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:8:0) after 1m8s
[09:06:53.850] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:8:0)
[09:06:53.953] Build status: STARTED
[09:06:53.953] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:9:0) after 9m1s
[09:15:55.117] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:9:0)
[09:15:55.147] Build status: STARTED
[09:15:55.147] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:10:0) after 6m6s
[09:22:01.173] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:10:0)
[09:22:01.213] Build status: STARTED
[09:22:01.213] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:11:0) after 3m10s
[09:25:11.385] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:11:0)
[09:25:11.419] Build status: STARTED
[09:25:11.419] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:12:0) after 8m50s
[09:34:01.526] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:12:0)
[09:34:01.566] Build status: STARTED
[09:34:01.566] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:13:0) after 7m36s
[09:41:37.605] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:13:0)
[09:41:38.634] Build status: STARTED
[09:41:38.634] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:14:0) after 6m54s
[09:48:32.807] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:14:0)
[09:48:32.833] Build status: STARTED
[09:48:32.833] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:15:0) after 5m31s
[09:54:03.851] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:15:0)
[09:54:03.881] Build status: STARTED
[09:54:03.881] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:16:0) after 4m14s
[09:58:18.554] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:16:0)
[09:58:18.602] Build status: STARTED
[09:58:18.602] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:17:0) after 3m33s
[10:01:52.607] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:17:0)
[10:01:52.637] Build status: STARTED
[10:01:52.637] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:18:0) after 6m18s
[10:08:10.780] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:18:0)
[10:08:10.803] Build status: STARTED
[10:08:10.803] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:19:0) after 9m46s
[10:17:56.930] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:19:0)
[10:17:56.948] Build status: STARTED
[10:17:56.948] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:20:0) after 2m7s
[10:20:04.095] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:20:0)
[10:20:04.138] Build status: STARTED
[10:20:04.138] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:21:0) after 5m4s
[10:25:08.228] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:21:0)
[10:25:08.242] Build status: STARTED
[10:25:08.242] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:22:0) after 8m58s
[10:34:06.454] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:22:0)
[10:34:06.478] Build status: STARTED
[10:34:06.478] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:23:0) after 9m35s
[10:43:41.583] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:23:0)
[10:43:41.600] Build status: STARTED
[10:43:41.600] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:24:0) after 1m29s
[10:45:10.616] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:24:0)
[10:45:10.631] Build status: STARTED
[10:45:10.631] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:25:0) after 8m16s
[10:53:27.030] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:25:0)
[10:53:27.048] Build status: STARTED
[10:53:27.048] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:26:0) after 4m13s
[10:57:40.386] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:26:0)
[10:57:40.402] Build status: STARTED
[10:57:40.402] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:27:0) after 2m56s
[11:00:37.178] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:27:0)
[11:00:37.197] Build status: STARTED
[11:00:37.197] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:28:0) after 6m55s
[11:07:32.328] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:28:0)
[11:07:32.348] Build status: STARTED
[11:07:32.348] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:29:0) after 6m29s
[11:14:01.384] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:29:0)
[11:14:01.404] Build status: STARTED
[11:14:01.404] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:30:0) after 5m24s
[11:19:25.847] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:30:0)
[11:19:25.863] Build status: STARTED
[11:19:25.863] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:31:0) after 4m9s
[11:23:34.884] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:31:0)
[11:23:34.915] Build status: STARTED
[11:23:34.915] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:32:0) after 8m15s
[11:31:49.895] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:32:0)
[11:31:49.953] Build status: STARTED
[11:31:49.953] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:33:0) after 3m17s
[11:35:07.184] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:33:0)
[11:35:07.231] Build status: STARTED
[11:35:07.231] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:34:0) after 6m25s
[11:41:32.256] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:34:0)
[11:41:32.289] Build status: STARTED
[11:41:32.289] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:35:0) after 3m17s
[11:44:49.611] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:35:0)
[11:44:49.639] Build status: STARTED
[11:44:49.639] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:36:0) after 3m59s
[11:48:48.657] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:36:0)
[11:48:48.672] Build status: STARTED
[11:48:48.672] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:37:0) after 8m36s
[11:57:24.699] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:37:0)
[11:57:24.716] Build status: STARTED
[11:57:24.716] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:38:0) after 4m58s
[12:02:23.153] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:38:0)
[12:02:23.174] Build status: STARTED
[12:02:23.174] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:39:0) after 7m10s
[12:09:33.645] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:39:0)
[12:09:33.663] Build status: STARTED
[12:09:33.663] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:40:0) after 1m41s
[12:11:14.687] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:40:0)
[12:11:14.713] Build status: STARTED
[12:11:14.713] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:41:0) after 9m10s
[12:20:25.366] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:41:0)
[12:20:25.386] Build status: STARTED
[12:20:25.386] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:42:0) after 3m18s
[12:23:44.518] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:42:0)
[12:23:44.550] Build status: STARTED
[12:23:44.550] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:43:0) after 3m45s
[12:27:29.578] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:43:0)
[12:27:29.600] Build status: STARTED
[12:27:29.600] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:44:0) after 3m5s
[12:30:34.735] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:44:0)
[12:30:34.762] Build status: STARTED
[12:30:34.762] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:45:0) after 2m37s
[12:33:11.770] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:45:0)
[12:33:11.794] Build status: STARTED
[12:33:11.794] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:46:0) after 1m45s
[12:34:56.831] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:46:0)
[12:34:56.852] Build status: STARTED
[12:34:56.852] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:47:0) after 1m47s
[12:36:43.907] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:47:0)
[12:36:43.924] Build status: STARTED
[12:36:43.924] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:48:0) after 9m46s
[12:46:30.042] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:48:0)
[12:46:30.081] Build status: STARTED
[12:46:30.081] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:49:0) after 2m56s
[12:49:26.150] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:49:0)
[12:49:26.171] Build status: STARTED
[12:49:26.171] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:50:0) after 2m59s
[12:52:25.186] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:50:0)
[12:52:25.251] Build status: STARTED
[12:52:25.251] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:51:0) after 2m0s
[12:54:25.301] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:51:0)
[12:54:25.319] Build status: STARTED
[12:54:25.319] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:52:0) after 9m18s
[13:03:43.344] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:52:0)
[13:03:43.363] Build status: STARTED
[13:03:43.363] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:53:0) after 5m30s
[13:09:13.349] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:53:0)
[13:09:13.374] Build status: STARTED
[13:09:13.374] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:54:0) after 3m37s
[13:12:50.387] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:54:0)
[13:12:50.419] Build status: STARTED
[13:12:50.419] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:55:0) after 2m45s
[13:15:35.852] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:55:0)
[13:15:35.871] Build status: STARTED
[13:15:35.871] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885865434462299376:56:0) after 5m21s
[13:20:45.560] Received PubSub notification, asking Buildbucket for the build status
[13:20:45.585] Build:
{
"id": "8720435372613693809",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10055,
"createdBy": "project:chromium",
"createTime": "2025-03-14T08:42:59.465820853Z",
"startTime": "2025-03-14T08:44:00.773320590Z",
"endTime": "2025-03-14T13:20:45.266991012Z",
"updateTime": "2025-03-14T13:20:45.266991012Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "08b5aad019d3196d7080c0708c728e2efd7bf62a",
"ref": "refs/heads/main"
}
}
}
[13:20:45.585] Invocation finished in 4h37m47.265969536s with status FAILED