[17:10:30.287] New invocation is queued and will start shortly
[17:10:31.336] Starting the invocation (attempt 1)
[17:10:31.377] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/04dcea85f67d1f03b59b99b3c283485b9b422c5f"
[17:10:31.377] Popped gitiles commit info from properties and tags
[17:10:31.377] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:10:31.378] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:10:31.378] Buildbucket request:
{
"requestId": "8887464248660879552",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "04dcea85f67d1f03b59b99b3c283485b9b422c5f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887464248660879552"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:10:31.987] Scheduled build:
{
"id": "8722034186800766689",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9757,
"createdBy": "project:chromium",
"createTime": "2025-02-24T17:10:31.438376552Z",
"updateTime": "2025-02-24T17:10:31.438376552Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "04dcea85f67d1f03b59b99b3c283485b9b422c5f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[17:10:31.987] Task URL: https://cr-buildbucket.appspot.com/build/8722034186800766689
[17:10:31.987] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:2:0) after 1m43s
[17:10:32.995] Received PubSub notification, asking Buildbucket for the build status
[17:10:33.017] Build status: SCHEDULED
[17:11:39.889] Received PubSub notification, asking Buildbucket for the build status
[17:11:39.915] Build status: STARTED
[17:12:14.993] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:2:0)
[17:12:15.032] Build status: STARTED
[17:12:15.032] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:5:0) after 8m1s
[17:20:16.159] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:5:0)
[17:20:16.182] Build status: STARTED
[17:20:16.182] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:6:0) after 5m47s
[17:26:03.232] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:6:0)
[17:26:03.258] Build status: STARTED
[17:26:03.258] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:7:0) after 1m7s
[17:27:10.330] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:7:0)
[17:27:10.344] Build status: STARTED
[17:27:10.344] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:8:0) after 2m16s
[17:29:26.363] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:8:0)
[17:29:26.382] Build status: STARTED
[17:29:26.382] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:9:0) after 9m36s
[17:39:02.454] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:9:0)
[17:39:02.475] Build status: STARTED
[17:39:02.475] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:10:0) after 2m59s
[17:42:01.515] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:10:0)
[17:42:01.533] Build status: STARTED
[17:42:01.533] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:11:0) after 7m34s
[17:49:35.666] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:11:0)
[17:49:35.687] Build status: STARTED
[17:49:35.687] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:12:0) after 9m48s
[17:59:23.714] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:12:0)
[17:59:23.734] Build status: STARTED
[17:59:23.734] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:13:0) after 7m6s
[18:06:29.800] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:13:0)
[18:06:29.833] Build status: STARTED
[18:06:29.833] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:14:0) after 1m12s
[18:07:41.905] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:14:0)
[18:07:41.922] Build status: STARTED
[18:07:41.922] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:15:0) after 9m29s
[18:17:10.943] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:15:0)
[18:17:10.965] Build status: STARTED
[18:17:10.965] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:16:0) after 6m4s
[18:23:15.111] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:16:0)
[18:23:15.135] Build status: STARTED
[18:23:15.135] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:17:0) after 6m53s
[18:30:08.255] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:17:0)
[18:30:08.293] Build status: STARTED
[18:30:08.293] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:18:0) after 7m18s
[18:37:26.317] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:18:0)
[18:37:26.331] Build status: STARTED
[18:37:26.331] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:19:0) after 7m15s
[18:44:41.354] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:19:0)
[18:44:41.373] Build status: STARTED
[18:44:41.373] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:20:0) after 1m56s
[18:46:37.446] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:20:0)
[18:46:37.468] Build status: STARTED
[18:46:37.468] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:21:0) after 5m24s
[18:52:01.513] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:21:0)
[18:52:01.533] Build status: STARTED
[18:52:01.533] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:22:0) after 2m11s
[18:54:12.512] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:22:0)
[18:54:12.529] Build status: STARTED
[18:54:12.529] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:23:0) after 2m37s
[18:56:49.555] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:23:0)
[18:56:49.572] Build status: STARTED
[18:56:49.572] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:24:0) after 7m13s
[19:04:02.685] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:24:0)
[19:04:02.822] Build status: STARTED
[19:04:02.822] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:25:0) after 7m27s
[19:11:29.985] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:25:0)
[19:11:30.063] Build status: STARTED
[19:11:30.063] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:26:0) after 6m53s
[19:18:23.084] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:26:0)
[19:18:23.127] Build status: STARTED
[19:18:23.127] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:27:0) after 5m41s
[19:24:04.367] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:27:0)
[19:24:04.468] Build status: STARTED
[19:24:04.468] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:28:0) after 6m36s
[19:30:40.529] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:28:0)
[19:30:40.543] Build status: STARTED
[19:30:40.543] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:29:0) after 3m31s
[19:34:11.622] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:29:0)
[19:34:11.642] Build status: STARTED
[19:34:11.642] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:30:0) after 3m48s
[19:37:59.759] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:30:0)
[19:37:59.776] Build status: STARTED
[19:37:59.776] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:31:0) after 8m59s
[19:46:58.839] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:31:0)
[19:46:58.857] Build status: STARTED
[19:46:58.857] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:32:0) after 7m20s
[19:54:18.866] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:32:0)
[19:54:18.882] Build status: STARTED
[19:54:18.882] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:33:0) after 3m8s
[19:57:26.944] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:33:0)
[19:57:26.983] Build status: STARTED
[19:57:26.983] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:34:0) after 3m53s
[20:01:19.972] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:34:0)
[20:01:19.992] Build status: STARTED
[20:01:19.992] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:35:0) after 1m39s
[20:02:59.070] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:35:0)
[20:02:59.094] Build status: STARTED
[20:02:59.094] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:36:0) after 1m40s
[20:04:39.116] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:36:0)
[20:04:39.139] Build status: STARTED
[20:04:39.140] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:37:0) after 2m34s
[20:07:13.219] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:37:0)
[20:07:13.240] Build status: STARTED
[20:07:13.240] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:38:0) after 5m10s
[20:12:23.367] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:38:0)
[20:12:23.386] Build status: STARTED
[20:12:23.386] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:39:0) after 5m45s
[20:18:08.494] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:39:0)
[20:18:08.510] Build status: STARTED
[20:18:08.510] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:40:0) after 6m48s
[20:24:56.623] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:40:0)
[20:24:56.639] Build status: STARTED
[20:24:56.639] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:41:0) after 6m48s
[20:31:44.663] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:41:0)
[20:31:44.857] Build status: STARTED
[20:31:44.857] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:42:0) after 9m59s
[20:41:43.880] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:42:0)
[20:41:43.897] Build status: STARTED
[20:41:43.897] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:43:0) after 6m2s
[20:47:45.919] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:43:0)
[20:47:45.942] Build status: STARTED
[20:47:45.942] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:44:0) after 1m6s
[20:48:51.966] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:44:0)
[20:48:51.981] Build status: STARTED
[20:48:51.981] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:45:0) after 1m42s
[20:50:34.079] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:45:0)
[20:50:34.104] Build status: STARTED
[20:50:34.104] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:46:0) after 3m40s
[20:54:14.119] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:46:0)
[20:54:14.144] Build status: STARTED
[20:54:14.144] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:47:0) after 8m4s
[21:02:18.168] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:47:0)
[21:02:18.211] Build status: STARTED
[21:02:18.212] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:48:0) after 8m29s
[21:10:47.306] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:48:0)
[21:10:47.324] Build status: STARTED
[21:10:47.324] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:49:0) after 5m21s
[21:16:08.343] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:49:0)
[21:16:08.361] Build status: STARTED
[21:16:08.361] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:50:0) after 7m41s
[21:23:49.446] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:50:0)
[21:23:49.465] Build status: STARTED
[21:23:49.465] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:51:0) after 3m54s
[21:27:43.485] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:51:0)
[21:27:43.583] Build status: STARTED
[21:27:43.583] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887464248660879552:52:0) after 8m42s
[21:34:08.168] Received PubSub notification, asking Buildbucket for the build status
[21:34:08.185] Build:
{
"id": "8722034186800766689",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9757,
"createdBy": "project:chromium",
"createTime": "2025-02-24T17:10:31.438376552Z",
"startTime": "2025-02-24T17:11:39.538040980Z",
"endTime": "2025-02-24T21:34:05.324207079Z",
"updateTime": "2025-02-24T21:34:05.324207079Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "04dcea85f67d1f03b59b99b3c283485b9b422c5f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:34:08.185] Invocation finished in 4h23m37.90454324s with status FAILED