[00:38:38.465] New invocation is queued and will start shortly
[00:38:39.579] Starting the invocation (attempt 1)
[00:38:39.617] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a552da9525c0a85700668f0d277ef549569d602d"
[00:38:39.617] Popped gitiles commit info from properties and tags
[00:38:39.617] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:38:39.618] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:38:39.618] Buildbucket request:
{
"requestId": "8887345457402673552",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a552da9525c0a85700668f0d277ef549569d602d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887345457402673552"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:38:40.256] Scheduled build:
{
"id": "8721915395468119569",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9765,
"createdBy": "project:chromium",
"createTime": "2025-02-26T00:38:39.681253175Z",
"updateTime": "2025-02-26T00:38:39.681253175Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a552da9525c0a85700668f0d277ef549569d602d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:38:40.256] Task URL: https://cr-buildbucket.appspot.com/build/8721915395468119569
[00:38:40.256] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:2:0) after 9m49s
[00:39:18.295] Received PubSub notification, asking Buildbucket for the build status
[00:39:18.326] Build status: STARTED
[00:39:22.854] Received PubSub notification, asking Buildbucket for the build status
[00:39:22.885] Build status: STARTED
[00:48:29.404] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:2:0)
[00:48:29.452] Build status: STARTED
[00:48:29.452] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:5:0) after 8m32s
[00:57:01.505] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:5:0)
[00:57:01.526] Build status: STARTED
[00:57:01.526] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:6:0) after 9m25s
[01:06:26.582] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:6:0)
[01:06:26.606] Build status: STARTED
[01:06:26.606] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:7:0) after 4m41s
[01:11:07.591] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:7:0)
[01:11:07.619] Build status: STARTED
[01:11:07.619] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:8:0) after 4m51s
[01:15:58.650] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:8:0)
[01:15:58.691] Build status: STARTED
[01:15:58.691] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:9:0) after 5m58s
[01:21:56.695] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:9:0)
[01:21:56.716] Build status: STARTED
[01:21:56.716] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:10:0) after 3m45s
[01:25:41.764] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:10:0)
[01:25:41.825] Build status: STARTED
[01:25:41.826] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:11:0) after 2m2s
[01:27:43.850] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:11:0)
[01:27:43.870] Build status: STARTED
[01:27:43.870] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:12:0) after 8m54s
[01:36:38.003] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:12:0)
[01:36:38.050] Build status: STARTED
[01:36:38.050] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:13:0) after 9m33s
[01:46:11.170] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:13:0)
[01:46:11.192] Build status: STARTED
[01:46:11.192] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:14:0) after 9m3s
[01:55:14.219] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:14:0)
[01:55:14.242] Build status: STARTED
[01:55:14.242] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:15:0) after 1m37s
[01:56:51.266] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:15:0)
[01:56:51.297] Build status: STARTED
[01:56:51.297] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:16:0) after 4m22s
[02:01:13.486] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:16:0)
[02:01:13.507] Build status: STARTED
[02:01:13.507] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:17:0) after 6m42s
[02:07:55.579] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:17:0)
[02:07:55.597] Build status: STARTED
[02:07:55.597] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:18:0) after 2m13s
[02:10:08.623] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:18:0)
[02:10:08.671] Build status: STARTED
[02:10:08.671] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:19:0) after 5m34s
[02:15:42.701] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:19:0)
[02:15:42.777] Build status: STARTED
[02:15:42.777] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:20:0) after 2m15s
[02:17:57.804] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:20:0)
[02:17:57.833] Build status: STARTED
[02:17:57.833] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:21:0) after 9m5s
[02:27:02.862] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:21:0)
[02:27:02.906] Build status: STARTED
[02:27:02.906] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:22:0) after 8m34s
[02:35:36.986] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:22:0)
[02:35:37.011] Build status: STARTED
[02:35:37.011] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:23:0) after 5m52s
[02:41:29.101] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:23:0)
[02:41:29.133] Build status: STARTED
[02:41:29.133] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:24:0) after 7m5s
[02:48:34.157] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:24:0)
[02:48:34.176] Build status: STARTED
[02:48:34.176] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:25:0) after 9m43s
[02:58:17.204] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:25:0)
[02:58:17.230] Build status: STARTED
[02:58:17.230] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:26:0) after 6m6s
[03:04:23.217] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:26:0)
[03:04:23.326] Build status: STARTED
[03:04:23.326] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:27:0) after 3m43s
[03:08:06.356] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:27:0)
[03:08:06.375] Build status: STARTED
[03:08:06.375] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:28:0) after 9m27s
[03:17:33.403] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:28:0)
[03:17:33.479] Build status: STARTED
[03:17:33.479] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:29:0) after 8m5s
[03:25:38.697] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:29:0)
[03:25:38.711] Build status: STARTED
[03:25:38.711] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:30:0) after 5m32s
[03:31:10.737] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:30:0)
[03:31:10.846] Build status: STARTED
[03:31:10.846] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:31:0) after 9m31s
[03:40:41.926] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:31:0)
[03:40:41.942] Build status: STARTED
[03:40:41.942] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:32:0) after 3m23s
[03:44:04.964] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:32:0)
[03:44:05.113] Build status: STARTED
[03:44:05.113] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:33:0) after 5m31s
[03:49:36.159] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:33:0)
[03:49:36.189] Build status: STARTED
[03:49:36.189] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:34:0) after 4m28s
[03:54:04.209] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:34:0)
[03:54:04.229] Build status: STARTED
[03:54:04.229] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:35:0) after 5m13s
[03:59:17.408] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:35:0)
[03:59:17.429] Build status: STARTED
[03:59:17.429] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:36:0) after 2m25s
[04:01:42.456] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:36:0)
[04:01:42.491] Build status: STARTED
[04:01:42.491] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:37:0) after 3m22s
[04:05:04.772] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:37:0)
[04:05:04.799] Build status: STARTED
[04:05:04.800] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:38:0) after 6m46s
[04:11:50.984] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:38:0)
[04:11:51.009] Build status: STARTED
[04:11:51.009] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:39:0) after 1m46s
[04:13:37.515] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:39:0)
[04:13:37.537] Build status: STARTED
[04:13:37.537] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:40:0) after 5m46s
[04:19:23.648] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:40:0)
[04:19:23.669] Build status: STARTED
[04:19:23.669] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:41:0) after 5m19s
[04:24:42.830] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:41:0)
[04:24:42.858] Build status: STARTED
[04:24:42.858] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:42:0) after 5m27s
[04:30:10.228] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:42:0)
[04:30:10.242] Build status: STARTED
[04:30:10.242] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:43:0) after 8m30s
[04:38:40.266] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:43:0)
[04:38:40.285] Build status: STARTED
[04:38:40.285] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:44:0) after 8m10s
[04:46:50.397] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:44:0)
[04:46:50.410] Build status: STARTED
[04:46:50.410] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:45:0) after 5m50s
[04:52:40.494] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:45:0)
[04:52:40.536] Build status: STARTED
[04:52:40.536] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:46:0) after 4m49s
[04:57:29.543] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:46:0)
[04:57:29.563] Build status: STARTED
[04:57:29.564] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:47:0) after 9m14s
[05:06:43.821] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:47:0)
[05:06:43.840] Build status: STARTED
[05:06:43.840] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:48:0) after 3m50s
[05:10:33.885] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:48:0)
[05:10:33.908] Build status: STARTED
[05:10:33.908] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8887345457402673552:49:0) after 8m15s
[05:12:19.136] Received PubSub notification, asking Buildbucket for the build status
[05:12:19.159] Build:
{
"id": "8721915395468119569",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9765,
"createdBy": "project:chromium",
"createTime": "2025-02-26T00:38:39.681253175Z",
"startTime": "2025-02-26T00:38:46.131469775Z",
"endTime": "2025-02-26T05:12:18.852005031Z",
"updateTime": "2025-02-26T05:12:18.852005031Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a552da9525c0a85700668f0d277ef549569d602d",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:12:19.159] Invocation finished in 4h33m40.706085717s with status FAILED