[18:06:58.666] New invocation is queued and will start shortly
[18:06:59.823] Starting the invocation (attempt 1)
[18:06:59.848] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/61e8db21acd146444e8fb743d7337e9ab4943d86"
[18:06:59.848] Popped gitiles commit info from properties and tags
[18:06:59.848] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:06:59.848] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:06:59.848] Buildbucket request:
{
"requestId": "8885558159403780448",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61e8db21acd146444e8fb743d7337e9ab4943d86",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8885558159403780448"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:07:00.383] Scheduled build:
{
"id": "8720128097434185249",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10166,
"createdBy": "project:chromium",
"createTime": "2025-03-17T18:06:59.912726637Z",
"updateTime": "2025-03-17T18:06:59.912726637Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61e8db21acd146444e8fb743d7337e9ab4943d86",
"ref": "refs/heads/main"
}
}
}
[18:07:00.383] Task URL: https://cr-buildbucket.appspot.com/build/8720128097434185249
[18:07:00.383] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:2:0) after 2m45s
[18:07:01.427] Received PubSub notification, asking Buildbucket for the build status
[18:07:01.452] Build status: SCHEDULED
[18:07:13.448] Received PubSub notification, asking Buildbucket for the build status
[18:07:13.468] Build status: STARTED
[18:09:45.486] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:2:0)
[18:09:45.513] Build status: STARTED
[18:09:45.513] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:5:0) after 5m26s
[18:15:11.545] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:5:0)
[18:15:11.574] Build status: STARTED
[18:15:11.574] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:6:0) after 3m42s
[18:18:53.601] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:6:0)
[18:18:53.631] Build status: STARTED
[18:18:53.631] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:7:0) after 7m47s
[18:26:40.656] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:7:0)
[18:26:40.690] Build status: STARTED
[18:26:40.690] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:8:0) after 3m28s
[18:30:08.818] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:8:0)
[18:30:08.848] Build status: STARTED
[18:30:08.848] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:9:0) after 4m31s
[18:34:39.963] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:9:0)
[18:34:39.985] Build status: STARTED
[18:34:39.985] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:10:0) after 5m22s
[18:40:02.038] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:10:0)
[18:40:02.065] Build status: STARTED
[18:40:02.065] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:11:0) after 9m35s
[18:49:37.203] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:11:0)
[18:49:37.227] Build status: STARTED
[18:49:37.228] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:12:0) after 6m23s
[18:56:00.305] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:12:0)
[18:56:00.365] Build status: STARTED
[18:56:00.365] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:13:0) after 7m37s
[19:03:37.439] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:13:0)
[19:03:37.490] Build status: STARTED
[19:03:37.490] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:14:0) after 9m20s
[19:12:57.515] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:14:0)
[19:12:57.541] Build status: STARTED
[19:12:57.541] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:15:0) after 3m23s
[19:16:20.568] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:15:0)
[19:16:20.605] Build status: STARTED
[19:16:20.605] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:16:0) after 6m51s
[19:23:11.638] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:16:0)
[19:23:11.662] Build status: STARTED
[19:23:11.662] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:17:0) after 6m24s
[19:29:35.831] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:17:0)
[19:29:35.847] Build status: STARTED
[19:29:35.847] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:18:0) after 7m34s
[19:37:09.919] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:18:0)
[19:37:09.937] Build status: STARTED
[19:37:09.937] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:19:0) after 1m8s
[19:38:17.957] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:19:0)
[19:38:17.979] Build status: STARTED
[19:38:17.979] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:20:0) after 3m40s
[19:41:58.006] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:20:0)
[19:41:58.027] Build status: STARTED
[19:41:58.027] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:21:0) after 1m56s
[19:43:54.052] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:21:0)
[19:43:54.069] Build status: STARTED
[19:43:54.069] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:22:0) after 9m21s
[19:53:15.095] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:22:0)
[19:53:15.119] Build status: STARTED
[19:53:15.119] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:23:0) after 1m15s
[19:54:30.141] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:23:0)
[19:54:30.172] Build status: STARTED
[19:54:30.172] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:24:0) after 2m59s
[19:57:29.199] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:24:0)
[19:57:29.217] Build status: STARTED
[19:57:29.217] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:25:0) after 1m20s
[19:58:49.305] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:25:0)
[19:58:49.342] Build status: STARTED
[19:58:49.342] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:26:0) after 1m52s
[20:00:41.364] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:26:0)
[20:00:41.384] Build status: STARTED
[20:00:41.384] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:27:0) after 4m45s
[20:05:26.404] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:27:0)
[20:05:26.461] Build status: STARTED
[20:05:26.461] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:28:0) after 7m33s
[20:12:59.524] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:28:0)
[20:12:59.549] Build status: STARTED
[20:12:59.549] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:29:0) after 7m50s
[20:20:49.727] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:29:0)
[20:20:49.744] Build status: STARTED
[20:20:49.744] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:30:0) after 9m52s
[20:30:41.854] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:30:0)
[20:30:41.872] Build status: STARTED
[20:30:41.872] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:31:0) after 6m13s
[20:36:54.948] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:31:0)
[20:36:54.965] Build status: STARTED
[20:36:54.965] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:32:0) after 2m40s
[20:39:35.027] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:32:0)
[20:39:35.046] Build status: STARTED
[20:39:35.046] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:33:0) after 2m32s
[20:42:07.067] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:33:0)
[20:42:07.094] Build status: STARTED
[20:42:07.094] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:34:0) after 3m26s
[20:45:33.194] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:34:0)
[20:45:33.232] Build status: STARTED
[20:45:33.232] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:35:0) after 9m27s
[20:55:00.379] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:35:0)
[20:55:00.414] Build status: STARTED
[20:55:00.414] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:36:0) after 5m12s
[21:00:12.564] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:36:0)
[21:00:12.581] Build status: STARTED
[21:00:12.582] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:37:0) after 8m14s
[21:08:26.653] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:37:0)
[21:08:26.756] Build status: STARTED
[21:08:26.756] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:38:0) after 1m46s
[21:10:12.742] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:38:0)
[21:10:12.761] Build status: STARTED
[21:10:12.761] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:39:0) after 2m31s
[21:12:43.784] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:39:0)
[21:12:43.801] Build status: STARTED
[21:12:43.801] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:40:0) after 4m8s
[21:16:51.831] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:40:0)
[21:16:51.883] Build status: STARTED
[21:16:51.883] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:41:0) after 8m37s
[21:25:28.903] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:41:0)
[21:25:28.961] Build status: STARTED
[21:25:28.961] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:42:0) after 1m27s
[21:26:56.090] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:42:0)
[21:26:56.111] Build status: STARTED
[21:26:56.111] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:43:0) after 5m24s
[21:32:20.146] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:43:0)
[21:32:20.173] Build status: STARTED
[21:32:20.173] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:44:0) after 1m29s
[21:33:49.251] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:44:0)
[21:33:49.336] Build status: STARTED
[21:33:49.336] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:45:0) after 6m32s
[21:40:21.324] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:45:0)
[21:40:21.343] Build status: STARTED
[21:40:21.343] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:46:0) after 6m55s
[21:47:16.496] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:46:0)
[21:47:16.511] Build status: STARTED
[21:47:16.511] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:47:0) after 1m43s
[21:48:59.531] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:47:0)
[21:48:59.555] Build status: STARTED
[21:48:59.555] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:48:0) after 6m40s
[21:55:39.582] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:48:0)
[21:55:39.606] Build status: STARTED
[21:55:39.606] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:49:0) after 1m47s
[21:57:26.782] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:49:0)
[21:57:26.820] Build status: STARTED
[21:57:26.821] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:50:0) after 9m7s
[22:06:33.944] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:50:0)
[22:06:33.962] Build status: STARTED
[22:06:33.962] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:51:0) after 5m33s
[22:12:06.987] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:51:0)
[22:12:07.014] Build status: STARTED
[22:12:07.014] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:52:0) after 8m33s
[22:20:40.091] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:52:0)
[22:20:40.106] Build status: STARTED
[22:20:40.106] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8885558159403780448:53:0) after 9m33s
[22:25:09.450] Received PubSub notification, asking Buildbucket for the build status
[22:25:09.465] Build:
{
"id": "8720128097434185249",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 10166,
"createdBy": "project:chromium",
"createTime": "2025-03-17T18:06:59.912726637Z",
"startTime": "2025-03-17T18:07:13.244846120Z",
"endTime": "2025-03-17T22:25:09.082084621Z",
"updateTime": "2025-03-17T22:25:09.082084621Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "61e8db21acd146444e8fb743d7337e9ab4943d86",
"ref": "refs/heads/main"
}
}
}
[22:25:09.465] Invocation finished in 4h18m10.814870481s with status FAILED