[20:34:58.606] New invocation is queued and will start shortly
[20:35:00.876] Starting the invocation (attempt 1)
[20:35:00.906] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/323c4f7833de12d9013203730e01e355fff5daf2"
[20:35:00.906] Popped gitiles commit info from properties and tags
[20:35:00.906] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:35:00.909] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:35:00.910] Buildbucket request:
{
"requestId": "8891890635756630976",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "323c4f7833de12d9013203730e01e355fff5daf2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8891890635756630976"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:35:01.454] Scheduled build:
{
"id": "8726460572620178593",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 8678,
"createdBy": "project:chromium",
"createTime": "2025-01-06T20:35:00.968261337Z",
"updateTime": "2025-01-06T20:35:00.968261337Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "323c4f7833de12d9013203730e01e355fff5daf2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[20:35:01.454] Task URL: https://cr-buildbucket.appspot.com/build/8726460572620178593
[20:35:01.454] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:2:0) after 5m37s
[20:35:02.528] Received PubSub notification, asking Buildbucket for the build status
[20:35:02.553] Build status: SCHEDULED
[20:36:27.456] Received PubSub notification, asking Buildbucket for the build status
[20:36:27.536] Build status: STARTED
[20:40:38.472] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:2:0)
[20:40:38.504] Build status: STARTED
[20:40:38.504] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:5:0) after 3m41s
[20:44:19.772] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:5:0)
[20:44:19.881] Build status: STARTED
[20:44:19.881] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:6:0) after 6m4s
[20:50:23.954] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:6:0)
[20:50:23.972] Build status: STARTED
[20:50:23.972] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:7:0) after 3m42s
[20:54:05.993] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:7:0)
[20:54:06.021] Build status: STARTED
[20:54:06.021] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:8:0) after 7m25s
[21:01:31.046] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:8:0)
[21:01:31.066] Build status: STARTED
[21:01:31.066] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:9:0) after 3m30s
[21:05:01.223] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:9:0)
[21:05:01.260] Build status: STARTED
[21:05:01.260] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:10:0) after 8m30s
[21:13:31.410] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:10:0)
[21:13:31.479] Build status: STARTED
[21:13:31.480] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:11:0) after 8m14s
[21:21:45.500] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:11:0)
[21:21:45.607] Build status: STARTED
[21:21:45.607] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:12:0) after 6m11s
[21:27:56.657] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:12:0)
[21:27:56.685] Build status: STARTED
[21:27:56.685] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:13:0) after 8m10s
[21:36:06.728] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:13:0)
[21:36:06.750] Build status: STARTED
[21:36:06.750] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:14:0) after 7m40s
[21:43:46.922] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:14:0)
[21:43:46.938] Build status: STARTED
[21:43:46.938] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:15:0) after 3m47s
[21:47:34.022] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:15:0)
[21:47:34.050] Build status: STARTED
[21:47:34.050] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:16:0) after 9m54s
[21:57:28.133] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:16:0)
[21:57:28.151] Build status: STARTED
[21:57:28.151] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:17:0) after 7m32s
[22:05:00.132] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:17:0)
[22:05:00.152] Build status: STARTED
[22:05:00.152] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:18:0) after 7m2s
[22:12:02.239] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:18:0)
[22:12:02.270] Build status: STARTED
[22:12:02.270] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:19:0) after 1m17s
[22:13:19.287] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:19:0)
[22:13:19.307] Build status: STARTED
[22:13:19.307] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:20:0) after 8m11s
[22:21:30.522] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:20:0)
[22:21:30.537] Build status: STARTED
[22:21:30.537] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:21:0) after 1m30s
[22:23:00.554] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:21:0)
[22:23:00.579] Build status: STARTED
[22:23:00.579] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:22:0) after 2m15s
[22:25:15.609] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:22:0)
[22:25:15.630] Build status: STARTED
[22:25:15.630] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:23:0) after 1m38s
[22:26:53.691] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:23:0)
[22:26:53.771] Build status: STARTED
[22:26:53.771] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:24:0) after 4m3s
[22:30:56.800] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:24:0)
[22:30:56.831] Build status: STARTED
[22:30:56.831] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:25:0) after 2m36s
[22:33:32.925] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:25:0)
[22:33:32.971] Build status: STARTED
[22:33:32.971] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:26:0) after 4m9s
[22:37:42.002] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:26:0)
[22:37:42.021] Build status: STARTED
[22:37:42.021] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:27:0) after 9m39s
[22:47:21.096] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:27:0)
[22:47:21.115] Build status: STARTED
[22:47:21.115] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:28:0) after 9m48s
[22:57:09.176] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:28:0)
[22:57:09.196] Build status: STARTED
[22:57:09.196] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:29:0) after 1m40s
[22:58:49.276] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:29:0)
[22:58:49.489] Build status: STARTED
[22:58:49.489] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:30:0) after 3m16s
[23:02:05.526] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:30:0)
[23:02:05.544] Build status: STARTED
[23:02:05.544] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:31:0) after 1m58s
[23:04:03.567] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:31:0)
[23:04:03.589] Build status: STARTED
[23:04:03.589] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:32:0) after 5m44s
[23:09:47.685] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:32:0)
[23:09:47.747] Build status: STARTED
[23:09:47.747] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:33:0) after 5m11s
[23:14:58.782] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:33:0)
[23:14:58.801] Build status: STARTED
[23:14:58.801] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:34:0) after 9m51s
[23:24:49.872] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:34:0)
[23:24:49.900] Build status: STARTED
[23:24:49.900] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:35:0) after 4m59s
[23:29:48.986] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:35:0)
[23:29:49.011] Build status: STARTED
[23:29:49.011] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:36:0) after 5m52s
[23:35:41.092] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:36:0)
[23:35:41.117] Build status: STARTED
[23:35:41.117] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:37:0) after 3m0s
[23:38:41.191] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:37:0)
[23:38:41.211] Build status: STARTED
[23:38:41.212] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:38:0) after 7m39s
[23:46:20.258] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:38:0)
[23:46:20.337] Build status: STARTED
[23:46:20.337] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:39:0) after 3m37s
[23:49:57.452] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:39:0)
[23:49:57.495] Build status: STARTED
[23:49:57.495] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:40:0) after 1m47s
[23:51:44.523] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:40:0)
[23:51:44.555] Build status: STARTED
[23:51:44.555] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:41:0) after 2m31s
[23:54:15.645] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:41:0)
[23:54:15.666] Build status: STARTED
[23:54:15.666] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:42:0) after 1m1s
[23:55:16.722] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:42:0)
[23:55:16.743] Build status: STARTED
[23:55:16.743] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:43:0) after 1m7s
[23:56:23.739] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:43:0)
[23:56:23.767] Build status: STARTED
[23:56:23.767] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:44:0) after 8m7s
[00:04:31.244] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:44:0)
[00:04:31.264] Build status: STARTED
[00:04:31.264] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:45:0) after 5m33s
[00:10:04.536] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:45:0)
[00:10:04.558] Build status: STARTED
[00:10:04.558] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:46:0) after 2m12s
[00:12:16.591] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:46:0)
[00:12:16.620] Build status: STARTED
[00:12:16.620] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:47:0) after 1m8s
[00:13:24.675] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:47:0)
[00:13:24.696] Build status: STARTED
[00:13:24.696] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:48:0) after 6m26s
[00:19:50.778] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:48:0)
[00:19:50.799] Build status: STARTED
[00:19:50.799] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:49:0) after 2m13s
[00:22:03.824] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:49:0)
[00:22:03.845] Build status: STARTED
[00:22:03.845] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:50:0) after 4m55s
[00:26:58.950] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:50:0)
[00:26:58.966] Build status: STARTED
[00:26:58.966] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:51:0) after 6m9s
[00:33:07.990] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:51:0)
[00:33:08.021] Build status: STARTED
[00:33:08.021] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:52:0) after 8m32s
[00:41:40.047] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:52:0)
[00:41:40.105] Build status: STARTED
[00:41:40.105] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:53:0) after 1m14s
[00:42:54.139] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:53:0)
[00:42:54.157] Build status: STARTED
[00:42:54.157] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:54:0) after 2m0s
[00:44:54.190] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:54:0)
[00:44:54.508] Build status: STARTED
[00:44:54.508] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:55:0) after 5m6s
[00:50:00.641] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:55:0)
[00:50:00.679] Build status: STARTED
[00:50:00.679] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8891890635756630976:56:0) after 7m3s
[00:56:19.323] Received PubSub notification, asking Buildbucket for the build status
[00:56:19.342] Build:
{
"id": "8726460572620178593",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 8678,
"createdBy": "project:chromium",
"createTime": "2025-01-06T20:35:00.968261337Z",
"startTime": "2025-01-06T20:36:27.204259865Z",
"endTime": "2025-01-07T00:56:18.753684832Z",
"updateTime": "2025-01-07T00:56:18.753684832Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "323c4f7833de12d9013203730e01e355fff5daf2",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:56:19.342] Invocation finished in 4h21m20.749118821s with status FAILED