[02:18:10.999] New invocation is queued and will start shortly
[02:18:12.043] Starting the invocation (attempt 1)
[02:18:12.072] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2c16ea6db0416ee1358845cbb04134da5dee6ef2"
[02:18:12.072] Popped gitiles commit info from properties and tags
[02:18:12.072] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:18:12.072] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:18:12.072] Buildbucket request:
{
"requestId": "8886795612944796240",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2c16ea6db0416ee1358845cbb04134da5dee6ef2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886795612944796240"
},
{
"key": "scheduler_job_id",
"value": "chromium/Linux Builder (canonical wd) (reclient compare)"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:18:12.657] Scheduled build:
{
"id": "8721365551071981761",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9848,
"createdBy": "project:chromium",
"createTime": "2025-03-04T02:18:12.160777327Z",
"updateTime": "2025-03-04T02:18:12.160777327Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2c16ea6db0416ee1358845cbb04134da5dee6ef2",
"ref": "refs/heads/main"
}
}
}
[02:18:12.658] Task URL: https://cr-buildbucket.appspot.com/build/8721365551071981761
[02:18:12.658] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:2:0) after 6m46s
[02:18:13.618] Received PubSub notification, asking Buildbucket for the build status
[02:18:13.640] Build status: SCHEDULED
[02:19:11.153] Received PubSub notification, asking Buildbucket for the build status
[02:19:11.238] Build status: STARTED
[02:24:58.707] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:2:0)
[02:24:58.732] Build status: STARTED
[02:24:58.732] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:5:0) after 1m49s
[02:26:48.116] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:5:0)
[02:26:48.134] Build status: STARTED
[02:26:48.135] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:6:0) after 6m30s
[02:33:18.790] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:6:0)
[02:33:18.835] Build status: STARTED
[02:33:18.835] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:7:0) after 1m42s
[02:35:01.069] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:7:0)
[02:35:01.096] Build status: STARTED
[02:35:01.096] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:8:0) after 1m26s
[02:36:27.503] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:8:0)
[02:36:27.538] Build status: STARTED
[02:36:27.538] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:9:0) after 6m45s
[02:43:12.571] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:9:0)
[02:43:12.596] Build status: STARTED
[02:43:12.597] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:10:0) after 4m10s
[02:47:22.952] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:10:0)
[02:47:22.973] Build status: STARTED
[02:47:22.973] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:11:0) after 5m44s
[02:53:07.627] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:11:0)
[02:53:07.648] Build status: STARTED
[02:53:07.648] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:12:0) after 2m22s
[02:55:29.667] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:12:0)
[02:55:29.680] Build status: STARTED
[02:55:29.680] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:13:0) after 8m21s
[03:03:50.703] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:13:0)
[03:03:50.719] Build status: STARTED
[03:03:50.719] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:14:0) after 1m26s
[03:05:16.733] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:14:0)
[03:05:16.750] Build status: STARTED
[03:05:16.750] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:15:0) after 6m37s
[03:11:53.757] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:15:0)
[03:11:53.777] Build status: STARTED
[03:11:53.777] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:16:0) after 5m40s
[03:17:33.961] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:16:0)
[03:17:33.990] Build status: STARTED
[03:17:33.990] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:17:0) after 3m0s
[03:20:34.110] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:17:0)
[03:20:34.125] Build status: STARTED
[03:20:34.125] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:18:0) after 1m32s
[03:22:06.564] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:18:0)
[03:22:06.577] Build status: STARTED
[03:22:06.577] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:19:0) after 8m6s
[03:30:12.659] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:19:0)
[03:30:12.687] Build status: STARTED
[03:30:12.687] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:20:0) after 2m16s
[03:32:28.706] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:20:0)
[03:32:28.734] Build status: STARTED
[03:32:28.735] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:21:0) after 8m4s
[03:40:32.846] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:21:0)
[03:40:32.917] Build status: STARTED
[03:40:32.917] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:22:0) after 8m31s
[03:49:04.242] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:22:0)
[03:49:04.261] Build status: STARTED
[03:49:04.261] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:23:0) after 8m39s
[03:57:43.245] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:23:0)
[03:57:43.277] Build status: STARTED
[03:57:43.277] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:24:0) after 2m4s
[03:59:47.438] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:24:0)
[03:59:47.467] Build status: STARTED
[03:59:47.467] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:25:0) after 9m40s
[04:09:27.627] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:25:0)
[04:09:27.659] Build status: STARTED
[04:09:27.659] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:26:0) after 8m21s
[04:17:49.070] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:26:0)
[04:17:49.089] Build status: STARTED
[04:17:49.089] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:27:0) after 4m49s
[04:22:38.113] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:27:0)
[04:22:38.128] Build status: STARTED
[04:22:38.128] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:28:0) after 9m36s
[04:32:14.390] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:28:0)
[04:32:14.411] Build status: STARTED
[04:32:14.411] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:29:0) after 3m12s
[04:35:26.636] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:29:0)
[04:35:26.655] Build status: STARTED
[04:35:26.655] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:30:0) after 3m20s
[04:38:46.678] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:30:0)
[04:38:46.723] Build status: STARTED
[04:38:46.723] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:31:0) after 2m3s
[04:40:49.740] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:31:0)
[04:40:49.849] Build status: STARTED
[04:40:49.849] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:32:0) after 8m8s
[04:48:57.971] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:32:0)
[04:48:57.991] Build status: STARTED
[04:48:57.991] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:33:0) after 3m39s
[04:52:37.461] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:33:0)
[04:52:37.492] Build status: STARTED
[04:52:37.492] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:34:0) after 2m3s
[04:54:40.510] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:34:0)
[04:54:40.527] Build status: STARTED
[04:54:40.527] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:35:0) after 6m48s
[05:01:28.541] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:35:0)
[05:01:28.561] Build status: STARTED
[05:01:28.561] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:36:0) after 3m32s
[05:05:00.602] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:36:0)
[05:05:00.621] Build status: STARTED
[05:05:00.621] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:37:0) after 7m58s
[05:12:58.757] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:37:0)
[05:12:58.774] Build status: STARTED
[05:12:58.774] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:38:0) after 4m3s
[05:17:01.799] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:38:0)
[05:17:01.818] Build status: STARTED
[05:17:01.818] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:39:0) after 8m27s
[05:25:28.960] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:39:0)
[05:25:28.979] Build status: STARTED
[05:25:28.979] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:40:0) after 9m34s
[05:35:03.167] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:40:0)
[05:35:03.185] Build status: STARTED
[05:35:03.185] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:41:0) after 7m53s
[05:42:56.405] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:41:0)
[05:42:56.432] Build status: STARTED
[05:42:56.432] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:42:0) after 6m38s
[05:49:34.450] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:42:0)
[05:49:34.536] Build status: STARTED
[05:49:34.536] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:43:0) after 6m16s
[05:55:50.548] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:43:0)
[05:55:50.564] Build status: STARTED
[05:55:50.564] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:44:0) after 2m23s
[05:58:13.767] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:44:0)
[05:58:13.800] Build status: STARTED
[05:58:13.800] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:45:0) after 5m22s
[06:03:35.946] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:45:0)
[06:03:35.963] Build status: STARTED
[06:03:35.964] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:46:0) after 3m19s
[06:06:54.994] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:46:0)
[06:06:55.015] Build status: STARTED
[06:06:55.015] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:47:0) after 2m30s
[06:09:24.985] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:47:0)
[06:09:25.004] Build status: STARTED
[06:09:25.005] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:48:0) after 7m48s
[06:17:13.068] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:48:0)
[06:17:13.094] Build status: STARTED
[06:17:13.094] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:49:0) after 3m25s
[06:20:38.107] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:49:0)
[06:20:38.123] Build status: STARTED
[06:20:38.123] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:50:0) after 6m0s
[06:26:38.197] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:50:0)
[06:26:38.214] Build status: STARTED
[06:26:38.214] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:51:0) after 1m9s
[06:27:47.287] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:51:0)
[06:27:47.322] Build status: STARTED
[06:27:47.322] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:52:0) after 5m27s
[06:33:14.357] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:52:0)
[06:33:14.377] Build status: STARTED
[06:33:14.378] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:53:0) after 8m24s
[06:41:38.424] Handling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:53:0)
[06:41:38.441] Build status: STARTED
[06:41:38.441] Scheduling timer "check-buildbucket-build-status" (chromium/Linux Builder (canonical wd) (reclient compare):8886795612944796240:54:0) after 6m46s
[06:45:04.904] Received PubSub notification, asking Buildbucket for the build status
[06:45:04.916] Build:
{
"id": "8721365551071981761",
"builder": {
"project": "chromium",
"bucket": "reclient",
"builder": "Linux Builder (canonical wd) (reclient compare)"
},
"number": 9848,
"createdBy": "project:chromium",
"createTime": "2025-03-04T02:18:12.160777327Z",
"startTime": "2025-03-04T02:19:10.948050404Z",
"endTime": "2025-03-04T06:45:04.605048265Z",
"updateTime": "2025-03-04T06:45:04.605048265Z",
"status": "INFRA_FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2c16ea6db0416ee1358845cbb04134da5dee6ef2",
"ref": "refs/heads/main"
}
}
}
[06:45:04.916] Invocation finished in 4h26m53.926460872s with status FAILED