[01:57:19.214] New invocation is queued and will start shortly
[01:57:20.323] Starting the invocation (attempt 1)
[01:57:20.353] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4638437dfdab54901e55400dca0d20a1705e283d"
[01:57:20.353] Popped gitiles commit info from properties and tags
[01:57:20.353] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:57:20.353] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:57:20.353] Buildbucket request:
{
"requestId": "8886978119465252608",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4638437dfdab54901e55400dca0d20a1705e283d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886978119465252608"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:57:20.906] Scheduled build:
{
"id": "8721548057558103777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15719,
"createdBy": "project:chromium",
"createTime": "2025-03-02T01:57:20.412286334Z",
"updateTime": "2025-03-02T01:57:20.412286334Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4638437dfdab54901e55400dca0d20a1705e283d",
"ref": "refs/heads/main"
}
}
}
[01:57:20.906] Task URL: https://cr-buildbucket.appspot.com/build/8721548057558103777
[01:57:20.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:2:0) after 6m51s
[01:57:21.917] Received PubSub notification, asking Buildbucket for the build status
[01:57:21.930] Build status: SCHEDULED
[01:58:30.625] Received PubSub notification, asking Buildbucket for the build status
[01:58:30.700] Build status: STARTED
[02:04:11.966] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:2:0)
[02:04:11.980] Build status: STARTED
[02:04:11.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:5:0) after 2m11s
[02:06:23.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:5:0)
[02:06:23.021] Build status: STARTED
[02:06:23.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:6:0) after 7m21s
[02:13:44.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:6:0)
[02:13:44.042] Build status: STARTED
[02:13:44.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:7:0) after 7m14s
[02:20:58.258] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:7:0)
[02:20:58.330] Build status: STARTED
[02:20:58.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:8:0) after 8m33s
[02:29:31.506] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:8:0)
[02:29:31.527] Build status: STARTED
[02:29:31.527] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:9:0) after 8m57s
[02:38:28.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:9:0)
[02:38:28.612] Build status: STARTED
[02:38:28.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:10:0) after 2m15s
[02:40:43.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:10:0)
[02:40:43.727] Build status: STARTED
[02:40:43.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:11:0) after 6m8s
[02:46:51.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:11:0)
[02:46:51.772] Build status: STARTED
[02:46:51.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:12:0) after 1m8s
[02:47:59.839] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:12:0)
[02:47:59.910] Build status: STARTED
[02:47:59.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:13:0) after 2m28s
[02:50:27.929] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:13:0)
[02:50:27.951] Build status: STARTED
[02:50:27.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:14:0) after 7m6s
[02:57:33.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:14:0)
[02:57:34.053] Build status: STARTED
[02:57:34.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:15:0) after 4m8s
[03:01:42.032] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:15:0)
[03:01:42.058] Build status: STARTED
[03:01:42.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:16:0) after 3m21s
[03:05:03.243] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:16:0)
[03:05:03.269] Build status: STARTED
[03:05:03.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:17:0) after 9m14s
[03:14:17.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:17:0)
[03:14:17.524] Build status: STARTED
[03:14:17.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:18:0) after 7m58s
[03:22:15.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:18:0)
[03:22:15.564] Build status: STARTED
[03:22:15.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:19:0) after 2m6s
[03:24:21.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:19:0)
[03:24:21.699] Build status: STARTED
[03:24:21.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:20:0) after 9m22s
[03:33:43.733] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:20:0)
[03:33:43.756] Build status: STARTED
[03:33:43.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:21:0) after 7m13s
[03:40:57.026] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:21:0)
[03:40:57.051] Build status: STARTED
[03:40:57.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:22:0) after 4m34s
[03:45:31.238] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:22:0)
[03:45:31.264] Build status: STARTED
[03:45:31.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:23:0) after 6m53s
[03:52:24.371] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:23:0)
[03:52:24.388] Build status: STARTED
[03:52:24.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:24:0) after 6m19s
[03:58:43.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:24:0)
[03:58:43.441] Build status: STARTED
[03:58:43.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:25:0) after 1m13s
[03:59:56.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:25:0)
[03:59:56.656] Build status: STARTED
[03:59:56.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:26:0) after 1m19s
[04:01:15.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:26:0)
[04:01:15.748] Build status: STARTED
[04:01:15.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:27:0) after 7m12s
[04:08:27.914] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:27:0)
[04:08:27.937] Build status: STARTED
[04:08:27.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:28:0) after 5m8s
[04:13:35.983] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:28:0)
[04:13:36.014] Build status: STARTED
[04:13:36.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:29:0) after 6m34s
[04:20:10.075] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:29:0)
[04:20:10.092] Build status: STARTED
[04:20:10.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:30:0) after 6m4s
[04:26:14.115] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:30:0)
[04:26:14.132] Build status: STARTED
[04:26:14.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:31:0) after 8m20s
[04:34:34.360] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:31:0)
[04:34:34.427] Build status: STARTED
[04:34:34.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:32:0) after 2m52s
[04:37:26.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:32:0)
[04:37:26.685] Build status: STARTED
[04:37:26.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:33:0) after 5m46s
[04:43:12.746] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:33:0)
[04:43:12.761] Build status: STARTED
[04:43:12.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:34:0) after 2m13s
[04:45:25.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:34:0)
[04:45:25.800] Build status: STARTED
[04:45:25.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:35:0) after 6m38s
[04:52:03.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:35:0)
[04:52:03.940] Build status: STARTED
[04:52:03.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:36:0) after 4m23s
[04:56:26.962] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:36:0)
[04:56:26.995] Build status: STARTED
[04:56:26.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:37:0) after 3m25s
[04:59:51.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:37:0)
[04:59:52.002] Build status: STARTED
[04:59:52.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:38:0) after 8m43s
[05:08:35.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:38:0)
[05:08:35.046] Build status: STARTED
[05:08:35.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:39:0) after 2m32s
[05:11:07.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:39:0)
[05:11:07.117] Build status: STARTED
[05:11:07.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:40:0) after 1m31s
[05:12:38.140] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:40:0)
[05:12:38.175] Build status: STARTED
[05:12:38.175] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:41:0) after 1m10s
[05:13:48.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:41:0)
[05:13:48.209] Build status: STARTED
[05:13:48.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:42:0) after 1m59s
[05:15:47.286] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:42:0)
[05:15:47.311] Build status: STARTED
[05:15:47.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:43:0) after 4m18s
[05:20:05.395] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:43:0)
[05:20:05.414] Build status: STARTED
[05:20:05.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:44:0) after 2m3s
[05:22:08.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:44:0)
[05:22:08.540] Build status: STARTED
[05:22:08.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:45:0) after 3m4s
[05:25:12.564] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:45:0)
[05:25:12.582] Build status: STARTED
[05:25:12.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:46:0) after 9m42s
[05:34:54.993] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:46:0)
[05:34:55.009] Build status: STARTED
[05:34:55.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:47:0) after 9m55s
[05:44:50.030] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:47:0)
[05:44:50.048] Build status: STARTED
[05:44:50.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:48:0) after 8m42s
[05:53:32.067] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:48:0)
[05:53:32.082] Build status: STARTED
[05:53:32.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:49:0) after 8m6s
[06:01:38.129] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:49:0)
[06:01:38.148] Build status: STARTED
[06:01:38.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:50:0) after 2m15s
[06:03:53.320] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:50:0)
[06:03:53.339] Build status: STARTED
[06:03:53.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:51:0) after 1m0s
[06:04:53.434] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:51:0)
[06:04:53.455] Build status: STARTED
[06:04:53.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:52:0) after 7m31s
[06:12:24.531] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:52:0)
[06:12:24.545] Build status: STARTED
[06:12:24.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:53:0) after 9m33s
[06:21:57.579] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:53:0)
[06:21:57.596] Build status: STARTED
[06:21:57.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:54:0) after 7m54s
[06:29:51.608] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:54:0)
[06:29:51.623] Build status: STARTED
[06:29:51.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:55:0) after 4m22s
[06:34:13.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:55:0)
[06:34:13.667] Build status: STARTED
[06:34:13.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:56:0) after 3m5s
[06:37:18.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:56:0)
[06:37:18.796] Build status: STARTED
[06:37:18.796] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:57:0) after 9m38s
[06:46:56.852] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:57:0)
[06:46:56.903] Build status: STARTED
[06:46:56.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:58:0) after 5m15s
[06:52:11.921] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:58:0)
[06:52:11.939] Build status: STARTED
[06:52:11.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886978119465252608:59:0) after 5m42s
[06:52:12.233] Received PubSub notification, asking Buildbucket for the build status
[06:52:12.258] Build:
{
"id": "8721548057558103777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15719,
"createdBy": "project:chromium",
"createTime": "2025-03-02T01:57:20.412286334Z",
"startTime": "2025-03-02T01:58:27.012311738Z",
"endTime": "2025-03-02T06:52:11.880948561Z",
"updateTime": "2025-03-02T06:52:11.880948561Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4638437dfdab54901e55400dca0d20a1705e283d",
"ref": "refs/heads/main"
}
}
}
[06:52:12.258] Invocation finished in 4h54m53.049032667s with status FAILED