[06:25:26.659] New invocation is queued and will start shortly
[06:25:27.733] Starting the invocation (attempt 1)
[06:25:27.759] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aafac216305e476992bfdc410d5a59102ab1f9bd"
[06:25:27.759] Popped gitiles commit info from properties and tags
[06:25:27.759] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:25:27.759] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:25:27.759] Buildbucket request:
{
"requestId": "8922928246222301440",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aafac216305e476992bfdc410d5a59102ab1f9bd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8922928246222301440"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:25:28.686] Scheduled build:
{
"id": "8757498184347433137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 10412,
"createdBy": "project:chromium",
"createTime": "2024-01-30T06:25:27.821857014Z",
"updateTime": "2024-01-30T06:25:27.821857014Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aafac216305e476992bfdc410d5a59102ab1f9bd",
"ref": "refs/heads/main"
}
}
}
[06:25:28.686] Task URL: https://cr-buildbucket.appspot.com/build/8757498184347433137
[06:25:28.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:2:0) after 9m41s
[06:25:29.314] Received PubSub notification, asking Buildbucket for the build status
[06:25:29.365] Build status: SCHEDULED
[06:27:02.990] Received PubSub notification, asking Buildbucket for the build status
[06:27:03.018] Build status: STARTED
[06:35:09.723] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:2:0)
[06:35:09.749] Build status: STARTED
[06:35:09.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:5:0) after 9m20s
[06:44:29.766] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:5:0)
[06:44:29.801] Build status: STARTED
[06:44:29.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:6:0) after 6m28s
[06:50:57.901] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:6:0)
[06:50:57.924] Build status: STARTED
[06:50:57.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:7:0) after 1m28s
[06:52:26.065] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:7:0)
[06:52:26.085] Build status: STARTED
[06:52:26.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:8:0) after 5m46s
[06:58:12.113] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:8:0)
[06:58:12.146] Build status: STARTED
[06:58:12.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:9:0) after 3m4s
[07:01:16.384] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:9:0)
[07:01:16.422] Build status: STARTED
[07:01:16.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:10:0) after 4m39s
[07:05:55.548] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:10:0)
[07:05:55.595] Build status: STARTED
[07:05:55.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:11:0) after 1m1s
[07:06:56.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:11:0)
[07:06:56.629] Build status: STARTED
[07:06:56.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:12:0) after 1m28s
[07:08:24.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:12:0)
[07:08:24.669] Build status: STARTED
[07:08:24.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:13:0) after 1m23s
[07:09:47.751] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:13:0)
[07:09:47.805] Build status: STARTED
[07:09:47.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:14:0) after 2m20s
[07:12:07.801] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:14:0)
[07:12:07.829] Build status: STARTED
[07:12:07.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:15:0) after 8m5s
[07:20:12.869] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:15:0)
[07:20:12.885] Build status: STARTED
[07:20:12.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:16:0) after 7m18s
[07:27:30.973] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:16:0)
[07:27:31.004] Build status: STARTED
[07:27:31.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:17:0) after 4m3s
[07:31:34.338] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:17:0)
[07:31:34.398] Build status: STARTED
[07:31:34.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:18:0) after 8m24s
[07:39:58.417] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:18:0)
[07:39:58.435] Build status: STARTED
[07:39:58.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:19:0) after 7m49s
[07:47:47.450] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:19:0)
[07:47:47.471] Build status: STARTED
[07:47:47.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:20:0) after 7m13s
[07:55:00.708] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:20:0)
[07:55:00.773] Build status: STARTED
[07:55:00.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:21:0) after 9m53s
[08:04:53.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:21:0)
[08:04:53.912] Build status: STARTED
[08:04:53.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:22:0) after 4m49s
[08:09:42.933] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:22:0)
[08:09:42.949] Build status: STARTED
[08:09:42.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:23:0) after 1m35s
[08:11:17.977] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:23:0)
[08:11:18.005] Build status: STARTED
[08:11:18.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:24:0) after 1m18s
[08:12:36.004] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:24:0)
[08:12:36.022] Build status: STARTED
[08:12:36.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:25:0) after 4m47s
[08:17:23.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:25:0)
[08:17:23.081] Build status: STARTED
[08:17:23.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:26:0) after 4m48s
[08:22:11.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:26:0)
[08:22:11.135] Build status: STARTED
[08:22:11.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:27:0) after 4m37s
[08:26:48.164] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:27:0)
[08:26:48.181] Build status: STARTED
[08:26:48.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:28:0) after 8m51s
[08:35:39.313] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:28:0)
[08:35:39.352] Build status: STARTED
[08:35:39.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:29:0) after 2m46s
[08:38:25.494] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:29:0)
[08:38:25.512] Build status: STARTED
[08:38:25.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:30:0) after 3m51s
[08:42:16.677] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:30:0)
[08:42:16.697] Build status: STARTED
[08:42:16.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:31:0) after 5m38s
[08:47:54.715] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:31:0)
[08:47:54.736] Build status: STARTED
[08:47:54.736] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:32:0) after 3m12s
[08:51:06.754] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:32:0)
[08:51:06.773] Build status: STARTED
[08:51:06.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:33:0) after 5m38s
[08:56:44.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:33:0)
[08:56:44.818] Build status: STARTED
[08:56:44.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:34:0) after 3m58s
[09:00:42.841] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:34:0)
[09:00:42.857] Build status: STARTED
[09:00:42.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:35:0) after 2m5s
[09:02:47.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:35:0)
[09:02:47.891] Build status: STARTED
[09:02:47.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:36:0) after 7m55s
[09:10:42.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:36:0)
[09:10:42.971] Build status: STARTED
[09:10:42.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:37:0) after 8m45s
[09:19:27.996] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:37:0)
[09:19:28.067] Build status: STARTED
[09:19:28.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:38:0) after 8m6s
[09:27:34.191] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:38:0)
[09:27:34.224] Build status: STARTED
[09:27:34.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:39:0) after 4m35s
[09:32:09.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:39:0)
[09:32:09.266] Build status: STARTED
[09:32:09.266] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:40:0) after 9m32s
[09:41:41.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:40:0)
[09:41:41.310] Build status: STARTED
[09:41:41.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:41:0) after 6m50s
[09:48:31.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:41:0)
[09:48:31.648] Build status: STARTED
[09:48:31.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:42:0) after 2m8s
[09:50:39.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:42:0)
[09:50:39.685] Build status: STARTED
[09:50:39.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:43:0) after 7m21s
[09:58:00.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:43:0)
[09:58:00.753] Build status: STARTED
[09:58:00.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:44:0) after 9m45s
[10:07:46.031] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:44:0)
[10:07:46.085] Build status: STARTED
[10:07:46.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:45:0) after 7m14s
[10:15:00.109] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:45:0)
[10:15:00.130] Build status: STARTED
[10:15:00.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:46:0) after 4m51s
[10:19:51.154] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:46:0)
[10:19:51.185] Build status: STARTED
[10:19:51.185] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:47:0) after 2m29s
[10:22:20.209] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:47:0)
[10:22:20.232] Build status: STARTED
[10:22:20.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:48:0) after 2m51s
[10:25:11.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:48:0)
[10:25:11.393] Build status: STARTED
[10:25:11.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:49:0) after 3m46s
[10:28:57.509] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:49:0)
[10:28:57.549] Build status: STARTED
[10:28:57.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:50:0) after 5m6s
[10:34:03.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:50:0)
[10:34:03.587] Build status: STARTED
[10:34:03.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:51:0) after 3m38s
[10:37:41.767] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:51:0)
[10:37:41.785] Build status: STARTED
[10:37:41.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:52:0) after 9m18s
[10:46:59.810] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:52:0)
[10:46:59.832] Build status: STARTED
[10:46:59.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8922928246222301440:53:0) after 2m55s
[10:48:15.098] Received PubSub notification, asking Buildbucket for the build status
[10:48:15.128] Build:
{
"id": "8757498184347433137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 10412,
"createdBy": "project:chromium",
"createTime": "2024-01-30T06:25:27.821857014Z",
"startTime": "2024-01-30T06:27:02.782764157Z",
"endTime": "2024-01-30T10:48:14.627734Z",
"updateTime": "2024-01-30T10:48:14.627734Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aafac216305e476992bfdc410d5a59102ab1f9bd",
"ref": "refs/heads/main"
}
}
}
[10:48:15.128] Invocation finished in 4h22m48.479525832s with status FAILED