[11:22:24.826] New invocation is queued and will start shortly
[11:22:26.056] Starting the invocation (attempt 1)
[11:22:26.083] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5dddd598708b7ff8df56d287c2a7b28e613b12d3"
[11:22:26.083] Popped gitiles commit info from properties and tags
[11:22:26.083] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[11:22:26.083] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[11:22:26.083] Buildbucket request:
{
"requestId": "8906783302508695744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5dddd598708b7ff8df56d287c2a7b28e613b12d3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8906783302508695744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[11:22:27.024] Scheduled build:
{
"id": "8741353240251213057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 13223,
"createdBy": "project:chromium",
"createTime": "2024-07-26T11:22:26.345476801Z",
"updateTime": "2024-07-26T11:22:26.345476801Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5dddd598708b7ff8df56d287c2a7b28e613b12d3",
"ref": "refs/heads/main"
}
}
}
[11:22:27.024] Task URL: https://cr-buildbucket.appspot.com/build/8741353240251213057
[11:22:27.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:2:0) after 9m2s
[11:22:27.839] Received PubSub notification, asking Buildbucket for the build status
[11:22:27.863] Build status: SCHEDULED
[11:26:43.406] Received PubSub notification, asking Buildbucket for the build status
[11:26:43.496] Build status: STARTED
[11:31:29.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:2:0)
[11:31:29.191] Build status: STARTED
[11:31:29.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:5:0) after 7m32s
[11:39:01.400] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:5:0)
[11:39:01.422] Build status: STARTED
[11:39:01.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:6:0) after 4m21s
[11:43:22.440] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:6:0)
[11:43:22.514] Build status: STARTED
[11:43:22.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:7:0) after 9m38s
[11:53:00.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:7:0)
[11:53:00.602] Build status: STARTED
[11:53:00.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:8:0) after 9m17s
[12:02:17.629] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:8:0)
[12:02:17.645] Build status: STARTED
[12:02:17.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:9:0) after 4m2s
[12:06:20.361] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:9:0)
[12:06:20.380] Build status: STARTED
[12:06:20.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:10:0) after 2m16s
[12:08:36.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:10:0)
[12:08:36.629] Build status: STARTED
[12:08:36.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:11:0) after 8m14s
[12:16:50.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:11:0)
[12:16:50.669] Build status: STARTED
[12:16:50.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:12:0) after 8m7s
[12:24:57.956] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:12:0)
[12:24:57.974] Build status: STARTED
[12:24:57.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:13:0) after 7m35s
[12:32:33.055] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:13:0)
[12:32:33.078] Build status: STARTED
[12:32:33.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:14:0) after 7m15s
[12:39:48.105] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:14:0)
[12:39:48.124] Build status: STARTED
[12:39:48.124] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:15:0) after 4m17s
[12:44:05.242] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:15:0)
[12:44:05.324] Build status: STARTED
[12:44:05.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:16:0) after 5m16s
[12:49:21.401] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:16:0)
[12:49:21.426] Build status: STARTED
[12:49:21.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:17:0) after 9m5s
[12:58:26.435] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:17:0)
[12:58:26.454] Build status: STARTED
[12:58:26.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:18:0) after 1m47s
[13:00:13.479] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:18:0)
[13:00:13.505] Build status: STARTED
[13:00:13.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:19:0) after 1m13s
[13:01:26.741] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:19:0)
[13:01:26.763] Build status: STARTED
[13:01:26.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:20:0) after 4m23s
[13:05:49.789] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:20:0)
[13:05:49.805] Build status: STARTED
[13:05:49.805] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:21:0) after 3m59s
[13:09:49.130] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:21:0)
[13:09:49.146] Build status: STARTED
[13:09:49.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:22:0) after 5m4s
[13:14:53.124] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:22:0)
[13:14:53.186] Build status: STARTED
[13:14:53.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:23:0) after 7m42s
[13:22:35.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:23:0)
[13:22:35.361] Build status: STARTED
[13:22:35.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:24:0) after 6m28s
[13:29:03.386] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:24:0)
[13:29:03.405] Build status: STARTED
[13:29:03.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:25:0) after 6m35s
[13:35:38.469] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:25:0)
[13:35:38.493] Build status: STARTED
[13:35:38.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:26:0) after 1m31s
[13:37:09.562] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:26:0)
[13:37:09.578] Build status: STARTED
[13:37:09.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:27:0) after 8m59s
[13:46:08.597] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:27:0)
[13:46:08.615] Build status: STARTED
[13:46:08.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:28:0) after 9m21s
[13:55:29.650] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:28:0)
[13:55:29.685] Build status: STARTED
[13:55:29.685] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:29:0) after 4m3s
[13:59:32.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:29:0)
[13:59:32.818] Build status: STARTED
[13:59:32.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:30:0) after 9m4s
[14:08:36.880] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:30:0)
[14:08:36.899] Build status: STARTED
[14:08:36.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:31:0) after 5m39s
[14:14:15.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:31:0)
[14:14:15.944] Build status: STARTED
[14:14:15.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:32:0) after 3m6s
[14:17:22.011] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:32:0)
[14:17:22.037] Build status: STARTED
[14:17:22.037] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:33:0) after 1m11s
[14:18:33.061] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:33:0)
[14:18:33.079] Build status: STARTED
[14:18:33.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:34:0) after 8m0s
[14:26:33.224] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:34:0)
[14:26:33.246] Build status: STARTED
[14:26:33.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:35:0) after 3m47s
[14:30:20.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:35:0)
[14:30:20.351] Build status: STARTED
[14:30:20.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:36:0) after 1m58s
[14:32:18.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:36:0)
[14:32:18.400] Build status: STARTED
[14:32:18.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:37:0) after 5m9s
[14:37:27.418] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:37:0)
[14:37:27.436] Build status: STARTED
[14:37:27.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:38:0) after 3m46s
[14:41:13.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:38:0)
[14:41:13.515] Build status: STARTED
[14:41:13.515] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:39:0) after 9m8s
[14:50:21.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:39:0)
[14:50:21.606] Build status: STARTED
[14:50:21.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:40:0) after 9m37s
[14:59:58.653] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:40:0)
[14:59:58.670] Build status: STARTED
[14:59:58.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:41:0) after 1m9s
[15:01:07.727] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:41:0)
[15:01:07.753] Build status: STARTED
[15:01:07.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:42:0) after 4m18s
[15:05:25.783] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:42:0)
[15:05:25.802] Build status: STARTED
[15:05:25.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:43:0) after 8m38s
[15:14:03.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:43:0)
[15:14:03.888] Build status: STARTED
[15:14:03.888] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:44:0) after 4m33s
[15:18:36.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:44:0)
[15:18:36.908] Build status: STARTED
[15:18:36.908] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:45:0) after 9m44s
[15:28:20.932] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:45:0)
[15:28:20.953] Build status: STARTED
[15:28:20.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:46:0) after 9m22s
[15:37:43.021] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:46:0)
[15:37:43.108] Build status: STARTED
[15:37:43.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:47:0) after 6m51s
[15:44:34.125] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:47:0)
[15:44:34.143] Build status: STARTED
[15:44:34.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:48:0) after 3m53s
[15:48:27.217] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:48:0)
[15:48:27.234] Build status: STARTED
[15:48:27.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:49:0) after 4m34s
[15:53:01.274] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:49:0)
[15:53:01.319] Build status: STARTED
[15:53:01.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:50:0) after 4m48s
[15:57:49.348] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:50:0)
[15:57:49.384] Build status: STARTED
[15:57:49.384] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8906783302508695744:51:0) after 7m35s
[16:03:38.594] Received PubSub notification, asking Buildbucket for the build status
[16:03:38.612] Build:
{
"id": "8741353240251213057",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 13223,
"createdBy": "project:chromium",
"createTime": "2024-07-26T11:22:26.345476801Z",
"startTime": "2024-07-26T11:26:43.186877505Z",
"endTime": "2024-07-26T16:03:38.233651684Z",
"updateTime": "2024-07-26T16:03:38.233651684Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5dddd598708b7ff8df56d287c2a7b28e613b12d3",
"ref": "refs/heads/main"
}
}
}
[16:03:38.612] Invocation finished in 4h41m13.802655602s with status FAILED