[16:13:42.789] New invocation is queued and will start shortly
[16:13:43.879] Starting the invocation (attempt 1)
[16:13:43.907] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ac682e34153bd76de0e7891b5726c933aca77670"
[16:13:43.907] Popped gitiles commit info from properties and tags
[16:13:43.907] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:13:43.907] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:13:43.907] Buildbucket request:
{
"requestId": "8842259935450019152",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac682e34153bd76de0e7891b5726c933aca77670",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842259935450019152"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:13:49.341] Scheduled build:
{
"id": "8676829873550447169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 21622,
"createdBy": "project:chromium",
"createTime": "2026-07-08T16:13:43.976559471Z",
"updateTime": "2026-07-08T16:13:43.976559471Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac682e34153bd76de0e7891b5726c933aca77670",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:13:49.341] Task URL: https://cr-buildbucket.appspot.com/build/8676829873550447169
[16:13:49.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:2:0) after 7m29s
[16:13:50.361] Received PubSub notification, asking Buildbucket for the build status
[16:13:50.391] Build status: SCHEDULED
[16:14:55.354] Received PubSub notification, asking Buildbucket for the build status
[16:14:55.384] Build status: STARTED
[16:21:18.408] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:2:0)
[16:21:18.428] Build status: STARTED
[16:21:18.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:5:0) after 5m54s
[16:27:12.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:5:0)
[16:27:12.574] Build status: STARTED
[16:27:12.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:6:0) after 4m13s
[16:31:25.606] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:6:0)
[16:31:25.629] Build status: STARTED
[16:31:25.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:7:0) after 3m56s
[16:35:21.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:7:0)
[16:35:21.696] Build status: STARTED
[16:35:21.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:8:0) after 5m10s
[16:40:31.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:8:0)
[16:40:31.739] Build status: STARTED
[16:40:31.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:9:0) after 8m52s
[16:49:23.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:9:0)
[16:49:23.885] Build status: STARTED
[16:49:23.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:10:0) after 4m25s
[16:53:48.885] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:10:0)
[16:53:48.905] Build status: STARTED
[16:53:48.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:11:0) after 4m2s
[16:57:50.923] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:11:0)
[16:57:50.942] Build status: STARTED
[16:57:50.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:12:0) after 7m34s
[17:05:24.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:12:0)
[17:05:25.003] Build status: STARTED
[17:05:25.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:13:0) after 8m54s
[17:14:18.998] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:13:0)
[17:14:19.039] Build status: STARTED
[17:14:19.039] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:14:0) after 7m56s
[17:22:15.063] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:14:0)
[17:22:15.090] Build status: STARTED
[17:22:15.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:15:0) after 7m18s
[17:29:33.160] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:15:0)
[17:29:33.178] Build status: STARTED
[17:29:33.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:16:0) after 6m30s
[17:36:03.383] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:16:0)
[17:36:03.474] Build status: STARTED
[17:36:03.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:17:0) after 1m29s
[17:37:32.458] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:17:0)
[17:37:32.524] Build status: STARTED
[17:37:32.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:18:0) after 2m2s
[17:39:34.712] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:18:0)
[17:39:34.732] Build status: STARTED
[17:39:34.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:19:0) after 1m36s
[17:41:10.749] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:19:0)
[17:41:10.768] Build status: STARTED
[17:41:10.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:20:0) after 4m39s
[17:45:49.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:20:0)
[17:45:49.889] Build status: STARTED
[17:45:49.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:21:0) after 3m1s
[17:48:50.960] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:21:0)
[17:48:50.980] Build status: STARTED
[17:48:50.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:22:0) after 2m46s
[17:51:37.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:22:0)
[17:51:37.058] Build status: STARTED
[17:51:37.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:23:0) after 9m32s
[18:01:09.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:23:0)
[18:01:09.475] Build status: STARTED
[18:01:09.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:24:0) after 5m10s
[18:06:19.464] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:24:0)
[18:06:19.484] Build status: STARTED
[18:06:19.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:25:0) after 8m26s
[18:14:45.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:25:0)
[18:14:45.591] Build status: STARTED
[18:14:45.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:26:0) after 8m47s
[18:23:32.675] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:26:0)
[18:23:32.690] Build status: STARTED
[18:23:32.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:27:0) after 2m41s
[18:26:13.714] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:27:0)
[18:26:13.732] Build status: STARTED
[18:26:13.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:28:0) after 2m14s
[18:28:27.750] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:28:0)
[18:28:27.771] Build status: STARTED
[18:28:27.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:29:0) after 4m10s
[18:32:37.803] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:29:0)
[18:32:37.825] Build status: STARTED
[18:32:37.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:30:0) after 6m19s
[18:38:56.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:30:0)
[18:38:56.868] Build status: STARTED
[18:38:56.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:31:0) after 7m44s
[18:46:40.938] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:31:0)
[18:46:40.950] Build status: STARTED
[18:46:40.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:32:0) after 6m28s
[18:53:08.999] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:32:0)
[18:53:09.017] Build status: STARTED
[18:53:09.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:33:0) after 4m49s
[18:57:58.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:33:0)
[18:57:58.065] Build status: STARTED
[18:57:58.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8842259935450019152:34:0) after 5m26s
[18:58:35.319] Received PubSub notification, asking Buildbucket for the build status
[18:58:35.336] Build:
{
"id": "8676829873550447169",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 21622,
"createdBy": "project:chromium",
"createTime": "2026-07-08T16:13:43.976559471Z",
"startTime": "2026-07-08T16:14:53.024875122Z",
"endTime": "2026-07-08T18:58:34.477729499Z",
"updateTime": "2026-07-08T18:58:34.477729499Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ac682e34153bd76de0e7891b5726c933aca77670",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:58:35.336] Invocation finished in 2h44m52.555701061s with status FAILED