[01:48:04.964] New invocation is queued and will start shortly
[01:48:07.029] Starting the invocation (attempt 1)
[01:48:07.063] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b3ae7c416b1ab016e267c874a23f3e275be2f61f"
[01:48:07.063] Popped gitiles commit info from properties and tags
[01:48:07.063] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:48:07.064] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:48:07.064] Buildbucket request:
{
"requestId": "8887431685470957744",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3ae7c416b1ab016e267c874a23f3e275be2f61f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887431685470957744"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:48:07.520] Scheduled build:
{
"id": "8722001622545915809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15696,
"createdBy": "project:chromium",
"createTime": "2025-02-25T01:48:07.132466686Z",
"updateTime": "2025-02-25T01:48:07.132466686Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3ae7c416b1ab016e267c874a23f3e275be2f61f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:48:07.520] Task URL: https://cr-buildbucket.appspot.com/build/8722001622545915809
[01:48:07.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:2:0) after 7m11s
[01:48:07.597] Received PubSub notification, asking Buildbucket for the build status
[01:48:07.748] Build status: SCHEDULED
[01:48:12.944] Received PubSub notification, asking Buildbucket for the build status
[01:48:12.977] Build status: STARTED
[01:55:18.761] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:2:0)
[01:55:18.783] Build status: STARTED
[01:55:18.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:5:0) after 5m13s
[02:00:31.815] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:5:0)
[02:00:31.840] Build status: STARTED
[02:00:31.840] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:6:0) after 1m26s
[02:01:57.939] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:6:0)
[02:01:57.965] Build status: STARTED
[02:01:57.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:7:0) after 1m31s
[02:03:28.991] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:7:0)
[02:03:29.031] Build status: STARTED
[02:03:29.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:8:0) after 9m27s
[02:12:56.077] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:8:0)
[02:12:56.106] Build status: STARTED
[02:12:56.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:9:0) after 9m48s
[02:22:44.138] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:9:0)
[02:22:44.157] Build status: STARTED
[02:22:44.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:10:0) after 9m3s
[02:31:47.185] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:10:0)
[02:31:47.203] Build status: STARTED
[02:31:47.203] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:11:0) after 3m5s
[02:34:52.246] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:11:0)
[02:34:52.265] Build status: STARTED
[02:34:52.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:12:0) after 8m50s
[02:43:42.302] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:12:0)
[02:43:42.320] Build status: STARTED
[02:43:42.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:13:0) after 6m57s
[02:50:39.368] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:13:0)
[02:50:39.412] Build status: STARTED
[02:50:39.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:14:0) after 2m50s
[02:53:29.508] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:14:0)
[02:53:29.524] Build status: STARTED
[02:53:29.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:15:0) after 8m48s
[03:02:17.607] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:15:0)
[03:02:17.630] Build status: STARTED
[03:02:17.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:16:0) after 8m2s
[03:10:19.763] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:16:0)
[03:10:19.782] Build status: STARTED
[03:10:19.782] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:17:0) after 9m42s
[03:20:01.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:17:0)
[03:20:01.829] Build status: STARTED
[03:20:01.829] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:18:0) after 4m47s
[03:24:48.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:18:0)
[03:24:48.893] Build status: STARTED
[03:24:48.893] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:19:0) after 3m28s
[03:28:17.028] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:19:0)
[03:28:17.044] Build status: STARTED
[03:28:17.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:20:0) after 6m15s
[03:34:32.089] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:20:0)
[03:34:32.104] Build status: STARTED
[03:34:32.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:21:0) after 4m5s
[03:38:37.174] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:21:0)
[03:38:37.191] Build status: STARTED
[03:38:37.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:22:0) after 2m32s
[03:41:09.218] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:22:0)
[03:41:09.284] Build status: STARTED
[03:41:09.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:23:0) after 7m30s
[03:48:39.372] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:23:0)
[03:48:39.391] Build status: STARTED
[03:48:39.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:24:0) after 3m26s
[03:52:05.407] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:24:0)
[03:52:05.421] Build status: STARTED
[03:52:05.421] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:25:0) after 3m59s
[03:56:04.507] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:25:0)
[03:56:04.523] Build status: STARTED
[03:56:04.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:26:0) after 4m35s
[04:00:39.552] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:26:0)
[04:00:39.573] Build status: STARTED
[04:00:39.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:27:0) after 1m43s
[04:02:22.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:27:0)
[04:02:22.628] Build status: STARTED
[04:02:22.628] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:28:0) after 2m42s
[04:05:04.703] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:28:0)
[04:05:04.728] Build status: STARTED
[04:05:04.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:29:0) after 8m22s
[04:13:26.817] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:29:0)
[04:13:26.831] Build status: STARTED
[04:13:26.831] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:30:0) after 1m30s
[04:14:56.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:30:0)
[04:14:56.866] Build status: STARTED
[04:14:56.866] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:31:0) after 3m50s
[04:18:46.906] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:31:0)
[04:18:46.927] Build status: STARTED
[04:18:46.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:32:0) after 2m49s
[04:21:35.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:32:0)
[04:21:35.985] Build status: STARTED
[04:21:35.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:33:0) after 7m27s
[04:29:03.571] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:33:0)
[04:29:03.586] Build status: STARTED
[04:29:03.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:34:0) after 5m59s
[04:35:02.617] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:34:0)
[04:35:02.645] Build status: STARTED
[04:35:02.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:35:0) after 9m41s
[04:44:43.879] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:35:0)
[04:44:43.897] Build status: STARTED
[04:44:43.897] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:36:0) after 4m32s
[04:49:16.034] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:36:0)
[04:49:16.053] Build status: STARTED
[04:49:16.053] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:37:0) after 3m7s
[04:52:23.389] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:37:0)
[04:52:23.461] Build status: STARTED
[04:52:23.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:38:0) after 6m42s
[04:59:05.488] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:38:0)
[04:59:05.507] Build status: STARTED
[04:59:05.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:39:0) after 4m44s
[05:03:49.680] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:39:0)
[05:03:49.715] Build status: STARTED
[05:03:49.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:40:0) after 9m0s
[05:12:49.881] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:40:0)
[05:12:49.917] Build status: STARTED
[05:12:49.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:41:0) after 7m20s
[05:20:10.192] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:41:0)
[05:20:10.214] Build status: STARTED
[05:20:10.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:42:0) after 5m26s
[05:25:36.673] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:42:0)
[05:25:36.688] Build status: STARTED
[05:25:36.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:43:0) after 7m36s
[05:33:12.694] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:43:0)
[05:33:12.715] Build status: STARTED
[05:33:12.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:44:0) after 6m23s
[05:39:35.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:44:0)
[05:39:35.811] Build status: STARTED
[05:39:35.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:45:0) after 1m59s
[05:41:34.896] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:45:0)
[05:41:34.916] Build status: STARTED
[05:41:34.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:46:0) after 4m57s
[05:46:32.163] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:46:0)
[05:46:32.180] Build status: STARTED
[05:46:32.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:47:0) after 3m54s
[05:50:26.237] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:47:0)
[05:50:26.251] Build status: STARTED
[05:50:26.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:48:0) after 4m6s
[05:54:32.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:48:0)
[05:54:32.620] Build status: STARTED
[05:54:32.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:49:0) after 9m40s
[06:04:12.670] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:49:0)
[06:04:12.687] Build status: STARTED
[06:04:12.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:50:0) after 6m36s
[06:10:48.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:50:0)
[06:10:48.938] Build status: STARTED
[06:10:48.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:51:0) after 4m45s
[06:15:33.971] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:51:0)
[06:15:33.991] Build status: STARTED
[06:15:33.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:52:0) after 4m12s
[06:19:46.029] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:52:0)
[06:19:46.050] Build status: STARTED
[06:19:46.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887431685470957744:53:0) after 5m48s
[06:23:38.560] Received PubSub notification, asking Buildbucket for the build status
[06:23:38.575] Build:
{
"id": "8722001622545915809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15696,
"createdBy": "project:chromium",
"createTime": "2025-02-25T01:48:07.132466686Z",
"startTime": "2025-02-25T01:48:12.736977008Z",
"endTime": "2025-02-25T06:23:38.328004951Z",
"updateTime": "2025-02-25T06:23:38.328004951Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3ae7c416b1ab016e267c874a23f3e275be2f61f",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:23:38.575] Invocation finished in 4h35m33.616239293s with status FAILED