[04:25:28.787] New invocation is queued and will start shortly
[04:25:29.870] Starting the invocation (attempt 1)
[04:25:29.897] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/dce42241be9e2b095874bc44866b1ca5f1dc38a5"
[04:25:29.897] Popped gitiles commit info from properties and tags
[04:25:29.898] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:25:29.898] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:25:29.898] Buildbucket request:
{
"requestId": "8850911205451023040",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dce42241be9e2b095874bc44866b1ca5f1dc38a5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850911205451023040"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:25:31.178] Scheduled build:
{
"id": "8685481143225964561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20211,
"createdBy": "project:chromium",
"createTime": "2026-04-04T04:25:30.282186316Z",
"updateTime": "2026-04-04T04:25:30.282186316Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dce42241be9e2b095874bc44866b1ca5f1dc38a5",
"ref": "refs/heads/main"
}
}
}
[04:25:31.178] Task URL: https://cr-buildbucket.appspot.com/build/8685481143225964561
[04:25:31.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:2:0) after 9m13s
[04:25:32.210] Received PubSub notification, asking Buildbucket for the build status
[04:25:32.241] Build status: SCHEDULED
[04:26:29.390] Received PubSub notification, asking Buildbucket for the build status
[04:26:29.406] Build status: STARTED
[04:34:44.201] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:2:0)
[04:34:44.227] Build status: STARTED
[04:34:44.227] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:5:0) after 9m35s
[04:44:19.551] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:5:0)
[04:44:19.568] Build status: STARTED
[04:44:19.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:6:0) after 8m5s
[04:52:24.843] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:6:0)
[04:52:24.857] Build status: STARTED
[04:52:24.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:7:0) after 8m7s
[05:00:31.882] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:7:0)
[05:00:31.937] Build status: STARTED
[05:00:31.937] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:8:0) after 8m52s
[05:09:23.953] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:8:0)
[05:09:24.069] Build status: STARTED
[05:09:24.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:9:0) after 6m31s
[05:15:55.083] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:9:0)
[05:15:55.197] Build status: STARTED
[05:15:55.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:10:0) after 9m4s
[05:24:59.340] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:10:0)
[05:24:59.514] Build status: STARTED
[05:24:59.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:11:0) after 4m28s
[05:29:27.631] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:11:0)
[05:29:27.652] Build status: STARTED
[05:29:27.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:12:0) after 9m58s
[05:39:25.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:12:0)
[05:39:25.763] Build status: STARTED
[05:39:25.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:13:0) after 2m16s
[05:41:41.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:13:0)
[05:41:41.833] Build status: STARTED
[05:41:41.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:14:0) after 3m29s
[05:45:10.849] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:14:0)
[05:45:10.871] Build status: STARTED
[05:45:10.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:15:0) after 3m56s
[05:49:07.056] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:15:0)
[05:49:07.075] Build status: STARTED
[05:49:07.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:16:0) after 4m34s
[05:53:41.177] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:16:0)
[05:53:41.259] Build status: STARTED
[05:53:41.259] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:17:0) after 3m52s
[05:57:33.545] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:17:0)
[05:57:33.566] Build status: STARTED
[05:57:33.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:18:0) after 7m23s
[06:04:56.709] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:18:0)
[06:04:56.729] Build status: STARTED
[06:04:56.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:19:0) after 6m47s
[06:11:43.976] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:19:0)
[06:11:43.997] Build status: STARTED
[06:11:43.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:20:0) after 2m40s
[06:14:24.081] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:20:0)
[06:14:24.105] Build status: STARTED
[06:14:24.105] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:21:0) after 9m59s
[06:24:23.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:21:0)
[06:24:23.177] Build status: STARTED
[06:24:23.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:22:0) after 6m5s
[06:30:28.193] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:22:0)
[06:30:28.305] Build status: STARTED
[06:30:28.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:23:0) after 3m11s
[06:33:39.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:23:0)
[06:33:39.490] Build status: STARTED
[06:33:39.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:24:0) after 7m32s
[06:41:11.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:24:0)
[06:41:11.492] Build status: STARTED
[06:41:11.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:25:0) after 3m11s
[06:44:22.515] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:25:0)
[06:44:22.538] Build status: STARTED
[06:44:22.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:26:0) after 3m49s
[06:48:11.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:26:0)
[06:48:11.585] Build status: STARTED
[06:48:11.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:27:0) after 2m30s
[06:50:41.604] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:27:0)
[06:50:41.620] Build status: STARTED
[06:50:41.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:28:0) after 6m48s
[06:57:29.784] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:28:0)
[06:57:29.804] Build status: STARTED
[06:57:29.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:29:0) after 9m32s
[07:07:01.978] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:29:0)
[07:07:01.997] Build status: STARTED
[07:07:01.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:30:0) after 5m40s
[07:12:42.247] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:30:0)
[07:12:42.268] Build status: STARTED
[07:12:42.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:31:0) after 8m30s
[07:21:12.512] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:31:0)
[07:21:12.529] Build status: STARTED
[07:21:12.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:32:0) after 2m8s
[07:23:20.776] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:32:0)
[07:23:20.824] Build status: STARTED
[07:23:20.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:33:0) after 6m31s
[07:29:51.876] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:33:0)
[07:29:51.923] Build status: STARTED
[07:29:51.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:34:0) after 9m15s
[07:39:06.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:34:0)
[07:39:07.024] Build status: STARTED
[07:39:07.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:35:0) after 9m24s
[07:48:31.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:35:0)
[07:48:31.061] Build status: STARTED
[07:48:31.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:36:0) after 7m18s
[07:55:49.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:36:0)
[07:55:49.065] Build status: STARTED
[07:55:49.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:37:0) after 5m10s
[08:00:59.057] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:37:0)
[08:00:59.133] Build status: STARTED
[08:00:59.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:38:0) after 1m6s
[08:02:05.329] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:38:0)
[08:02:05.361] Build status: STARTED
[08:02:05.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:39:0) after 3m8s
[08:05:13.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:39:0)
[08:05:13.397] Build status: STARTED
[08:05:13.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:40:0) after 1m16s
[08:06:29.573] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:40:0)
[08:06:29.597] Build status: STARTED
[08:06:29.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:41:0) after 5m6s
[08:11:35.612] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:41:0)
[08:11:35.630] Build status: STARTED
[08:11:35.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:42:0) after 6m26s
[08:18:01.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:42:0)
[08:18:01.663] Build status: STARTED
[08:18:01.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:43:0) after 4m47s
[08:22:48.782] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:43:0)
[08:22:48.830] Build status: STARTED
[08:22:48.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:44:0) after 2m37s
[08:25:25.844] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:44:0)
[08:25:25.919] Build status: STARTED
[08:25:25.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:45:0) after 4m27s
[08:29:53.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:45:0)
[08:29:53.138] Build status: STARTED
[08:29:53.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:46:0) after 5m46s
[08:35:39.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:46:0)
[08:35:39.270] Build status: STARTED
[08:35:39.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:47:0) after 6m1s
[08:41:40.379] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:47:0)
[08:41:40.394] Build status: STARTED
[08:41:40.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:48:0) after 9m35s
[08:51:15.414] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:48:0)
[08:51:15.435] Build status: STARTED
[08:51:15.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:49:0) after 2m8s
[08:53:23.543] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:49:0)
[08:53:23.562] Build status: STARTED
[08:53:23.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:50:0) after 9m19s
[09:02:42.611] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:50:0)
[09:02:42.629] Build status: STARTED
[09:02:42.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:51:0) after 4m49s
[09:07:31.654] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:51:0)
[09:07:31.676] Build status: STARTED
[09:07:31.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8850911205451023040:52:0) after 2m2s
[09:08:11.374] Received PubSub notification, asking Buildbucket for the build status
[09:08:11.405] Build:
{
"id": "8685481143225964561",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 20211,
"createdBy": "project:chromium",
"createTime": "2026-04-04T04:25:30.282186316Z",
"startTime": "2026-04-04T04:26:29.207825003Z",
"endTime": "2026-04-04T09:08:11.092029424Z",
"updateTime": "2026-04-04T09:08:11.092029424Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "dce42241be9e2b095874bc44866b1ca5f1dc38a5",
"ref": "refs/heads/main"
}
}
}
[09:08:11.405] Invocation finished in 4h42m42.628315115s with status FAILED