[16:43:28.063] New invocation is queued and will start shortly
[16:43:29.128] Starting the invocation (attempt 1)
[16:43:29.153] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f3ca28df5439f0c1a817393491e863278eea0187"
[16:43:29.153] Popped gitiles commit info from properties and tags
[16:43:29.153] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:43:29.153] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:43:29.153] Buildbucket request:
{
"requestId": "8887012964853390208",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3ca28df5439f0c1a817393491e863278eea0187",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8887012964853390208"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:43:29.825] Scheduled build:
{
"id": "8721582903000543089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15717,
"createdBy": "project:chromium",
"createTime": "2025-03-01T16:43:29.208116125Z",
"updateTime": "2025-03-01T16:43:29.208116125Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3ca28df5439f0c1a817393491e863278eea0187",
"ref": "refs/heads/main"
}
}
}
[16:43:29.825] Task URL: https://cr-buildbucket.appspot.com/build/8721582903000543089
[16:43:29.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:2:0) after 2m17s
[16:43:30.835] Received PubSub notification, asking Buildbucket for the build status
[16:43:30.860] Build status: SCHEDULED
[16:44:33.992] Received PubSub notification, asking Buildbucket for the build status
[16:44:34.017] Build status: STARTED
[16:45:46.851] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:2:0)
[16:45:46.875] Build status: STARTED
[16:45:46.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:5:0) after 7m56s
[16:53:42.944] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:5:0)
[16:53:42.996] Build status: STARTED
[16:53:42.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:6:0) after 6m14s
[16:59:57.041] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:6:0)
[16:59:57.065] Build status: STARTED
[16:59:57.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:7:0) after 7m25s
[17:07:22.610] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:7:0)
[17:07:22.636] Build status: STARTED
[17:07:22.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:8:0) after 1m2s
[17:08:24.636] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:8:0)
[17:08:24.671] Build status: STARTED
[17:08:24.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:9:0) after 7m12s
[17:15:36.759] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:9:0)
[17:15:36.781] Build status: STARTED
[17:15:36.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:10:0) after 1m17s
[17:16:53.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:10:0)
[17:16:53.892] Build status: STARTED
[17:16:53.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:11:0) after 9m41s
[17:26:35.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:11:0)
[17:26:35.029] Build status: STARTED
[17:26:35.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:12:0) after 1m1s
[17:27:36.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:12:0)
[17:27:36.078] Build status: STARTED
[17:27:36.078] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:13:0) after 9m26s
[17:37:02.227] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:13:0)
[17:37:02.252] Build status: STARTED
[17:37:02.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:14:0) after 2m53s
[17:39:55.500] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:14:0)
[17:39:55.574] Build status: STARTED
[17:39:55.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:15:0) after 9m7s
[17:49:02.765] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:15:0)
[17:49:02.784] Build status: STARTED
[17:49:02.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:16:0) after 5m14s
[17:54:16.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:16:0)
[17:54:16.940] Build status: STARTED
[17:54:16.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:17:0) after 8m49s
[18:03:05.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:17:0)
[18:03:05.981] Build status: STARTED
[18:03:05.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:18:0) after 4m31s
[18:07:37.399] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:18:0)
[18:07:37.422] Build status: STARTED
[18:07:37.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:19:0) after 4m26s
[18:12:03.448] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:19:0)
[18:12:03.463] Build status: STARTED
[18:12:03.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:20:0) after 5m57s
[18:18:00.594] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:20:0)
[18:18:00.612] Build status: STARTED
[18:18:00.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:21:0) after 5m35s
[18:23:35.642] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:21:0)
[18:23:35.694] Build status: STARTED
[18:23:35.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:22:0) after 2m33s
[18:26:08.799] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:22:0)
[18:26:08.817] Build status: STARTED
[18:26:08.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:23:0) after 3m48s
[18:29:56.845] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:23:0)
[18:29:56.873] Build status: STARTED
[18:29:56.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:24:0) after 1m31s
[18:31:28.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:24:0)
[18:31:28.159] Build status: STARTED
[18:31:28.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:25:0) after 8m9s
[18:39:37.332] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:25:0)
[18:39:37.344] Build status: STARTED
[18:39:37.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:26:0) after 1m58s
[18:41:35.534] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:26:0)
[18:41:35.552] Build status: STARTED
[18:41:35.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:27:0) after 8m43s
[18:50:18.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:27:0)
[18:50:18.677] Build status: STARTED
[18:50:18.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:28:0) after 3m4s
[18:53:22.713] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:28:0)
[18:53:22.730] Build status: STARTED
[18:53:22.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:29:0) after 6m8s
[18:59:30.753] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:29:0)
[18:59:30.769] Build status: STARTED
[18:59:30.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:30:0) after 6m56s
[19:06:26.797] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:30:0)
[19:06:26.815] Build status: STARTED
[19:06:26.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:31:0) after 6m45s
[19:13:11.835] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:31:0)
[19:13:11.849] Build status: STARTED
[19:13:11.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:32:0) after 2m7s
[19:15:18.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:32:0)
[19:15:18.992] Build status: STARTED
[19:15:18.992] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:33:0) after 9m7s
[19:24:26.180] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:33:0)
[19:24:26.198] Build status: STARTED
[19:24:26.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:34:0) after 9m13s
[19:33:39.215] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:34:0)
[19:33:39.238] Build status: STARTED
[19:33:39.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:35:0) after 3m33s
[19:37:12.289] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:35:0)
[19:37:12.431] Build status: STARTED
[19:37:12.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:36:0) after 8m28s
[19:45:40.439] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:36:0)
[19:45:40.458] Build status: STARTED
[19:45:40.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:37:0) after 1m18s
[19:46:58.644] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:37:0)
[19:46:58.668] Build status: STARTED
[19:46:58.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:38:0) after 7m36s
[19:54:34.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:38:0)
[19:54:34.737] Build status: STARTED
[19:54:34.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:39:0) after 1m55s
[19:56:29.926] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:39:0)
[19:56:29.943] Build status: STARTED
[19:56:29.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:40:0) after 2m34s
[19:59:03.970] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:40:0)
[19:59:04.007] Build status: STARTED
[19:59:04.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:41:0) after 7m7s
[20:06:11.052] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:41:0)
[20:06:11.087] Build status: STARTED
[20:06:11.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:42:0) after 3m13s
[20:09:24.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:42:0)
[20:09:24.132] Build status: STARTED
[20:09:24.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:43:0) after 3m9s
[20:12:33.149] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:43:0)
[20:12:33.165] Build status: STARTED
[20:12:33.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:44:0) after 3m27s
[20:16:00.172] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:44:0)
[20:16:00.192] Build status: STARTED
[20:16:00.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:45:0) after 4m59s
[20:20:59.211] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:45:0)
[20:20:59.237] Build status: STARTED
[20:20:59.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:46:0) after 4m42s
[20:25:41.253] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:46:0)
[20:25:41.269] Build status: STARTED
[20:25:41.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:47:0) after 4m24s
[20:30:05.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:47:0)
[20:30:05.454] Build status: STARTED
[20:30:05.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:48:0) after 8m53s
[20:38:58.811] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:48:0)
[20:38:58.835] Build status: STARTED
[20:38:58.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:49:0) after 2m27s
[20:41:25.857] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:49:0)
[20:41:25.875] Build status: STARTED
[20:41:25.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:50:0) after 4m52s
[20:46:17.974] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:50:0)
[20:46:17.991] Build status: STARTED
[20:46:17.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:51:0) after 4m42s
[20:51:00.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:51:0)
[20:51:00.025] Build status: STARTED
[20:51:00.025] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:52:0) after 7m57s
[20:58:57.121] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:52:0)
[20:58:57.138] Build status: STARTED
[20:58:57.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:53:0) after 6m30s
[21:05:27.176] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:53:0)
[21:05:27.249] Build status: STARTED
[21:05:27.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:54:0) after 6m57s
[21:12:24.333] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:54:0)
[21:12:24.350] Build status: STARTED
[21:12:24.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:55:0) after 8m58s
[21:21:22.475] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:55:0)
[21:21:22.543] Build status: STARTED
[21:21:22.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:56:0) after 4m31s
[21:25:53.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:56:0)
[21:25:53.656] Build status: STARTED
[21:25:53.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8887012964853390208:57:0) after 8m4s
[21:27:31.795] Received PubSub notification, asking Buildbucket for the build status
[21:27:31.811] Build:
{
"id": "8721582903000543089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15717,
"createdBy": "project:chromium",
"createTime": "2025-03-01T16:43:29.208116125Z",
"startTime": "2025-03-01T16:44:33.826098076Z",
"endTime": "2025-03-01T21:27:31.520888049Z",
"updateTime": "2025-03-01T21:27:31.520888049Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f3ca28df5439f0c1a817393491e863278eea0187",
"ref": "refs/heads/main"
}
}
}
[21:27:31.811] Invocation finished in 4h44m3.753688599s with status FAILED