[18:56:29.093] New invocation is queued and will start shortly
[18:56:30.185] Starting the invocation (attempt 1)
[18:56:30.216] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/aa181ba84ebb48c252e5198a0fee6d5b4b7040aa"
[18:56:30.216] Popped gitiles commit info from properties and tags
[18:56:30.216] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:56:30.216] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:56:30.216] Buildbucket request:
{
"requestId": "8886913999172263488",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa181ba84ebb48c252e5198a0fee6d5b4b7040aa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8886913999172263488"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:56:30.846] Scheduled build:
{
"id": "8721483937276074929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15723,
"createdBy": "project:chromium",
"createTime": "2025-03-02T18:56:30.278513076Z",
"updateTime": "2025-03-02T18:56:30.278513076Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa181ba84ebb48c252e5198a0fee6d5b4b7040aa",
"ref": "refs/heads/main"
}
}
}
[18:56:30.846] Task URL: https://cr-buildbucket.appspot.com/build/8721483937276074929
[18:56:30.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:2:0) after 9m49s
[18:56:31.780] Received PubSub notification, asking Buildbucket for the build status
[18:56:31.804] Build status: SCHEDULED
[18:57:37.013] Received PubSub notification, asking Buildbucket for the build status
[18:57:37.034] Build status: STARTED
[19:06:19.867] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:2:0)
[19:06:19.889] Build status: STARTED
[19:06:19.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:5:0) after 8m14s
[19:14:33.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:5:0)
[19:14:33.932] Build status: STARTED
[19:14:33.932] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:6:0) after 2m24s
[19:16:58.000] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:6:0)
[19:16:58.033] Build status: STARTED
[19:16:58.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:7:0) after 8m23s
[19:25:21.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:7:0)
[19:25:21.071] Build status: STARTED
[19:25:21.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:8:0) after 2m59s
[19:28:20.196] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:8:0)
[19:28:20.236] Build status: STARTED
[19:28:20.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:9:0) after 2m59s
[19:31:19.378] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:9:0)
[19:31:19.405] Build status: STARTED
[19:31:19.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:10:0) after 8m29s
[19:39:48.424] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:10:0)
[19:39:48.530] Build status: STARTED
[19:39:48.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:11:0) after 2m27s
[19:42:15.628] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:11:0)
[19:42:15.659] Build status: STARTED
[19:42:15.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:12:0) after 4m5s
[19:46:20.785] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:12:0)
[19:46:20.809] Build status: STARTED
[19:46:20.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:13:0) after 1m17s
[19:47:37.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:13:0)
[19:47:37.856] Build status: STARTED
[19:47:37.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:14:0) after 1m43s
[19:49:20.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:14:0)
[19:49:20.896] Build status: STARTED
[19:49:20.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:15:0) after 7m4s
[19:56:24.912] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:15:0)
[19:56:25.090] Build status: STARTED
[19:56:25.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:16:0) after 3m7s
[19:59:32.139] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:16:0)
[19:59:32.209] Build status: STARTED
[19:59:32.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:17:0) after 1m2s
[20:00:34.586] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:17:0)
[20:00:34.610] Build status: STARTED
[20:00:34.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:18:0) after 1m45s
[20:02:19.598] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:18:0)
[20:02:19.619] Build status: STARTED
[20:02:19.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:19:0) after 5m5s
[20:07:24.646] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:19:0)
[20:07:24.663] Build status: STARTED
[20:07:24.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:20:0) after 1m32s
[20:08:56.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:20:0)
[20:08:56.815] Build status: STARTED
[20:08:56.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:21:0) after 2m46s
[20:11:42.829] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:21:0)
[20:11:42.859] Build status: STARTED
[20:11:42.859] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:22:0) after 7m49s
[20:19:31.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:22:0)
[20:19:31.985] Build status: STARTED
[20:19:31.985] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:23:0) after 9m43s
[20:29:15.042] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:23:0)
[20:29:15.126] Build status: STARTED
[20:29:15.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:24:0) after 6m26s
[20:35:41.514] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:24:0)
[20:35:41.596] Build status: STARTED
[20:35:41.596] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:25:0) after 2m28s
[20:38:09.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:25:0)
[20:38:09.718] Build status: STARTED
[20:38:09.718] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:26:0) after 2m6s
[20:40:15.812] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:26:0)
[20:40:15.826] Build status: STARTED
[20:40:15.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:27:0) after 7m50s
[20:48:06.234] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:27:0)
[20:48:06.310] Build status: STARTED
[20:48:06.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:28:0) after 5m34s
[20:53:40.462] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:28:0)
[20:53:40.479] Build status: STARTED
[20:53:40.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:29:0) after 2m1s
[20:55:41.560] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:29:0)
[20:55:41.574] Build status: STARTED
[20:55:41.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:30:0) after 8m9s
[21:03:50.596] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:30:0)
[21:03:50.617] Build status: STARTED
[21:03:50.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:31:0) after 4m42s
[21:08:32.640] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:31:0)
[21:08:32.659] Build status: STARTED
[21:08:32.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:32:0) after 1m31s
[21:10:03.738] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:32:0)
[21:10:03.780] Build status: STARTED
[21:10:03.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:33:0) after 3m51s
[21:13:54.883] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:33:0)
[21:13:54.902] Build status: STARTED
[21:13:54.902] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:34:0) after 1m24s
[21:15:19.162] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:34:0)
[21:15:19.223] Build status: STARTED
[21:15:19.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:35:0) after 8m20s
[21:23:39.241] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:35:0)
[21:23:39.355] Build status: STARTED
[21:23:39.355] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:36:0) after 1m12s
[21:24:51.691] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:36:0)
[21:24:51.713] Build status: STARTED
[21:24:51.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:37:0) after 7m52s
[21:32:43.742] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:37:0)
[21:32:43.887] Build status: STARTED
[21:32:43.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:38:0) after 4m13s
[21:36:56.941] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:38:0)
[21:36:56.966] Build status: STARTED
[21:36:56.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:39:0) after 8m2s
[21:44:58.985] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:39:0)
[21:44:59.009] Build status: STARTED
[21:44:59.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:40:0) after 7m9s
[21:52:08.036] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:40:0)
[21:52:08.063] Build status: STARTED
[21:52:08.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:41:0) after 9m43s
[22:01:51.086] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:41:0)
[22:01:51.102] Build status: STARTED
[22:01:51.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:42:0) after 4m24s
[22:06:15.264] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:42:0)
[22:06:15.282] Build status: STARTED
[22:06:15.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:43:0) after 8m42s
[22:14:57.266] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:43:0)
[22:14:57.287] Build status: STARTED
[22:14:57.287] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:44:0) after 3m35s
[22:18:32.325] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:44:0)
[22:18:32.341] Build status: STARTED
[22:18:32.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:45:0) after 2m41s
[22:21:13.577] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:45:0)
[22:21:13.597] Build status: STARTED
[22:21:13.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:46:0) after 3m5s
[22:24:18.639] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:46:0)
[22:24:18.659] Build status: STARTED
[22:24:18.659] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:47:0) after 9m1s
[22:33:19.778] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:47:0)
[22:33:19.793] Build status: STARTED
[22:33:19.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:48:0) after 2m32s
[22:35:51.826] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:48:0)
[22:35:51.848] Build status: STARTED
[22:35:51.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:49:0) after 7m48s
[22:43:39.870] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:49:0)
[22:43:39.896] Build status: STARTED
[22:43:39.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:50:0) after 6m28s
[22:50:07.919] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:50:0)
[22:50:08.008] Build status: STARTED
[22:50:08.008] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8886913999172263488:51:0) after 9m48s
[22:59:21.670] Received PubSub notification, asking Buildbucket for the build status
[22:59:21.686] Build:
{
"id": "8721483937276074929",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 15723,
"createdBy": "project:chromium",
"createTime": "2025-03-02T18:56:30.278513076Z",
"startTime": "2025-03-02T18:57:36.757941193Z",
"endTime": "2025-03-02T22:59:21.263578346Z",
"updateTime": "2025-03-02T22:59:21.263578346Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "aa181ba84ebb48c252e5198a0fee6d5b4b7040aa",
"ref": "refs/heads/main"
}
}
}
[22:59:21.686] Invocation finished in 4h2m52.600492119s with status FAILED