[08:44:46.493] New invocation is queued and will start shortly
[08:44:47.559] Starting the invocation (attempt 1)
[08:44:47.582] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/29d688675f21bc772e0b4874c1fcccf9e1892e79"
[08:44:47.582] Popped gitiles commit info from properties and tags
[08:44:47.582] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:44:47.582] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:44:47.583] Buildbucket request:
{
"requestId": "8911957247363928336",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29d688675f21bc772e0b4874c1fcccf9e1892e79",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8911957247363928336"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:44:48.234] Scheduled build:
{
"id": "8746527185491763809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 12416,
"createdBy": "project:chromium",
"createTime": "2024-05-30T08:44:47.655157194Z",
"updateTime": "2024-05-30T08:44:47.655157194Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29d688675f21bc772e0b4874c1fcccf9e1892e79",
"ref": "refs/heads/main"
}
},
"canary": true
}
[08:44:48.234] Task URL: https://cr-buildbucket.appspot.com/build/8746527185491763809
[08:44:48.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:2:0) after 9m43s
[08:44:48.546] Received PubSub notification, asking Buildbucket for the build status
[08:44:48.570] Build status: SCHEDULED
[08:44:55.813] Received PubSub notification, asking Buildbucket for the build status
[08:44:55.838] Build status: STARTED
[08:54:31.249] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:2:0)
[08:54:31.273] Build status: STARTED
[08:54:31.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:5:0) after 8m52s
[09:03:23.324] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:5:0)
[09:03:23.346] Build status: STARTED
[09:03:23.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:6:0) after 2m59s
[09:06:22.364] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:6:0)
[09:06:22.385] Build status: STARTED
[09:06:22.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:7:0) after 3m45s
[09:10:07.436] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:7:0)
[09:10:07.462] Build status: STARTED
[09:10:07.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:8:0) after 9m36s
[09:19:43.674] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:8:0)
[09:19:43.705] Build status: STARTED
[09:19:43.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:9:0) after 2m4s
[09:21:47.719] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:9:0)
[09:21:47.743] Build status: STARTED
[09:21:47.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:10:0) after 6m55s
[09:28:42.922] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:10:0)
[09:28:42.940] Build status: STARTED
[09:28:42.940] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:11:0) after 1m58s
[09:30:40.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:11:0)
[09:30:40.990] Build status: STARTED
[09:30:40.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:12:0) after 2m57s
[09:33:38.261] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:12:0)
[09:33:38.277] Build status: STARTED
[09:33:38.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:13:0) after 2m6s
[09:35:44.827] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:13:0)
[09:35:44.842] Build status: STARTED
[09:35:44.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:14:0) after 9m59s
[09:45:43.893] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:14:0)
[09:45:43.915] Build status: STARTED
[09:45:43.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:15:0) after 4m39s
[09:50:22.931] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:15:0)
[09:50:22.953] Build status: STARTED
[09:50:22.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:16:0) after 1m5s
[09:51:28.068] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:16:0)
[09:51:28.097] Build status: STARTED
[09:51:28.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:17:0) after 3m26s
[09:54:54.072] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:17:0)
[09:54:54.090] Build status: STARTED
[09:54:54.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:18:0) after 3m52s
[09:58:46.189] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:18:0)
[09:58:46.209] Build status: STARTED
[09:58:46.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:19:0) after 3m56s
[10:02:42.357] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:19:0)
[10:02:42.458] Build status: STARTED
[10:02:42.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:20:0) after 5m59s
[10:08:41.602] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:20:0)
[10:08:41.619] Build status: STARTED
[10:08:41.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:21:0) after 5m56s
[10:14:37.725] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:21:0)
[10:14:37.744] Build status: STARTED
[10:14:37.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:22:0) after 5m2s
[10:19:40.204] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:22:0)
[10:19:40.257] Build status: STARTED
[10:19:40.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:23:0) after 4m43s
[10:24:23.453] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:23:0)
[10:24:23.471] Build status: STARTED
[10:24:23.471] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:24:0) after 7m49s
[10:32:13.049] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:24:0)
[10:32:13.070] Build status: STARTED
[10:32:13.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:25:0) after 9m12s
[10:41:25.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:25:0)
[10:41:25.127] Build status: STARTED
[10:41:25.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:26:0) after 2m19s
[10:43:44.298] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:26:0)
[10:43:44.381] Build status: STARTED
[10:43:44.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:27:0) after 5m55s
[10:49:39.707] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:27:0)
[10:49:39.727] Build status: STARTED
[10:49:39.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:28:0) after 4m41s
[10:54:20.915] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:28:0)
[10:54:21.009] Build status: STARTED
[10:54:21.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:29:0) after 4m40s
[10:59:01.131] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:29:0)
[10:59:01.150] Build status: STARTED
[10:59:01.150] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:30:0) after 2m8s
[11:01:09.382] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:30:0)
[11:01:09.426] Build status: STARTED
[11:01:09.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:31:0) after 1m14s
[11:02:23.943] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:31:0)
[11:02:23.961] Build status: STARTED
[11:02:23.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:32:0) after 9m29s
[11:11:53.005] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:32:0)
[11:11:53.023] Build status: STARTED
[11:11:53.023] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:33:0) after 1m33s
[11:13:26.120] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:33:0)
[11:13:26.147] Build status: STARTED
[11:13:26.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:34:0) after 2m58s
[11:16:24.668] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:34:0)
[11:16:24.775] Build status: STARTED
[11:16:24.775] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:35:0) after 2m9s
[11:18:33.798] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:35:0)
[11:18:33.819] Build status: STARTED
[11:18:33.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:36:0) after 8m0s
[11:26:33.950] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:36:0)
[11:26:33.974] Build status: STARTED
[11:26:33.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:37:0) after 3m17s
[11:29:51.044] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:37:0)
[11:29:51.090] Build status: STARTED
[11:29:51.090] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:38:0) after 3m34s
[11:33:25.426] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:38:0)
[11:33:25.442] Build status: STARTED
[11:33:25.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:39:0) after 1m27s
[11:34:52.443] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:39:0)
[11:34:52.464] Build status: STARTED
[11:34:52.464] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:40:0) after 8m12s
[11:43:04.649] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:40:0)
[11:43:04.764] Build status: STARTED
[11:43:04.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:41:0) after 3m17s
[11:46:21.814] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:41:0)
[11:46:21.832] Build status: STARTED
[11:46:21.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:42:0) after 2m23s
[11:48:44.874] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:42:0)
[11:48:44.890] Build status: STARTED
[11:48:44.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:43:0) after 6m44s
[11:55:28.907] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:43:0)
[11:55:28.929] Build status: STARTED
[11:55:28.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:44:0) after 3m50s
[11:59:19.017] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:44:0)
[11:59:19.043] Build status: STARTED
[11:59:19.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:45:0) after 4m32s
[12:03:51.219] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:45:0)
[12:03:51.252] Build status: STARTED
[12:03:51.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:46:0) after 5m56s
[12:09:47.322] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:46:0)
[12:09:47.346] Build status: STARTED
[12:09:47.347] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:47:0) after 7m56s
[12:17:43.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:47:0)
[12:17:43.381] Build status: STARTED
[12:17:43.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:48:0) after 8m16s
[12:26:00.363] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:48:0)
[12:26:00.380] Build status: STARTED
[12:26:00.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:49:0) after 6m28s
[12:32:28.495] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:49:0)
[12:32:28.511] Build status: STARTED
[12:32:28.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:50:0) after 2m0s
[12:34:28.716] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:50:0)
[12:34:28.737] Build status: STARTED
[12:34:28.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8911957247363928336:51:0) after 7m1s
[12:36:48.189] Received PubSub notification, asking Buildbucket for the build status
[12:36:48.219] Build:
{
"id": "8746527185491763809",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 12416,
"createdBy": "project:chromium",
"createTime": "2024-05-30T08:44:47.655157194Z",
"startTime": "2024-05-30T08:44:55.473861242Z",
"endTime": "2024-05-30T12:35:37.682485784Z",
"updateTime": "2024-05-30T12:35:37.682485784Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "29d688675f21bc772e0b4874c1fcccf9e1892e79",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:36:48.219] Invocation finished in 3h52m1.732361898s with status FAILED