[18:10:38.750] New invocation is queued and will start shortly
[18:10:39.808] Starting the invocation (attempt 1)
[18:10:39.844] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8aa397b709d188d5e0c2c5be2c5d35569499a092"
[18:10:39.844] Popped gitiles commit info from properties and tags
[18:10:39.844] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:10:39.845] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:10:39.845] Buildbucket request:
{
"requestId": "8899238070554164752",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8aa397b709d188d5e0c2c5be2c5d35569499a092",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8899238070554164752"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:10:40.499] Scheduled build:
{
"id": "8733808008669585137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 14348,
"createdBy": "project:chromium",
"createTime": "2024-10-17T18:10:39.916937187Z",
"updateTime": "2024-10-17T18:10:39.916937187Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8aa397b709d188d5e0c2c5be2c5d35569499a092",
"ref": "refs/heads/main"
}
}
}
[18:10:40.499] Task URL: https://cr-buildbucket.appspot.com/build/8733808008669585137
[18:10:40.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:2:0) after 4m19s
[18:10:41.402] Received PubSub notification, asking Buildbucket for the build status
[18:10:41.431] Build status: SCHEDULED
[18:12:11.812] Received PubSub notification, asking Buildbucket for the build status
[18:12:11.841] Build status: STARTED
[18:14:59.524] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:2:0)
[18:14:59.553] Build status: STARTED
[18:14:59.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:5:0) after 4m48s
[18:19:47.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:5:0)
[18:19:47.600] Build status: STARTED
[18:19:47.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:6:0) after 6m1s
[18:25:48.638] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:6:0)
[18:25:48.655] Build status: STARTED
[18:25:48.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:7:0) after 4m7s
[18:29:55.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:7:0)
[18:29:55.716] Build status: STARTED
[18:29:55.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:8:0) after 8m36s
[18:38:31.743] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:8:0)
[18:38:31.762] Build status: STARTED
[18:38:31.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:9:0) after 4m50s
[18:43:21.840] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:9:0)
[18:43:21.867] Build status: STARTED
[18:43:21.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:10:0) after 3m8s
[18:46:29.890] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:10:0)
[18:46:29.920] Build status: STARTED
[18:46:29.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:11:0) after 2m57s
[18:49:27.002] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:11:0)
[18:49:27.029] Build status: STARTED
[18:49:27.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:12:0) after 6m2s
[18:55:29.050] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:12:0)
[18:55:29.071] Build status: STARTED
[18:55:29.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:13:0) after 2m8s
[18:57:37.111] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:13:0)
[18:57:37.130] Build status: STARTED
[18:57:37.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:14:0) after 2m39s
[19:00:16.299] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:14:0)
[19:00:16.316] Build status: STARTED
[19:00:16.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:15:0) after 3m19s
[19:03:35.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:15:0)
[19:03:35.370] Build status: STARTED
[19:03:35.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:16:0) after 6m17s
[19:09:52.370] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:16:0)
[19:09:52.454] Build status: STARTED
[19:09:52.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:17:0) after 1m25s
[19:11:17.487] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:17:0)
[19:11:17.502] Build status: STARTED
[19:11:17.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:18:0) after 1m19s
[19:12:36.533] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:18:0)
[19:12:36.553] Build status: STARTED
[19:12:36.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:19:0) after 8m49s
[19:21:25.582] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:19:0)
[19:21:25.619] Build status: STARTED
[19:21:25.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:20:0) after 4m8s
[19:25:33.647] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:20:0)
[19:25:33.667] Build status: STARTED
[19:25:33.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:21:0) after 5m19s
[19:30:52.697] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:21:0)
[19:30:52.740] Build status: STARTED
[19:30:52.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:22:0) after 7m36s
[19:38:28.824] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:22:0)
[19:38:28.841] Build status: STARTED
[19:38:28.841] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:23:0) after 2m54s
[19:41:22.864] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:23:0)
[19:41:22.921] Build status: STARTED
[19:41:22.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:24:0) after 5m8s
[19:46:31.009] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:24:0)
[19:46:31.046] Build status: STARTED
[19:46:31.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:25:0) after 5m41s
[19:52:12.159] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:25:0)
[19:52:12.179] Build status: STARTED
[19:52:12.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:26:0) after 9m31s
[20:01:43.281] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:26:0)
[20:01:43.302] Build status: STARTED
[20:01:43.302] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:27:0) after 9m2s
[20:10:45.349] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:27:0)
[20:10:45.376] Build status: STARTED
[20:10:45.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:28:0) after 8m5s
[20:18:50.446] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:28:0)
[20:18:50.463] Build status: STARTED
[20:18:50.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:29:0) after 7m19s
[20:26:09.569] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:29:0)
[20:26:09.589] Build status: STARTED
[20:26:09.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:30:0) after 7m23s
[20:33:32.565] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:30:0)
[20:33:32.584] Build status: STARTED
[20:33:32.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:31:0) after 8m34s
[20:42:06.613] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:31:0)
[20:42:06.638] Build status: STARTED
[20:42:06.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:32:0) after 1m53s
[20:43:59.661] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:32:0)
[20:43:59.687] Build status: STARTED
[20:43:59.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:33:0) after 1m21s
[20:45:20.711] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:33:0)
[20:45:20.738] Build status: STARTED
[20:45:20.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:34:0) after 4m24s
[20:49:44.786] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:34:0)
[20:49:44.804] Build status: STARTED
[20:49:44.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:35:0) after 7m57s
[20:57:41.825] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:35:0)
[20:57:41.842] Build status: STARTED
[20:57:41.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:36:0) after 6m2s
[21:03:43.868] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:36:0)
[21:03:43.884] Build status: STARTED
[21:03:43.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:37:0) after 1m6s
[21:04:49.990] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:37:0)
[21:04:50.005] Build status: STARTED
[21:04:50.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:38:0) after 9m15s
[21:14:05.039] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:38:0)
[21:14:05.070] Build status: STARTED
[21:14:05.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:39:0) after 6m42s
[21:20:47.100] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:39:0)
[21:20:47.121] Build status: STARTED
[21:20:47.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:40:0) after 6m44s
[21:27:31.203] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:40:0)
[21:27:31.223] Build status: STARTED
[21:27:31.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:41:0) after 5m0s
[21:32:31.251] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:41:0)
[21:32:31.267] Build status: STARTED
[21:32:31.267] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:42:0) after 9m47s
[21:42:18.345] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:42:0)
[21:42:18.375] Build status: STARTED
[21:42:18.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:43:0) after 5m15s
[21:47:33.447] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:43:0)
[21:47:33.467] Build status: STARTED
[21:47:33.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:44:0) after 5m56s
[21:53:29.490] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:44:0)
[21:53:29.508] Build status: STARTED
[21:53:29.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:45:0) after 5m43s
[21:59:12.504] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:45:0)
[21:59:12.524] Build status: STARTED
[21:59:12.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:46:0) after 1m6s
[22:00:18.557] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:46:0)
[22:00:18.574] Build status: STARTED
[22:00:18.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:47:0) after 2m30s
[22:02:48.652] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:47:0)
[22:02:48.668] Build status: STARTED
[22:02:48.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:48:0) after 9m12s
[22:12:00.659] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:48:0)
[22:12:00.675] Build status: STARTED
[22:12:00.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:49:0) after 6m58s
[22:18:58.696] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:49:0)
[22:18:58.725] Build status: STARTED
[22:18:58.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:50:0) after 7m3s
[22:26:01.729] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:50:0)
[22:26:01.753] Build status: STARTED
[22:26:01.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:51:0) after 5m13s
[22:31:14.819] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:51:0)
[22:31:14.839] Build status: STARTED
[22:31:14.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:52:0) after 2m50s
[22:34:04.872] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:52:0)
[22:34:04.894] Build status: STARTED
[22:34:04.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:53:0) after 9m29s
[22:43:33.920] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:53:0)
[22:43:33.938] Build status: STARTED
[22:43:33.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:54:0) after 6m16s
[22:49:49.963] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:54:0)
[22:49:50.001] Build status: STARTED
[22:49:50.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:55:0) after 2m36s
[22:52:26.022] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:55:0)
[22:52:26.048] Build status: STARTED
[22:52:26.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:56:0) after 6m14s
[22:58:40.116] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:56:0)
[22:58:40.135] Build status: STARTED
[22:58:40.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:57:0) after 8m30s
[23:07:10.168] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:57:0)
[23:07:10.249] Build status: STARTED
[23:07:10.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:58:0) after 3m46s
[23:10:56.279] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:58:0)
[23:10:56.300] Build status: STARTED
[23:10:56.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:59:0) after 7m5s
[23:18:01.463] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:59:0)
[23:18:01.486] Build status: STARTED
[23:18:01.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8899238070554164752:60:0) after 1m4s
[23:18:53.901] Received PubSub notification, asking Buildbucket for the build status
[23:18:53.917] Build:
{
"id": "8733808008669585137",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 14348,
"createdBy": "project:chromium",
"createTime": "2024-10-17T18:10:39.916937187Z",
"startTime": "2024-10-17T18:12:11.535327704Z",
"endTime": "2024-10-17T23:18:53.601226372Z",
"updateTime": "2024-10-17T23:18:53.601226372Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8aa397b709d188d5e0c2c5be2c5d35569499a092",
"ref": "refs/heads/main"
}
}
}
[23:18:53.917] Invocation finished in 5h8m15.182257447s with status FAILED