[09:21:57.015] New invocation is queued and will start shortly
[09:21:58.334] Starting the invocation (attempt 1)
[09:21:58.361] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d1015ba3d70880ba31d671e014a041618bfd5d3e"
[09:21:58.361] Popped gitiles commit info from properties and tags
[09:21:58.361] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:21:58.361] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:21:58.361] Buildbucket request:
{
"requestId": "8955532049330833024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1015ba3d70880ba31d671e014a041618bfd5d3e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8955532049330833024"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTLinuxPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:21:58.863] Scheduled build:
{
"id": "8790101987145149665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 7351,
"createdBy": "project:chromium",
"createTime": "2023-02-04T09:21:58.476650469Z",
"updateTime": "2023-02-04T09:21:58.476650469Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1015ba3d70880ba31d671e014a041618bfd5d3e",
"ref": "refs/heads/main"
}
}
}
[09:21:58.863] Task URL: https://cr-buildbucket.appspot.com/build/8790101987145149665
[09:21:58.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:2:0) after 3m32s
[09:23:11.601] Received PubSub notification, asking Buildbucket for the build status
[09:23:11.624] Build status: STARTED
[09:25:30.891] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:2:0)
[09:25:30.912] Build status: STARTED
[09:25:30.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:4:0) after 6m50s
[09:32:20.928] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:4:0)
[09:32:20.957] Build status: STARTED
[09:32:20.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:5:0) after 4m43s
[09:37:04.010] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:5:0)
[09:37:04.036] Build status: STARTED
[09:37:04.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:6:0) after 1m57s
[09:39:01.053] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:6:0)
[09:39:01.103] Build status: STARTED
[09:39:01.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:7:0) after 5m24s
[09:44:25.118] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:7:0)
[09:44:25.147] Build status: STARTED
[09:44:25.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:8:0) after 2m11s
[09:46:36.166] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:8:0)
[09:46:36.199] Build status: STARTED
[09:46:36.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:9:0) after 9m4s
[09:55:40.214] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:9:0)
[09:55:40.236] Build status: STARTED
[09:55:40.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:10:0) after 9m17s
[10:04:57.256] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:10:0)
[10:04:57.282] Build status: STARTED
[10:04:57.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:11:0) after 2m7s
[10:07:04.410] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:11:0)
[10:07:04.440] Build status: STARTED
[10:07:04.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:12:0) after 7m42s
[10:14:46.455] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:12:0)
[10:14:46.480] Build status: STARTED
[10:14:46.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:13:0) after 1m4s
[10:15:50.516] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:13:0)
[10:15:50.536] Build status: STARTED
[10:15:50.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:14:0) after 3m9s
[10:18:59.553] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:14:0)
[10:18:59.573] Build status: STARTED
[10:18:59.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:15:0) after 3m27s
[10:22:26.592] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:15:0)
[10:22:26.772] Build status: STARTED
[10:22:26.772] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:16:0) after 6m17s
[10:28:43.790] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:16:0)
[10:28:43.848] Build status: STARTED
[10:28:43.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:17:0) after 6m11s
[10:34:54.961] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:17:0)
[10:34:55.012] Build status: STARTED
[10:34:55.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:18:0) after 8m46s
[10:43:41.037] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:18:0)
[10:43:41.067] Build status: STARTED
[10:43:41.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:19:0) after 5m31s
[10:49:12.184] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:19:0)
[10:49:12.211] Build status: STARTED
[10:49:12.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:20:0) after 8m4s
[10:57:16.252] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:20:0)
[10:57:16.271] Build status: STARTED
[10:57:16.271] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:21:0) after 3m1s
[11:00:17.291] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:21:0)
[11:00:17.310] Build status: STARTED
[11:00:17.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:22:0) after 5m34s
[11:05:51.536] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:22:0)
[11:05:51.569] Build status: STARTED
[11:05:51.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:23:0) after 2m0s
[11:07:51.590] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:23:0)
[11:07:51.611] Build status: STARTED
[11:07:51.611] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:24:0) after 1m50s
[11:09:41.630] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:24:0)
[11:09:41.656] Build status: STARTED
[11:09:41.656] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:25:0) after 9m35s
[11:19:16.745] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:25:0)
[11:19:16.771] Build status: STARTED
[11:19:16.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:26:0) after 4m37s
[11:23:53.800] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:26:0)
[11:23:53.822] Build status: STARTED
[11:23:53.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:27:0) after 8m2s
[11:31:55.847] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:27:0)
[11:31:55.872] Build status: STARTED
[11:31:55.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:28:0) after 6m55s
[11:38:50.894] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:28:0)
[11:38:50.913] Build status: STARTED
[11:38:50.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:29:0) after 2m8s
[11:40:58.918] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:29:0)
[11:40:58.938] Build status: STARTED
[11:40:58.938] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:30:0) after 4m50s
[11:45:48.965] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:30:0)
[11:45:48.998] Build status: STARTED
[11:45:48.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:31:0) after 6m58s
[11:52:47.016] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:31:0)
[11:52:47.054] Build status: STARTED
[11:52:47.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:32:0) after 5m47s
[11:58:34.082] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:32:0)
[11:58:34.104] Build status: STARTED
[11:58:34.104] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:33:0) after 9m38s
[12:08:12.183] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:33:0)
[12:08:12.204] Build status: STARTED
[12:08:12.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:34:0) after 3m46s
[12:11:58.392] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:34:0)
[12:11:58.438] Build status: STARTED
[12:11:58.438] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:35:0) after 3m40s
[12:15:38.465] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:35:0)
[12:15:38.490] Build status: STARTED
[12:15:38.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:36:0) after 4m30s
[12:20:08.521] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:36:0)
[12:20:08.541] Build status: STARTED
[12:20:08.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:37:0) after 4m24s
[12:24:32.525] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:37:0)
[12:24:32.569] Build status: STARTED
[12:24:32.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:38:0) after 5m24s
[12:29:56.581] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:38:0)
[12:29:56.602] Build status: STARTED
[12:29:56.602] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:39:0) after 2m12s
[12:32:08.984] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:39:0)
[12:32:09.036] Build status: STARTED
[12:32:09.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:40:0) after 6m23s
[12:38:32.054] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:40:0)
[12:38:32.074] Build status: STARTED
[12:38:32.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:41:0) after 9m1s
[12:47:33.104] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:41:0)
[12:47:33.136] Build status: STARTED
[12:47:33.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:42:0) after 4m27s
[12:52:00.161] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:42:0)
[12:52:00.214] Build status: STARTED
[12:52:00.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:43:0) after 2m31s
[12:54:31.323] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:43:0)
[12:54:31.344] Build status: STARTED
[12:54:31.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:44:0) after 7m56s
[13:02:27.549] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:44:0)
[13:02:27.578] Build status: STARTED
[13:02:27.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:45:0) after 8m29s
[13:10:56.660] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:45:0)
[13:10:56.680] Build status: STARTED
[13:10:56.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:46:0) after 1m46s
[13:12:43.344] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:46:0)
[13:12:43.364] Build status: STARTED
[13:12:43.364] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:47:0) after 1m29s
[13:14:12.816] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:47:0)
[13:14:12.867] Build status: STARTED
[13:14:12.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:48:0) after 4m30s
[13:18:42.889] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:48:0)
[13:18:42.969] Build status: STARTED
[13:18:42.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:49:0) after 3m8s
[13:21:50.994] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:49:0)
[13:21:51.017] Build status: STARTED
[13:21:51.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:50:0) after 7m13s
[13:29:04.035] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:50:0)
[13:29:04.084] Build status: STARTED
[13:29:04.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:51:0) after 3m42s
[13:32:46.699] Handling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:51:0)
[13:32:46.731] Build status: STARTED
[13:32:46.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTLinuxPGO:8955532049330833024:52:0) after 6m37s
[13:35:43.207] Received PubSub notification, asking Buildbucket for the build status
[13:35:43.226] Build:
{
"id": "8790101987145149665",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTLinuxPGO"
},
"number": 7351,
"createdBy": "project:chromium",
"createTime": "2023-02-04T09:21:58.476650469Z",
"startTime": "2023-02-04T09:23:10.947610Z",
"endTime": "2023-02-04T13:35:43.010677653Z",
"updateTime": "2023-02-04T13:35:43.010677653Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d1015ba3d70880ba31d671e014a041618bfd5d3e",
"ref": "refs/heads/main"
}
}
}
[13:35:43.226] Invocation finished in 4h13m46.218376584s with status FAILED