[10:17:04.082] New invocation is queued and will start shortly
[10:17:05.143] Starting the invocation (attempt 1)
[10:17:05.186] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b194ac8608e9c93a6c09e9dcb4b836f0c6772f0d"
[10:17:05.186] Popped gitiles commit info from properties and tags
[10:17:05.186] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[10:17:05.186] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[10:17:05.186] Buildbucket request:
{
"requestId": "8916571886067038448",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b194ac8608e9c93a6c09e9dcb4b836f0c6772f0d",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8916571886067038448"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[10:17:05.722] Scheduled build:
{
"id": "8751141824197531521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 2463,
"createdBy": "project:chromium",
"createTime": "2024-04-09T10:17:05.242410024Z",
"updateTime": "2024-04-09T10:17:05.242410024Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b194ac8608e9c93a6c09e9dcb4b836f0c6772f0d",
"ref": "refs/heads/main"
}
}
}
[10:17:05.722] Task URL: https://cr-buildbucket.appspot.com/build/8751141824197531521
[10:17:05.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:2:0) after 1m3s
[10:17:05.962] Received PubSub notification, asking Buildbucket for the build status
[10:17:06.010] Build status: SCHEDULED
[10:18:09.296] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:2:0)
[10:18:09.315] Build status: SCHEDULED
[10:18:09.315] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:4:0) after 1m3s
[10:18:47.137] Received PubSub notification, asking Buildbucket for the build status
[10:18:47.181] Build status: STARTED
[10:19:12.506] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:4:0)
[10:19:12.544] Build status: STARTED
[10:19:12.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:6:0) after 7m56s
[10:27:08.714] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:6:0)
[10:27:08.749] Build status: STARTED
[10:27:08.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:7:0) after 5m47s
[10:32:56.138] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:7:0)
[10:32:56.189] Build status: STARTED
[10:32:56.189] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:8:0) after 4m39s
[10:37:35.318] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:8:0)
[10:37:35.359] Build status: STARTED
[10:37:35.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:9:0) after 9m17s
[10:46:52.379] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:9:0)
[10:46:52.397] Build status: STARTED
[10:46:52.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:10:0) after 8m47s
[10:55:39.540] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:10:0)
[10:55:39.592] Build status: STARTED
[10:55:39.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:11:0) after 7m36s
[11:03:15.613] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:11:0)
[11:03:15.631] Build status: STARTED
[11:03:15.631] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:12:0) after 5m26s
[11:08:42.044] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:12:0)
[11:08:42.086] Build status: STARTED
[11:08:42.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:13:0) after 2m52s
[11:11:34.204] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:13:0)
[11:11:34.233] Build status: STARTED
[11:11:34.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:14:0) after 6m17s
[11:17:51.408] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:14:0)
[11:17:51.425] Build status: STARTED
[11:17:51.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:15:0) after 7m20s
[11:25:11.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:15:0)
[11:25:11.702] Build status: STARTED
[11:25:11.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:16:0) after 4m58s
[11:30:10.050] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:16:0)
[11:30:10.070] Build status: STARTED
[11:30:10.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:17:0) after 5m2s
[11:35:12.302] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:17:0)
[11:35:12.328] Build status: STARTED
[11:35:12.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:18:0) after 3m29s
[11:38:41.390] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:18:0)
[11:38:41.416] Build status: STARTED
[11:38:41.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:19:0) after 9m20s
[11:48:01.449] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:19:0)
[11:48:01.472] Build status: STARTED
[11:48:01.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:20:0) after 3m38s
[11:51:39.641] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:20:0)
[11:51:39.664] Build status: STARTED
[11:51:39.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:21:0) after 6m22s
[11:58:01.653] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:21:0)
[11:58:01.672] Build status: STARTED
[11:58:01.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:22:0) after 7m56s
[12:05:58.130] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:22:0)
[12:05:58.155] Build status: STARTED
[12:05:58.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:23:0) after 9m43s
[12:15:41.203] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:23:0)
[12:15:41.230] Build status: STARTED
[12:15:41.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:24:0) after 4m45s
[12:20:26.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:24:0)
[12:20:26.233] Build status: STARTED
[12:20:26.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:25:0) after 8m39s
[12:29:05.259] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:25:0)
[12:29:05.290] Build status: STARTED
[12:29:05.290] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:26:0) after 8m29s
[12:37:34.312] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:26:0)
[12:37:34.349] Build status: STARTED
[12:37:34.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:27:0) after 3m11s
[12:40:45.473] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:27:0)
[12:40:45.524] Build status: STARTED
[12:40:45.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:28:0) after 4m57s
[12:45:42.557] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:28:0)
[12:45:42.583] Build status: STARTED
[12:45:42.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:29:0) after 3m39s
[12:49:21.635] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:29:0)
[12:49:21.655] Build status: STARTED
[12:49:21.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:30:0) after 9m21s
[12:58:42.776] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:30:0)
[12:58:42.826] Build status: STARTED
[12:58:42.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:31:0) after 5m42s
[13:04:25.197] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:31:0)
[13:04:25.229] Build status: STARTED
[13:04:25.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:32:0) after 4m47s
[13:09:12.345] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:32:0)
[13:09:12.374] Build status: STARTED
[13:09:12.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:33:0) after 2m50s
[13:12:02.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:33:0)
[13:12:02.953] Build status: STARTED
[13:12:02.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:34:0) after 8m29s
[13:20:32.004] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:34:0)
[13:20:32.027] Build status: STARTED
[13:20:32.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:35:0) after 3m12s
[13:23:44.162] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:35:0)
[13:23:44.197] Build status: STARTED
[13:23:44.197] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:36:0) after 8m3s
[13:31:47.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:36:0)
[13:31:47.576] Build status: STARTED
[13:31:47.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:37:0) after 3m34s
[13:35:21.599] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:37:0)
[13:35:21.618] Build status: STARTED
[13:35:21.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:38:0) after 1m27s
[13:36:48.645] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:38:0)
[13:36:48.662] Build status: STARTED
[13:36:48.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:39:0) after 6m7s
[13:42:55.698] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:39:0)
[13:42:55.745] Build status: STARTED
[13:42:55.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:40:0) after 6m57s
[13:49:52.854] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:40:0)
[13:49:52.883] Build status: STARTED
[13:49:52.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:41:0) after 8m2s
[13:57:54.910] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:41:0)
[13:57:54.966] Build status: STARTED
[13:57:54.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:42:0) after 3m16s
[14:01:11.122] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:42:0)
[14:01:11.291] Build status: STARTED
[14:01:11.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:43:0) after 8m49s
[14:10:00.442] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:43:0)
[14:10:00.501] Build status: STARTED
[14:10:00.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:44:0) after 5m42s
[14:15:42.525] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:44:0)
[14:15:42.591] Build status: STARTED
[14:15:42.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:45:0) after 4m45s
[14:20:27.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:45:0)
[14:20:27.804] Build status: STARTED
[14:20:27.804] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:46:0) after 3m23s
[14:23:50.885] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:46:0)
[14:23:50.965] Build status: STARTED
[14:23:50.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:47:0) after 5m7s
[14:28:58.058] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:47:0)
[14:28:58.118] Build status: STARTED
[14:28:58.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:48:0) after 6m2s
[14:35:00.158] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:48:0)
[14:35:00.183] Build status: STARTED
[14:35:00.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:49:0) after 9m12s
[14:44:12.382] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:49:0)
[14:44:12.477] Build status: STARTED
[14:44:12.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:50:0) after 5m28s
[14:49:40.603] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:50:0)
[14:49:40.634] Build status: STARTED
[14:49:40.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:51:0) after 9m41s
[14:59:22.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:51:0)
[14:59:22.120] Build status: STARTED
[14:59:22.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:52:0) after 2m56s
[15:02:18.237] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:52:0)
[15:02:18.270] Build status: STARTED
[15:02:18.270] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:53:0) after 6m23s
[15:08:41.984] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:53:0)
[15:08:42.016] Build status: STARTED
[15:08:42.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:54:0) after 8m57s
[15:17:39.044] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:54:0)
[15:17:39.087] Build status: STARTED
[15:17:39.087] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:55:0) after 4m16s
[15:21:55.434] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:55:0)
[15:21:55.469] Build status: STARTED
[15:21:55.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:56:0) after 6m31s
[15:28:26.836] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:56:0)
[15:28:26.878] Build status: STARTED
[15:28:26.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:57:0) after 7m58s
[15:36:25.359] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:57:0)
[15:36:25.381] Build status: STARTED
[15:36:25.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:58:0) after 6m11s
[15:42:36.641] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:58:0)
[15:42:36.836] Build status: STARTED
[15:42:36.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:59:0) after 1m35s
[15:44:11.835] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:59:0)
[15:44:11.936] Build status: STARTED
[15:44:11.936] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:60:0) after 8m26s
[15:52:37.960] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:60:0)
[15:52:37.979] Build status: STARTED
[15:52:37.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:61:0) after 2m43s
[15:55:21.157] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:61:0)
[15:55:21.212] Build status: STARTED
[15:55:21.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8916571886067038448:62:0) after 7m9s
[15:56:25.592] Received PubSub notification, asking Buildbucket for the build status
[15:56:25.685] Build:
{
"id": "8751141824197531521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 2463,
"createdBy": "project:chromium",
"createTime": "2024-04-09T10:17:05.242410024Z",
"startTime": "2024-04-09T10:18:46.707008737Z",
"endTime": "2024-04-09T15:56:24.946266657Z",
"updateTime": "2024-04-09T15:56:24.946266657Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b194ac8608e9c93a6c09e9dcb4b836f0c6772f0d",
"ref": "refs/heads/main"
}
}
}
[15:56:25.685] Invocation finished in 5h39m21.610551174s with status FAILED