[06:45:40.495] New invocation is queued and will start shortly
[06:45:41.604] Starting the invocation (attempt 1)
[06:45:41.638] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/a5bf4efa7172c18b85799f525b06ea4243564f31"
[06:45:41.638] Popped gitiles commit info from properties and tags
[06:45:41.638] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:45:41.638] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:45:41.638] Buildbucket request:
{
"requestId": "8924014137015665776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a5bf4efa7172c18b85799f525b06ea4243564f31",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8924014137015665776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:45:42.277] Scheduled build:
{
"id": "8758584075109815649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1419,
"createdBy": "project:chromium",
"createTime": "2024-01-18T06:45:41.690808837Z",
"updateTime": "2024-01-18T06:45:41.690808837Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a5bf4efa7172c18b85799f525b06ea4243564f31",
"ref": "refs/heads/main"
}
}
}
[06:45:42.277] Task URL: https://cr-buildbucket.appspot.com/build/8758584075109815649
[06:45:42.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:2:0) after 5m39s
[06:45:43.317] Received PubSub notification, asking Buildbucket for the build status
[06:45:43.334] Build status: SCHEDULED
[06:45:46.616] Received PubSub notification, asking Buildbucket for the build status
[06:45:46.645] Build status: STARTED
[06:51:21.296] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:2:0)
[06:51:21.332] Build status: STARTED
[06:51:21.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:5:0) after 5m30s
[06:56:51.324] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:5:0)
[06:56:51.341] Build status: STARTED
[06:56:51.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:6:0) after 9m29s
[07:06:20.522] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:6:0)
[07:06:20.545] Build status: STARTED
[07:06:20.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:7:0) after 4m11s
[07:10:32.351] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:7:0)
[07:10:32.369] Build status: STARTED
[07:10:32.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:8:0) after 2m0s
[07:12:32.586] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:8:0)
[07:12:32.643] Build status: STARTED
[07:12:32.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:9:0) after 2m6s
[07:14:38.664] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:9:0)
[07:14:38.693] Build status: STARTED
[07:14:38.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:10:0) after 5m0s
[07:19:38.829] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:10:0)
[07:19:38.853] Build status: STARTED
[07:19:38.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:11:0) after 9m34s
[07:29:12.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:11:0)
[07:29:12.903] Build status: STARTED
[07:29:12.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:12:0) after 5m49s
[07:35:01.975] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:12:0)
[07:35:02.000] Build status: STARTED
[07:35:02.000] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:13:0) after 4m25s
[07:39:27.129] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:13:0)
[07:39:27.153] Build status: STARTED
[07:39:27.153] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:14:0) after 6m34s
[07:46:01.171] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:14:0)
[07:46:01.219] Build status: STARTED
[07:46:01.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:15:0) after 3m39s
[07:49:40.457] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:15:0)
[07:49:40.523] Build status: STARTED
[07:49:40.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:16:0) after 9m19s
[07:58:59.629] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:16:0)
[07:58:59.643] Build status: STARTED
[07:58:59.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:17:0) after 3m31s
[08:02:30.766] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:17:0)
[08:02:30.811] Build status: STARTED
[08:02:30.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:18:0) after 4m12s
[08:06:42.904] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:18:0)
[08:06:42.923] Build status: STARTED
[08:06:42.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:19:0) after 7m41s
[08:14:23.958] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:19:0)
[08:14:23.975] Build status: STARTED
[08:14:23.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:20:0) after 3m9s
[08:17:32.992] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:20:0)
[08:17:33.010] Build status: STARTED
[08:17:33.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:21:0) after 9m17s
[08:26:50.187] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:21:0)
[08:26:50.223] Build status: STARTED
[08:26:50.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:22:0) after 4m15s
[08:31:05.463] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:22:0)
[08:31:05.517] Build status: STARTED
[08:31:05.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:23:0) after 8m22s
[08:39:27.638] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:23:0)
[08:39:27.661] Build status: STARTED
[08:39:27.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:24:0) after 9m50s
[08:49:17.693] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:24:0)
[08:49:17.739] Build status: STARTED
[08:49:17.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:25:0) after 9m19s
[08:58:36.915] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:25:0)
[08:58:36.939] Build status: STARTED
[08:58:36.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:26:0) after 6m50s
[09:05:26.967] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:26:0)
[09:05:26.997] Build status: STARTED
[09:05:26.997] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:27:0) after 6m33s
[09:12:00.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:27:0)
[09:12:00.041] Build status: STARTED
[09:12:00.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:28:0) after 3m23s
[09:15:23.233] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:28:0)
[09:15:23.252] Build status: STARTED
[09:15:23.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:29:0) after 6m12s
[09:21:35.260] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:29:0)
[09:21:35.279] Build status: STARTED
[09:21:35.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:30:0) after 7m20s
[09:28:55.308] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:30:0)
[09:28:55.330] Build status: STARTED
[09:28:55.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:31:0) after 7m33s
[09:36:28.353] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:31:0)
[09:36:28.372] Build status: STARTED
[09:36:28.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:32:0) after 2m54s
[09:39:22.411] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:32:0)
[09:39:22.429] Build status: STARTED
[09:39:22.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:33:0) after 6m43s
[09:46:05.450] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:33:0)
[09:46:05.477] Build status: STARTED
[09:46:05.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:34:0) after 9m17s
[09:55:22.541] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:34:0)
[09:55:22.558] Build status: STARTED
[09:55:22.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:35:0) after 6m16s
[10:01:38.693] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:35:0)
[10:01:38.742] Build status: STARTED
[10:01:38.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:36:0) after 7m34s
[10:09:12.910] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:36:0)
[10:09:12.925] Build status: STARTED
[10:09:12.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:37:0) after 9m41s
[10:18:54.061] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:37:0)
[10:18:54.077] Build status: STARTED
[10:18:54.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:38:0) after 2m44s
[10:21:38.138] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:38:0)
[10:21:38.167] Build status: STARTED
[10:21:38.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:39:0) after 8m37s
[10:30:15.438] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:39:0)
[10:30:15.462] Build status: STARTED
[10:30:15.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:40:0) after 2m2s
[10:32:17.560] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:40:0)
[10:32:17.577] Build status: STARTED
[10:32:17.577] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:41:0) after 5m24s
[10:37:41.604] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:41:0)
[10:37:41.648] Build status: STARTED
[10:37:41.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:42:0) after 5m8s
[10:42:49.669] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:42:0)
[10:42:49.687] Build status: STARTED
[10:42:49.687] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:43:0) after 3m26s
[10:46:15.807] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:43:0)
[10:46:15.832] Build status: STARTED
[10:46:15.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:44:0) after 5m13s
[10:51:28.853] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:44:0)
[10:51:28.872] Build status: STARTED
[10:51:28.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:45:0) after 1m8s
[10:52:36.977] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:45:0)
[10:52:37.001] Build status: STARTED
[10:52:37.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:46:0) after 7m28s
[11:00:05.115] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:46:0)
[11:00:05.159] Build status: STARTED
[11:00:05.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:47:0) after 7m38s
[11:07:43.180] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:47:0)
[11:07:43.196] Build status: STARTED
[11:07:43.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:48:0) after 7m4s
[11:14:47.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:48:0)
[11:14:47.258] Build status: STARTED
[11:14:47.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:49:0) after 7m31s
[11:22:18.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:49:0)
[11:22:18.518] Build status: STARTED
[11:22:18.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:50:0) after 5m16s
[11:27:34.614] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:50:0)
[11:27:34.632] Build status: STARTED
[11:27:34.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:51:0) after 4m48s
[11:32:22.652] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:51:0)
[11:32:22.672] Build status: STARTED
[11:32:22.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:52:0) after 8m54s
[11:41:16.702] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:52:0)
[11:41:16.721] Build status: STARTED
[11:41:16.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:53:0) after 8m25s
[11:49:42.022] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:53:0)
[11:49:42.041] Build status: STARTED
[11:49:42.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:54:0) after 8m46s
[11:58:28.027] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:54:0)
[11:58:28.045] Build status: STARTED
[11:58:28.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:55:0) after 3m22s
[12:01:50.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:55:0)
[12:01:50.236] Build status: STARTED
[12:01:50.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:56:0) after 7m27s
[12:09:17.439] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:56:0)
[12:09:17.496] Build status: STARTED
[12:09:17.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:57:0) after 4m45s
[12:14:02.470] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:57:0)
[12:14:02.488] Build status: STARTED
[12:14:02.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:58:0) after 6m43s
[12:20:45.520] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:58:0)
[12:20:45.540] Build status: STARTED
[12:20:45.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:59:0) after 3m20s
[12:24:05.604] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:59:0)
[12:24:05.658] Build status: STARTED
[12:24:05.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8924014137015665776:60:0) after 8m15s
[12:28:52.143] Received PubSub notification, asking Buildbucket for the build status
[12:28:52.207] Build:
{
"id": "8758584075109815649",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1419,
"createdBy": "project:chromium",
"createTime": "2024-01-18T06:45:41.690808837Z",
"startTime": "2024-01-18T06:45:45.880740Z",
"endTime": "2024-01-18T12:28:51.110225Z",
"updateTime": "2024-01-18T12:28:51.110225Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "a5bf4efa7172c18b85799f525b06ea4243564f31",
"ref": "refs/heads/main"
}
}
}
[12:28:52.207] Invocation finished in 5h43m11.717600211s with status FAILED