[17:16:28.159] New invocation is queued and will start shortly
[17:16:29.233] Starting the invocation (attempt 1)
[17:16:29.262] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8426bcc2f4bdb679ef92bc87e0b371fcc65f0a38"
[17:16:29.262] Popped gitiles commit info from properties and tags
[17:16:29.262] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[17:16:29.262] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[17:16:29.262] Buildbucket request:
{
"requestId": "8906579833316902816",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8426bcc2f4bdb679ef92bc87e0b371fcc65f0a38",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8906579833316902816"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[17:16:30.021] Scheduled build:
{
"id": "8741149771404673409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 3519,
"createdBy": "project:chromium",
"createTime": "2024-07-28T17:16:29.358677749Z",
"updateTime": "2024-07-28T17:16:29.358677749Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8426bcc2f4bdb679ef92bc87e0b371fcc65f0a38",
"ref": "refs/heads/main"
}
}
}
[17:16:30.021] Task URL: https://cr-buildbucket.appspot.com/build/8741149771404673409
[17:16:30.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:2:0) after 6m55s
[17:16:30.899] Received PubSub notification, asking Buildbucket for the build status
[17:16:30.917] Build status: SCHEDULED
[17:23:25.046] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:2:0)
[17:23:25.063] Build status: SCHEDULED
[17:23:25.063] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:4:0) after 7m40s
[17:31:05.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:4:0)
[17:31:05.172] Build status: SCHEDULED
[17:31:05.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:5:0) after 6m57s
[17:38:02.198] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:5:0)
[17:38:02.236] Build status: SCHEDULED
[17:38:02.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:6:0) after 9m20s
[17:47:13.532] Received PubSub notification, asking Buildbucket for the build status
[17:47:13.556] Build status: STARTED
[17:47:22.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:6:0)
[17:47:22.458] Build status: STARTED
[17:47:22.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:8:0) after 5m0s
[17:52:22.476] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:8:0)
[17:52:22.502] Build status: STARTED
[17:52:22.502] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:9:0) after 8m31s
[18:00:53.690] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:9:0)
[18:00:53.750] Build status: STARTED
[18:00:53.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:10:0) after 1m29s
[18:02:22.882] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:10:0)
[18:02:22.899] Build status: STARTED
[18:02:22.899] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:11:0) after 3m56s
[18:06:18.929] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:11:0)
[18:06:18.951] Build status: STARTED
[18:06:18.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:12:0) after 9m27s
[18:15:46.149] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:12:0)
[18:15:46.172] Build status: STARTED
[18:15:46.172] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:13:0) after 6m37s
[18:22:23.192] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:13:0)
[18:22:23.217] Build status: STARTED
[18:22:23.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:14:0) after 2m53s
[18:25:16.269] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:14:0)
[18:25:16.334] Build status: STARTED
[18:25:16.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:15:0) after 1m10s
[18:26:26.364] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:15:0)
[18:26:26.385] Build status: STARTED
[18:26:26.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:16:0) after 6m18s
[18:32:44.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:16:0)
[18:32:44.686] Build status: STARTED
[18:32:44.686] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:17:0) after 2m17s
[18:35:01.747] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:17:0)
[18:35:01.764] Build status: STARTED
[18:35:01.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:18:0) after 2m37s
[18:37:38.847] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:18:0)
[18:37:38.868] Build status: STARTED
[18:37:38.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:19:0) after 2m10s
[18:39:48.891] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:19:0)
[18:39:48.915] Build status: STARTED
[18:39:48.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:20:0) after 2m7s
[18:41:56.015] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:20:0)
[18:41:56.060] Build status: STARTED
[18:41:56.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:21:0) after 8m50s
[18:50:46.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:21:0)
[18:50:46.199] Build status: STARTED
[18:50:46.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:22:0) after 5m9s
[18:55:55.379] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:22:0)
[18:55:55.396] Build status: STARTED
[18:55:55.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:23:0) after 1m17s
[18:57:12.469] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:23:0)
[18:57:12.498] Build status: STARTED
[18:57:12.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:24:0) after 2m50s
[19:00:02.583] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:24:0)
[19:00:02.626] Build status: STARTED
[19:00:02.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:25:0) after 4m38s
[19:04:40.641] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:25:0)
[19:04:40.663] Build status: STARTED
[19:04:40.663] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:26:0) after 7m55s
[19:12:35.868] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:26:0)
[19:12:35.886] Build status: STARTED
[19:12:35.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:27:0) after 1m33s
[19:14:08.903] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:27:0)
[19:14:08.923] Build status: STARTED
[19:14:08.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:28:0) after 7m32s
[19:21:41.140] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:28:0)
[19:21:41.165] Build status: STARTED
[19:21:41.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:29:0) after 3m29s
[19:25:10.439] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:29:0)
[19:25:10.469] Build status: STARTED
[19:25:10.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:30:0) after 4m1s
[19:29:11.629] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:30:0)
[19:29:11.649] Build status: STARTED
[19:29:11.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:31:0) after 6m25s
[19:35:36.667] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:31:0)
[19:35:36.715] Build status: STARTED
[19:35:36.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:32:0) after 3m3s
[19:38:40.168] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:32:0)
[19:38:40.188] Build status: STARTED
[19:38:40.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:33:0) after 9m25s
[19:48:05.209] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:33:0)
[19:48:05.236] Build status: STARTED
[19:48:05.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:34:0) after 9m4s
[19:57:09.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:34:0)
[19:57:09.316] Build status: STARTED
[19:57:09.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:35:0) after 4m22s
[20:01:31.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:35:0)
[20:01:31.372] Build status: STARTED
[20:01:31.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:36:0) after 4m44s
[20:06:15.396] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:36:0)
[20:06:15.447] Build status: STARTED
[20:06:15.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:37:0) after 9m15s
[20:15:30.708] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:37:0)
[20:15:30.726] Build status: STARTED
[20:15:30.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:38:0) after 8m59s
[20:24:29.747] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:38:0)
[20:24:29.763] Build status: STARTED
[20:24:29.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:39:0) after 9m56s
[20:34:25.781] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:39:0)
[20:34:25.799] Build status: STARTED
[20:34:25.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:40:0) after 5m7s
[20:39:32.821] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:40:0)
[20:39:33.045] Build status: STARTED
[20:39:33.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:41:0) after 7m17s
[20:46:50.064] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:41:0)
[20:46:50.113] Build status: STARTED
[20:46:50.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:42:0) after 5m54s
[20:52:44.204] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:42:0)
[20:52:44.233] Build status: STARTED
[20:52:44.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:43:0) after 9m36s
[21:02:20.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:43:0)
[21:02:20.240] Build status: STARTED
[21:02:20.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:44:0) after 8m57s
[21:11:17.259] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:44:0)
[21:11:17.299] Build status: STARTED
[21:11:17.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:45:0) after 1m15s
[21:12:32.488] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:45:0)
[21:12:32.514] Build status: STARTED
[21:12:32.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:46:0) after 9m19s
[21:21:51.713] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:46:0)
[21:21:51.733] Build status: STARTED
[21:21:51.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:47:0) after 3m42s
[21:25:33.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:47:0)
[21:25:33.889] Build status: STARTED
[21:25:33.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:48:0) after 3m40s
[21:29:13.961] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:48:0)
[21:29:14.018] Build status: STARTED
[21:29:14.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:49:0) after 5m5s
[21:34:19.130] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:49:0)
[21:34:19.195] Build status: STARTED
[21:34:19.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:50:0) after 7m14s
[21:41:33.218] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:50:0)
[21:41:33.237] Build status: STARTED
[21:41:33.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:51:0) after 1m27s
[21:43:00.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:51:0)
[21:43:00.308] Build status: STARTED
[21:43:00.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:52:0) after 1m38s
[21:44:38.336] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:52:0)
[21:44:38.356] Build status: STARTED
[21:44:38.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:53:0) after 8m55s
[21:53:33.558] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:53:0)
[21:53:33.574] Build status: STARTED
[21:53:33.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:54:0) after 3m20s
[21:56:53.617] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:54:0)
[21:56:53.695] Build status: STARTED
[21:56:53.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:55:0) after 5m19s
[22:02:12.944] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:55:0)
[22:02:12.964] Build status: STARTED
[22:02:12.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:56:0) after 2m23s
[22:04:35.996] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:56:0)
[22:04:36.026] Build status: STARTED
[22:04:36.026] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:57:0) after 4m24s
[22:09:00.048] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:57:0)
[22:09:00.069] Build status: STARTED
[22:09:00.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:58:0) after 6m19s
[22:15:19.092] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:58:0)
[22:15:19.118] Build status: STARTED
[22:15:19.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:59:0) after 2m16s
[22:17:35.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:59:0)
[22:17:35.163] Build status: STARTED
[22:17:35.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:60:0) after 2m36s
[22:20:11.205] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:60:0)
[22:20:11.235] Build status: STARTED
[22:20:11.235] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:61:0) after 5m56s
[22:26:07.385] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:61:0)
[22:26:07.406] Build status: STARTED
[22:26:07.406] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:62:0) after 1m7s
[22:27:14.599] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:62:0)
[22:27:14.643] Build status: STARTED
[22:27:14.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:63:0) after 3m51s
[22:31:05.859] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:63:0)
[22:31:05.918] Build status: STARTED
[22:31:05.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:64:0) after 2m51s
[22:33:57.056] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:64:0)
[22:33:57.075] Build status: STARTED
[22:33:57.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8906579833316902816:65:0) after 7m41s
[22:37:48.905] Received PubSub notification, asking Buildbucket for the build status
[22:37:48.924] Build:
{
"id": "8741149771404673409",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 3519,
"createdBy": "project:chromium",
"createTime": "2024-07-28T17:16:29.358677749Z",
"startTime": "2024-07-28T17:47:13.176948770Z",
"endTime": "2024-07-28T22:36:31.149221750Z",
"updateTime": "2024-07-28T22:36:31.149221750Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8426bcc2f4bdb679ef92bc87e0b371fcc65f0a38",
"ref": "refs/heads/main"
}
}
}
[22:37:48.924] Invocation finished in 5h21m20.773233347s with status FAILED