[01:21:43.101] New invocation is queued and will start shortly
[01:21:44.209] Starting the invocation (attempt 1)
[01:21:44.235] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb"
[01:21:44.235] Popped gitiles commit info from properties and tags
[01:21:44.235] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:21:44.235] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:21:44.235] Buildbucket request:
{
"requestId": "8923309742868695936",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923309742868695936"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:21:44.774] Scheduled build:
{
"id": "8757879680955716369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1561,
"createdBy": "project:chromium",
"createTime": "2024-01-26T01:21:44.304127438Z",
"updateTime": "2024-01-26T01:21:44.304127438Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb",
"ref": "refs/heads/main"
}
}
}
[01:21:44.774] Task URL: https://cr-buildbucket.appspot.com/build/8757879680955716369
[01:21:44.774] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:2:0) after 4m8s
[01:21:45.735] Received PubSub notification, asking Buildbucket for the build status
[01:21:45.755] Build status: SCHEDULED
[01:23:28.238] Received PubSub notification, asking Buildbucket for the build status
[01:23:28.260] Build status: STARTED
[01:25:52.880] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:2:0)
[01:25:52.901] Build status: STARTED
[01:25:52.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:5:0) after 5m41s
[01:31:33.896] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:5:0)
[01:31:34.044] Build status: STARTED
[01:31:34.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:6:0) after 6m39s
[01:38:13.069] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:6:0)
[01:38:13.112] Build status: STARTED
[01:38:13.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:7:0) after 7m37s
[01:45:50.223] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:7:0)
[01:45:50.251] Build status: STARTED
[01:45:50.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:8:0) after 2m53s
[01:48:43.406] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:8:0)
[01:48:43.436] Build status: STARTED
[01:48:43.437] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:9:0) after 1m41s
[01:50:24.572] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:9:0)
[01:50:24.588] Build status: STARTED
[01:50:24.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:10:0) after 3m32s
[01:53:56.620] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:10:0)
[01:53:56.644] Build status: STARTED
[01:53:56.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:11:0) after 1m47s
[01:55:43.668] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:11:0)
[01:55:43.773] Build status: STARTED
[01:55:43.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:12:0) after 6m55s
[02:02:38.799] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:12:0)
[02:02:38.825] Build status: STARTED
[02:02:38.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:13:0) after 8m51s
[02:11:29.900] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:13:0)
[02:11:29.971] Build status: STARTED
[02:11:29.971] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:14:0) after 2m13s
[02:13:43.052] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:14:0)
[02:13:43.071] Build status: STARTED
[02:13:43.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:15:0) after 4m15s
[02:17:58.085] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:15:0)
[02:17:58.152] Build status: STARTED
[02:17:58.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:16:0) after 6m1s
[02:23:59.429] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:16:0)
[02:23:59.447] Build status: STARTED
[02:23:59.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:17:0) after 1m6s
[02:25:05.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:17:0)
[02:25:05.925] Build status: STARTED
[02:25:05.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:18:0) after 7m47s
[02:32:52.943] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:18:0)
[02:32:52.961] Build status: STARTED
[02:32:52.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:19:0) after 8m3s
[02:40:55.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:19:0)
[02:40:56.004] Build status: STARTED
[02:40:56.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:20:0) after 8m17s
[02:49:13.041] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:20:0)
[02:49:13.066] Build status: STARTED
[02:49:13.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:21:0) after 2m12s
[02:51:25.136] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:21:0)
[02:51:25.155] Build status: STARTED
[02:51:25.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:22:0) after 6m15s
[02:57:40.179] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:22:0)
[02:57:40.196] Build status: STARTED
[02:57:40.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:23:0) after 2m12s
[02:59:52.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:23:0)
[02:59:52.236] Build status: STARTED
[02:59:52.236] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:24:0) after 7m20s
[03:07:12.265] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:24:0)
[03:07:12.282] Build status: STARTED
[03:07:12.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:25:0) after 3m51s
[03:11:03.513] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:25:0)
[03:11:03.534] Build status: STARTED
[03:11:03.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:26:0) after 8m19s
[03:19:22.694] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:26:0)
[03:19:22.713] Build status: STARTED
[03:19:22.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:27:0) after 7m17s
[03:26:39.787] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:27:0)
[03:26:39.809] Build status: STARTED
[03:26:39.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:28:0) after 8m15s
[03:34:54.979] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:28:0)
[03:34:55.003] Build status: STARTED
[03:34:55.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:29:0) after 2m40s
[03:37:35.064] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:29:0)
[03:37:35.086] Build status: STARTED
[03:37:35.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:30:0) after 5m18s
[03:42:53.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:30:0)
[03:42:53.242] Build status: STARTED
[03:42:53.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:31:0) after 1m28s
[03:44:21.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:31:0)
[03:44:21.449] Build status: STARTED
[03:44:21.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:32:0) after 9m27s
[03:53:48.443] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:32:0)
[03:53:48.461] Build status: STARTED
[03:53:48.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:33:0) after 1m41s
[03:55:29.557] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:33:0)
[03:55:29.576] Build status: STARTED
[03:55:29.576] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:34:0) after 5m50s
[04:01:19.696] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:34:0)
[04:01:19.715] Build status: STARTED
[04:01:19.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:35:0) after 9m46s
[04:11:05.714] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:35:0)
[04:11:05.785] Build status: STARTED
[04:11:05.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:36:0) after 4m33s
[04:15:38.815] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:36:0)
[04:15:38.875] Build status: STARTED
[04:15:38.875] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:37:0) after 1m59s
[04:17:37.942] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:37:0)
[04:17:37.964] Build status: STARTED
[04:17:37.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:38:0) after 3m54s
[04:21:32.240] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:38:0)
[04:21:32.261] Build status: STARTED
[04:21:32.261] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:39:0) after 4m27s
[04:25:59.311] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:39:0)
[04:25:59.332] Build status: STARTED
[04:25:59.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:40:0) after 8m39s
[04:34:38.371] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:40:0)
[04:34:38.456] Build status: STARTED
[04:34:38.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:41:0) after 8m37s
[04:43:15.711] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:41:0)
[04:43:15.824] Build status: STARTED
[04:43:15.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:42:0) after 2m51s
[04:46:07.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:42:0)
[04:46:07.028] Build status: STARTED
[04:46:07.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:43:0) after 4m19s
[04:50:26.009] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:43:0)
[04:50:26.038] Build status: STARTED
[04:50:26.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:44:0) after 7m50s
[04:58:16.072] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:44:0)
[04:58:16.163] Build status: STARTED
[04:58:16.163] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:45:0) after 6m47s
[05:05:03.195] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:45:0)
[05:05:03.238] Build status: STARTED
[05:05:03.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:46:0) after 2m54s
[05:07:57.261] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:46:0)
[05:07:57.279] Build status: STARTED
[05:07:57.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:47:0) after 8m33s
[05:16:30.300] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:47:0)
[05:16:30.317] Build status: STARTED
[05:16:30.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:48:0) after 2m43s
[05:19:13.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:48:0)
[05:19:13.548] Build status: STARTED
[05:19:13.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:49:0) after 9m16s
[05:29:33.972] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:49:0)
[05:29:33.993] Build status: STARTED
[05:29:33.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:50:0) after 6m23s
[05:35:57.121] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:50:0)
[05:35:57.142] Build status: STARTED
[05:35:57.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:51:0) after 1m51s
[05:37:48.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:51:0)
[05:37:48.193] Build status: STARTED
[05:37:48.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:52:0) after 7m49s
[05:45:37.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:52:0)
[05:45:37.234] Build status: STARTED
[05:45:37.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:53:0) after 7m36s
[05:53:13.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:53:0)
[05:53:13.280] Build status: STARTED
[05:53:13.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:54:0) after 7m21s
[06:00:34.313] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:54:0)
[06:00:34.426] Build status: STARTED
[06:00:34.426] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:55:0) after 4m22s
[06:04:56.448] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:55:0)
[06:04:56.465] Build status: STARTED
[06:04:56.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:56:0) after 1m5s
[06:06:01.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:56:0)
[06:06:01.546] Build status: STARTED
[06:06:01.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:57:0) after 2m23s
[06:08:24.577] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:57:0)
[06:08:24.603] Build status: STARTED
[06:08:24.604] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:58:0) after 1m24s
[06:09:48.627] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:58:0)
[06:09:48.645] Build status: STARTED
[06:09:48.645] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:59:0) after 5m4s
[06:14:52.862] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:59:0)
[06:14:52.883] Build status: STARTED
[06:14:52.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:60:0) after 6m17s
[06:21:09.906] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:60:0)
[06:21:09.935] Build status: STARTED
[06:21:09.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:61:0) after 2m40s
[06:23:49.966] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:61:0)
[06:23:49.983] Build status: STARTED
[06:23:49.983] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:62:0) after 7m1s
[06:30:51.021] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:62:0)
[06:30:51.042] Build status: STARTED
[06:30:51.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:63:0) after 1m54s
[06:32:45.660] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:63:0)
[06:32:46.001] Build status: STARTED
[06:32:46.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:64:0) after 9m40s
[06:42:26.074] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:64:0)
[06:42:26.094] Build status: STARTED
[06:42:26.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923309742868695936:65:0) after 7m57s
[06:47:39.910] Received PubSub notification, asking Buildbucket for the build status
[06:47:39.929] Build:
{
"id": "8757879680955716369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1561,
"createdBy": "project:chromium",
"createTime": "2024-01-26T01:21:44.304127438Z",
"startTime": "2024-01-26T01:23:27.766877Z",
"endTime": "2024-01-26T06:47:38.326752Z",
"updateTime": "2024-01-26T06:47:38.326752Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1684bf2d9a5c02301ae10a86baf6d6a44d0aabdb",
"ref": "refs/heads/main"
}
}
}
[06:47:39.929] Invocation finished in 5h25m56.832825022s with status FAILED