[21:15:58.100] New invocation is queued and will start shortly
[21:15:59.286] Starting the invocation (attempt 1)
[21:15:59.311] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/484bfa56b7fc137e518dcaad415c7870a3a6a1dc"
[21:15:59.311] Popped gitiles commit info from properties and tags
[21:15:59.311] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:15:59.311] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:15:59.311] Buildbucket request:
{
"requestId": "8880110451153141056",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "484bfa56b7fc137e518dcaad415c7870a3a6a1dc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8880110451153141056"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:15:59.975] Scheduled build:
{
"id": "8714680389132702049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 11875,
"createdBy": "project:chromium",
"createTime": "2025-05-16T21:15:59.402967986Z",
"updateTime": "2025-05-16T21:15:59.402967986Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "484bfa56b7fc137e518dcaad415c7870a3a6a1dc",
"ref": "refs/heads/main"
}
}
}
[21:15:59.975] Task URL: https://cr-buildbucket.appspot.com/build/8714680389132702049
[21:15:59.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:2:0) after 8m28s
[21:16:00.968] Received PubSub notification, asking Buildbucket for the build status
[21:16:01.016] Build status: SCHEDULED
[21:24:27.996] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:2:0)
[21:24:28.018] Build status: SCHEDULED
[21:24:28.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:4:0) after 6m10s
[21:30:38.113] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:4:0)
[21:30:38.144] Build status: SCHEDULED
[21:30:38.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:5:0) after 5m20s
[21:35:58.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:5:0)
[21:35:58.222] Build status: SCHEDULED
[21:35:58.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:6:0) after 6m21s
[21:42:19.396] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:6:0)
[21:42:19.477] Build status: SCHEDULED
[21:42:19.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:7:0) after 7m0s
[21:49:19.546] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:7:0)
[21:49:19.565] Build status: SCHEDULED
[21:49:19.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:8:0) after 6m57s
[21:56:16.595] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:8:0)
[21:56:16.619] Build status: SCHEDULED
[21:56:16.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:9:0) after 5m57s
[22:02:13.641] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:9:0)
[22:02:13.766] Build status: SCHEDULED
[22:02:13.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:10:0) after 7m54s
[22:10:07.795] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:10:0)
[22:10:07.835] Build status: SCHEDULED
[22:10:07.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:11:0) after 2m56s
[22:13:03.857] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:11:0)
[22:13:03.883] Build status: SCHEDULED
[22:13:03.883] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:12:0) after 9m56s
[22:18:24.046] Received PubSub notification, asking Buildbucket for the build status
[22:18:24.074] Build status: STARTED
[22:22:59.871] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:12:0)
[22:22:59.968] Build status: STARTED
[22:22:59.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:14:0) after 5m17s
[22:28:16.993] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:14:0)
[22:28:17.013] Build status: STARTED
[22:28:17.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:15:0) after 5m23s
[22:33:40.045] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:15:0)
[22:33:40.062] Build status: STARTED
[22:33:40.062] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:16:0) after 5m12s
[22:38:52.144] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:16:0)
[22:38:52.180] Build status: STARTED
[22:38:52.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:17:0) after 6m37s
[22:45:29.317] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:17:0)
[22:45:29.334] Build status: STARTED
[22:45:29.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:18:0) after 4m12s
[22:49:41.365] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:18:0)
[22:49:41.424] Build status: STARTED
[22:49:41.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:19:0) after 7m59s
[22:57:40.415] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:19:0)
[22:57:40.430] Build status: STARTED
[22:57:40.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:20:0) after 1m5s
[22:58:45.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:20:0)
[22:58:45.486] Build status: STARTED
[22:58:45.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:21:0) after 6m31s
[23:05:16.519] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:21:0)
[23:05:16.538] Build status: STARTED
[23:05:16.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:22:0) after 1m2s
[23:06:18.620] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:22:0)
[23:06:18.635] Build status: STARTED
[23:06:18.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:23:0) after 5m29s
[23:11:47.656] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:23:0)
[23:11:47.670] Build status: STARTED
[23:11:47.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:24:0) after 6m59s
[23:18:46.756] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:24:0)
[23:18:46.777] Build status: STARTED
[23:18:46.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:25:0) after 4m14s
[23:23:00.850] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:25:0)
[23:23:00.963] Build status: STARTED
[23:23:00.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:26:0) after 9m49s
[23:32:49.991] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:26:0)
[23:32:50.010] Build status: STARTED
[23:32:50.010] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:27:0) after 9m58s
[23:42:48.038] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:27:0)
[23:42:48.060] Build status: STARTED
[23:42:48.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:28:0) after 4m44s
[23:47:32.118] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:28:0)
[23:47:32.151] Build status: STARTED
[23:47:32.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:29:0) after 9m48s
[23:57:20.716] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:29:0)
[23:57:20.740] Build status: STARTED
[23:57:20.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:30:0) after 6m17s
[00:03:38.210] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:30:0)
[00:03:38.228] Build status: STARTED
[00:03:38.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:31:0) after 3m51s
[00:07:29.418] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:31:0)
[00:07:29.466] Build status: STARTED
[00:07:29.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:32:0) after 6m49s
[00:14:18.571] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:32:0)
[00:14:18.609] Build status: STARTED
[00:14:18.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:33:0) after 6m47s
[00:21:05.739] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:33:0)
[00:21:05.759] Build status: STARTED
[00:21:05.759] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:34:0) after 7m33s
[00:28:38.781] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:34:0)
[00:28:38.802] Build status: STARTED
[00:28:38.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:35:0) after 1m19s
[00:29:57.831] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:35:0)
[00:29:57.851] Build status: STARTED
[00:29:57.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:36:0) after 3m36s
[00:33:33.892] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:36:0)
[00:33:33.930] Build status: STARTED
[00:33:33.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:37:0) after 1m32s
[00:35:05.959] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:37:0)
[00:35:05.979] Build status: STARTED
[00:35:05.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:38:0) after 5m25s
[00:40:31.030] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:38:0)
[00:40:31.059] Build status: STARTED
[00:40:31.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:39:0) after 2m33s
[00:43:04.126] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:39:0)
[00:43:04.155] Build status: STARTED
[00:43:04.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:40:0) after 7m27s
[00:50:31.215] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:40:0)
[00:50:31.327] Build status: STARTED
[00:50:31.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:41:0) after 2m51s
[00:53:22.427] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:41:0)
[00:53:22.445] Build status: STARTED
[00:53:22.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:42:0) after 6m53s
[01:00:15.542] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:42:0)
[01:00:15.568] Build status: STARTED
[01:00:15.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:43:0) after 7m35s
[01:07:50.596] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:43:0)
[01:07:50.676] Build status: STARTED
[01:07:50.676] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:44:0) after 6m37s
[01:14:27.701] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:44:0)
[01:14:27.719] Build status: STARTED
[01:14:27.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:45:0) after 7m3s
[01:21:30.876] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:45:0)
[01:21:30.889] Build status: STARTED
[01:21:30.889] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:46:0) after 6m17s
[01:27:47.920] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:46:0)
[01:27:47.980] Build status: STARTED
[01:27:47.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:47:0) after 2m57s
[01:30:45.026] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:47:0)
[01:30:45.058] Build status: STARTED
[01:30:45.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:48:0) after 9m57s
[01:40:42.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:48:0)
[01:40:42.106] Build status: STARTED
[01:40:42.106] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:49:0) after 2m24s
[01:43:06.187] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:49:0)
[01:43:06.206] Build status: STARTED
[01:43:06.206] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:50:0) after 5m13s
[01:48:19.211] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:50:0)
[01:48:19.230] Build status: STARTED
[01:48:19.230] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:51:0) after 4m48s
[01:53:07.364] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:51:0)
[01:53:07.379] Build status: STARTED
[01:53:07.380] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:52:0) after 3m49s
[01:56:56.405] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:52:0)
[01:56:56.451] Build status: STARTED
[01:56:56.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:53:0) after 9m31s
[02:06:27.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:53:0)
[02:06:27.609] Build status: STARTED
[02:06:27.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:54:0) after 3m13s
[02:09:40.625] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:54:0)
[02:09:40.666] Build status: STARTED
[02:09:40.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:55:0) after 8m39s
[02:18:19.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:55:0)
[02:18:19.809] Build status: STARTED
[02:18:19.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:56:0) after 4m33s
[02:22:52.839] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:56:0)
[02:22:52.857] Build status: STARTED
[02:22:52.857] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:57:0) after 7m50s
[02:30:43.142] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:57:0)
[02:30:43.162] Build status: STARTED
[02:30:43.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:58:0) after 1m35s
[02:32:18.255] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:58:0)
[02:32:18.272] Build status: STARTED
[02:32:18.272] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:59:0) after 1m4s
[02:33:22.499] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:59:0)
[02:33:22.524] Build status: STARTED
[02:33:22.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:60:0) after 1m35s
[02:34:57.651] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:60:0)
[02:34:57.681] Build status: STARTED
[02:34:57.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:61:0) after 7m50s
[02:42:47.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:61:0)
[02:42:47.734] Build status: STARTED
[02:42:47.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:62:0) after 5m17s
[02:48:04.823] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:62:0)
[02:48:04.853] Build status: STARTED
[02:48:04.904] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:63:0) after 6m23s
[02:54:28.480] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:63:0)
[02:54:28.503] Build status: STARTED
[02:54:28.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:64:0) after 5m27s
[02:59:55.580] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:64:0)
[02:59:55.598] Build status: STARTED
[02:59:55.598] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:65:0) after 5m31s
[03:05:26.787] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:65:0)
[03:05:26.825] Build status: STARTED
[03:05:26.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:66:0) after 6m52s
[03:12:18.855] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:66:0)
[03:12:18.885] Build status: STARTED
[03:12:18.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8880110451153141056:67:0) after 9m1s
[03:13:16.046] Received PubSub notification, asking Buildbucket for the build status
[03:13:16.066] Build:
{
"id": "8714680389132702049",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 11875,
"createdBy": "project:chromium",
"createTime": "2025-05-16T21:15:59.402967986Z",
"startTime": "2025-05-16T22:18:23.873551503Z",
"endTime": "2025-05-17T03:13:15.772423535Z",
"updateTime": "2025-05-17T03:13:15.772423535Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "484bfa56b7fc137e518dcaad415c7870a3a6a1dc",
"ref": "refs/heads/main"
}
}
}
[03:13:16.066] Invocation finished in 5h57m17.974033546s with status FAILED