[14:46:24.750] New invocation is queued and will start shortly
[14:46:25.998] Starting the invocation (attempt 1)
[14:46:26.030] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0"
[14:46:26.030] Popped gitiles commit info from properties and tags
[14:46:26.030] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:46:26.030] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:46:26.030] Buildbucket request:
{
"requestId": "8923259115894741840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923259115894741840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:46:26.770] Scheduled build:
{
"id": "8757829053761961873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 7553,
"createdBy": "project:chromium",
"createTime": "2024-01-26T14:46:26.158376402Z",
"updateTime": "2024-01-26T14:46:26.158376402Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0",
"ref": "refs/heads/main"
}
}
}
[14:46:26.770] Task URL: https://cr-buildbucket.appspot.com/build/8757829053761961873
[14:46:26.770] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:2:0) after 4m46s
[14:46:27.633] Received PubSub notification, asking Buildbucket for the build status
[14:46:27.706] Build status: SCHEDULED
[14:48:13.865] Received PubSub notification, asking Buildbucket for the build status
[14:48:13.885] Build status: STARTED
[14:51:12.884] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:2:0)
[14:51:12.964] Build status: STARTED
[14:51:12.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:5:0) after 2m27s
[14:53:40.118] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:5:0)
[14:53:40.138] Build status: STARTED
[14:53:40.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:6:0) after 5m13s
[14:58:53.580] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:6:0)
[14:58:53.683] Build status: STARTED
[14:58:53.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:7:0) after 1m54s
[15:00:47.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:7:0)
[15:00:47.951] Build status: STARTED
[15:00:47.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:8:0) after 7m10s
[15:07:58.046] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:8:0)
[15:07:58.066] Build status: STARTED
[15:07:58.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:9:0) after 2m23s
[15:10:21.123] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:9:0)
[15:10:21.155] Build status: STARTED
[15:10:21.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:10:0) after 9m54s
[15:20:15.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:10:0)
[15:20:15.644] Build status: STARTED
[15:20:15.644] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:11:0) after 4m18s
[15:24:33.692] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:11:0)
[15:24:33.711] Build status: STARTED
[15:24:33.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:12:0) after 8m7s
[15:32:41.196] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:12:0)
[15:32:41.229] Build status: STARTED
[15:32:41.229] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:13:0) after 7m48s
[15:40:29.306] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:13:0)
[15:40:29.332] Build status: STARTED
[15:40:29.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:14:0) after 4m6s
[15:44:35.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:14:0)
[15:44:35.383] Build status: STARTED
[15:44:35.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:15:0) after 5m12s
[15:49:47.446] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:15:0)
[15:49:47.467] Build status: STARTED
[15:49:47.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:16:0) after 2m27s
[15:52:14.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:16:0)
[15:52:14.504] Build status: STARTED
[15:52:14.504] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:17:0) after 5m22s
[15:57:36.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:17:0)
[15:57:36.558] Build status: STARTED
[15:57:36.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:18:0) after 3m13s
[16:00:49.583] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:18:0)
[16:00:49.603] Build status: STARTED
[16:00:49.603] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:19:0) after 1m38s
[16:02:27.677] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:19:0)
[16:02:27.697] Build status: STARTED
[16:02:27.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:20:0) after 2m58s
[16:05:25.784] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:20:0)
[16:05:25.825] Build status: STARTED
[16:05:25.825] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:21:0) after 2m38s
[16:08:03.992] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:21:0)
[16:08:04.015] Build status: STARTED
[16:08:04.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:22:0) after 5m31s
[16:13:35.735] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:22:0)
[16:13:35.799] Build status: STARTED
[16:13:35.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:23:0) after 1m32s
[16:15:08.376] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:23:0)
[16:15:08.400] Build status: STARTED
[16:15:08.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:24:0) after 6m54s
[16:22:02.591] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:24:0)
[16:22:02.610] Build status: STARTED
[16:22:02.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:25:0) after 5m34s
[16:27:36.819] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:25:0)
[16:27:36.915] Build status: STARTED
[16:27:36.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:26:0) after 7m0s
[16:34:36.891] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:26:0)
[16:34:36.910] Build status: STARTED
[16:34:36.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:27:0) after 2m10s
[16:36:46.937] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:27:0)
[16:36:46.956] Build status: STARTED
[16:36:46.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:28:0) after 3m56s
[16:40:43.015] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:28:0)
[16:40:43.034] Build status: STARTED
[16:40:43.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:29:0) after 6m45s
[16:47:28.089] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:29:0)
[16:47:28.115] Build status: STARTED
[16:47:28.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:30:0) after 5m1s
[16:52:29.164] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:30:0)
[16:52:29.242] Build status: STARTED
[16:52:29.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:31:0) after 5m6s
[16:57:35.270] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:31:0)
[16:57:35.293] Build status: STARTED
[16:57:35.293] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:32:0) after 1m55s
[16:59:30.312] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:32:0)
[16:59:30.332] Build status: STARTED
[16:59:30.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:33:0) after 4m38s
[17:04:08.403] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:33:0)
[17:04:08.424] Build status: STARTED
[17:04:08.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:34:0) after 4m45s
[17:08:53.447] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:34:0)
[17:08:53.469] Build status: STARTED
[17:08:53.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:35:0) after 6m37s
[17:15:30.786] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:35:0)
[17:15:30.816] Build status: STARTED
[17:15:30.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:36:0) after 2m30s
[17:18:00.870] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:36:0)
[17:18:00.890] Build status: STARTED
[17:18:00.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:37:0) after 7m45s
[17:25:45.907] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:37:0)
[17:25:45.929] Build status: STARTED
[17:25:45.929] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:38:0) after 3m6s
[17:28:52.028] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:38:0)
[17:28:52.049] Build status: STARTED
[17:28:52.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:39:0) after 3m5s
[17:31:57.068] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:39:0)
[17:31:57.088] Build status: STARTED
[17:31:57.088] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:40:0) after 5m29s
[17:37:26.193] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:40:0)
[17:37:26.371] Build status: STARTED
[17:37:26.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:41:0) after 3m40s
[17:41:06.378] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:41:0)
[17:41:06.398] Build status: STARTED
[17:41:06.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:42:0) after 1m15s
[17:42:21.420] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:42:0)
[17:42:21.435] Build status: STARTED
[17:42:21.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:43:0) after 4m50s
[17:47:11.431] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:43:0)
[17:47:11.448] Build status: STARTED
[17:47:11.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:44:0) after 3m3s
[17:50:14.473] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:44:0)
[17:50:14.490] Build status: STARTED
[17:50:14.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:45:0) after 6m46s
[17:57:00.558] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:45:0)
[17:57:00.582] Build status: STARTED
[17:57:00.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:46:0) after 1m25s
[17:58:25.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:46:0)
[17:58:25.651] Build status: STARTED
[17:58:25.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:47:0) after 7m12s
[18:05:37.681] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:47:0)
[18:05:37.711] Build status: STARTED
[18:05:37.711] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:48:0) after 1m5s
[18:06:42.708] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:48:0)
[18:06:42.782] Build status: STARTED
[18:06:42.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:49:0) after 9m24s
[18:16:06.832] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:49:0)
[18:16:06.852] Build status: STARTED
[18:16:06.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:50:0) after 7m0s
[18:23:06.937] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:50:0)
[18:23:07.011] Build status: STARTED
[18:23:07.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:51:0) after 7m14s
[18:30:21.083] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:51:0)
[18:30:21.146] Build status: STARTED
[18:30:21.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:52:0) after 6m40s
[18:37:01.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:52:0)
[18:37:01.186] Build status: STARTED
[18:37:01.186] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:53:0) after 8m54s
[18:45:55.196] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:53:0)
[18:45:55.228] Build status: STARTED
[18:45:55.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:54:0) after 4m29s
[18:50:24.247] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:54:0)
[18:50:24.268] Build status: STARTED
[18:50:24.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:55:0) after 3m57s
[18:54:21.325] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:55:0)
[18:54:21.376] Build status: STARTED
[18:54:21.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:56:0) after 9m9s
[19:03:30.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:56:0)
[19:03:30.432] Build status: STARTED
[19:03:30.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:57:0) after 7m34s
[19:11:04.526] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:57:0)
[19:11:04.693] Build status: STARTED
[19:11:04.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:58:0) after 1m21s
[19:12:25.719] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:58:0)
[19:12:25.740] Build status: STARTED
[19:12:25.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:59:0) after 4m8s
[19:16:33.766] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:59:0)
[19:16:33.809] Build status: STARTED
[19:16:33.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:60:0) after 2m36s
[19:19:09.828] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:60:0)
[19:19:09.861] Build status: STARTED
[19:19:09.861] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:61:0) after 6m57s
[19:26:06.890] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:61:0)
[19:26:06.964] Build status: STARTED
[19:26:06.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:62:0) after 9m14s
[19:35:21.011] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:62:0)
[19:35:21.029] Build status: STARTED
[19:35:21.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:63:0) after 4m46s
[19:40:07.046] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:63:0)
[19:40:07.061] Build status: STARTED
[19:40:07.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:64:0) after 7m22s
[19:47:29.127] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:64:0)
[19:47:29.198] Build status: STARTED
[19:47:29.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923259115894741840:65:0) after 1m27s
[19:48:43.707] Received PubSub notification, asking Buildbucket for the build status
[19:48:43.727] Build:
{
"id": "8757829053761961873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 7553,
"createdBy": "project:chromium",
"createTime": "2024-01-26T14:46:26.158376402Z",
"startTime": "2024-01-26T14:48:12.574010Z",
"endTime": "2024-01-26T19:48:42.595753Z",
"updateTime": "2024-01-26T19:48:42.595753Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3714914231ebfdf2d3fd5e63229ae2e2bc96b9d0",
"ref": "refs/heads/main"
}
}
}
[19:48:43.727] Invocation finished in 5h2m18.986211658s with status FAILED