[22:45:14.863] New invocation is queued and will start shortly
[22:45:15.952] Starting the invocation (attempt 1)
[22:45:15.991] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3b5c65b39e8a331bcf25b6dee2fb891762afb264"
[22:45:15.991] Popped gitiles commit info from properties and tags
[22:45:15.991] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:45:15.991] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:45:15.992] Buildbucket request:
{
"requestId": "8973238515647361456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b5c65b39e8a331bcf25b6dee2fb891762afb264",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973238515647361456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:45:16.924] Scheduled build:
{
"id": "8807808453666204161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3259,
"createdBy": "project:chromium",
"createTime": "2022-07-23T22:45:16.120901775Z",
"updateTime": "2022-07-23T22:45:16.120901775Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b5c65b39e8a331bcf25b6dee2fb891762afb264",
"ref": "refs/heads/main"
}
}
}
[22:45:16.924] Task URL: https://cr-buildbucket.appspot.com/build/8807808453666204161
[22:45:16.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:2:0) after 8m58s
[22:45:34.372] Received PubSub notification, asking Buildbucket for the build status
[22:45:34.398] Build status: STARTED
[22:54:14.944] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:2:0)
[22:54:14.962] Build status: STARTED
[22:54:14.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:4:0) after 5m42s
[22:59:56.979] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:4:0)
[22:59:57.016] Build status: STARTED
[22:59:57.017] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:5:0) after 2m4s
[23:02:01.056] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:5:0)
[23:02:01.138] Build status: STARTED
[23:02:01.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:6:0) after 2m41s
[23:04:42.155] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:6:0)
[23:04:42.212] Build status: STARTED
[23:04:42.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:7:0) after 6m32s
[23:11:14.246] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:7:0)
[23:11:14.278] Build status: STARTED
[23:11:14.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:8:0) after 2m4s
[23:13:18.557] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:8:0)
[23:13:18.612] Build status: STARTED
[23:13:18.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:9:0) after 4m10s
[23:17:28.758] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:9:0)
[23:17:28.793] Build status: STARTED
[23:17:28.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:10:0) after 1m11s
[23:18:39.812] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:10:0)
[23:18:39.845] Build status: STARTED
[23:18:39.845] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:11:0) after 6m44s
[23:25:23.862] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:11:0)
[23:25:23.896] Build status: STARTED
[23:25:23.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:12:0) after 5m56s
[23:31:19.912] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:12:0)
[23:31:19.946] Build status: STARTED
[23:31:19.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:13:0) after 7m18s
[23:38:37.963] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:13:0)
[23:38:37.984] Build status: STARTED
[23:38:37.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:14:0) after 4m9s
[23:42:47.000] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:14:0)
[23:42:47.035] Build status: STARTED
[23:42:47.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:15:0) after 9m24s
[23:52:11.151] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:15:0)
[23:52:11.181] Build status: STARTED
[23:52:11.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:16:0) after 7m22s
[23:59:33.201] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:16:0)
[23:59:33.221] Build status: STARTED
[23:59:33.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:17:0) after 1m43s
[00:01:16.237] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:17:0)
[00:01:16.269] Build status: STARTED
[00:01:16.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:18:0) after 4m43s
[00:05:59.295] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:18:0)
[00:05:59.316] Build status: STARTED
[00:05:59.316] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:19:0) after 3m18s
[00:09:17.991] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:19:0)
[00:09:18.069] Build status: STARTED
[00:09:18.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:20:0) after 2m10s
[00:11:28.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:20:0)
[00:11:28.109] Build status: STARTED
[00:11:28.109] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:21:0) after 5m25s
[00:16:53.129] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:21:0)
[00:16:53.148] Build status: STARTED
[00:16:53.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:22:0) after 9m39s
[00:26:32.212] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:22:0)
[00:26:32.242] Build status: STARTED
[00:26:32.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:23:0) after 4m17s
[00:30:49.258] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:23:0)
[00:30:49.330] Build status: STARTED
[00:30:49.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:24:0) after 4m46s
[00:35:35.398] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:24:0)
[00:35:35.431] Build status: STARTED
[00:35:35.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:25:0) after 3m25s
[00:39:00.811] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:25:0)
[00:39:00.839] Build status: STARTED
[00:39:00.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:26:0) after 8m34s
[00:47:35.181] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:26:0)
[00:47:35.204] Build status: STARTED
[00:47:35.204] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:27:0) after 9m28s
[00:57:03.879] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:27:0)
[00:57:03.903] Build status: STARTED
[00:57:03.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:28:0) after 2m46s
[00:59:49.989] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:28:0)
[00:59:50.007] Build status: STARTED
[00:59:50.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:29:0) after 7m0s
[01:06:50.187] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:29:0)
[01:06:50.404] Build status: STARTED
[01:06:50.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:30:0) after 7m26s
[01:14:18.934] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:30:0)
[01:14:18.961] Build status: STARTED
[01:14:18.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:31:0) after 5m5s
[01:19:24.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:31:0)
[01:19:24.128] Build status: STARTED
[01:19:24.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:32:0) after 2m15s
[01:21:39.382] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:32:0)
[01:21:39.416] Build status: STARTED
[01:21:39.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:33:0) after 6m43s
[01:28:22.502] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:33:0)
[01:28:22.524] Build status: STARTED
[01:28:22.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:34:0) after 4m18s
[01:32:40.646] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:34:0)
[01:32:40.727] Build status: STARTED
[01:32:40.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:35:0) after 2m25s
[01:35:05.742] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:35:0)
[01:35:05.764] Build status: STARTED
[01:35:05.764] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:36:0) after 2m26s
[01:37:32.110] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:36:0)
[01:37:32.159] Build status: STARTED
[01:37:32.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:37:0) after 1m31s
[01:39:03.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:37:0)
[01:39:03.301] Build status: STARTED
[01:39:03.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:38:0) after 2m5s
[01:41:08.381] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:38:0)
[01:41:08.425] Build status: STARTED
[01:41:08.425] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:39:0) after 9m15s
[01:50:23.502] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:39:0)
[01:50:23.536] Build status: STARTED
[01:50:23.536] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:40:0) after 9m49s
[02:00:12.564] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:40:0)
[02:00:12.586] Build status: STARTED
[02:00:12.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:41:0) after 5m36s
[02:05:48.844] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:41:0)
[02:05:48.869] Build status: STARTED
[02:05:48.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:42:0) after 1m54s
[02:07:43.048] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:42:0)
[02:07:43.072] Build status: STARTED
[02:07:43.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:43:0) after 6m52s
[02:14:35.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:43:0)
[02:14:35.123] Build status: STARTED
[02:14:35.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:44:0) after 2m58s
[02:17:34.813] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:44:0)
[02:17:34.837] Build status: STARTED
[02:17:34.837] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:45:0) after 4m7s
[02:21:41.996] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:45:0)
[02:21:42.029] Build status: STARTED
[02:21:42.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:46:0) after 1m3s
[02:22:45.045] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:46:0)
[02:22:45.071] Build status: STARTED
[02:22:45.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:47:0) after 4m30s
[02:27:15.088] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:47:0)
[02:27:15.119] Build status: STARTED
[02:27:15.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:48:0) after 7m1s
[02:34:16.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:48:0)
[02:34:16.478] Build status: STARTED
[02:34:16.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:49:0) after 4m34s
[02:38:50.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:49:0)
[02:38:50.534] Build status: STARTED
[02:38:50.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:50:0) after 7m34s
[02:46:24.552] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:50:0)
[02:46:24.584] Build status: STARTED
[02:46:24.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:51:0) after 3m33s
[02:49:58.085] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:51:0)
[02:49:58.110] Build status: STARTED
[02:49:58.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:52:0) after 7m32s
[02:57:30.129] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:52:0)
[02:57:30.156] Build status: STARTED
[02:57:30.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:53:0) after 2m59s
[03:00:29.418] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:53:0)
[03:00:29.453] Build status: STARTED
[03:00:29.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:54:0) after 7m53s
[03:08:22.925] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:54:0)
[03:08:22.972] Build status: STARTED
[03:08:22.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:55:0) after 4m44s
[03:13:07.380] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:55:0)
[03:13:07.403] Build status: STARTED
[03:13:07.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:56:0) after 5m20s
[03:18:27.420] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:56:0)
[03:18:27.444] Build status: STARTED
[03:18:27.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973238515647361456:57:0) after 7m13s
[03:18:56.415] Received PubSub notification, asking Buildbucket for the build status
[03:18:56.447] Build:
{
"id": "8807808453666204161",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3259,
"createdBy": "project:chromium",
"createTime": "2022-07-23T22:45:16.120901775Z",
"startTime": "2022-07-23T22:45:33.277889Z",
"endTime": "2022-07-24T03:18:56.140703009Z",
"updateTime": "2022-07-24T03:18:56.140703009Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b5c65b39e8a331bcf25b6dee2fb891762afb264",
"ref": "refs/heads/main"
}
}
}
[03:18:56.447] Invocation finished in 4h33m41.599715114s with status FAILED