[05:03:20.470] New invocation is queued and will start shortly
[05:03:21.549] Starting the invocation (attempt 1)
[05:03:21.577] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0f4fe29825309df4ba2bbf87f7b9f29420429b6f"
[05:03:21.577] Popped gitiles commit info from properties and tags
[05:03:21.577] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:03:21.577] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:03:21.577] Buildbucket request:
{
"requestId": "8908256703148810384",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0f4fe29825309df4ba2bbf87f7b9f29420429b6f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8908256703148810384"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:03:22.217] Scheduled build:
{
"id": "8742826641216926417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 9396,
"createdBy": "project:chromium",
"createTime": "2024-07-10T05:03:21.687348577Z",
"updateTime": "2024-07-10T05:03:21.687348577Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0f4fe29825309df4ba2bbf87f7b9f29420429b6f",
"ref": "refs/heads/main"
}
}
}
[05:03:22.217] Task URL: https://cr-buildbucket.appspot.com/build/8742826641216926417
[05:03:22.217] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:2:0) after 4m57s
[05:03:23.220] Received PubSub notification, asking Buildbucket for the build status
[05:03:23.246] Build status: SCHEDULED
[05:05:39.264] Received PubSub notification, asking Buildbucket for the build status
[05:05:39.289] Build status: STARTED
[05:08:19.235] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:2:0)
[05:08:19.319] Build status: STARTED
[05:08:19.320] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:5:0) after 1m6s
[05:09:25.440] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:5:0)
[05:09:25.466] Build status: STARTED
[05:09:25.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:6:0) after 6m14s
[05:15:39.486] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:6:0)
[05:15:39.519] Build status: STARTED
[05:15:39.519] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:7:0) after 3m6s
[05:18:45.770] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:7:0)
[05:18:45.789] Build status: STARTED
[05:18:45.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:8:0) after 5m28s
[05:24:14.009] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:8:0)
[05:24:14.043] Build status: STARTED
[05:24:14.043] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:9:0) after 1m22s
[05:25:36.100] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:9:0)
[05:25:36.132] Build status: STARTED
[05:25:36.132] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:10:0) after 4m38s
[05:30:14.153] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:10:0)
[05:30:14.182] Build status: STARTED
[05:30:14.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:11:0) after 9m54s
[05:40:08.231] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:11:0)
[05:40:08.263] Build status: STARTED
[05:40:08.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:12:0) after 3m25s
[05:43:33.318] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:12:0)
[05:43:33.346] Build status: STARTED
[05:43:33.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:13:0) after 3m22s
[05:46:55.362] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:13:0)
[05:46:55.389] Build status: STARTED
[05:46:55.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:14:0) after 7m57s
[05:54:52.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:14:0)
[05:54:52.657] Build status: STARTED
[05:54:52.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:15:0) after 6m52s
[06:01:44.732] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:15:0)
[06:01:44.753] Build status: STARTED
[06:01:44.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:16:0) after 9m30s
[06:11:15.023] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:16:0)
[06:11:15.042] Build status: STARTED
[06:11:15.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:17:0) after 3m9s
[06:14:24.242] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:17:0)
[06:14:24.260] Build status: STARTED
[06:14:24.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:18:0) after 7m6s
[06:21:30.273] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:18:0)
[06:21:30.304] Build status: STARTED
[06:21:30.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:19:0) after 6m57s
[06:28:27.687] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:19:0)
[06:28:27.704] Build status: STARTED
[06:28:27.704] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:20:0) after 6m27s
[06:34:55.088] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:20:0)
[06:34:55.118] Build status: STARTED
[06:34:55.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:21:0) after 8m36s
[06:43:31.255] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:21:0)
[06:43:31.274] Build status: STARTED
[06:43:31.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:22:0) after 3m52s
[06:47:23.458] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:22:0)
[06:47:23.477] Build status: STARTED
[06:47:23.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:23:0) after 6m17s
[06:53:40.784] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:23:0)
[06:53:40.806] Build status: STARTED
[06:53:40.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:24:0) after 8m5s
[07:01:46.000] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:24:0)
[07:01:46.021] Build status: STARTED
[07:01:46.021] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:25:0) after 8m45s
[07:10:31.574] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:25:0)
[07:10:31.595] Build status: STARTED
[07:10:31.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:26:0) after 3m48s
[07:14:19.812] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:26:0)
[07:14:19.848] Build status: STARTED
[07:14:19.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:27:0) after 5m16s
[07:19:36.018] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:27:0)
[07:19:36.032] Build status: STARTED
[07:19:36.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:28:0) after 8m20s
[07:27:56.055] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:28:0)
[07:27:56.145] Build status: STARTED
[07:27:56.145] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:29:0) after 8m50s
[07:36:46.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:29:0)
[07:36:46.300] Build status: STARTED
[07:36:46.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:30:0) after 7m24s
[07:44:10.465] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:30:0)
[07:44:10.538] Build status: STARTED
[07:44:10.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:31:0) after 5m36s
[07:49:46.762] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:31:0)
[07:49:46.810] Build status: STARTED
[07:49:46.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:32:0) after 1m41s
[07:51:28.053] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:32:0)
[07:51:28.070] Build status: STARTED
[07:51:28.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:33:0) after 4m38s
[07:56:06.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:33:0)
[07:56:06.257] Build status: STARTED
[07:56:06.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:34:0) after 5m34s
[08:01:40.229] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:34:0)
[08:01:40.341] Build status: STARTED
[08:01:40.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:35:0) after 4m21s
[08:06:01.506] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:35:0)
[08:06:01.552] Build status: STARTED
[08:06:01.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:36:0) after 7m47s
[08:13:48.621] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:36:0)
[08:13:48.641] Build status: STARTED
[08:13:48.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:37:0) after 9m10s
[08:22:58.937] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:37:0)
[08:22:58.967] Build status: STARTED
[08:22:58.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:38:0) after 7m17s
[08:30:15.987] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:38:0)
[08:30:16.006] Build status: STARTED
[08:30:16.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:39:0) after 3m36s
[08:33:52.277] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:39:0)
[08:33:52.300] Build status: STARTED
[08:33:52.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:40:0) after 8m48s
[08:42:40.402] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:40:0)
[08:42:40.420] Build status: STARTED
[08:42:40.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:41:0) after 4m45s
[08:47:25.539] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:41:0)
[08:47:25.559] Build status: STARTED
[08:47:25.559] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:42:0) after 4m5s
[08:51:31.327] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:42:0)
[08:51:31.346] Build status: STARTED
[08:51:31.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:43:0) after 2m8s
[08:53:39.330] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:43:0)
[08:53:39.356] Build status: STARTED
[08:53:39.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:44:0) after 2m46s
[08:56:25.378] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:44:0)
[08:56:25.397] Build status: STARTED
[08:56:25.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:45:0) after 7m11s
[09:03:36.860] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:45:0)
[09:03:36.878] Build status: STARTED
[09:03:36.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:46:0) after 4m14s
[09:07:50.908] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:46:0)
[09:07:50.964] Build status: STARTED
[09:07:50.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:47:0) after 2m10s
[09:10:00.994] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:47:0)
[09:10:01.012] Build status: STARTED
[09:10:01.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:48:0) after 5m24s
[09:15:25.031] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:48:0)
[09:15:25.082] Build status: STARTED
[09:15:25.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:49:0) after 6m31s
[09:21:56.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:49:0)
[09:21:56.218] Build status: STARTED
[09:21:56.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:50:0) after 3m43s
[09:25:39.380] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:50:0)
[09:25:39.399] Build status: STARTED
[09:25:39.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:51:0) after 7m37s
[09:33:16.650] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:51:0)
[09:33:16.672] Build status: STARTED
[09:33:16.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:52:0) after 8m46s
[09:42:02.710] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:52:0)
[09:42:02.729] Build status: STARTED
[09:42:02.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:53:0) after 6m8s
[09:48:11.224] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:53:0)
[09:48:11.244] Build status: STARTED
[09:48:11.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:54:0) after 6m36s
[09:54:47.349] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:54:0)
[09:54:47.368] Build status: STARTED
[09:54:47.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:55:0) after 7m28s
[10:02:15.377] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:55:0)
[10:02:15.397] Build status: STARTED
[10:02:15.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:56:0) after 1m55s
[10:04:10.476] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:56:0)
[10:04:10.496] Build status: STARTED
[10:04:10.496] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:57:0) after 9m50s
[10:14:00.582] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:57:0)
[10:14:00.606] Build status: STARTED
[10:14:00.606] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:58:0) after 9m21s
[10:23:21.664] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:58:0)
[10:23:21.684] Build status: STARTED
[10:23:21.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:59:0) after 3m2s
[10:26:23.721] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:59:0)
[10:26:23.747] Build status: STARTED
[10:26:23.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:60:0) after 3m48s
[10:30:12.075] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:60:0)
[10:30:12.128] Build status: STARTED
[10:30:12.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:61:0) after 4m0s
[10:34:12.195] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:61:0)
[10:34:12.238] Build status: STARTED
[10:34:12.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:62:0) after 2m45s
[10:36:57.229] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:62:0)
[10:36:57.247] Build status: STARTED
[10:36:57.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:63:0) after 9m41s
[10:46:38.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:63:0)
[10:46:38.439] Build status: STARTED
[10:46:38.439] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:64:0) after 4m30s
[10:51:08.581] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:64:0)
[10:51:08.601] Build status: STARTED
[10:51:08.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:65:0) after 7m28s
[10:58:36.758] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:65:0)
[10:58:36.780] Build status: STARTED
[10:58:36.780] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8908256703148810384:66:0) after 1m48s
[10:59:09.709] Received PubSub notification, asking Buildbucket for the build status
[10:59:09.729] Build:
{
"id": "8742826641216926417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 9396,
"createdBy": "project:chromium",
"createTime": "2024-07-10T05:03:21.687348577Z",
"startTime": "2024-07-10T05:05:38.949585192Z",
"endTime": "2024-07-10T10:59:08.337720960Z",
"updateTime": "2024-07-10T10:59:08.337720960Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0f4fe29825309df4ba2bbf87f7b9f29420429b6f",
"ref": "refs/heads/main"
}
}
}
[10:59:09.729] Invocation finished in 5h55m49.26743148s with status FAILED