[07:05:56.156] New invocation is queued and will start shortly
[07:05:57.328] Starting the invocation (attempt 1)
[07:05:57.375] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0abe844b70bdf6d3f74b08436e368916a96850b2"
[07:05:57.375] Popped gitiles commit info from properties and tags
[07:05:57.375] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:05:57.375] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:05:57.375] Buildbucket request:
{
"requestId": "8973569402972116288",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0abe844b70bdf6d3f74b08436e368916a96850b2",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973569402972116288"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:05:57.959] Scheduled build:
{
"id": "8808139340926042017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3241,
"createdBy": "project:chromium",
"createTime": "2022-07-20T07:05:57.439852708Z",
"updateTime": "2022-07-20T07:05:57.439852708Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0abe844b70bdf6d3f74b08436e368916a96850b2",
"ref": "refs/heads/main"
}
}
}
[07:05:57.959] Task URL: https://cr-buildbucket.appspot.com/build/8808139340926042017
[07:05:57.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:2:0) after 7m9s
[07:09:49.165] Received PubSub notification, asking Buildbucket for the build status
[07:09:49.203] Build status: STARTED
[07:13:06.976] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:2:0)
[07:13:07.002] Build status: STARTED
[07:13:07.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:4:0) after 4m44s
[07:17:51.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:4:0)
[07:17:51.055] Build status: STARTED
[07:17:51.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:5:0) after 7m23s
[07:25:14.196] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:5:0)
[07:25:14.216] Build status: STARTED
[07:25:14.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:6:0) after 9m56s
[07:35:10.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:6:0)
[07:35:10.370] Build status: STARTED
[07:35:10.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:7:0) after 1m50s
[07:37:00.388] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:7:0)
[07:37:00.408] Build status: STARTED
[07:37:00.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:8:0) after 6m8s
[07:43:08.425] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:8:0)
[07:43:08.529] Build status: STARTED
[07:43:08.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:9:0) after 2m4s
[07:45:12.549] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:9:0)
[07:45:12.580] Build status: STARTED
[07:45:12.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:10:0) after 6m16s
[07:51:28.673] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:10:0)
[07:51:28.694] Build status: STARTED
[07:51:28.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:11:0) after 9m37s
[08:01:05.794] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:11:0)
[08:01:05.842] Build status: STARTED
[08:01:05.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:12:0) after 4m10s
[08:05:15.977] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:12:0)
[08:05:16.011] Build status: STARTED
[08:05:16.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:13:0) after 3m23s
[08:08:39.380] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:13:0)
[08:08:39.409] Build status: STARTED
[08:08:39.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:14:0) after 4m24s
[08:13:03.583] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:14:0)
[08:13:03.607] Build status: STARTED
[08:13:03.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:15:0) after 5m48s
[08:18:51.863] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:15:0)
[08:18:51.896] Build status: STARTED
[08:18:51.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:16:0) after 7m15s
[08:26:07.066] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:16:0)
[08:26:07.108] Build status: STARTED
[08:26:07.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:17:0) after 7m20s
[08:33:27.167] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:17:0)
[08:33:27.189] Build status: STARTED
[08:33:27.190] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:18:0) after 1m47s
[08:35:14.379] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:18:0)
[08:35:14.399] Build status: STARTED
[08:35:14.399] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:19:0) after 9m55s
[08:45:09.428] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:19:0)
[08:45:09.453] Build status: STARTED
[08:45:09.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:20:0) after 9m54s
[08:55:03.540] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:20:0)
[08:55:03.574] Build status: STARTED
[08:55:03.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:21:0) after 2m58s
[08:58:01.697] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:21:0)
[08:58:01.720] Build status: STARTED
[08:58:01.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:22:0) after 5m3s
[09:03:04.742] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:22:0)
[09:03:04.766] Build status: STARTED
[09:03:04.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:23:0) after 8m15s
[09:11:19.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:23:0)
[09:11:20.003] Build status: STARTED
[09:11:20.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:24:0) after 5m7s
[09:16:27.111] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:24:0)
[09:16:27.133] Build status: STARTED
[09:16:27.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:25:0) after 8m31s
[09:24:58.153] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:25:0)
[09:24:58.182] Build status: STARTED
[09:24:58.182] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:26:0) after 8m11s
[09:33:09.732] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:26:0)
[09:33:09.756] Build status: STARTED
[09:33:09.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:27:0) after 6m57s
[09:40:07.028] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:27:0)
[09:40:07.050] Build status: STARTED
[09:40:07.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:28:0) after 4m16s
[09:44:23.072] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:28:0)
[09:44:23.097] Build status: STARTED
[09:44:23.097] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:29:0) after 7m22s
[09:51:45.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:29:0)
[09:51:45.243] Build status: STARTED
[09:51:45.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:30:0) after 7m34s
[09:59:19.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:30:0)
[09:59:19.299] Build status: STARTED
[09:59:19.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:31:0) after 1m55s
[10:01:14.401] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:31:0)
[10:01:14.424] Build status: STARTED
[10:01:14.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:32:0) after 2m34s
[10:03:48.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:32:0)
[10:03:48.472] Build status: STARTED
[10:03:48.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:33:0) after 3m19s
[10:07:07.572] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:33:0)
[10:07:07.600] Build status: STARTED
[10:07:07.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:34:0) after 9m31s
[10:16:38.708] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:34:0)
[10:16:38.730] Build status: STARTED
[10:16:38.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:35:0) after 4m38s
[10:21:17.022] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:35:0)
[10:21:17.045] Build status: STARTED
[10:21:17.045] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:36:0) after 3m47s
[10:25:04.367] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:36:0)
[10:25:04.393] Build status: STARTED
[10:25:04.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:37:0) after 7m36s
[10:32:40.517] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:37:0)
[10:32:40.549] Build status: STARTED
[10:32:40.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:38:0) after 4m37s
[10:37:17.574] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:38:0)
[10:37:17.621] Build status: STARTED
[10:37:17.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:39:0) after 9m3s
[10:46:20.949] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:39:0)
[10:46:21.006] Build status: STARTED
[10:46:21.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:40:0) after 4m18s
[10:50:39.035] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:40:0)
[10:50:39.070] Build status: STARTED
[10:50:39.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:41:0) after 9m1s
[10:59:40.094] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:41:0)
[10:59:40.125] Build status: STARTED
[10:59:40.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:42:0) after 1m10s
[11:00:50.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:42:0)
[11:00:50.240] Build status: STARTED
[11:00:50.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:43:0) after 1m42s
[11:02:32.410] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:43:0)
[11:02:32.431] Build status: STARTED
[11:02:32.431] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:44:0) after 5m40s
[11:08:12.451] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:44:0)
[11:08:12.473] Build status: STARTED
[11:08:12.473] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:45:0) after 1m5s
[11:09:17.602] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:45:0)
[11:09:17.623] Build status: STARTED
[11:09:17.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:46:0) after 5m17s
[11:14:34.650] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:46:0)
[11:14:34.729] Build status: STARTED
[11:14:34.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:47:0) after 3m33s
[11:18:07.854] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:47:0)
[11:18:07.886] Build status: STARTED
[11:18:07.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:48:0) after 8m57s
[11:27:04.888] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:48:0)
[11:27:04.927] Build status: STARTED
[11:27:04.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:49:0) after 8m31s
[11:35:36.105] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:49:0)
[11:35:36.143] Build status: STARTED
[11:35:36.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:50:0) after 3m42s
[11:39:18.445] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:50:0)
[11:39:18.484] Build status: STARTED
[11:39:18.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:51:0) after 7m54s
[11:47:12.729] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:51:0)
[11:47:12.769] Build status: STARTED
[11:47:12.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:52:0) after 5m11s
[11:52:23.789] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:52:0)
[11:52:23.814] Build status: STARTED
[11:52:23.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:53:0) after 6m20s
[11:58:43.906] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:53:0)
[11:58:43.928] Build status: STARTED
[11:58:43.928] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:54:0) after 5m0s
[12:03:44.191] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:54:0)
[12:03:44.216] Build status: STARTED
[12:03:44.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:55:0) after 9m46s
[12:13:30.254] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:55:0)
[12:13:30.288] Build status: STARTED
[12:13:30.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:56:0) after 2m0s
[12:15:30.268] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:56:0)
[12:15:30.310] Build status: STARTED
[12:15:30.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:57:0) after 8m38s
[12:24:08.433] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:57:0)
[12:24:08.465] Build status: STARTED
[12:24:08.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:58:0) after 6m52s
[12:31:00.489] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:58:0)
[12:31:00.512] Build status: STARTED
[12:31:00.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:59:0) after 9m44s
[12:40:44.758] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:59:0)
[12:40:44.793] Build status: STARTED
[12:40:44.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:60:0) after 1m51s
[12:42:35.961] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:60:0)
[12:42:36.149] Build status: STARTED
[12:42:36.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:61:0) after 5m20s
[12:47:56.184] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:61:0)
[12:47:56.233] Build status: STARTED
[12:47:56.233] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:62:0) after 6m32s
[12:54:28.295] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:62:0)
[12:54:28.319] Build status: STARTED
[12:54:28.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:63:0) after 4m11s
[12:58:39.328] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:63:0)
[12:58:39.360] Build status: STARTED
[12:58:39.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:64:0) after 1m0s
[12:59:39.454] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:64:0)
[12:59:39.478] Build status: STARTED
[12:59:39.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:65:0) after 9m59s
[13:09:38.521] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:65:0)
[13:09:38.540] Build status: STARTED
[13:09:38.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:66:0) after 5m12s
[13:14:50.561] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:66:0)
[13:14:50.586] Build status: STARTED
[13:14:50.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:67:0) after 9m10s
[13:24:00.604] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:67:0)
[13:24:00.630] Build status: STARTED
[13:24:00.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973569402972116288:68:0) after 9m29s
[13:27:08.650] Received PubSub notification, asking Buildbucket for the build status
[13:27:08.686] Build:
{
"id": "8808139340926042017",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3241,
"createdBy": "project:chromium",
"createTime": "2022-07-20T07:05:57.439852708Z",
"startTime": "2022-07-20T07:09:48.508406Z",
"endTime": "2022-07-20T13:27:07.756131606Z",
"updateTime": "2022-07-20T13:27:07.756131606Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0abe844b70bdf6d3f74b08436e368916a96850b2",
"ref": "refs/heads/main"
}
}
}
[13:27:08.686] Invocation finished in 6h21m12.581171135s with status FAILED