[19:48:44.853] New invocation is queued and will start shortly
[19:48:45.928] Starting the invocation (attempt 1)
[19:48:45.958] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ff6825425ccd0aad4f5351e54da7de7f0a6e8519"
[19:48:45.958] Popped gitiles commit info from properties and tags
[19:48:45.958] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:48:45.958] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:48:45.958] Buildbucket request:
{
"requestId": "8923240094614381584",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff6825425ccd0aad4f5351e54da7de7f0a6e8519",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923240094614381584"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:48:47.099] Scheduled build:
{
"id": "8757810032735039089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 7554,
"createdBy": "project:chromium",
"createTime": "2024-01-26T19:48:46.023634532Z",
"updateTime": "2024-01-26T19:48:46.023634532Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff6825425ccd0aad4f5351e54da7de7f0a6e8519",
"ref": "refs/heads/main"
}
}
}
[19:48:47.099] Task URL: https://cr-buildbucket.appspot.com/build/8757810032735039089
[19:48:47.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:2:0) after 7m58s
[19:48:47.897] Received PubSub notification, asking Buildbucket for the build status
[19:48:47.954] Build status: SCHEDULED
[19:50:39.165] Received PubSub notification, asking Buildbucket for the build status
[19:50:39.195] Build status: STARTED
[19:56:45.157] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:2:0)
[19:56:45.200] Build status: STARTED
[19:56:45.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:5:0) after 2m11s
[19:58:56.226] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:5:0)
[19:58:56.252] Build status: STARTED
[19:58:56.252] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:6:0) after 2m53s
[20:01:49.233] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:6:0)
[20:01:49.331] Build status: STARTED
[20:01:49.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:7:0) after 6m14s
[20:08:03.355] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:7:0)
[20:08:03.387] Build status: STARTED
[20:08:03.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:8:0) after 5m33s
[20:13:36.412] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:8:0)
[20:13:36.430] Build status: STARTED
[20:13:36.430] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:9:0) after 6m1s
[20:19:37.457] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:9:0)
[20:19:37.482] Build status: STARTED
[20:19:37.482] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:10:0) after 4m23s
[20:24:00.507] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:10:0)
[20:24:00.533] Build status: STARTED
[20:24:00.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:11:0) after 8m2s
[20:32:02.570] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:11:0)
[20:32:02.608] Build status: STARTED
[20:32:02.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:12:0) after 3m30s
[20:35:32.637] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:12:0)
[20:35:32.662] Build status: STARTED
[20:35:32.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:13:0) after 5m37s
[20:41:09.697] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:13:0)
[20:41:09.715] Build status: STARTED
[20:41:09.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:14:0) after 3m24s
[20:44:33.731] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:14:0)
[20:44:33.752] Build status: STARTED
[20:44:33.752] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:15:0) after 7m53s
[20:52:26.846] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:15:0)
[20:52:26.878] Build status: STARTED
[20:52:26.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:16:0) after 2m40s
[20:55:06.930] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:16:0)
[20:55:06.956] Build status: STARTED
[20:55:06.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:17:0) after 1m33s
[20:56:39.974] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:17:0)
[20:56:40.005] Build status: STARTED
[20:56:40.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:18:0) after 6m45s
[21:03:25.126] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:18:0)
[21:03:25.147] Build status: STARTED
[21:03:25.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:19:0) after 8m21s
[21:11:46.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:19:0)
[21:11:46.307] Build status: STARTED
[21:11:46.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:20:0) after 2m28s
[21:14:14.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:20:0)
[21:14:14.379] Build status: STARTED
[21:14:14.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:21:0) after 1m28s
[21:15:42.479] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:21:0)
[21:15:42.500] Build status: STARTED
[21:15:42.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:22:0) after 5m21s
[21:21:03.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:22:0)
[21:21:03.600] Build status: STARTED
[21:21:03.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:23:0) after 7m41s
[21:28:44.620] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:23:0)
[21:28:44.643] Build status: STARTED
[21:28:44.643] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:24:0) after 1m33s
[21:30:17.672] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:24:0)
[21:30:17.691] Build status: STARTED
[21:30:17.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:25:0) after 7m38s
[21:37:55.748] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:25:0)
[21:37:55.768] Build status: STARTED
[21:37:55.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:26:0) after 6m2s
[21:43:57.810] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:26:0)
[21:43:57.843] Build status: STARTED
[21:43:57.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:27:0) after 9m14s
[21:53:12.364] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:27:0)
[21:53:12.397] Build status: STARTED
[21:53:12.397] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:28:0) after 4m54s
[21:58:06.421] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:28:0)
[21:58:06.441] Build status: STARTED
[21:58:06.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:29:0) after 2m2s
[22:00:08.470] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:29:0)
[22:00:08.503] Build status: STARTED
[22:00:08.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:30:0) after 6m18s
[22:06:26.684] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:30:0)
[22:06:26.728] Build status: STARTED
[22:06:26.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:31:0) after 1m36s
[22:08:03.099] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:31:0)
[22:08:03.116] Build status: STARTED
[22:08:03.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:32:0) after 9m29s
[22:17:32.588] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:32:0)
[22:17:32.608] Build status: STARTED
[22:17:32.608] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:33:0) after 8m22s
[22:25:54.864] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:33:0)
[22:25:54.890] Build status: STARTED
[22:25:54.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:34:0) after 1m36s
[22:27:31.301] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:34:0)
[22:27:31.340] Build status: STARTED
[22:27:31.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:35:0) after 6m48s
[22:34:19.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:35:0)
[22:34:19.483] Build status: STARTED
[22:34:19.483] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:36:0) after 4m50s
[22:39:09.649] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:36:0)
[22:39:09.675] Build status: STARTED
[22:39:09.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:37:0) after 5m50s
[22:44:59.710] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:37:0)
[22:44:59.727] Build status: STARTED
[22:44:59.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:38:0) after 7m41s
[22:52:40.951] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:38:0)
[22:52:40.972] Build status: STARTED
[22:52:40.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:39:0) after 4m53s
[22:57:34.225] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:39:0)
[22:57:34.244] Build status: STARTED
[22:57:34.244] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:40:0) after 5m24s
[23:02:58.303] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:40:0)
[23:02:58.333] Build status: STARTED
[23:02:58.333] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:41:0) after 9m52s
[23:12:50.390] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:41:0)
[23:12:50.408] Build status: STARTED
[23:12:50.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:42:0) after 2m41s
[23:15:31.437] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:42:0)
[23:15:31.462] Build status: STARTED
[23:15:31.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:43:0) after 6m5s
[23:21:36.806] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:43:0)
[23:21:36.822] Build status: STARTED
[23:21:36.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:44:0) after 2m54s
[23:24:30.849] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:44:0)
[23:24:30.867] Build status: STARTED
[23:24:30.867] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:45:0) after 1m7s
[23:25:37.969] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:45:0)
[23:25:37.987] Build status: STARTED
[23:25:37.987] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:46:0) after 4m16s
[23:29:54.150] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:46:0)
[23:29:54.174] Build status: STARTED
[23:29:54.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:47:0) after 3m2s
[23:32:56.216] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:47:0)
[23:32:56.301] Build status: STARTED
[23:32:56.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:48:0) after 5m14s
[23:38:10.341] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:48:0)
[23:38:10.358] Build status: STARTED
[23:38:10.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:49:0) after 1m8s
[23:39:18.486] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:49:0)
[23:39:18.691] Build status: STARTED
[23:39:18.691] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:50:0) after 1m9s
[23:40:27.747] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:50:0)
[23:40:27.809] Build status: STARTED
[23:40:27.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:51:0) after 5m37s
[23:46:04.929] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:51:0)
[23:46:05.042] Build status: STARTED
[23:46:05.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:52:0) after 6m24s
[23:52:29.776] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:52:0)
[23:52:29.798] Build status: STARTED
[23:52:29.798] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:53:0) after 8m10s
[00:00:40.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:53:0)
[00:00:40.108] Build status: STARTED
[00:00:40.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:54:0) after 8m34s
[00:09:14.555] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:54:0)
[00:09:14.583] Build status: STARTED
[00:09:14.583] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:55:0) after 1m54s
[00:11:08.924] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:55:0)
[00:11:09.008] Build status: STARTED
[00:11:09.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:56:0) after 6m25s
[00:17:34.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:56:0)
[00:17:34.117] Build status: STARTED
[00:17:34.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:57:0) after 2m0s
[00:19:34.137] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:57:0)
[00:19:34.208] Build status: STARTED
[00:19:34.208] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:58:0) after 8m33s
[00:28:07.222] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:58:0)
[00:28:07.241] Build status: STARTED
[00:28:07.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:59:0) after 4m40s
[00:32:47.248] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:59:0)
[00:32:47.275] Build status: STARTED
[00:32:47.275] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:60:0) after 5m42s
[00:38:29.297] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:60:0)
[00:38:29.317] Build status: STARTED
[00:38:29.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:61:0) after 1m20s
[00:39:49.356] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:61:0)
[00:39:49.478] Build status: STARTED
[00:39:49.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:62:0) after 8m9s
[00:47:58.515] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:62:0)
[00:47:58.537] Build status: STARTED
[00:47:58.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923240094614381584:63:0) after 3m0s
[00:49:18.884] Received PubSub notification, asking Buildbucket for the build status
[00:49:18.901] Build:
{
"id": "8757810032735039089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 7554,
"createdBy": "project:chromium",
"createTime": "2024-01-26T19:48:46.023634532Z",
"startTime": "2024-01-26T19:50:38.538308Z",
"endTime": "2024-01-27T00:49:17.829810Z",
"updateTime": "2024-01-27T00:49:17.829810Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ff6825425ccd0aad4f5351e54da7de7f0a6e8519",
"ref": "refs/heads/main"
}
}
}
[00:49:18.901] Invocation finished in 5h0m34.054807807s with status FAILED