[21:17:06.999] New invocation is queued and will start shortly
[21:17:08.112] Starting the invocation (attempt 1)
[21:17:08.146] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d58d283ba3b8a32b73165bd6aac92f1b5f03728b"
[21:17:08.146] Popped gitiles commit info from properties and tags
[21:17:08.146] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:17:08.146] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:17:08.147] Buildbucket request:
{
"requestId": "8932294231556398224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d58d283ba3b8a32b73165bd6aac92f1b5f03728b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8932294231556398224"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:17:08.921] Scheduled build:
{
"id": "8766864169553381617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 6641,
"createdBy": "project:chromium",
"createTime": "2023-10-18T21:17:08.282824825Z",
"updateTime": "2023-10-18T21:17:08.282824825Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d58d283ba3b8a32b73165bd6aac92f1b5f03728b",
"ref": "refs/heads/main"
}
}
}
[21:17:08.921] Task URL: https://cr-buildbucket.appspot.com/build/8766864169553381617
[21:17:08.921] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:2:0) after 4m59s
[21:17:09.893] Received PubSub notification, asking Buildbucket for the build status
[21:17:09.908] Build status: SCHEDULED
[21:17:10.412] Received PubSub notification, asking Buildbucket for the build status
[21:17:10.507] Build status: STARTED
[21:22:07.988] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:2:0)
[21:22:08.029] Build status: STARTED
[21:22:08.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:5:0) after 7m53s
[21:30:01.342] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:5:0)
[21:30:01.379] Build status: STARTED
[21:30:01.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:6:0) after 9m17s
[21:39:18.429] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:6:0)
[21:39:18.455] Build status: STARTED
[21:39:18.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:7:0) after 9m27s
[21:48:45.794] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:7:0)
[21:48:45.836] Build status: STARTED
[21:48:45.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:8:0) after 9m17s
[21:58:02.981] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:8:0)
[21:58:02.999] Build status: STARTED
[21:58:02.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:9:0) after 4m57s
[22:03:00.186] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:9:0)
[22:03:00.213] Build status: STARTED
[22:03:00.214] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:10:0) after 9m32s
[22:12:32.900] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:10:0)
[22:12:32.926] Build status: STARTED
[22:12:32.926] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:11:0) after 7m50s
[22:20:23.241] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:11:0)
[22:20:23.324] Build status: STARTED
[22:20:23.324] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:12:0) after 8m23s
[22:28:46.556] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:12:0)
[22:28:46.574] Build status: STARTED
[22:28:46.574] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:13:0) after 1m29s
[22:30:16.002] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:13:0)
[22:30:16.196] Build status: STARTED
[22:30:16.196] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:14:0) after 2m24s
[22:32:40.230] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:14:0)
[22:32:40.253] Build status: STARTED
[22:32:40.253] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:15:0) after 7m41s
[22:40:21.344] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:15:0)
[22:40:21.412] Build status: STARTED
[22:40:21.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:16:0) after 5m34s
[22:45:55.574] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:16:0)
[22:45:55.641] Build status: STARTED
[22:45:55.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:17:0) after 5m25s
[22:51:20.761] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:17:0)
[22:51:20.779] Build status: STARTED
[22:51:20.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:18:0) after 6m27s
[22:57:47.810] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:18:0)
[22:57:47.835] Build status: STARTED
[22:57:47.835] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:19:0) after 6m45s
[23:04:32.949] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:19:0)
[23:04:32.967] Build status: STARTED
[23:04:32.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:20:0) after 7m19s
[23:11:52.184] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:20:0)
[23:11:52.205] Build status: STARTED
[23:11:52.205] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:21:0) after 6m49s
[23:18:41.474] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:21:0)
[23:18:41.494] Build status: STARTED
[23:18:41.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:22:0) after 5m3s
[23:23:44.933] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:22:0)
[23:23:44.956] Build status: STARTED
[23:23:44.956] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:23:0) after 6m42s
[23:30:26.968] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:23:0)
[23:30:26.984] Build status: STARTED
[23:30:26.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:24:0) after 1m56s
[23:32:23.010] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:24:0)
[23:32:23.137] Build status: STARTED
[23:32:23.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:25:0) after 1m29s
[23:33:52.423] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:25:0)
[23:33:52.441] Build status: STARTED
[23:33:52.441] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:26:0) after 1m17s
[23:35:09.489] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:26:0)
[23:35:09.533] Build status: STARTED
[23:35:09.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:27:0) after 5m59s
[23:41:08.674] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:27:0)
[23:41:08.695] Build status: STARTED
[23:41:08.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:28:0) after 7m48s
[23:48:56.892] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:28:0)
[23:48:56.960] Build status: STARTED
[23:48:56.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:29:0) after 1m58s
[23:50:55.089] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:29:0)
[23:50:55.108] Build status: STARTED
[23:50:55.108] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:30:0) after 7m40s
[23:58:35.391] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:30:0)
[23:58:35.409] Build status: STARTED
[23:58:35.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:31:0) after 6m18s
[00:04:53.656] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:31:0)
[00:04:53.713] Build status: STARTED
[00:04:53.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:32:0) after 5m8s
[00:10:01.751] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:32:0)
[00:10:01.817] Build status: STARTED
[00:10:01.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:33:0) after 3m4s
[00:13:06.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:33:0)
[00:13:06.114] Build status: STARTED
[00:13:06.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:34:0) after 1m47s
[00:14:53.156] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:34:0)
[00:14:53.173] Build status: STARTED
[00:14:53.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:35:0) after 9m33s
[00:24:26.473] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:35:0)
[00:24:26.580] Build status: STARTED
[00:24:26.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:36:0) after 5m5s
[00:29:31.666] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:36:0)
[00:29:31.715] Build status: STARTED
[00:29:31.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:37:0) after 6m44s
[00:36:16.438] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:37:0)
[00:36:16.461] Build status: STARTED
[00:36:16.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:38:0) after 8m9s
[00:44:26.596] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:38:0)
[00:44:26.632] Build status: STARTED
[00:44:26.632] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:39:0) after 9m12s
[00:53:39.437] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:39:0)
[00:53:39.458] Build status: STARTED
[00:53:39.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:40:0) after 3m52s
[00:57:31.543] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:40:0)
[00:57:31.566] Build status: STARTED
[00:57:31.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:41:0) after 3m57s
[01:01:28.910] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:41:0)
[01:01:28.939] Build status: STARTED
[01:01:28.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:42:0) after 8m38s
[01:10:07.180] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:42:0)
[01:10:07.200] Build status: STARTED
[01:10:07.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:43:0) after 4m4s
[01:14:11.285] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:43:0)
[01:14:11.307] Build status: STARTED
[01:14:11.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:44:0) after 8m13s
[01:22:24.883] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:44:0)
[01:22:24.901] Build status: STARTED
[01:22:24.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:45:0) after 5m7s
[01:27:31.953] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:45:0)
[01:27:32.002] Build status: STARTED
[01:27:32.002] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:46:0) after 5m43s
[01:33:15.048] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:46:0)
[01:33:15.381] Build status: STARTED
[01:33:15.381] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:47:0) after 2m57s
[01:36:12.394] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:47:0)
[01:36:12.436] Build status: STARTED
[01:36:12.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:48:0) after 2m25s
[01:38:37.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:48:0)
[01:38:37.477] Build status: STARTED
[01:38:37.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:49:0) after 4m34s
[01:43:11.490] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:49:0)
[01:43:11.508] Build status: STARTED
[01:43:11.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:50:0) after 2m11s
[01:45:22.541] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:50:0)
[01:45:22.609] Build status: STARTED
[01:45:22.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:51:0) after 9m0s
[01:54:22.675] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:51:0)
[01:54:22.694] Build status: STARTED
[01:54:22.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:52:0) after 4m25s
[01:58:48.202] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:52:0)
[01:58:48.232] Build status: STARTED
[01:58:48.232] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:53:0) after 5m4s
[02:03:52.276] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:53:0)
[02:03:52.298] Build status: STARTED
[02:03:52.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:54:0) after 6m24s
[02:10:16.620] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:54:0)
[02:10:16.651] Build status: STARTED
[02:10:16.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:55:0) after 5m7s
[02:15:23.679] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:55:0)
[02:15:23.699] Build status: STARTED
[02:15:23.699] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:56:0) after 5m26s
[02:20:49.724] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:56:0)
[02:20:49.745] Build status: STARTED
[02:20:49.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:57:0) after 7m13s
[02:28:02.789] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:57:0)
[02:28:02.811] Build status: STARTED
[02:28:02.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:58:0) after 4m49s
[02:32:51.924] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:58:0)
[02:32:51.946] Build status: STARTED
[02:32:51.946] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:59:0) after 4m58s
[02:37:50.016] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:59:0)
[02:37:50.033] Build status: STARTED
[02:37:50.033] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:60:0) after 2m22s
[02:40:12.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:60:0)
[02:40:12.164] Build status: STARTED
[02:40:12.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:61:0) after 2m8s
[02:42:20.213] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:61:0)
[02:42:20.234] Build status: STARTED
[02:42:20.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8932294231556398224:62:0) after 8m23s
[02:48:11.098] Received PubSub notification, asking Buildbucket for the build status
[02:48:11.117] Build:
{
"id": "8766864169553381617",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 6641,
"createdBy": "project:chromium",
"createTime": "2023-10-18T21:17:08.282824825Z",
"startTime": "2023-10-18T21:17:09.678780Z",
"endTime": "2023-10-19T02:48:09.285105185Z",
"updateTime": "2023-10-19T02:48:09.285105185Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d58d283ba3b8a32b73165bd6aac92f1b5f03728b",
"ref": "refs/heads/main"
}
}
}
[02:48:11.117] Invocation finished in 5h31m4.128516747s with status FAILED