[04:49:28.295] New invocation is queued and will start shortly
[04:49:29.588] Starting the invocation (attempt 1)
[04:49:29.628] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/15b777c9bbe15fd40f05de8b8bba276dae3cd17b"
[04:49:29.628] Popped gitiles commit info from properties and tags
[04:49:29.628] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:49:29.628] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:49:29.628] Buildbucket request:
{
"requestId": "8973668585494837776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "15b777c9bbe15fd40f05de8b8bba276dae3cd17b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8973668585494837776"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:49:30.128] Scheduled build:
{
"id": "8808238523358812257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3235,
"createdBy": "project:chromium",
"createTime": "2022-07-19T04:49:29.700888327Z",
"updateTime": "2022-07-19T04:49:29.700888327Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "15b777c9bbe15fd40f05de8b8bba276dae3cd17b",
"ref": "refs/heads/main"
}
}
}
[04:49:30.128] Task URL: https://cr-buildbucket.appspot.com/build/8808238523358812257
[04:49:30.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:2:0) after 7m12s
[04:50:20.180] Received PubSub notification, asking Buildbucket for the build status
[04:50:20.200] Build status: STARTED
[04:56:42.436] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:2:0)
[04:56:42.463] Build status: STARTED
[04:56:42.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:4:0) after 6m12s
[05:02:54.496] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:4:0)
[05:02:54.530] Build status: STARTED
[05:02:54.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:5:0) after 2m15s
[05:05:09.549] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:5:0)
[05:05:09.579] Build status: STARTED
[05:05:09.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:6:0) after 2m59s
[05:08:08.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:6:0)
[05:08:08.634] Build status: STARTED
[05:08:08.634] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:7:0) after 3m33s
[05:11:41.726] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:7:0)
[05:11:41.748] Build status: STARTED
[05:11:41.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:8:0) after 4m51s
[05:16:32.767] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:8:0)
[05:16:32.794] Build status: STARTED
[05:16:32.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:9:0) after 5m22s
[05:21:54.921] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:9:0)
[05:21:54.953] Build status: STARTED
[05:21:54.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:10:0) after 8m49s
[05:30:43.975] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:10:0)
[05:30:44.011] Build status: STARTED
[05:30:44.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:11:0) after 5m54s
[05:36:38.035] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:11:0)
[05:36:38.144] Build status: STARTED
[05:36:38.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:12:0) after 9m1s
[05:45:39.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:12:0)
[05:45:39.285] Build status: STARTED
[05:45:39.285] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:13:0) after 3m53s
[05:49:32.304] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:13:0)
[05:49:32.339] Build status: STARTED
[05:49:32.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:14:0) after 6m36s
[05:56:08.365] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:14:0)
[05:56:08.417] Build status: STARTED
[05:56:08.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:15:0) after 7m37s
[06:03:45.546] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:15:0)
[06:03:45.571] Build status: STARTED
[06:03:45.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:16:0) after 6m37s
[06:10:22.695] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:16:0)
[06:10:22.723] Build status: STARTED
[06:10:22.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:17:0) after 4m13s
[06:14:35.761] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:17:0)
[06:14:35.783] Build status: STARTED
[06:14:35.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:18:0) after 2m4s
[06:16:39.995] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:18:0)
[06:16:40.018] Build status: STARTED
[06:16:40.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:19:0) after 7m27s
[06:24:07.048] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:19:0)
[06:24:07.069] Build status: STARTED
[06:24:07.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:20:0) after 7m8s
[06:31:15.285] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:20:0)
[06:31:15.308] Build status: STARTED
[06:31:15.308] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:21:0) after 8m0s
[06:39:15.579] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:21:0)
[06:39:15.625] Build status: STARTED
[06:39:15.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:22:0) after 1m42s
[06:40:57.683] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:22:0)
[06:40:57.750] Build status: STARTED
[06:40:57.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:23:0) after 4m38s
[06:45:35.774] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:23:0)
[06:45:35.819] Build status: STARTED
[06:45:35.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:24:0) after 8m57s
[06:54:32.846] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:24:0)
[06:54:32.868] Build status: STARTED
[06:54:32.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:25:0) after 9m9s
[07:03:41.895] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:25:0)
[07:03:41.922] Build status: STARTED
[07:03:41.922] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:26:0) after 2m10s
[07:05:51.950] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:26:0)
[07:05:51.984] Build status: STARTED
[07:05:51.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:27:0) after 5m9s
[07:11:01.137] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:27:0)
[07:11:01.176] Build status: STARTED
[07:11:01.177] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:28:0) after 7m45s
[07:18:46.198] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:28:0)
[07:18:46.221] Build status: STARTED
[07:18:46.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:29:0) after 7m7s
[07:25:53.204] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:29:0)
[07:25:53.238] Build status: STARTED
[07:25:53.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:30:0) after 1m16s
[07:27:09.375] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:30:0)
[07:27:09.398] Build status: STARTED
[07:27:09.398] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:31:0) after 8m16s
[07:35:25.518] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:31:0)
[07:35:25.541] Build status: STARTED
[07:35:25.541] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:32:0) after 1m38s
[07:37:03.672] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:32:0)
[07:37:03.703] Build status: STARTED
[07:37:03.703] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:33:0) after 5m46s
[07:42:49.796] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:33:0)
[07:42:49.818] Build status: STARTED
[07:42:49.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:34:0) after 5m27s
[07:48:16.953] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:34:0)
[07:48:16.980] Build status: STARTED
[07:48:16.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:35:0) after 8m58s
[07:57:15.002] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:35:0)
[07:57:15.051] Build status: STARTED
[07:57:15.051] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:36:0) after 3m24s
[08:00:39.175] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:36:0)
[08:00:39.220] Build status: STARTED
[08:00:39.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:37:0) after 1m51s
[08:02:30.257] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:37:0)
[08:02:30.360] Build status: STARTED
[08:02:30.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:38:0) after 5m33s
[08:08:03.389] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:38:0)
[08:08:03.432] Build status: STARTED
[08:08:03.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:39:0) after 6m36s
[08:14:39.444] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:39:0)
[08:14:39.469] Build status: STARTED
[08:14:39.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:40:0) after 2m22s
[08:17:01.543] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:40:0)
[08:17:01.570] Build status: STARTED
[08:17:01.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:41:0) after 7m24s
[08:24:25.733] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:41:0)
[08:24:25.756] Build status: STARTED
[08:24:25.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:42:0) after 7m47s
[08:32:12.918] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:42:0)
[08:32:12.953] Build status: STARTED
[08:32:12.953] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:43:0) after 8m27s
[08:40:40.032] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:43:0)
[08:40:40.061] Build status: STARTED
[08:40:40.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:44:0) after 7m44s
[08:48:24.422] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:44:0)
[08:48:24.453] Build status: STARTED
[08:48:24.453] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:45:0) after 6m48s
[08:55:12.628] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:45:0)
[08:55:12.650] Build status: STARTED
[08:55:12.650] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:46:0) after 4m10s
[08:59:22.826] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:46:0)
[08:59:22.846] Build status: STARTED
[08:59:22.846] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:47:0) after 9m59s
[09:09:22.059] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:47:0)
[09:09:22.086] Build status: STARTED
[09:09:22.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:48:0) after 2m47s
[09:12:09.109] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:48:0)
[09:12:09.133] Build status: STARTED
[09:12:09.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:49:0) after 4m14s
[09:16:23.158] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:49:0)
[09:16:23.192] Build status: STARTED
[09:16:23.192] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:50:0) after 6m5s
[09:22:28.431] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:50:0)
[09:22:28.459] Build status: STARTED
[09:22:28.459] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:51:0) after 7m59s
[09:30:27.482] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:51:0)
[09:30:27.514] Build status: STARTED
[09:30:27.514] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8973668585494837776:52:0) after 4m59s
[09:31:44.678] Received PubSub notification, asking Buildbucket for the build status
[09:31:44.716] Build:
{
"id": "8808238523358812257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 3235,
"createdBy": "project:chromium",
"createTime": "2022-07-19T04:49:29.700888327Z",
"startTime": "2022-07-19T04:50:19.684581Z",
"endTime": "2022-07-19T09:31:44.366179093Z",
"updateTime": "2022-07-19T09:31:44.366179093Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "15b777c9bbe15fd40f05de8b8bba276dae3cd17b",
"ref": "refs/heads/main"
}
}
}
[09:31:44.716] Invocation finished in 4h42m16.436408971s with status FAILED