[02:40:52.332] New invocation is queued and will start shortly
[02:40:53.435] Starting the invocation (attempt 1)
[02:40:53.460] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/4579c57594c1bb5d335db525f7264ff50f92c8cb"
[02:40:53.460] Popped gitiles commit info from properties and tags
[02:40:53.460] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:40:53.462] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:40:53.462] Buildbucket request:
{
"requestId": "8923485956871652256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4579c57594c1bb5d335db525f7264ff50f92c8cb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923485956871652256"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:40:54.394] Scheduled build:
{
"id": "8758055894899311313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 7495,
"createdBy": "project:chromium",
"createTime": "2024-01-24T02:40:53.592420476Z",
"updateTime": "2024-01-24T02:40:53.592420476Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4579c57594c1bb5d335db525f7264ff50f92c8cb",
"ref": "refs/heads/main"
}
}
}
[02:40:54.394] Task URL: https://cr-buildbucket.appspot.com/build/8758055894899311313
[02:40:54.394] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:2:0) after 1m35s
[02:40:55.204] Received PubSub notification, asking Buildbucket for the build status
[02:40:55.219] Build status: SCHEDULED
[02:42:21.486] Received PubSub notification, asking Buildbucket for the build status
[02:42:21.577] Build status: STARTED
[02:42:29.655] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:2:0)
[02:42:29.670] Build status: STARTED
[02:42:29.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:5:0) after 5m18s
[02:47:47.884] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:5:0)
[02:47:47.915] Build status: STARTED
[02:47:47.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:6:0) after 9m22s
[02:57:10.068] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:6:0)
[02:57:10.146] Build status: STARTED
[02:57:10.146] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:7:0) after 6m53s
[03:04:03.201] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:7:0)
[03:04:03.298] Build status: STARTED
[03:04:03.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:8:0) after 9m2s
[03:13:05.327] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:8:0)
[03:13:05.370] Build status: STARTED
[03:13:05.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:9:0) after 7m20s
[03:20:25.384] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:9:0)
[03:20:25.408] Build status: STARTED
[03:20:25.408] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:10:0) after 4m9s
[03:24:34.435] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:10:0)
[03:24:34.494] Build status: STARTED
[03:24:34.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:11:0) after 2m58s
[03:27:32.508] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:11:0)
[03:27:32.532] Build status: STARTED
[03:27:32.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:12:0) after 7m20s
[03:34:52.841] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:12:0)
[03:34:52.860] Build status: STARTED
[03:34:52.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:13:0) after 3m45s
[03:38:37.857] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:13:0)
[03:38:37.885] Build status: STARTED
[03:38:37.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:14:0) after 5m51s
[03:44:29.094] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:14:0)
[03:44:29.112] Build status: STARTED
[03:44:29.112] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:15:0) after 2m0s
[03:46:29.137] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:15:0)
[03:46:29.156] Build status: STARTED
[03:46:29.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:16:0) after 6m16s
[03:52:45.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:16:0)
[03:52:45.415] Build status: STARTED
[03:52:45.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:17:0) after 9m52s
[04:02:37.735] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:17:0)
[04:02:37.753] Build status: STARTED
[04:02:37.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:18:0) after 5m31s
[04:08:08.776] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:18:0)
[04:08:08.792] Build status: STARTED
[04:08:08.792] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:19:0) after 5m5s
[04:13:13.997] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:19:0)
[04:13:14.015] Build status: STARTED
[04:13:14.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:20:0) after 4m38s
[04:17:52.137] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:20:0)
[04:17:52.159] Build status: STARTED
[04:17:52.159] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:21:0) after 4m10s
[04:22:02.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:21:0)
[04:22:02.251] Build status: STARTED
[04:22:02.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:22:0) after 7m50s
[04:29:52.272] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:22:0)
[04:29:52.289] Build status: STARTED
[04:29:52.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:23:0) after 8m34s
[04:38:26.352] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:23:0)
[04:38:26.370] Build status: STARTED
[04:38:26.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:24:0) after 7m43s
[04:46:09.446] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:24:0)
[04:46:09.465] Build status: STARTED
[04:46:09.465] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:25:0) after 6m34s
[04:52:43.488] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:25:0)
[04:52:43.505] Build status: STARTED
[04:52:43.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:26:0) after 1m33s
[04:54:16.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:26:0)
[04:54:16.721] Build status: STARTED
[04:54:16.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:27:0) after 9m12s
[05:03:28.818] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:27:0)
[05:03:28.895] Build status: STARTED
[05:03:28.895] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:28:0) after 2m57s
[05:06:26.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:28:0)
[05:06:26.501] Build status: STARTED
[05:06:26.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:29:0) after 3m7s
[05:09:34.200] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:29:0)
[05:09:34.216] Build status: STARTED
[05:09:34.216] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:30:0) after 3m1s
[05:12:35.484] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:30:0)
[05:12:35.508] Build status: STARTED
[05:12:35.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:31:0) after 3m1s
[05:15:36.728] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:31:0)
[05:15:36.744] Build status: STARTED
[05:15:36.744] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:32:0) after 6m17s
[05:21:53.751] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:32:0)
[05:21:53.769] Build status: STARTED
[05:21:53.769] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:33:0) after 2m26s
[05:24:19.747] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:33:0)
[05:24:19.762] Build status: STARTED
[05:24:19.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:34:0) after 6m24s
[05:30:44.295] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:34:0)
[05:30:44.311] Build status: STARTED
[05:30:44.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:35:0) after 8m14s
[05:38:58.339] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:35:0)
[05:38:58.361] Build status: STARTED
[05:38:58.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:36:0) after 7m22s
[05:46:20.379] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:36:0)
[05:46:20.415] Build status: STARTED
[05:46:20.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:37:0) after 5m43s
[05:52:03.438] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:37:0)
[05:52:03.453] Build status: STARTED
[05:52:03.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:38:0) after 3m54s
[05:55:57.464] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:38:0)
[05:55:57.481] Build status: STARTED
[05:55:57.481] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:39:0) after 8m40s
[06:04:37.543] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:39:0)
[06:04:37.728] Build status: STARTED
[06:04:37.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:40:0) after 9m7s
[06:13:44.754] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:40:0)
[06:13:44.771] Build status: STARTED
[06:13:44.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:41:0) after 3m48s
[06:17:32.926] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:41:0)
[06:17:32.944] Build status: STARTED
[06:17:32.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:42:0) after 8m12s
[06:25:46.084] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:42:0)
[06:25:46.107] Build status: STARTED
[06:25:46.107] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:43:0) after 3m54s
[06:29:40.539] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:43:0)
[06:29:40.557] Build status: STARTED
[06:29:40.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:44:0) after 5m20s
[06:35:00.571] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:44:0)
[06:35:00.594] Build status: STARTED
[06:35:00.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:45:0) after 7m44s
[06:42:44.685] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:45:0)
[06:42:44.702] Build status: STARTED
[06:42:44.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:46:0) after 9m50s
[06:52:34.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:46:0)
[06:52:34.833] Build status: STARTED
[06:52:34.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:47:0) after 5m15s
[06:57:49.843] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:47:0)
[06:57:49.873] Build status: STARTED
[06:57:49.873] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:48:0) after 1m11s
[06:59:00.894] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:48:0)
[06:59:00.913] Build status: STARTED
[06:59:00.913] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:49:0) after 3m16s
[07:02:16.946] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:49:0)
[07:02:16.967] Build status: STARTED
[07:02:16.967] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:50:0) after 4m49s
[07:07:06.246] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:50:0)
[07:07:06.279] Build status: STARTED
[07:07:06.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:51:0) after 8m46s
[07:15:52.434] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:51:0)
[07:15:52.452] Build status: STARTED
[07:15:52.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:52:0) after 8m57s
[07:24:49.468] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:52:0)
[07:24:49.488] Build status: STARTED
[07:24:49.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:53:0) after 7m40s
[07:32:30.270] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:53:0)
[07:32:30.300] Build status: STARTED
[07:32:30.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8923485956871652256:54:0) after 3m43s
[07:33:31.930] Received PubSub notification, asking Buildbucket for the build status
[07:33:31.945] Build:
{
"id": "8758055894899311313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 7495,
"createdBy": "project:chromium",
"createTime": "2024-01-24T02:40:53.592420476Z",
"startTime": "2024-01-24T02:42:18.782135Z",
"endTime": "2024-01-24T07:33:31.013915Z",
"updateTime": "2024-01-24T07:33:31.013915Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "4579c57594c1bb5d335db525f7264ff50f92c8cb",
"ref": "refs/heads/main"
}
}
}
[07:33:31.945] Invocation finished in 4h52m39.618135878s with status FAILED