[15:22:00.086] New invocation is queued and will start shortly
[15:22:01.197] Starting the invocation (attempt 1)
[15:22:01.235] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c9d93c47280146995c0926b56a009e038b0b9b45"
[15:22:01.235] Popped gitiles commit info from properties and tags
[15:22:01.235] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[15:22:01.235] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[15:22:01.235] Buildbucket request:
{
"requestId": "8945724924507438320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9d93c47280146995c0926b56a009e038b0b9b45",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8945724924507438320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWin64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[15:22:01.809] Scheduled build:
{
"id": "8780294862563507089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 5415,
"createdBy": "project:chromium",
"createTime": "2023-05-23T15:22:01.307649480Z",
"updateTime": "2023-05-23T15:22:01.307649480Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9d93c47280146995c0926b56a009e038b0b9b45",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:22:01.809] Task URL: https://cr-buildbucket.appspot.com/build/8780294862563507089
[15:22:01.810] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:2:0) after 5m8s
[15:22:44.461] Received PubSub notification, asking Buildbucket for the build status
[15:22:44.479] Build status: STARTED
[15:27:09.925] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:2:0)
[15:27:09.966] Build status: STARTED
[15:27:09.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:4:0) after 2m17s
[15:29:27.005] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:4:0)
[15:29:27.024] Build status: STARTED
[15:29:27.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:5:0) after 8m28s
[15:37:55.217] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:5:0)
[15:37:55.335] Build status: STARTED
[15:37:55.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:6:0) after 2m39s
[15:40:34.417] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:6:0)
[15:40:34.436] Build status: STARTED
[15:40:34.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:7:0) after 5m41s
[15:46:15.465] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:7:0)
[15:46:15.489] Build status: STARTED
[15:46:15.489] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:8:0) after 7m7s
[15:53:22.540] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:8:0)
[15:53:22.560] Build status: STARTED
[15:53:22.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:9:0) after 1m0s
[15:54:22.607] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:9:0)
[15:54:22.626] Build status: STARTED
[15:54:22.626] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:10:0) after 3m1s
[15:57:23.699] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:10:0)
[15:57:24.715] Build status: STARTED
[15:57:24.715] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:11:0) after 3m16s
[16:00:40.748] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:11:0)
[16:00:40.824] Build status: STARTED
[16:00:40.824] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:12:0) after 3m2s
[16:03:42.860] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:12:0)
[16:03:42.877] Build status: STARTED
[16:03:42.877] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:13:0) after 5m18s
[16:09:00.955] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:13:0)
[16:09:00.994] Build status: STARTED
[16:09:00.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:14:0) after 5m12s
[16:14:13.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:14:0)
[16:14:13.156] Build status: STARTED
[16:14:13.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:15:0) after 7m14s
[16:21:27.219] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:15:0)
[16:21:27.240] Build status: STARTED
[16:21:27.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:16:0) after 8m58s
[16:30:25.274] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:16:0)
[16:30:25.292] Build status: STARTED
[16:30:25.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:17:0) after 5m22s
[16:35:47.397] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:17:0)
[16:35:47.544] Build status: STARTED
[16:35:47.544] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:18:0) after 6m41s
[16:42:28.576] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:18:0)
[16:42:28.597] Build status: STARTED
[16:42:28.597] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:19:0) after 4m47s
[16:47:15.595] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:19:0)
[16:47:15.613] Build status: STARTED
[16:47:15.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:20:0) after 8m1s
[16:55:16.639] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:20:0)
[16:55:16.660] Build status: STARTED
[16:55:16.660] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:21:0) after 8m48s
[17:04:04.715] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:21:0)
[17:04:04.742] Build status: STARTED
[17:04:04.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:22:0) after 3m12s
[17:07:16.810] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:22:0)
[17:07:16.868] Build status: STARTED
[17:07:16.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:23:0) after 5m12s
[17:12:28.894] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:23:0)
[17:12:28.915] Build status: STARTED
[17:12:28.915] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:24:0) after 6m45s
[17:19:13.947] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:24:0)
[17:19:13.974] Build status: STARTED
[17:19:13.974] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:25:0) after 8m55s
[17:28:09.099] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:25:0)
[17:28:09.249] Build status: STARTED
[17:28:09.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:26:0) after 2m26s
[17:30:35.284] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:26:0)
[17:30:35.311] Build status: STARTED
[17:30:35.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:27:0) after 7m29s
[17:38:04.344] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:27:0)
[17:38:04.367] Build status: STARTED
[17:38:04.367] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:28:0) after 9m7s
[17:47:11.459] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:28:0)
[17:47:11.479] Build status: STARTED
[17:47:11.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:29:0) after 9m31s
[17:56:42.521] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:29:0)
[17:56:42.560] Build status: STARTED
[17:56:42.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:30:0) after 4m3s
[18:00:45.731] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:30:0)
[18:00:45.751] Build status: STARTED
[18:00:45.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:31:0) after 7m19s
[18:08:04.827] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:31:0)
[18:08:04.872] Build status: STARTED
[18:08:04.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:32:0) after 3m33s
[18:11:37.919] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:32:0)
[18:11:37.980] Build status: STARTED
[18:11:37.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:33:0) after 3m48s
[18:15:26.030] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:33:0)
[18:15:26.092] Build status: STARTED
[18:15:26.092] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:34:0) after 2m7s
[18:17:33.111] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:34:0)
[18:17:33.136] Build status: STARTED
[18:17:33.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:35:0) after 3m15s
[18:20:48.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:35:0)
[18:20:48.224] Build status: STARTED
[18:20:48.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:36:0) after 9m31s
[18:30:19.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:36:0)
[18:30:19.350] Build status: STARTED
[18:30:19.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:37:0) after 4m10s
[18:34:29.371] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:37:0)
[18:34:29.400] Build status: STARTED
[18:34:29.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:38:0) after 2m12s
[18:36:41.476] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:38:0)
[18:36:41.543] Build status: STARTED
[18:36:41.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:39:0) after 3m2s
[18:39:43.723] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:39:0)
[18:39:43.745] Build status: STARTED
[18:39:43.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:40:0) after 5m51s
[18:45:34.936] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:40:0)
[18:45:34.960] Build status: STARTED
[18:45:34.960] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:41:0) after 8m22s
[18:53:57.177] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:41:0)
[18:53:57.200] Build status: STARTED
[18:53:57.200] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:42:0) after 9m26s
[19:03:24.054] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:42:0)
[19:03:24.100] Build status: STARTED
[19:03:24.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:43:0) after 1m38s
[19:05:02.247] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:43:0)
[19:05:02.299] Build status: STARTED
[19:05:02.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:44:0) after 5m10s
[19:10:12.377] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:44:0)
[19:10:12.403] Build status: STARTED
[19:10:12.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:45:0) after 4m1s
[19:14:13.458] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:45:0)
[19:14:13.477] Build status: STARTED
[19:14:13.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:46:0) after 2m0s
[19:16:13.506] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:46:0)
[19:16:13.531] Build status: STARTED
[19:16:13.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:47:0) after 6m25s
[19:22:38.722] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:47:0)
[19:22:38.848] Build status: STARTED
[19:22:38.849] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:48:0) after 3m39s
[19:26:18.084] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:48:0)
[19:26:18.102] Build status: STARTED
[19:26:18.103] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:49:0) after 4m55s
[19:31:13.259] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:49:0)
[19:31:13.299] Build status: STARTED
[19:31:13.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:50:0) after 4m14s
[19:35:27.554] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:50:0)
[19:35:27.580] Build status: STARTED
[19:35:27.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:51:0) after 7m14s
[19:42:41.634] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:51:0)
[19:42:41.655] Build status: STARTED
[19:42:41.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:52:0) after 3m37s
[19:46:18.685] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:52:0)
[19:46:18.729] Build status: STARTED
[19:46:18.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:53:0) after 7m0s
[19:53:18.861] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:53:0)
[19:53:18.881] Build status: STARTED
[19:53:18.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:54:0) after 2m47s
[19:56:05.912] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:54:0)
[19:56:05.934] Build status: STARTED
[19:56:05.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:55:0) after 9m28s
[20:05:34.082] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:55:0)
[20:05:34.119] Build status: STARTED
[20:05:34.119] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:56:0) after 6m54s
[20:12:28.254] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:56:0)
[20:12:28.285] Build status: STARTED
[20:12:28.286] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:57:0) after 9m6s
[20:21:34.324] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:57:0)
[20:21:34.345] Build status: STARTED
[20:21:34.345] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:58:0) after 1m47s
[20:23:21.477] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:58:0)
[20:23:21.494] Build status: STARTED
[20:23:21.494] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:59:0) after 3m11s
[20:26:32.732] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:59:0)
[20:26:32.757] Build status: STARTED
[20:26:32.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:60:0) after 1m50s
[20:28:23.206] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:60:0)
[20:28:23.237] Build status: STARTED
[20:28:23.237] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:61:0) after 7m35s
[20:35:58.414] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:61:0)
[20:35:58.444] Build status: STARTED
[20:35:58.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:62:0) after 5m5s
[20:41:03.634] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:62:0)
[20:41:03.657] Build status: STARTED
[20:41:03.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:63:0) after 9m23s
[20:50:26.715] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:63:0)
[20:50:26.737] Build status: STARTED
[20:50:26.737] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:64:0) after 1m12s
[20:51:38.758] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:64:0)
[20:51:38.786] Build status: STARTED
[20:51:38.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:65:0) after 9m15s
[21:00:53.813] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:65:0)
[21:00:53.848] Build status: STARTED
[21:00:53.848] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:66:0) after 1m56s
[21:02:50.098] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:66:0)
[21:02:50.128] Build status: STARTED
[21:02:50.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:67:0) after 8m51s
[21:11:41.192] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:67:0)
[21:11:41.213] Build status: STARTED
[21:11:41.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:68:0) after 4m32s
[21:16:13.243] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:68:0)
[21:16:13.269] Build status: STARTED
[21:16:13.269] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:69:0) after 7m21s
[21:23:34.311] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:69:0)
[21:23:34.341] Build status: STARTED
[21:23:34.341] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:70:0) after 8m46s
[21:32:20.381] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:70:0)
[21:32:20.428] Build status: STARTED
[21:32:20.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:71:0) after 9m34s
[21:41:54.466] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:71:0)
[21:41:54.560] Build status: STARTED
[21:41:54.560] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:72:0) after 3m18s
[21:45:12.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:72:0)
[21:45:12.673] Build status: STARTED
[21:45:12.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:73:0) after 9m41s
[21:54:53.706] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:73:0)
[21:54:53.723] Build status: STARTED
[21:54:53.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:74:0) after 8m56s
[22:03:49.751] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:74:0)
[22:03:49.821] Build status: STARTED
[22:03:49.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:75:0) after 3m5s
[22:06:54.949] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:75:0)
[22:06:54.968] Build status: STARTED
[22:06:54.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:76:0) after 6m14s
[22:13:08.991] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:76:0)
[22:13:09.056] Build status: STARTED
[22:13:09.056] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:77:0) after 1m7s
[22:14:16.093] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:77:0)
[22:14:16.115] Build status: STARTED
[22:14:16.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:78:0) after 4m20s
[22:18:36.218] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:78:0)
[22:18:36.234] Build status: STARTED
[22:18:36.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:79:0) after 2m19s
[22:20:55.354] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:79:0)
[22:20:55.372] Build status: STARTED
[22:20:55.372] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:80:0) after 6m34s
[22:27:30.996] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:80:0)
[22:27:31.029] Build status: STARTED
[22:27:31.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:81:0) after 6m52s
[22:34:23.009] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:81:0)
[22:34:23.070] Build status: STARTED
[22:34:23.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:82:0) after 4m51s
[22:39:14.281] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:82:0)
[22:39:14.297] Build status: STARTED
[22:39:14.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:83:0) after 9m20s
[22:48:34.734] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:83:0)
[22:48:34.753] Build status: STARTED
[22:48:34.753] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:84:0) after 6m34s
[22:55:08.978] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:84:0)
[22:55:09.005] Build status: STARTED
[22:55:09.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:85:0) after 2m37s
[22:57:46.310] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:85:0)
[22:57:46.329] Build status: STARTED
[22:57:46.329] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:86:0) after 3m53s
[23:01:39.371] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:86:0)
[23:01:39.391] Build status: STARTED
[23:01:39.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:87:0) after 7m4s
[23:08:43.512] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:87:0)
[23:08:43.532] Build status: STARTED
[23:08:43.532] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:88:0) after 6m17s
[23:15:00.941] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:88:0)
[23:15:00.965] Build status: STARTED
[23:15:00.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:89:0) after 1m48s
[23:16:49.148] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:89:0)
[23:16:49.165] Build status: STARTED
[23:16:49.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:90:0) after 6m58s
[23:23:47.184] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:90:0)
[23:23:47.210] Build status: STARTED
[23:23:47.210] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:91:0) after 8m28s
[23:32:15.842] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:91:0)
[23:32:15.905] Build status: STARTED
[23:32:15.905] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:92:0) after 4m3s
[23:36:19.104] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:92:0)
[23:36:19.151] Build status: STARTED
[23:36:19.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:93:0) after 2m18s
[23:38:37.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:93:0)
[23:38:37.568] Build status: STARTED
[23:38:37.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:94:0) after 5m40s
[23:44:17.721] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:94:0)
[23:44:17.739] Build status: STARTED
[23:44:17.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:95:0) after 5m7s
[23:49:24.824] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:95:0)
[23:49:24.843] Build status: STARTED
[23:49:24.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:96:0) after 8m34s
[23:57:58.939] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:96:0)
[23:57:59.121] Build status: STARTED
[23:57:59.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:97:0) after 2m2s
[00:00:01.276] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:97:0)
[00:00:01.325] Build status: STARTED
[00:00:01.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:98:0) after 9m44s
[00:09:45.543] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:98:0)
[00:09:45.579] Build status: STARTED
[00:09:45.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:99:0) after 3m38s
[00:13:23.603] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:99:0)
[00:13:23.670] Build status: STARTED
[00:13:23.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:100:0) after 2m36s
[00:15:59.667] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:100:0)
[00:15:59.689] Build status: STARTED
[00:15:59.689] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:101:0) after 5m19s
[00:21:19.008] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:101:0)
[00:21:19.028] Build status: STARTED
[00:21:19.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:102:0) after 3m42s
[00:25:01.090] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:102:0)
[00:25:01.117] Build status: STARTED
[00:25:01.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:103:0) after 2m51s
[00:27:52.181] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:103:0)
[00:27:52.283] Build status: STARTED
[00:27:52.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:104:0) after 4m9s
[00:32:01.313] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:104:0)
[00:32:01.338] Build status: STARTED
[00:32:01.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:105:0) after 6m29s
[00:38:30.381] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:105:0)
[00:38:30.401] Build status: STARTED
[00:38:30.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:106:0) after 8m14s
[00:46:44.413] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:106:0)
[00:46:44.431] Build status: STARTED
[00:46:44.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:107:0) after 6m24s
[00:53:08.526] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:107:0)
[00:53:08.565] Build status: STARTED
[00:53:08.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:108:0) after 6m8s
[00:59:16.681] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:108:0)
[00:59:16.698] Build status: STARTED
[00:59:16.698] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:109:0) after 7m48s
[01:07:04.856] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:109:0)
[01:07:04.887] Build status: STARTED
[01:07:04.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:110:0) after 8m22s
[01:15:26.976] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:110:0)
[01:15:26.996] Build status: STARTED
[01:15:26.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:111:0) after 5m51s
[01:21:18.310] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:111:0)
[01:21:18.330] Build status: STARTED
[01:21:18.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:112:0) after 3m28s
[01:24:46.385] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:112:0)
[01:24:46.407] Build status: STARTED
[01:24:46.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:113:0) after 6m51s
[01:31:37.503] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:113:0)
[01:31:37.523] Build status: STARTED
[01:31:37.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:114:0) after 9m8s
[01:40:45.550] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:114:0)
[01:40:45.599] Build status: STARTED
[01:40:45.599] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:115:0) after 9m5s
[01:49:50.726] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:115:0)
[01:49:50.751] Build status: STARTED
[01:49:50.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:116:0) after 6m29s
[01:56:19.784] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:116:0)
[01:56:19.894] Build status: STARTED
[01:56:19.894] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:117:0) after 8m12s
[02:04:31.935] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:117:0)
[02:04:31.957] Build status: STARTED
[02:04:31.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:118:0) after 6m17s
[02:10:49.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:118:0)
[02:10:49.198] Build status: STARTED
[02:10:49.198] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:119:0) after 8m18s
[02:19:07.470] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:119:0)
[02:19:07.492] Build status: STARTED
[02:19:07.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:120:0) after 5m9s
[02:24:16.581] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:120:0)
[02:24:16.613] Build status: STARTED
[02:24:16.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:121:0) after 5m19s
[02:29:35.804] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:121:0)
[02:29:35.832] Build status: STARTED
[02:29:35.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:122:0) after 3m51s
[02:33:27.102] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:122:0)
[02:33:27.136] Build status: STARTED
[02:33:27.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:123:0) after 2m0s
[02:35:27.461] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:123:0)
[02:35:27.493] Build status: STARTED
[02:35:27.493] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:124:0) after 2m51s
[02:38:18.792] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:124:0)
[02:38:18.818] Build status: STARTED
[02:38:18.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:125:0) after 2m48s
[02:41:06.831] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:125:0)
[02:41:06.850] Build status: STARTED
[02:41:06.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:126:0) after 1m1s
[02:42:08.117] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:126:0)
[02:42:08.142] Build status: STARTED
[02:42:08.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:127:0) after 4m6s
[02:46:14.304] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:127:0)
[02:46:14.331] Build status: STARTED
[02:46:14.331] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:128:0) after 2m17s
[02:48:31.361] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:128:0)
[02:48:31.419] Build status: STARTED
[02:48:31.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:129:0) after 3m5s
[02:51:36.448] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:129:0)
[02:51:36.487] Build status: STARTED
[02:51:36.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:130:0) after 4m27s
[02:56:03.538] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:130:0)
[02:56:03.572] Build status: STARTED
[02:56:03.572] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:131:0) after 3m5s
[02:59:08.610] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:131:0)
[02:59:08.635] Build status: STARTED
[02:59:08.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:132:0) after 6m11s
[03:05:19.665] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:132:0)
[03:05:19.682] Build status: STARTED
[03:05:19.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:133:0) after 1m54s
[03:07:13.712] Handling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:133:0)
[03:07:13.738] Build status: STARTED
[03:07:13.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWin64PGO:8945724924507438320:134:0) after 9m34s
[03:13:27.882] Received PubSub notification, asking Buildbucket for the build status
[03:13:27.903] Build:
{
"id": "8780294862563507089",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWin64PGO"
},
"number": 5415,
"createdBy": "project:chromium",
"createTime": "2023-05-23T15:22:01.307649480Z",
"startTime": "2023-05-23T15:22:43.666768Z",
"endTime": "2023-05-24T03:13:17.641167252Z",
"updateTime": "2023-05-24T03:13:17.641167252Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c9d93c47280146995c0926b56a009e038b0b9b45",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:13:27.903] Invocation finished in 11h51m27.833064506s with status FAILED