[00:22:02.248] New invocation is queued and will start shortly
[00:22:03.360] Starting the invocation (attempt 1)
[00:22:03.392] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/697fbe63f2a152c710b7854e5b81cea3970eb042"
[00:22:03.392] Popped gitiles commit info from properties and tags
[00:22:03.392] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:22:03.392] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:22:03.392] Buildbucket request:
{
"requestId": "8923222900699793920",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "697fbe63f2a152c710b7854e5b81cea3970eb042",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923222900699793920"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:22:04.126] Scheduled build:
{
"id": "8757792838724785361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1566,
"createdBy": "project:chromium",
"createTime": "2024-01-27T00:22:03.509782511Z",
"updateTime": "2024-01-27T00:22:03.509782511Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "697fbe63f2a152c710b7854e5b81cea3970eb042",
"ref": "refs/heads/main"
}
}
}
[00:22:04.126] Task URL: https://cr-buildbucket.appspot.com/build/8757792838724785361
[00:22:04.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:2:0) after 5m20s
[00:22:05.048] Received PubSub notification, asking Buildbucket for the build status
[00:22:05.071] Build status: SCHEDULED
[00:23:56.039] Received PubSub notification, asking Buildbucket for the build status
[00:23:56.057] Build status: STARTED
[00:27:24.143] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:2:0)
[00:27:24.165] Build status: STARTED
[00:27:24.165] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:5:0) after 4m40s
[00:32:04.305] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:5:0)
[00:32:04.330] Build status: STARTED
[00:32:04.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:6:0) after 4m24s
[00:36:28.360] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:6:0)
[00:36:28.387] Build status: STARTED
[00:36:28.387] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:7:0) after 1m33s
[00:38:01.410] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:7:0)
[00:38:01.442] Build status: STARTED
[00:38:01.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:8:0) after 7m49s
[00:45:50.461] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:8:0)
[00:45:50.484] Build status: STARTED
[00:45:50.484] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:9:0) after 7m17s
[00:53:08.160] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:9:0)
[00:53:08.178] Build status: STARTED
[00:53:08.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:10:0) after 1m45s
[00:54:53.278] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:10:0)
[00:54:53.301] Build status: STARTED
[00:54:53.301] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:11:0) after 6m59s
[01:01:52.326] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:11:0)
[01:01:52.344] Build status: STARTED
[01:01:52.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:12:0) after 7m2s
[01:08:55.044] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:12:0)
[01:08:55.070] Build status: STARTED
[01:08:55.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:13:0) after 1m26s
[01:10:21.166] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:13:0)
[01:10:21.195] Build status: STARTED
[01:10:21.195] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:14:0) after 7m29s
[01:17:50.678] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:14:0)
[01:17:50.702] Build status: STARTED
[01:17:50.702] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:15:0) after 8m20s
[01:26:10.866] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:15:0)
[01:26:10.906] Build status: STARTED
[01:26:10.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:16:0) after 8m24s
[01:34:35.163] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:16:0)
[01:34:35.181] Build status: STARTED
[01:34:35.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:17:0) after 4m12s
[01:38:47.537] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:17:0)
[01:38:47.668] Build status: STARTED
[01:38:47.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:18:0) after 6m59s
[01:45:46.728] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:18:0)
[01:45:46.973] Build status: STARTED
[01:45:46.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:19:0) after 9m26s
[01:55:13.239] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:19:0)
[01:55:13.260] Build status: STARTED
[01:55:13.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:20:0) after 7m27s
[02:02:40.507] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:20:0)
[02:02:40.587] Build status: STARTED
[02:02:40.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:21:0) after 3m56s
[02:06:36.709] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:21:0)
[02:06:36.729] Build status: STARTED
[02:06:36.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:22:0) after 9m14s
[02:15:50.873] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:22:0)
[02:15:50.994] Build status: STARTED
[02:15:50.994] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:23:0) after 2m46s
[02:18:37.262] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:23:0)
[02:18:37.303] Build status: STARTED
[02:18:37.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:24:0) after 2m54s
[02:21:31.421] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:24:0)
[02:21:31.440] Build status: STARTED
[02:21:31.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:25:0) after 5m37s
[02:27:09.016] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:25:0)
[02:27:09.034] Build status: STARTED
[02:27:09.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:26:0) after 1m20s
[02:28:29.165] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:26:0)
[02:28:29.222] Build status: STARTED
[02:28:29.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:27:0) after 3m7s
[02:31:36.225] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:27:0)
[02:31:36.246] Build status: STARTED
[02:31:36.246] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:28:0) after 5m47s
[02:37:23.314] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:28:0)
[02:37:23.335] Build status: STARTED
[02:37:23.335] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:29:0) after 9m24s
[02:46:47.502] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:29:0)
[02:46:47.523] Build status: STARTED
[02:46:47.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:30:0) after 7m25s
[02:54:12.552] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:30:0)
[02:54:12.569] Build status: STARTED
[02:54:12.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:31:0) after 4m49s
[02:59:01.775] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:31:0)
[02:59:01.794] Build status: STARTED
[02:59:01.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:32:0) after 9m12s
[03:08:13.817] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:32:0)
[03:08:13.836] Build status: STARTED
[03:08:13.836] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:33:0) after 6m25s
[03:14:38.862] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:33:0)
[03:14:38.901] Build status: STARTED
[03:14:38.901] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:34:0) after 1m31s
[03:16:10.171] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:34:0)
[03:16:10.190] Build status: STARTED
[03:16:10.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:35:0) after 6m23s
[03:22:33.267] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:35:0)
[03:22:33.284] Build status: STARTED
[03:22:33.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:36:0) after 3m32s
[03:26:05.344] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:36:0)
[03:26:05.379] Build status: STARTED
[03:26:05.379] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:37:0) after 5m19s
[03:31:24.400] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:37:0)
[03:31:24.432] Build status: STARTED
[03:31:24.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:38:0) after 2m21s
[03:33:45.654] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:38:0)
[03:33:45.675] Build status: STARTED
[03:33:45.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:39:0) after 9m40s
[03:43:25.701] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:39:0)
[03:43:25.723] Build status: STARTED
[03:43:25.723] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:40:0) after 7m1s
[03:50:26.747] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:40:0)
[03:50:26.822] Build status: STARTED
[03:50:26.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:41:0) after 2m33s
[03:52:59.851] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:41:0)
[03:52:59.871] Build status: STARTED
[03:52:59.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:42:0) after 3m0s
[03:55:59.969] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:42:0)
[03:55:59.991] Build status: STARTED
[03:55:59.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:43:0) after 6m25s
[04:02:25.108] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:43:0)
[04:02:25.144] Build status: STARTED
[04:02:25.144] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:44:0) after 2m23s
[04:04:48.290] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:44:0)
[04:04:48.313] Build status: STARTED
[04:04:48.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:45:0) after 8m16s
[04:13:04.435] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:45:0)
[04:13:04.461] Build status: STARTED
[04:13:04.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:46:0) after 6m49s
[04:19:53.937] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:46:0)
[04:19:54.047] Build status: STARTED
[04:19:54.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:47:0) after 3m50s
[04:23:44.468] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:47:0)
[04:23:44.622] Build status: STARTED
[04:23:44.622] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:48:0) after 6m3s
[04:29:47.653] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:48:0)
[04:29:47.677] Build status: STARTED
[04:29:47.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:49:0) after 5m49s
[04:35:36.740] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:49:0)
[04:35:36.761] Build status: STARTED
[04:35:36.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:50:0) after 5m39s
[04:41:15.954] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:50:0)
[04:41:15.972] Build status: STARTED
[04:41:15.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:51:0) after 6m44s
[04:48:00.019] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:51:0)
[04:48:00.036] Build status: STARTED
[04:48:00.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:52:0) after 6m35s
[04:54:35.202] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:52:0)
[04:54:35.222] Build status: STARTED
[04:54:35.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:53:0) after 5m12s
[04:59:47.304] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:53:0)
[04:59:47.768] Build status: STARTED
[04:59:47.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:54:0) after 6m28s
[05:06:15.843] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:54:0)
[05:06:15.872] Build status: STARTED
[05:06:15.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:55:0) after 6m58s
[05:13:14.059] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:55:0)
[05:13:14.082] Build status: STARTED
[05:13:14.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:56:0) after 4m43s
[05:17:57.213] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:56:0)
[05:17:57.242] Build status: STARTED
[05:17:57.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:57:0) after 3m10s
[05:21:07.300] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:57:0)
[05:21:07.319] Build status: STARTED
[05:21:07.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:58:0) after 6m13s
[05:27:20.385] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:58:0)
[05:27:20.407] Build status: STARTED
[05:27:20.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:59:0) after 4m56s
[05:32:16.528] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:59:0)
[05:32:16.568] Build status: STARTED
[05:32:16.568] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:60:0) after 3m22s
[05:35:38.781] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:60:0)
[05:35:38.800] Build status: STARTED
[05:35:38.800] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:61:0) after 1m48s
[05:37:26.913] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:61:0)
[05:37:26.931] Build status: STARTED
[05:37:26.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:62:0) after 3m34s
[05:41:01.061] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:62:0)
[05:41:01.082] Build status: STARTED
[05:41:01.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:63:0) after 1m17s
[05:42:18.110] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:63:0)
[05:42:18.142] Build status: STARTED
[05:42:18.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:64:0) after 8m58s
[05:51:16.259] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:64:0)
[05:51:16.280] Build status: STARTED
[05:51:16.280] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:65:0) after 4m47s
[05:56:03.311] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:65:0)
[05:56:03.332] Build status: STARTED
[05:56:03.332] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923222900699793920:66:0) after 7m24s
[05:56:55.853] Received PubSub notification, asking Buildbucket for the build status
[05:56:55.972] Build:
{
"id": "8757792838724785361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1566,
"createdBy": "project:chromium",
"createTime": "2024-01-27T00:22:03.509782511Z",
"startTime": "2024-01-27T00:23:54.270481Z",
"endTime": "2024-01-27T05:56:55.349237Z",
"updateTime": "2024-01-27T05:56:55.349237Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "697fbe63f2a152c710b7854e5b81cea3970eb042",
"ref": "refs/heads/main"
}
}
}
[05:56:55.972] Invocation finished in 5h34m53.729646464s with status FAILED