[05:59:49.195] New invocation is queued and will start shortly
[05:59:50.296] Starting the invocation (attempt 1)
[05:59:50.329] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/da49bc25600aeaefaafc71e5e8be04638111ddb5"
[05:59:50.329] Popped gitiles commit info from properties and tags
[05:59:50.329] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:59:50.329] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:59:50.329] Buildbucket request:
{
"requestId": "8908796731614846240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "da49bc25600aeaefaafc71e5e8be04638111ddb5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8908796731614846240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:59:51.221] Scheduled build:
{
"id": "8743366669699251777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 3249,
"createdBy": "project:chromium",
"createTime": "2024-07-04T05:59:50.393655022Z",
"updateTime": "2024-07-04T05:59:50.393655022Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "da49bc25600aeaefaafc71e5e8be04638111ddb5",
"ref": "refs/heads/main"
}
}
}
[05:59:51.221] Task URL: https://cr-buildbucket.appspot.com/build/8743366669699251777
[05:59:51.221] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:2:0) after 8m30s
[05:59:54.754] Received PubSub notification, asking Buildbucket for the build status
[05:59:54.784] Build status: SCHEDULED
[06:08:21.240] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:2:0)
[06:08:21.260] Build status: SCHEDULED
[06:08:21.260] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:4:0) after 6m7s
[06:14:28.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:4:0)
[06:14:28.440] Build status: SCHEDULED
[06:14:28.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:5:0) after 2m58s
[06:17:14.600] Received PubSub notification, asking Buildbucket for the build status
[06:17:14.616] Build status: STARTED
[06:17:26.462] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:5:0)
[06:17:26.479] Build status: STARTED
[06:17:26.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:7:0) after 1m11s
[06:18:37.503] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:7:0)
[06:18:37.528] Build status: STARTED
[06:18:37.528] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:8:0) after 7m56s
[06:26:33.552] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:8:0)
[06:26:33.570] Build status: STARTED
[06:26:33.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:9:0) after 8m57s
[06:35:30.664] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:9:0)
[06:35:30.682] Build status: STARTED
[06:35:30.682] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:10:0) after 9m22s
[06:44:52.713] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:10:0)
[06:44:52.731] Build status: STARTED
[06:44:52.731] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:11:0) after 7m8s
[06:52:00.891] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:11:0)
[06:52:00.910] Build status: STARTED
[06:52:00.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:12:0) after 3m30s
[06:55:30.967] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:12:0)
[06:55:30.989] Build status: STARTED
[06:55:30.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:13:0) after 5m27s
[07:00:58.243] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:13:0)
[07:00:58.298] Build status: STARTED
[07:00:58.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:14:0) after 6m16s
[07:07:14.319] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:14:0)
[07:07:14.343] Build status: STARTED
[07:07:14.343] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:15:0) after 3m6s
[07:10:20.491] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:15:0)
[07:10:20.510] Build status: STARTED
[07:10:20.510] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:16:0) after 6m57s
[07:17:17.526] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:16:0)
[07:17:17.546] Build status: STARTED
[07:17:17.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:17:0) after 6m26s
[07:23:43.681] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:17:0)
[07:23:43.705] Build status: STARTED
[07:23:43.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:18:0) after 7m54s
[07:31:37.844] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:18:0)
[07:31:37.881] Build status: STARTED
[07:31:37.881] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:19:0) after 9m51s
[07:41:29.174] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:19:0)
[07:41:29.191] Build status: STARTED
[07:41:29.191] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:20:0) after 8m30s
[07:50:00.027] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:20:0)
[07:50:00.055] Build status: STARTED
[07:50:00.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:21:0) after 5m32s
[07:55:32.073] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:21:0)
[07:55:32.100] Build status: STARTED
[07:55:32.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:22:0) after 8m15s
[08:03:47.265] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:22:0)
[08:03:47.312] Build status: STARTED
[08:03:47.312] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:23:0) after 5m10s
[08:08:57.337] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:23:0)
[08:08:57.368] Build status: STARTED
[08:08:57.368] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:24:0) after 1m42s
[08:10:39.553] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:24:0)
[08:10:39.570] Build status: STARTED
[08:10:39.571] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:25:0) after 9m23s
[08:20:02.595] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:25:0)
[08:20:02.615] Build status: STARTED
[08:20:02.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:26:0) after 5m2s
[08:25:04.615] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:26:0)
[08:25:04.640] Build status: STARTED
[08:25:04.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:27:0) after 1m4s
[08:26:08.846] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:27:0)
[08:26:08.909] Build status: STARTED
[08:26:08.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:28:0) after 6m51s
[08:32:59.938] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:28:0)
[08:32:59.959] Build status: STARTED
[08:32:59.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:29:0) after 4m12s
[08:37:11.982] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:29:0)
[08:37:11.999] Build status: STARTED
[08:37:11.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:30:0) after 1m26s
[08:38:38.124] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:30:0)
[08:38:38.143] Build status: STARTED
[08:38:38.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:31:0) after 1m54s
[08:40:32.252] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:31:0)
[08:40:32.268] Build status: STARTED
[08:40:32.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:32:0) after 3m58s
[08:44:30.296] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:32:0)
[08:44:30.360] Build status: STARTED
[08:44:30.360] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:33:0) after 1m19s
[08:45:49.383] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:33:0)
[08:45:49.401] Build status: STARTED
[08:45:49.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:34:0) after 9m27s
[08:55:16.421] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:34:0)
[08:55:16.480] Build status: STARTED
[08:55:16.480] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:35:0) after 1m8s
[08:56:24.486] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:35:0)
[08:56:24.512] Build status: STARTED
[08:56:24.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:36:0) after 6m17s
[09:02:41.539] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:36:0)
[09:02:41.556] Build status: STARTED
[09:02:41.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:37:0) after 7m58s
[09:10:39.571] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:37:0)
[09:10:39.592] Build status: STARTED
[09:10:39.592] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:38:0) after 3m38s
[09:14:17.705] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:38:0)
[09:14:17.765] Build status: STARTED
[09:14:17.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:39:0) after 1m11s
[09:15:28.785] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:39:0)
[09:15:28.828] Build status: STARTED
[09:15:28.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:40:0) after 1m45s
[09:17:13.945] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:40:0)
[09:17:13.962] Build status: STARTED
[09:17:13.962] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:41:0) after 1m25s
[09:18:38.985] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:41:0)
[09:18:39.005] Build status: STARTED
[09:18:39.005] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:42:0) after 5m4s
[09:23:43.060] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:42:0)
[09:23:43.081] Build status: STARTED
[09:23:43.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:43:0) after 2m36s
[09:26:19.238] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:43:0)
[09:26:19.256] Build status: STARTED
[09:26:19.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:44:0) after 7m25s
[09:33:44.359] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:44:0)
[09:33:44.420] Build status: STARTED
[09:33:44.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:45:0) after 4m34s
[09:38:18.464] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:45:0)
[09:38:18.488] Build status: STARTED
[09:38:18.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:46:0) after 6m34s
[09:44:52.632] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:46:0)
[09:44:52.649] Build status: STARTED
[09:44:52.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:47:0) after 1m43s
[09:46:35.820] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:47:0)
[09:46:35.839] Build status: STARTED
[09:46:35.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:48:0) after 7m28s
[09:54:03.858] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:48:0)
[09:54:03.898] Build status: STARTED
[09:54:03.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:49:0) after 1m21s
[09:55:25.016] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:49:0)
[09:55:25.067] Build status: STARTED
[09:55:25.067] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:50:0) after 7m50s
[10:03:15.494] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:50:0)
[10:03:15.512] Build status: STARTED
[10:03:15.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:51:0) after 2m9s
[10:05:24.539] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:51:0)
[10:05:24.652] Build status: STARTED
[10:05:24.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:52:0) after 2m32s
[10:07:56.667] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:52:0)
[10:07:56.683] Build status: STARTED
[10:07:56.683] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:53:0) after 3m31s
[10:11:27.841] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:53:0)
[10:11:27.856] Build status: STARTED
[10:11:27.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:54:0) after 7m17s
[10:18:44.924] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:54:0)
[10:18:44.942] Build status: STARTED
[10:18:44.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:55:0) after 1m59s
[10:20:43.997] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:55:0)
[10:20:44.014] Build status: STARTED
[10:20:44.014] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:56:0) after 8m58s
[10:29:41.982] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:56:0)
[10:29:42.001] Build status: STARTED
[10:29:42.001] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:57:0) after 8m22s
[10:38:04.043] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:57:0)
[10:38:04.064] Build status: STARTED
[10:38:04.064] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:58:0) after 8m58s
[10:47:02.087] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:58:0)
[10:47:02.114] Build status: STARTED
[10:47:02.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:59:0) after 8m43s
[10:55:45.132] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:59:0)
[10:55:45.149] Build status: STARTED
[10:55:45.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:60:0) after 4m59s
[11:00:44.175] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:60:0)
[11:00:44.212] Build status: STARTED
[11:00:44.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:61:0) after 9m37s
[11:10:21.301] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:61:0)
[11:10:21.330] Build status: STARTED
[11:10:21.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:62:0) after 9m45s
[11:20:06.675] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:62:0)
[11:20:06.690] Build status: STARTED
[11:20:06.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8908796731614846240:63:0) after 8m36s
[11:26:44.806] Received PubSub notification, asking Buildbucket for the build status
[11:26:44.824] Build:
{
"id": "8743366669699251777",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 3249,
"createdBy": "project:chromium",
"createTime": "2024-07-04T05:59:50.393655022Z",
"startTime": "2024-07-04T06:17:14.268338389Z",
"endTime": "2024-07-04T11:26:44.544769430Z",
"updateTime": "2024-07-04T11:26:44.544769430Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "da49bc25600aeaefaafc71e5e8be04638111ddb5",
"ref": "refs/heads/main"
}
}
}
[11:26:44.824] Invocation finished in 5h26m55.642122305s with status FAILED