[02:29:45.407] New invocation is queued and will start shortly
[02:29:46.550] Starting the invocation (attempt 1)
[02:29:46.574] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0ccc8b873c5a689fef3943f8b6408d9d8ee9fe2b"
[02:29:46.574] Popped gitiles commit info from properties and tags
[02:29:46.574] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:29:46.574] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:29:46.574] Buildbucket request:
{
"requestId": "8923577253159743872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ccc8b873c5a689fef3943f8b6408d9d8ee9fe2b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8923577253159743872"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTWinArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:29:47.077] Scheduled build:
{
"id": "8758147191222697985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1518,
"createdBy": "project:chromium",
"createTime": "2024-01-23T02:29:46.633464860Z",
"updateTime": "2024-01-23T02:29:46.633464860Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ccc8b873c5a689fef3943f8b6408d9d8ee9fe2b",
"ref": "refs/heads/main"
}
}
}
[02:29:47.077] Task URL: https://cr-buildbucket.appspot.com/build/8758147191222697985
[02:29:47.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:2:0) after 8m47s
[02:29:48.123] Received PubSub notification, asking Buildbucket for the build status
[02:29:48.146] Build status: SCHEDULED
[02:31:29.311] Received PubSub notification, asking Buildbucket for the build status
[02:31:29.336] Build status: STARTED
[02:38:34.432] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:2:0)
[02:38:34.589] Build status: STARTED
[02:38:34.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:5:0) after 3m40s
[02:42:14.605] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:5:0)
[02:42:14.621] Build status: STARTED
[02:42:14.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:6:0) after 1m3s
[02:43:18.007] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:6:0)
[02:43:18.034] Build status: STARTED
[02:43:18.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:7:0) after 3m54s
[02:47:12.057] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:7:0)
[02:47:12.075] Build status: STARTED
[02:47:12.075] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:8:0) after 8m57s
[02:56:09.095] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:8:0)
[02:56:09.125] Build status: STARTED
[02:56:09.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:9:0) after 4m2s
[03:00:11.902] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:9:0)
[03:00:12.044] Build status: STARTED
[03:00:12.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:10:0) after 5m44s
[03:05:56.061] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:10:0)
[03:05:56.085] Build status: STARTED
[03:05:56.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:11:0) after 8m17s
[03:14:13.109] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:11:0)
[03:14:13.152] Build status: STARTED
[03:14:13.152] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:12:0) after 1m32s
[03:15:45.165] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:12:0)
[03:15:45.184] Build status: STARTED
[03:15:45.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:13:0) after 6m7s
[03:21:52.199] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:13:0)
[03:21:52.220] Build status: STARTED
[03:21:52.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:14:0) after 1m22s
[03:23:14.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:14:0)
[03:23:14.490] Build status: STARTED
[03:23:14.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:15:0) after 8m20s
[03:31:34.513] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:15:0)
[03:31:34.566] Build status: STARTED
[03:31:34.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:16:0) after 1m49s
[03:33:23.580] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:16:0)
[03:33:23.601] Build status: STARTED
[03:33:23.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:17:0) after 7m40s
[03:41:03.658] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:17:0)
[03:41:03.675] Build status: STARTED
[03:41:03.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:18:0) after 7m11s
[03:48:14.690] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:18:0)
[03:48:14.720] Build status: STARTED
[03:48:14.720] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:19:0) after 7m26s
[03:55:40.999] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:19:0)
[03:55:41.100] Build status: STARTED
[03:55:41.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:20:0) after 8m59s
[04:04:40.096] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:20:0)
[04:04:40.113] Build status: STARTED
[04:04:40.113] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:21:0) after 8m44s
[04:13:24.331] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:21:0)
[04:13:24.349] Build status: STARTED
[04:13:24.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:22:0) after 3m42s
[04:17:06.530] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:22:0)
[04:17:06.555] Build status: STARTED
[04:17:06.555] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:23:0) after 7m28s
[04:24:34.586] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:23:0)
[04:24:34.605] Build status: STARTED
[04:24:34.605] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:24:0) after 5m41s
[04:30:15.889] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:24:0)
[04:30:15.964] Build status: STARTED
[04:30:15.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:25:0) after 7m36s
[04:37:52.182] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:25:0)
[04:37:52.199] Build status: STARTED
[04:37:52.199] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:26:0) after 5m5s
[04:42:57.188] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:26:0)
[04:42:57.201] Build status: STARTED
[04:42:57.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:27:0) after 2m2s
[04:44:59.926] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:27:0)
[04:44:59.944] Build status: STARTED
[04:44:59.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:28:0) after 4m23s
[04:49:22.949] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:28:0)
[04:49:22.966] Build status: STARTED
[04:49:22.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:29:0) after 6m11s
[04:55:34.146] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:29:0)
[04:55:34.263] Build status: STARTED
[04:55:34.263] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:30:0) after 4m29s
[05:00:03.282] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:30:0)
[05:00:03.319] Build status: STARTED
[05:00:03.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:31:0) after 3m21s
[05:03:24.704] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:31:0)
[05:03:24.727] Build status: STARTED
[05:03:24.727] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:32:0) after 2m39s
[05:06:03.861] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:32:0)
[05:06:03.878] Build status: STARTED
[05:06:03.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:33:0) after 9m41s
[05:15:44.905] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:33:0)
[05:15:44.919] Build status: STARTED
[05:15:44.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:34:0) after 1m28s
[05:17:13.302] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:34:0)
[05:17:13.319] Build status: STARTED
[05:17:13.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:35:0) after 5m12s
[05:22:25.340] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:35:0)
[05:22:25.361] Build status: STARTED
[05:22:25.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:36:0) after 6m32s
[05:28:57.574] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:36:0)
[05:28:57.590] Build status: STARTED
[05:28:57.590] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:37:0) after 7m44s
[05:36:41.718] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:37:0)
[05:36:41.732] Build status: STARTED
[05:36:41.732] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:38:0) after 3m28s
[05:40:09.823] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:38:0)
[05:40:09.899] Build status: STARTED
[05:40:09.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:39:0) after 5m11s
[05:45:21.440] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:39:0)
[05:45:21.467] Build status: STARTED
[05:45:21.467] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:40:0) after 9m31s
[05:54:52.563] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:40:0)
[05:54:52.580] Build status: STARTED
[05:54:52.580] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:41:0) after 4m35s
[05:59:27.828] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:41:0)
[05:59:27.871] Build status: STARTED
[05:59:27.871] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:42:0) after 1m52s
[06:01:19.951] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:42:0)
[06:01:19.969] Build status: STARTED
[06:01:19.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:43:0) after 6m14s
[06:07:34.221] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:43:0)
[06:07:34.239] Build status: STARTED
[06:07:34.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:44:0) after 3m24s
[06:10:58.233] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:44:0)
[06:10:58.256] Build status: STARTED
[06:10:58.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:45:0) after 3m6s
[06:14:04.298] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:45:0)
[06:14:04.317] Build status: STARTED
[06:14:04.319] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:46:0) after 3m17s
[06:17:21.426] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:46:0)
[06:17:21.444] Build status: STARTED
[06:17:21.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:47:0) after 1m35s
[06:18:56.460] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:47:0)
[06:18:56.476] Build status: STARTED
[06:18:56.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:48:0) after 2m57s
[06:21:53.572] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:48:0)
[06:21:53.588] Build status: STARTED
[06:21:53.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:49:0) after 1m10s
[06:23:03.986] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:49:0)
[06:23:04.007] Build status: STARTED
[06:23:04.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:50:0) after 6m15s
[06:29:19.357] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:50:0)
[06:29:19.407] Build status: STARTED
[06:29:19.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:51:0) after 1m3s
[06:30:22.584] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:51:0)
[06:30:22.646] Build status: STARTED
[06:30:22.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:52:0) after 1m9s
[06:31:31.757] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:52:0)
[06:31:31.832] Build status: STARTED
[06:31:31.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:53:0) after 5m59s
[06:37:30.828] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:53:0)
[06:37:30.909] Build status: STARTED
[06:37:30.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:54:0) after 8m30s
[06:46:01.179] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:54:0)
[06:46:01.201] Build status: STARTED
[06:46:01.201] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:55:0) after 7m28s
[06:53:29.301] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:55:0)
[06:53:29.382] Build status: STARTED
[06:53:29.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:56:0) after 2m0s
[06:55:29.418] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:56:0)
[06:55:29.436] Build status: STARTED
[06:55:29.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:57:0) after 2m45s
[06:58:14.586] Handling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:57:0)
[06:58:14.662] Build status: STARTED
[06:58:14.662] Scheduling timer "check-buildbucket-build-status" (chromium/ToTWinArm64PGO:8923577253159743872:58:0) after 5m2s
[07:01:12.899] Received PubSub notification, asking Buildbucket for the build status
[07:01:12.920] Build:
{
"id": "8758147191222697985",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTWinArm64PGO"
},
"number": 1518,
"createdBy": "project:chromium",
"createTime": "2024-01-23T02:29:46.633464860Z",
"startTime": "2024-01-23T02:31:28.791340Z",
"endTime": "2024-01-23T07:01:12.073622Z",
"updateTime": "2024-01-23T07:01:12.073622Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0ccc8b873c5a689fef3943f8b6408d9d8ee9fe2b",
"ref": "refs/heads/main"
}
}
}
[07:01:12.920] Invocation finished in 4h31m27.518310001s with status FAILED