[20:45:50.843] New invocation is queued and will start shortly
[20:45:54.343] Starting the invocation (attempt 1)
[20:45:54.375] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fc44cfe6e963474a1ff58681fb17b42dc12074b3"
[20:45:54.375] Popped gitiles commit info from properties and tags
[20:45:54.375] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[20:45:54.375] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[20:45:54.375] Buildbucket request:
{
"requestId": "8832005357042265264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc44cfe6e963474a1ff58681fb17b42dc12074b3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8832005357042265264"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[20:45:55.322] Scheduled build:
{
"id": "8666575292428192305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 6039,
"createdBy": "project:chromium",
"createTime": "2026-10-29T20:45:54.618972845Z",
"updateTime": "2026-10-29T20:45:54.618972845Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc44cfe6e963474a1ff58681fb17b42dc12074b3",
"ref": "refs/heads/main"
}
}
}
[20:45:55.322] Task URL: https://cr-buildbucket.appspot.com/build/8666575292428192305
[20:45:55.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:2:0) after 3m8s
[20:45:56.259] Received PubSub notification, asking Buildbucket for the build status
[20:45:56.283] Build status: SCHEDULED
[20:46:36.303] Received PubSub notification, asking Buildbucket for the build status
[20:46:36.333] Build status: STARTED
[20:49:03.422] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:2:0)
[20:49:03.449] Build status: STARTED
[20:49:03.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:5:0) after 4m6s
[20:53:09.534] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:5:0)
[20:53:09.586] Build status: STARTED
[20:53:09.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:6:0) after 2m48s
[20:55:57.609] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:6:0)
[20:55:58.117] Build status: STARTED
[20:55:58.118] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:7:0) after 6m23s
[21:02:21.156] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:7:0)
[21:02:21.206] Build status: STARTED
[21:02:21.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:8:0) after 7m20s
[21:09:41.265] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:8:0)
[21:09:41.294] Build status: STARTED
[21:09:41.294] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:9:0) after 2m26s
[21:12:07.349] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:9:0)
[21:12:07.369] Build status: STARTED
[21:12:07.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:10:0) after 5m37s
[21:17:44.432] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:10:0)
[21:17:44.450] Build status: STARTED
[21:17:44.450] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:11:0) after 5m58s
[21:23:42.479] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:11:0)
[21:23:42.545] Build status: STARTED
[21:23:42.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:12:0) after 7m39s
[21:31:21.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:12:0)
[21:31:21.636] Build status: STARTED
[21:31:21.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:13:0) after 8m18s
[21:39:39.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:13:0)
[21:39:39.754] Build status: STARTED
[21:39:39.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:14:0) after 9m36s
[21:49:15.818] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:14:0)
[21:49:15.849] Build status: STARTED
[21:49:15.850] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:15:0) after 9m11s
[21:58:26.946] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:15:0)
[21:58:26.968] Build status: STARTED
[21:58:26.968] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:16:0) after 9m3s
[22:07:30.081] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:16:0)
[22:07:30.139] Build status: STARTED
[22:07:30.139] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:17:0) after 9m36s
[22:17:06.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:17:0)
[22:17:06.258] Build status: STARTED
[22:17:06.258] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:18:0) after 1m19s
[22:18:25.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:18:0)
[22:18:25.323] Build status: STARTED
[22:18:25.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:19:0) after 7m18s
[22:25:43.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:19:0)
[22:25:43.389] Build status: STARTED
[22:25:43.389] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:20:0) after 1m32s
[22:27:15.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:20:0)
[22:27:15.556] Build status: STARTED
[22:27:15.557] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:21:0) after 5m37s
[22:32:52.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:21:0)
[22:32:52.649] Build status: STARTED
[22:32:52.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:22:0) after 5m57s
[22:38:49.641] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:22:0)
[22:38:49.684] Build status: STARTED
[22:38:49.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:23:0) after 6m11s
[22:45:00.786] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:23:0)
[22:45:00.807] Build status: STARTED
[22:45:00.807] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:24:0) after 5m51s
[22:50:51.888] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:24:0)
[22:50:51.912] Build status: STARTED
[22:50:51.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:25:0) after 1m47s
[22:52:39.097] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:25:0)
[22:52:39.116] Build status: STARTED
[22:52:39.116] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:26:0) after 2m14s
[22:54:53.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:26:0)
[22:54:53.225] Build status: STARTED
[22:54:53.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:27:0) after 9m42s
[23:04:35.293] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:27:0)
[23:04:35.342] Build status: STARTED
[23:04:35.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:28:0) after 8m13s
[23:12:48.397] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:28:0)
[23:12:48.479] Build status: STARTED
[23:12:48.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:29:0) after 5m23s
[23:18:11.560] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:29:0)
[23:18:11.584] Build status: STARTED
[23:18:11.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:30:0) after 3m45s
[23:21:56.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:30:0)
[23:21:57.003] Build status: STARTED
[23:21:57.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:31:0) after 4m14s
[23:26:11.093] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:31:0)
[23:26:11.122] Build status: STARTED
[23:26:11.122] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:32:0) after 2m29s
[23:28:40.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:32:0)
[23:28:40.354] Build status: STARTED
[23:28:40.354] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:33:0) after 7m47s
[23:36:27.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:33:0)
[23:36:27.497] Build status: STARTED
[23:36:27.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:34:0) after 7m44s
[23:44:11.572] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:34:0)
[23:44:11.588] Build status: STARTED
[23:44:11.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:35:0) after 1m38s
[23:45:49.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:35:0)
[23:45:49.617] Build status: STARTED
[23:45:49.617] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:36:0) after 1m11s
[23:47:00.679] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:36:0)
[23:47:00.746] Build status: STARTED
[23:47:00.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:37:0) after 7m31s
[23:54:31.793] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:37:0)
[23:54:31.809] Build status: STARTED
[23:54:31.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:38:0) after 5m44s
[00:00:15.881] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:38:0)
[00:00:15.909] Build status: STARTED
[00:00:15.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8832005357042265264:39:0) after 5m23s
[00:01:00.338] Received PubSub notification, asking Buildbucket for the build status
[00:01:00.355] Build:
{
"id": "8666575292428192305",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 6039,
"createdBy": "project:chromium",
"createTime": "2026-10-29T20:45:54.618972845Z",
"startTime": "2026-10-29T20:46:35.973791847Z",
"endTime": "2026-10-30T00:00:36.570991454Z",
"updateTime": "2026-10-30T00:00:36.570991454Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc44cfe6e963474a1ff58681fb17b42dc12074b3",
"ref": "refs/heads/main"
}
}
}
[00:01:00.355] Invocation finished in 3h15m9.520461839s with status FAILED