[09:33:58.109] New invocation is queued and will start shortly
[09:33:59.868] Starting the invocation (attempt 1)
[09:33:59.896] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c15b2cf75cb96a25fa4187351d040fad624a8d23"
[09:33:59.896] Popped gitiles commit info from properties and tags
[09:33:59.896] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:33:59.896] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:33:59.896] Buildbucket request:
{
"requestId": "8842103891276044992",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c15b2cf75cb96a25fa4187351d040fad624a8d23",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8842103891276044992"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:34:00.498] Scheduled build:
{
"id": "8676673828648203313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3784,
"createdBy": "project:chromium",
"createTime": "2026-07-10T09:33:59.991038397Z",
"updateTime": "2026-07-10T09:33:59.991038397Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c15b2cf75cb96a25fa4187351d040fad624a8d23",
"ref": "refs/heads/main"
}
}
}
[09:34:00.498] Task URL: https://cr-buildbucket.appspot.com/build/8676673828648203313
[09:34:00.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:2:0) after 7m34s
[09:34:53.332] Received PubSub notification, asking Buildbucket for the build status
[09:34:53.354] Build status: STARTED
[09:34:57.354] Received PubSub notification, asking Buildbucket for the build status
[09:34:57.377] Build status: STARTED
[09:41:34.511] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:2:0)
[09:41:34.533] Build status: STARTED
[09:41:34.533] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:5:0) after 8m0s
[09:49:34.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:5:0)
[09:49:34.582] Build status: STARTED
[09:49:34.582] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:6:0) after 3m30s
[09:53:04.657] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:6:0)
[09:53:04.674] Build status: STARTED
[09:53:04.675] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:7:0) after 6m42s
[09:59:46.688] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:7:0)
[09:59:46.706] Build status: STARTED
[09:59:46.706] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:8:0) after 6m20s
[10:06:06.762] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:8:0)
[10:06:06.839] Build status: STARTED
[10:06:06.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:9:0) after 4m51s
[10:10:57.899] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:9:0)
[10:10:57.917] Build status: STARTED
[10:10:57.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:10:0) after 7m19s
[10:18:16.974] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:10:0)
[10:18:16.993] Build status: STARTED
[10:18:16.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:11:0) after 4m47s
[10:23:04.009] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:11:0)
[10:23:04.048] Build status: STARTED
[10:23:04.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:12:0) after 2m57s
[10:26:01.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:12:0)
[10:26:01.142] Build status: STARTED
[10:26:01.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:13:0) after 3m58s
[10:29:59.152] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:13:0)
[10:29:59.224] Build status: STARTED
[10:29:59.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:14:0) after 9m49s
[10:39:48.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:14:0)
[10:39:48.369] Build status: STARTED
[10:39:48.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:15:0) after 4m59s
[10:44:47.470] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:15:0)
[10:44:47.500] Build status: STARTED
[10:44:47.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:16:0) after 6m19s
[10:51:06.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:16:0)
[10:51:06.637] Build status: STARTED
[10:51:06.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:17:0) after 8m7s
[10:59:13.655] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:17:0)
[10:59:13.677] Build status: STARTED
[10:59:13.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:18:0) after 2m13s
[11:01:27.064] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:18:0)
[11:01:27.081] Build status: STARTED
[11:01:27.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:19:0) after 8m30s
[11:09:57.113] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:19:0)
[11:09:57.134] Build status: STARTED
[11:09:57.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:20:0) after 5m12s
[11:15:09.154] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:20:0)
[11:15:09.222] Build status: STARTED
[11:15:09.223] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:21:0) after 6m2s
[11:21:11.266] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:21:0)
[11:21:11.300] Build status: STARTED
[11:21:11.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:22:0) after 9m2s
[11:30:13.319] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:22:0)
[11:30:13.351] Build status: STARTED
[11:30:13.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:23:0) after 5m54s
[11:36:07.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:23:0)
[11:36:07.383] Build status: STARTED
[11:36:07.383] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:24:0) after 1m28s
[11:37:35.399] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:24:0)
[11:37:35.418] Build status: STARTED
[11:37:35.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:25:0) after 1m15s
[11:38:50.438] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:25:0)
[11:38:50.455] Build status: STARTED
[11:38:50.455] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:26:0) after 6m49s
[11:45:39.460] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:26:0)
[11:45:39.588] Build status: STARTED
[11:45:39.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:27:0) after 3m18s
[11:48:57.607] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:27:0)
[11:48:57.638] Build status: STARTED
[11:48:57.638] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:28:0) after 4m47s
[11:53:44.653] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:28:0)
[11:53:44.670] Build status: STARTED
[11:53:44.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8842103891276044992:29:0) after 1m46s
[11:54:54.411] Received PubSub notification, asking Buildbucket for the build status
[11:54:54.476] Build:
{
"id": "8676673828648203313",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 3784,
"createdBy": "project:chromium",
"createTime": "2026-07-10T09:33:59.991038397Z",
"startTime": "2026-07-10T09:34:03.999103706Z",
"endTime": "2026-07-10T11:54:54.163227078Z",
"updateTime": "2026-07-10T11:54:54.163227078Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c15b2cf75cb96a25fa4187351d040fad624a8d23",
"ref": "refs/heads/main"
}
}
}
[11:54:54.476] Invocation finished in 2h20m56.374451797s with status FAILED