[16:10:12.180] New invocation is queued and will start shortly
[16:10:13.399] Starting the invocation (attempt 1)
[16:10:13.425] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2f5350d6206f5b390afbc0b07d75d278dbdd80d7"
[16:10:13.425] Popped gitiles commit info from properties and tags
[16:10:13.425] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:10:13.425] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:10:13.425] Buildbucket request:
{
"requestId": "8852497613496307760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f5350d6206f5b390afbc0b07d75d278dbdd80d7",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852497613496307760"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:10:14.019] Scheduled build:
{
"id": "8687067551454720993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 1847,
"createdBy": "project:chromium",
"createTime": "2026-03-17T16:10:13.499916441Z",
"updateTime": "2026-03-17T16:10:13.499916441Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f5350d6206f5b390afbc0b07d75d278dbdd80d7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[16:10:14.019] Task URL: https://cr-buildbucket.appspot.com/build/8687067551454720993
[16:10:14.019] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:2:0) after 9m23s
[16:10:14.951] Received PubSub notification, asking Buildbucket for the build status
[16:10:14.971] Build status: SCHEDULED
[16:10:20.484] Received PubSub notification, asking Buildbucket for the build status
[16:10:20.502] Build status: STARTED
[16:19:37.038] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:2:0)
[16:19:37.065] Build status: STARTED
[16:19:37.065] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:5:0) after 5m31s
[16:25:08.193] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:5:0)
[16:25:08.220] Build status: STARTED
[16:25:08.220] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:6:0) after 6m37s
[16:31:45.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:6:0)
[16:31:45.265] Build status: STARTED
[16:31:45.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:7:0) after 9m34s
[16:41:19.292] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:7:0)
[16:41:19.323] Build status: STARTED
[16:41:19.323] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:8:0) after 8m40s
[16:49:59.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:8:0)
[16:49:59.365] Build status: STARTED
[16:49:59.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:9:0) after 7m9s
[16:57:08.385] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:9:0)
[16:57:08.404] Build status: STARTED
[16:57:08.404] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:10:0) after 1m29s
[16:58:37.482] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:10:0)
[16:58:37.512] Build status: STARTED
[16:58:37.512] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:11:0) after 9m31s
[17:08:08.541] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:11:0)
[17:08:08.610] Build status: STARTED
[17:08:08.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:12:0) after 7m33s
[17:15:41.742] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:12:0)
[17:15:41.756] Build status: STARTED
[17:15:41.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:13:0) after 2m37s
[17:18:18.759] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:13:0)
[17:18:18.783] Build status: STARTED
[17:18:18.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:14:0) after 6m55s
[17:25:13.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:14:0)
[17:25:13.818] Build status: STARTED
[17:25:13.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:15:0) after 4m3s
[17:29:16.840] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:15:0)
[17:29:16.860] Build status: STARTED
[17:29:16.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:16:0) after 5m51s
[17:35:07.879] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:16:0)
[17:35:07.898] Build status: STARTED
[17:35:07.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:17:0) after 3m11s
[17:38:19.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:17:0)
[17:38:19.082] Build status: STARTED
[17:38:19.082] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:18:0) after 3m31s
[17:41:50.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:18:0)
[17:41:50.069] Build status: STARTED
[17:41:50.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:19:0) after 6m57s
[17:48:47.209] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:19:0)
[17:48:47.228] Build status: STARTED
[17:48:47.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:20:0) after 4m13s
[17:53:00.343] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:20:0)
[17:53:00.358] Build status: STARTED
[17:53:00.358] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:21:0) after 1m21s
[17:54:21.378] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:21:0)
[17:54:21.393] Build status: STARTED
[17:54:21.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:22:0) after 5m51s
[18:00:12.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:22:0)
[18:00:12.427] Build status: STARTED
[18:00:12.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:23:0) after 3m49s
[18:04:01.507] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:23:0)
[18:04:01.523] Build status: STARTED
[18:04:01.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:24:0) after 6m17s
[18:10:18.553] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:24:0)
[18:10:18.569] Build status: STARTED
[18:10:18.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:25:0) after 8m25s
[18:18:43.651] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:25:0)
[18:18:43.668] Build status: STARTED
[18:18:43.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:26:0) after 7m18s
[18:26:01.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:26:0)
[18:26:01.747] Build status: STARTED
[18:26:01.747] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:27:0) after 1m56s
[18:27:57.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:27:0)
[18:27:57.783] Build status: STARTED
[18:27:57.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:28:0) after 8m11s
[18:36:08.890] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:28:0)
[18:36:08.916] Build status: STARTED
[18:36:08.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:29:0) after 8m8s
[18:44:16.964] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:29:0)
[18:44:16.982] Build status: STARTED
[18:44:16.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:30:0) after 2m58s
[18:47:15.018] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:30:0)
[18:47:15.038] Build status: STARTED
[18:47:15.038] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:31:0) after 3m5s
[18:50:20.054] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:31:0)
[18:50:20.069] Build status: STARTED
[18:50:20.069] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:32:0) after 7m36s
[18:57:56.233] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:32:0)
[18:57:56.326] Build status: STARTED
[18:57:56.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:33:0) after 3m50s
[19:01:46.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:33:0)
[19:01:46.407] Build status: STARTED
[19:01:46.407] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:34:0) after 3m11s
[19:04:57.423] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:34:0)
[19:04:57.440] Build status: STARTED
[19:04:57.440] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:35:0) after 7m15s
[19:12:12.620] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:35:0)
[19:12:12.642] Build status: STARTED
[19:12:12.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:36:0) after 6m56s
[19:19:08.857] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:36:0)
[19:19:08.882] Build status: STARTED
[19:19:08.882] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:37:0) after 2m13s
[19:21:21.945] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:37:0)
[19:21:21.960] Build status: STARTED
[19:21:21.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:38:0) after 3m40s
[19:25:02.119] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:38:0)
[19:25:02.134] Build status: STARTED
[19:25:02.134] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:39:0) after 4m20s
[19:29:22.310] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:39:0)
[19:29:22.352] Build status: STARTED
[19:29:22.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:40:0) after 5m24s
[19:34:46.386] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:40:0)
[19:34:46.428] Build status: STARTED
[19:34:46.428] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:41:0) after 7m2s
[19:41:48.410] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:41:0)
[19:41:48.432] Build status: STARTED
[19:41:48.432] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:42:0) after 1m15s
[19:43:03.492] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:42:0)
[19:43:03.543] Build status: STARTED
[19:43:03.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:43:0) after 5m12s
[19:48:15.597] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:43:0)
[19:48:15.615] Build status: STARTED
[19:48:15.615] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:44:0) after 3m34s
[19:51:49.716] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:44:0)
[19:51:49.728] Build status: STARTED
[19:51:49.728] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:45:0) after 8m17s
[20:00:06.746] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:45:0)
[20:00:06.762] Build status: STARTED
[20:00:06.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:46:0) after 2m19s
[20:02:25.868] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:46:0)
[20:02:25.890] Build status: STARTED
[20:02:25.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:47:0) after 7m28s
[20:09:53.906] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:47:0)
[20:09:53.923] Build status: STARTED
[20:09:53.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:48:0) after 9m43s
[20:19:36.953] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:48:0)
[20:19:37.003] Build status: STARTED
[20:19:37.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:49:0) after 1m57s
[20:21:34.027] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:49:0)
[20:21:34.081] Build status: STARTED
[20:21:34.081] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:50:0) after 1m19s
[20:22:53.208] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:50:0)
[20:22:53.249] Build status: STARTED
[20:22:53.249] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:51:0) after 2m21s
[20:25:14.306] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:51:0)
[20:25:14.326] Build status: STARTED
[20:25:14.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:52:0) after 7m59s
[20:33:13.392] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:52:0)
[20:33:13.410] Build status: STARTED
[20:33:13.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:53:0) after 7m29s
[20:40:42.565] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:53:0)
[20:40:42.588] Build status: STARTED
[20:40:42.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:54:0) after 7m32s
[20:48:14.604] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:54:0)
[20:48:14.620] Build status: STARTED
[20:48:14.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:55:0) after 8m41s
[20:56:55.635] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:55:0)
[20:56:55.658] Build status: STARTED
[20:56:55.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:56:0) after 9m15s
[21:06:10.678] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:56:0)
[21:06:10.696] Build status: STARTED
[21:06:10.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:57:0) after 5m27s
[21:11:37.758] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:57:0)
[21:11:37.794] Build status: STARTED
[21:11:37.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:58:0) after 9m42s
[21:21:19.862] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:58:0)
[21:21:19.884] Build status: STARTED
[21:21:19.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:59:0) after 1m11s
[21:22:30.934] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:59:0)
[21:22:30.954] Build status: STARTED
[21:22:30.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:60:0) after 7m51s
[21:30:22.024] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:60:0)
[21:30:22.041] Build status: STARTED
[21:30:22.041] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:61:0) after 1m38s
[21:32:00.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:61:0)
[21:32:00.061] Build status: STARTED
[21:32:00.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:62:0) after 6m20s
[21:38:20.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:62:0)
[21:38:20.149] Build status: STARTED
[21:38:20.149] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852497613496307760:63:0) after 8m41s
[21:43:38.234] Received PubSub notification, asking Buildbucket for the build status
[21:43:38.265] Build:
{
"id": "8687067551454720993",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 1847,
"createdBy": "project:chromium",
"createTime": "2026-03-17T16:10:13.499916441Z",
"startTime": "2026-03-17T16:10:20.198540850Z",
"endTime": "2026-03-17T21:43:37.971143119Z",
"updateTime": "2026-03-17T21:43:37.971143119Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f5350d6206f5b390afbc0b07d75d278dbdd80d7",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:43:38.265] Invocation finished in 5h33m26.097517724s with status SUCCEEDED