[07:46:16.087] New invocation is queued and will start shortly
[07:46:17.681] Starting the invocation (attempt 1)
[07:46:17.703] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/02ea82f8d8cf231ca985965dc078f2c4455fdeed"
[07:46:17.703] Popped gitiles commit info from properties and tags
[07:46:17.703] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[07:46:17.703] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[07:46:17.703] Buildbucket request:
{
"requestId": "8852438721367550416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02ea82f8d8cf231ca985965dc078f2c4455fdeed",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8852438721367550416"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacArm64PGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[07:46:18.548] Scheduled build:
{
"id": "8687008658904843505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 1850,
"createdBy": "project:chromium",
"createTime": "2026-03-18T07:46:17.811390225Z",
"updateTime": "2026-03-18T07:46:17.811390225Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02ea82f8d8cf231ca985965dc078f2c4455fdeed",
"ref": "refs/heads/main"
}
}
}
[07:46:18.548] Task URL: https://cr-buildbucket.appspot.com/build/8687008658904843505
[07:46:18.549] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:2:0) after 1m23s
[07:46:39.291] Received PubSub notification, asking Buildbucket for the build status
[07:46:39.309] Build status: STARTED
[07:46:43.149] Received PubSub notification, asking Buildbucket for the build status
[07:46:43.165] Build status: STARTED
[07:47:41.563] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:2:0)
[07:47:41.581] Build status: STARTED
[07:47:41.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:5:0) after 1m32s
[07:49:13.595] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:5:0)
[07:49:13.614] Build status: STARTED
[07:49:13.614] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:6:0) after 1m22s
[07:50:35.647] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:6:0)
[07:50:35.664] Build status: STARTED
[07:50:35.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:7:0) after 4m10s
[07:54:45.730] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:7:0)
[07:54:45.751] Build status: STARTED
[07:54:45.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:8:0) after 4m42s
[07:59:27.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:8:0)
[07:59:27.789] Build status: STARTED
[07:59:27.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:9:0) after 3m36s
[08:03:03.803] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:9:0)
[08:03:03.819] Build status: STARTED
[08:03:03.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:10:0) after 2m46s
[08:05:49.837] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:10:0)
[08:05:49.872] Build status: STARTED
[08:05:49.872] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:11:0) after 8m59s
[08:14:48.929] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:11:0)
[08:14:48.944] Build status: STARTED
[08:14:48.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:12:0) after 3m49s
[08:18:37.956] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:12:0)
[08:18:37.973] Build status: STARTED
[08:18:37.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:13:0) after 8m8s
[08:26:45.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:13:0)
[08:26:45.999] Build status: STARTED
[08:26:45.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:14:0) after 7m7s
[08:33:53.034] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:14:0)
[08:33:53.095] Build status: STARTED
[08:33:53.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:15:0) after 2m42s
[08:36:35.111] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:15:0)
[08:36:35.125] Build status: STARTED
[08:36:35.125] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:16:0) after 6m30s
[08:43:05.251] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:16:0)
[08:43:05.268] Build status: STARTED
[08:43:05.268] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:17:0) after 3m4s
[08:46:09.283] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:17:0)
[08:46:09.304] Build status: STARTED
[08:46:09.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:18:0) after 3m21s
[08:49:30.379] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:18:0)
[08:49:30.403] Build status: STARTED
[08:49:30.403] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:19:0) after 2m37s
[08:52:07.383] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:19:0)
[08:52:07.413] Build status: STARTED
[08:52:07.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:20:0) after 7m10s
[08:59:17.431] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:20:0)
[08:59:17.466] Build status: STARTED
[08:59:17.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:21:0) after 6m23s
[09:05:40.478] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:21:0)
[09:05:40.500] Build status: STARTED
[09:05:40.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:22:0) after 4m56s
[09:10:36.540] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:22:0)
[09:10:36.570] Build status: STARTED
[09:10:36.570] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:23:0) after 8m19s
[09:18:55.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:23:0)
[09:18:55.609] Build status: STARTED
[09:18:55.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:24:0) after 8m33s
[09:27:28.698] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:24:0)
[09:27:28.725] Build status: STARTED
[09:27:28.725] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:25:0) after 1m36s
[09:29:04.743] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:25:0)
[09:29:04.756] Build status: STARTED
[09:29:04.756] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:26:0) after 3m39s
[09:32:43.773] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:26:0)
[09:32:43.787] Build status: STARTED
[09:32:43.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:27:0) after 7m33s
[09:40:16.930] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:27:0)
[09:40:16.949] Build status: STARTED
[09:40:16.949] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:28:0) after 9m8s
[09:49:25.036] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:28:0)
[09:49:25.055] Build status: STARTED
[09:49:25.055] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:29:0) after 9m13s
[09:58:38.169] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:29:0)
[09:58:38.241] Build status: STARTED
[09:58:38.241] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:30:0) after 7m51s
[10:06:29.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:30:0)
[10:06:29.375] Build status: STARTED
[10:06:29.375] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:31:0) after 3m34s
[10:10:03.448] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:31:0)
[10:10:03.469] Build status: STARTED
[10:10:03.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:32:0) after 2m59s
[10:13:02.520] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:32:0)
[10:13:02.550] Build status: STARTED
[10:13:02.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:33:0) after 6m45s
[10:19:47.549] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:33:0)
[10:19:47.569] Build status: STARTED
[10:19:47.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:34:0) after 8m3s
[10:27:50.584] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:34:0)
[10:27:50.601] Build status: STARTED
[10:27:50.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:35:0) after 3m24s
[10:31:14.617] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:35:0)
[10:31:14.635] Build status: STARTED
[10:31:14.635] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:36:0) after 4m55s
[10:36:09.704] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:36:0)
[10:36:09.733] Build status: STARTED
[10:36:09.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:37:0) after 8m22s
[10:44:31.970] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:37:0)
[10:44:31.995] Build status: STARTED
[10:44:31.995] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:38:0) after 6m36s
[10:51:08.123] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:38:0)
[10:51:08.137] Build status: STARTED
[10:51:08.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:39:0) after 2m55s
[10:54:03.166] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:39:0)
[10:54:03.181] Build status: STARTED
[10:54:03.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:40:0) after 8m49s
[11:02:52.205] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:40:0)
[11:02:52.243] Build status: STARTED
[11:02:52.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:41:0) after 1m2s
[11:03:54.274] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:41:0)
[11:03:54.296] Build status: STARTED
[11:03:54.296] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:42:0) after 2m57s
[11:06:51.309] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:42:0)
[11:06:51.325] Build status: STARTED
[11:06:51.325] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:43:0) after 1m32s
[11:08:23.347] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:43:0)
[11:08:23.363] Build status: STARTED
[11:08:23.363] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:44:0) after 9m58s
[11:18:21.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:44:0)
[11:18:21.377] Build status: STARTED
[11:18:21.377] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:45:0) after 7m4s
[11:25:25.355] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:45:0)
[11:25:25.443] Build status: STARTED
[11:25:25.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:46:0) after 3m25s
[11:28:50.489] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:46:0)
[11:28:50.529] Build status: STARTED
[11:28:50.529] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:47:0) after 7m8s
[11:35:58.677] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:47:0)
[11:35:58.694] Build status: STARTED
[11:35:58.694] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:48:0) after 7m32s
[11:43:30.717] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:48:0)
[11:43:30.743] Build status: STARTED
[11:43:30.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:49:0) after 7m24s
[11:50:54.772] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:49:0)
[11:50:54.806] Build status: STARTED
[11:50:54.806] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:50:0) after 3m2s
[11:53:56.828] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:50:0)
[11:53:56.863] Build status: STARTED
[11:53:56.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:51:0) after 8m11s
[12:02:07.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:51:0)
[12:02:07.919] Build status: STARTED
[12:02:07.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:52:0) after 7m55s
[12:10:02.980] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:52:0)
[12:10:02.999] Build status: STARTED
[12:10:02.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:53:0) after 8m44s
[12:18:47.067] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:53:0)
[12:18:47.083] Build status: STARTED
[12:18:47.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:54:0) after 9m59s
[12:28:46.112] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:54:0)
[12:28:46.133] Build status: STARTED
[12:28:46.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:55:0) after 7m23s
[12:36:09.259] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:55:0)
[12:36:09.282] Build status: STARTED
[12:36:09.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:56:0) after 9m34s
[12:45:43.458] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:56:0)
[12:45:43.485] Build status: STARTED
[12:45:43.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:57:0) after 3m21s
[12:49:04.485] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:57:0)
[12:49:04.548] Build status: STARTED
[12:49:04.548] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:58:0) after 3m37s
[12:52:41.603] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:58:0)
[12:52:41.625] Build status: STARTED
[12:52:41.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:59:0) after 9m5s
[13:01:46.644] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:59:0)
[13:01:46.666] Build status: STARTED
[13:01:46.666] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:60:0) after 5m14s
[13:07:00.690] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:60:0)
[13:07:00.739] Build status: STARTED
[13:07:00.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:61:0) after 3m39s
[13:10:39.756] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:61:0)
[13:10:39.802] Build status: STARTED
[13:10:39.802] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:62:0) after 5m36s
[13:16:15.824] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:62:0)
[13:16:15.844] Build status: STARTED
[13:16:15.844] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:63:0) after 2m23s
[13:18:38.993] Handling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:63:0)
[13:18:39.015] Build status: STARTED
[13:18:39.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacArm64PGO:8852438721367550416:64:0) after 8m42s
[13:22:20.576] Received PubSub notification, asking Buildbucket for the build status
[13:22:20.615] Build:
{
"id": "8687008658904843505",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacArm64PGO"
},
"number": 1850,
"createdBy": "project:chromium",
"createTime": "2026-03-18T07:46:17.811390225Z",
"startTime": "2026-03-18T07:46:21.476533721Z",
"endTime": "2026-03-18T13:22:20.101949443Z",
"updateTime": "2026-03-18T13:22:20.101949443Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "02ea82f8d8cf231ca985965dc078f2c4455fdeed",
"ref": "refs/heads/main"
}
}
}
[13:22:20.615] Invocation finished in 5h36m4.535560029s with status SUCCEEDED