[18:25:33.246] New invocation is queued and will start shortly
[18:25:34.334] Starting the invocation (attempt 1)
[18:25:34.357] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/343cee0c916d0d7e861b9e90587e7e43dab04aac"
[18:25:34.357] Popped gitiles commit info from properties and tags
[18:25:34.357] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[18:25:34.357] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[18:25:34.357] Buildbucket request:
{
"requestId": "8858377900753978224",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "343cee0c916d0d7e861b9e90587e7e43dab04aac",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8858377900753978224"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMacPGO"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[18:25:34.847] Scheduled build:
{
"id": "8692947838865516673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1130,
"createdBy": "project:chromium",
"createTime": "2026-01-11T18:25:34.422895044Z",
"updateTime": "2026-01-11T18:25:34.422895044Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "343cee0c916d0d7e861b9e90587e7e43dab04aac",
"ref": "refs/heads/main"
}
}
}
[18:25:34.847] Task URL: https://cr-buildbucket.appspot.com/build/8692947838865516673
[18:25:34.847] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:2:0) after 6m53s
[18:25:35.780] Received PubSub notification, asking Buildbucket for the build status
[18:25:35.855] Build status: SCHEDULED
[18:26:49.307] Received PubSub notification, asking Buildbucket for the build status
[18:26:49.323] Build status: STARTED
[18:32:27.863] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:2:0)
[18:32:27.884] Build status: STARTED
[18:32:27.884] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:5:0) after 5m23s
[18:37:50.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:5:0)
[18:37:50.954] Build status: STARTED
[18:37:50.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:6:0) after 3m22s
[18:41:13.105] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:6:0)
[18:41:13.127] Build status: STARTED
[18:41:13.128] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:7:0) after 2m10s
[18:43:23.200] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:7:0)
[18:43:23.221] Build status: STARTED
[18:43:23.222] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:8:0) after 2m28s
[18:45:51.239] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:8:0)
[18:45:51.257] Build status: STARTED
[18:45:51.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:9:0) after 9m35s
[18:55:26.369] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:9:0)
[18:55:26.388] Build status: STARTED
[18:55:26.388] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:10:0) after 1m3s
[18:56:29.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:10:0)
[18:56:29.553] Build status: STARTED
[18:56:29.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:11:0) after 4m28s
[19:00:57.567] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:11:0)
[19:00:57.583] Build status: STARTED
[19:00:57.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:12:0) after 7m32s
[19:08:29.599] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:12:0)
[19:08:29.620] Build status: STARTED
[19:08:29.620] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:13:0) after 2m42s
[19:11:11.638] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:13:0)
[19:11:11.649] Build status: STARTED
[19:11:11.649] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:14:0) after 8m46s
[19:19:57.671] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:14:0)
[19:19:57.690] Build status: STARTED
[19:19:57.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:15:0) after 8m59s
[19:28:56.731] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:15:0)
[19:28:56.756] Build status: STARTED
[19:28:56.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:16:0) after 5m16s
[19:34:12.771] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:16:0)
[19:34:12.783] Build status: STARTED
[19:34:12.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:17:0) after 6m17s
[19:40:30.010] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:17:0)
[19:40:30.044] Build status: STARTED
[19:40:30.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:18:0) after 1m0s
[19:41:30.061] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:18:0)
[19:41:30.349] Build status: STARTED
[19:41:30.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:19:0) after 3m45s
[19:45:15.564] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:19:0)
[19:45:15.581] Build status: STARTED
[19:45:15.581] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:20:0) after 6m29s
[19:51:44.732] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:20:0)
[19:51:44.750] Build status: STARTED
[19:51:44.750] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:21:0) after 6m51s
[19:58:35.766] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:21:0)
[19:58:35.785] Build status: STARTED
[19:58:35.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:22:0) after 2m25s
[20:01:00.800] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:22:0)
[20:01:00.814] Build status: STARTED
[20:01:00.814] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:23:0) after 2m50s
[20:03:50.987] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:23:0)
[20:03:50.999] Build status: STARTED
[20:03:50.999] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:24:0) after 8m43s
[20:12:34.016] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:24:0)
[20:12:34.028] Build status: STARTED
[20:12:34.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:25:0) after 3m14s
[20:15:48.045] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:25:0)
[20:15:48.060] Build status: STARTED
[20:15:48.060] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:26:0) after 4m55s
[20:20:43.076] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:26:0)
[20:20:43.135] Build status: STARTED
[20:20:43.135] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:27:0) after 5m11s
[20:25:54.360] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:27:0)
[20:25:54.460] Build status: STARTED
[20:25:54.460] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:28:0) after 5m6s
[20:31:00.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:28:0)
[20:31:00.566] Build status: STARTED
[20:31:00.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:29:0) after 3m22s
[20:34:22.767] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:29:0)
[20:34:22.783] Build status: STARTED
[20:34:22.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:30:0) after 3m20s
[20:37:42.799] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:30:0)
[20:37:42.839] Build status: STARTED
[20:37:42.839] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:31:0) after 8m46s
[20:46:28.955] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:31:0)
[20:46:28.972] Build status: STARTED
[20:46:28.972] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:32:0) after 4m51s
[20:51:20.032] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:32:0)
[20:51:20.047] Build status: STARTED
[20:51:20.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:33:0) after 8m35s
[20:59:55.148] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:33:0)
[20:59:55.160] Build status: STARTED
[20:59:55.161] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:34:0) after 1m55s
[21:01:50.403] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:34:0)
[21:01:50.420] Build status: STARTED
[21:01:50.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:35:0) after 6m18s
[21:08:08.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:35:0)
[21:08:08.443] Build status: STARTED
[21:08:08.443] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:36:0) after 5m40s
[21:13:48.459] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:36:0)
[21:13:48.490] Build status: STARTED
[21:13:48.490] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:37:0) after 9m53s
[21:23:41.510] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:37:0)
[21:23:41.525] Build status: STARTED
[21:23:41.525] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:38:0) after 5m19s
[21:29:00.542] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:38:0)
[21:29:00.600] Build status: STARTED
[21:29:00.601] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:39:0) after 8m52s
[21:37:52.618] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:39:0)
[21:37:52.653] Build status: STARTED
[21:37:52.653] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:40:0) after 2m16s
[21:40:08.672] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:40:0)
[21:40:08.690] Build status: STARTED
[21:40:08.690] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:41:0) after 8m32s
[21:48:40.705] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:41:0)
[21:48:40.719] Build status: STARTED
[21:48:40.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:42:0) after 1m42s
[21:50:22.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:42:0)
[21:50:22.920] Build status: STARTED
[21:50:22.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:43:0) after 4m58s
[21:55:20.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:43:0)
[21:55:20.918] Build status: STARTED
[21:55:20.918] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:44:0) after 4m9s
[21:59:29.933] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:44:0)
[21:59:29.969] Build status: STARTED
[21:59:29.969] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:45:0) after 8m24s
[22:07:53.988] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:45:0)
[22:07:54.004] Build status: STARTED
[22:07:54.004] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:46:0) after 4m18s
[22:12:12.167] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:46:0)
[22:12:12.183] Build status: STARTED
[22:12:12.183] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:47:0) after 8m14s
[22:20:26.201] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:47:0)
[22:20:26.213] Build status: STARTED
[22:20:26.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:48:0) after 7m12s
[22:27:38.281] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:48:0)
[22:27:38.297] Build status: STARTED
[22:27:38.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:49:0) after 5m37s
[22:33:15.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:49:0)
[22:33:15.328] Build status: STARTED
[22:33:15.328] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:50:0) after 4m12s
[22:37:27.537] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:50:0)
[22:37:27.553] Build status: STARTED
[22:37:27.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:51:0) after 6m52s
[22:44:19.898] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:51:0)
[22:44:20.007] Build status: STARTED
[22:44:20.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:52:0) after 3m8s
[22:47:28.025] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:52:0)
[22:47:28.042] Build status: STARTED
[22:47:28.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:53:0) after 6m12s
[22:53:40.258] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:53:0)
[22:53:40.283] Build status: STARTED
[22:53:40.283] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:54:0) after 7m10s
[23:00:50.298] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:54:0)
[23:00:50.317] Build status: STARTED
[23:00:50.317] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:55:0) after 8m36s
[23:09:26.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:55:0)
[23:09:26.566] Build status: STARTED
[23:09:26.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:56:0) after 5m3s
[23:14:29.725] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:56:0)
[23:14:29.739] Build status: STARTED
[23:14:29.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:57:0) after 4m10s
[23:18:39.887] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:57:0)
[23:18:39.950] Build status: STARTED
[23:18:39.950] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:58:0) after 7m35s
[23:26:15.245] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:58:0)
[23:26:15.300] Build status: STARTED
[23:26:15.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:59:0) after 8m22s
[23:34:37.314] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:59:0)
[23:34:37.327] Build status: STARTED
[23:34:37.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:60:0) after 3m12s
[23:37:50.006] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:60:0)
[23:37:50.027] Build status: STARTED
[23:37:50.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:61:0) after 1m46s
[23:39:36.044] Handling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:61:0)
[23:39:36.058] Build status: STARTED
[23:39:36.058] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMacPGO:8858377900753978224:62:0) after 6m3s
[23:44:51.268] Received PubSub notification, asking Buildbucket for the build status
[23:44:51.286] Build:
{
"id": "8692947838865516673",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMacPGO"
},
"number": 1130,
"createdBy": "project:chromium",
"createTime": "2026-01-11T18:25:34.422895044Z",
"startTime": "2026-01-11T18:26:49.042616200Z",
"endTime": "2026-01-11T23:44:16.847296098Z",
"updateTime": "2026-01-11T23:44:16.847296098Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "343cee0c916d0d7e861b9e90587e7e43dab04aac",
"ref": "refs/heads/main"
}
}
}
[23:44:51.286] Invocation finished in 5h19m18.047385675s with status FAILED