[02:44:05.498] New invocation is queued and will start shortly
[02:44:06.601] Starting the invocation (attempt 1)
[02:44:06.627] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c4143d8fc09a71ed6e6d20a1c65432fe41aaaa66"
[02:44:06.627] Popped gitiles commit info from properties and tags
[02:44:06.627] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:44:06.628] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:44:06.628] Buildbucket request:
{
"requestId": "8834791324217336144",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c4143d8fc09a71ed6e6d20a1c65432fe41aaaa66",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8834791324217336144"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-official"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:44:07.165] Scheduled build:
{
"id": "8669361262292438753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"number": 15191,
"createdBy": "project:chromium",
"createTime": "2026-09-29T02:44:06.712867434Z",
"updateTime": "2026-09-29T02:44:06.712867434Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c4143d8fc09a71ed6e6d20a1c65432fe41aaaa66",
"ref": "refs/heads/main"
}
}
}
[02:44:07.165] Task URL: https://cr-buildbucket.appspot.com/build/8669361262292438753
[02:44:07.165] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:2:0) after 7m45s
[02:44:08.313] Received PubSub notification, asking Buildbucket for the build status
[02:44:08.351] Build status: SCHEDULED
[02:51:52.291] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:2:0)
[02:51:52.311] Build status: SCHEDULED
[02:51:52.311] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:4:0) after 6m32s
[02:58:24.374] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:4:0)
[02:58:24.405] Build status: SCHEDULED
[02:58:24.405] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:5:0) after 7m1s
[03:05:25.475] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:5:0)
[03:05:25.494] Build status: SCHEDULED
[03:05:25.494] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:6:0) after 8m21s
[03:13:46.519] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:6:0)
[03:13:46.582] Build status: SCHEDULED
[03:13:46.582] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:7:0) after 9m39s
[03:23:25.611] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:7:0)
[03:23:25.637] Build status: SCHEDULED
[03:23:25.637] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:8:0) after 3m3s
[03:26:28.660] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:8:0)
[03:26:28.676] Build status: SCHEDULED
[03:26:28.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:9:0) after 5m51s
[03:32:19.743] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:9:0)
[03:32:19.763] Build status: SCHEDULED
[03:32:19.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:10:0) after 8m15s
[03:40:34.796] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:10:0)
[03:40:34.889] Build status: SCHEDULED
[03:40:34.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:11:0) after 4m36s
[03:45:10.986] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:11:0)
[03:45:11.008] Build status: SCHEDULED
[03:45:11.008] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:12:0) after 6m27s
[03:51:38.173] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:12:0)
[03:51:38.195] Build status: SCHEDULED
[03:51:38.195] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:13:0) after 8m8s
[03:59:46.283] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:13:0)
[03:59:46.303] Build status: SCHEDULED
[03:59:46.303] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:14:0) after 7m46s
[04:04:00.925] Received PubSub notification, asking Buildbucket for the build status
[04:04:00.946] Build status: STARTED
[04:07:32.326] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:14:0)
[04:07:32.347] Build status: STARTED
[04:07:32.347] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:16:0) after 5m32s
[04:13:04.439] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:16:0)
[04:13:04.459] Build status: STARTED
[04:13:04.459] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:17:0) after 5m9s
[04:18:13.472] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:17:0)
[04:18:13.492] Build status: STARTED
[04:18:13.492] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:18:0) after 3m56s
[04:22:09.570] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:18:0)
[04:22:09.597] Build status: STARTED
[04:22:09.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:19:0) after 9m7s
[04:31:16.633] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:19:0)
[04:31:16.657] Build status: STARTED
[04:31:16.657] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:20:0) after 5m4s
[04:36:20.844] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:20:0)
[04:36:20.863] Build status: STARTED
[04:36:20.863] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:21:0) after 5m55s
[04:42:15.936] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:21:0)
[04:42:15.962] Build status: STARTED
[04:42:15.962] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:22:0) after 6m37s
[04:48:53.006] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:22:0)
[04:48:53.028] Build status: STARTED
[04:48:53.028] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:23:0) after 7m49s
[04:56:42.053] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:23:0)
[04:56:42.068] Build status: STARTED
[04:56:42.068] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:24:0) after 8m19s
[05:05:01.117] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:24:0)
[05:05:01.148] Build status: STARTED
[05:05:01.148] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:25:0) after 7m28s
[05:12:29.176] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:25:0)
[05:12:29.197] Build status: STARTED
[05:12:29.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:26:0) after 5m29s
[05:17:58.284] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:26:0)
[05:17:58.300] Build status: STARTED
[05:17:58.300] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:27:0) after 5m51s
[05:23:49.333] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:27:0)
[05:23:49.388] Build status: STARTED
[05:23:49.388] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:28:0) after 4m13s
[05:28:02.415] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:28:0)
[05:28:02.435] Build status: STARTED
[05:28:02.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:29:0) after 9m34s
[05:37:36.470] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:29:0)
[05:37:36.506] Build status: STARTED
[05:37:36.506] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:30:0) after 9m57s
[05:47:33.536] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:30:0)
[05:47:33.553] Build status: STARTED
[05:47:33.553] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:31:0) after 6m23s
[05:53:56.664] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:31:0)
[05:53:56.685] Build status: STARTED
[05:53:56.685] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:32:0) after 6m11s
[06:00:07.720] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:32:0)
[06:00:07.952] Build status: STARTED
[06:00:07.952] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:33:0) after 4m50s
[06:04:57.977] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:33:0)
[06:04:58.009] Build status: STARTED
[06:04:58.009] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:34:0) after 4m18s
[06:09:16.037] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:34:0)
[06:09:16.061] Build status: STARTED
[06:09:16.061] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:35:0) after 6m34s
[06:15:50.098] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:35:0)
[06:15:50.118] Build status: STARTED
[06:15:50.118] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:36:0) after 9m55s
[06:25:45.146] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:36:0)
[06:25:45.225] Build status: STARTED
[06:25:45.226] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:37:0) after 1m2s
[06:26:47.250] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:37:0)
[06:26:47.269] Build status: STARTED
[06:26:47.269] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:38:0) after 7m6s
[06:33:53.304] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:38:0)
[06:33:53.323] Build status: STARTED
[06:33:53.323] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:39:0) after 3m20s
[06:37:13.350] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:39:0)
[06:37:13.416] Build status: STARTED
[06:37:13.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:40:0) after 9m16s
[06:46:29.525] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:40:0)
[06:46:29.564] Build status: STARTED
[06:46:29.564] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:41:0) after 2m35s
[06:49:04.546] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:41:0)
[06:49:04.578] Build status: STARTED
[06:49:04.578] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:42:0) after 5m25s
[06:54:29.629] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:42:0)
[06:54:29.652] Build status: STARTED
[06:54:29.652] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:43:0) after 1m47s
[06:56:16.720] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:43:0)
[06:56:16.738] Build status: STARTED
[06:56:16.738] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:44:0) after 6m26s
[07:02:42.766] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:44:0)
[07:02:42.782] Build status: STARTED
[07:02:42.782] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:45:0) after 4m29s
[07:07:11.799] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:45:0)
[07:07:11.828] Build status: STARTED
[07:07:11.828] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:46:0) after 2m44s
[07:09:55.908] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:46:0)
[07:09:55.928] Build status: STARTED
[07:09:55.928] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:47:0) after 4m13s
[07:14:08.971] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:47:0)
[07:14:09.007] Build status: STARTED
[07:14:09.007] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:48:0) after 9m7s
[07:23:16.047] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:48:0)
[07:23:16.068] Build status: STARTED
[07:23:16.068] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:49:0) after 5m55s
[07:29:11.133] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:49:0)
[07:29:11.152] Build status: STARTED
[07:29:11.152] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:50:0) after 1m41s
[07:30:52.282] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:50:0)
[07:30:52.306] Build status: STARTED
[07:30:52.306] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:51:0) after 1m30s
[07:32:22.332] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:51:0)
[07:32:22.385] Build status: STARTED
[07:32:22.385] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:52:0) after 9m41s
[07:42:03.427] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:52:0)
[07:42:03.445] Build status: STARTED
[07:42:03.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:53:0) after 4m22s
[07:46:25.490] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:53:0)
[07:46:25.622] Build status: STARTED
[07:46:25.622] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:54:0) after 9m8s
[07:55:33.654] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:54:0)
[07:55:33.669] Build status: STARTED
[07:55:33.669] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:55:0) after 1m29s
[07:57:02.693] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:55:0)
[07:57:02.717] Build status: STARTED
[07:57:02.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:56:0) after 5m8s
[08:02:10.743] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:56:0)
[08:02:10.900] Build status: STARTED
[08:02:10.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:57:0) after 3m6s
[08:05:16.990] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:57:0)
[08:05:17.025] Build status: STARTED
[08:05:17.025] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:58:0) after 7m32s
[08:12:49.099] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:58:0)
[08:12:49.121] Build status: STARTED
[08:12:49.121] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:59:0) after 7m4s
[08:19:53.475] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:59:0)
[08:19:53.493] Build status: STARTED
[08:19:53.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:60:0) after 4m32s
[08:24:25.658] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:60:0)
[08:24:25.678] Build status: STARTED
[08:24:25.678] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:61:0) after 7m48s
[08:32:13.765] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:61:0)
[08:32:13.791] Build status: STARTED
[08:32:13.791] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:62:0) after 9m33s
[08:41:46.868] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:62:0)
[08:41:47.040] Build status: STARTED
[08:41:47.040] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:63:0) after 2m9s
[08:43:56.161] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:63:0)
[08:43:56.196] Build status: STARTED
[08:43:56.196] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:64:0) after 2m48s
[08:46:44.254] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:64:0)
[08:46:44.283] Build status: STARTED
[08:46:44.283] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:65:0) after 7m26s
[08:54:10.319] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:65:0)
[08:54:10.368] Build status: STARTED
[08:54:10.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:66:0) after 1m7s
[08:55:17.395] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:66:0)
[08:55:17.416] Build status: STARTED
[08:55:17.416] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:67:0) after 3m2s
[08:58:19.495] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:67:0)
[08:58:19.521] Build status: STARTED
[08:58:19.521] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:68:0) after 1m30s
[08:59:49.599] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:68:0)
[08:59:49.649] Build status: STARTED
[08:59:49.649] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:69:0) after 5m2s
[09:04:51.770] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:69:0)
[09:04:51.788] Build status: STARTED
[09:04:51.788] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:70:0) after 1m43s
[09:06:34.861] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:70:0)
[09:06:34.883] Build status: STARTED
[09:06:34.883] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:71:0) after 2m11s
[09:08:45.930] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:71:0)
[09:08:45.951] Build status: STARTED
[09:08:45.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8834791324217336144:72:0) after 4m35s
[09:10:25.406] Received PubSub notification, asking Buildbucket for the build status
[09:10:25.457] Build:
{
"id": "8669361262292438753",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"number": 15191,
"createdBy": "project:chromium",
"createTime": "2026-09-29T02:44:06.712867434Z",
"startTime": "2026-09-29T04:04:00.731023509Z",
"endTime": "2026-09-29T09:10:25.041589714Z",
"updateTime": "2026-09-29T09:10:25.041589714Z",
"status": "SUCCESS",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c4143d8fc09a71ed6e6d20a1c65432fe41aaaa66",
"ref": "refs/heads/main"
}
}
}
[09:10:25.457] Invocation finished in 6h26m19.964249205s with status SUCCEEDED