[21:01:36.142] New invocation is queued and will start shortly
[21:01:37.208] Starting the invocation (attempt 1)
[21:01:37.235] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/41a7246b98ce021dba52d5b24679d223d8d60e80"
[21:01:37.235] Popped gitiles commit info from properties and tags
[21:01:37.235] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:01:37.236] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:01:37.236] Buildbucket request:
{
"requestId": "8853022862028097680",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "41a7246b98ce021dba52d5b24679d223d8d60e80",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853022862028097680"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-official"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:01:37.722] Scheduled build:
{
"id": "8687592800174625233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"number": 13968,
"createdBy": "project:chromium",
"createTime": "2026-03-11T21:01:37.285246656Z",
"updateTime": "2026-03-11T21:01:37.285246656Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "41a7246b98ce021dba52d5b24679d223d8d60e80",
"ref": "refs/heads/main"
}
}
}
[21:01:37.722] Task URL: https://cr-buildbucket.appspot.com/build/8687592800174625233
[21:01:37.722] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:2:0) after 2m44s
[21:01:37.860] Received PubSub notification, asking Buildbucket for the build status
[21:01:37.885] Build status: SCHEDULED
[21:01:43.830] Received PubSub notification, asking Buildbucket for the build status
[21:01:43.865] Build status: STARTED
[21:04:21.893] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:2:0)
[21:04:21.919] Build status: STARTED
[21:04:21.919] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:5:0) after 3m2s
[21:07:23.998] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:5:0)
[21:07:24.046] Build status: STARTED
[21:07:24.046] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:6:0) after 1m53s
[21:09:17.058] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:6:0)
[21:09:17.076] Build status: STARTED
[21:09:17.076] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:7:0) after 1m5s
[21:10:22.408] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:7:0)
[21:10:22.435] Build status: STARTED
[21:10:22.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:8:0) after 5m0s
[21:15:22.638] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:8:0)
[21:15:22.653] Build status: STARTED
[21:15:22.653] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:9:0) after 8m38s
[21:24:00.809] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:9:0)
[21:24:00.827] Build status: STARTED
[21:24:00.827] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:10:0) after 2m50s
[21:26:50.878] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:10:0)
[21:26:50.945] Build status: STARTED
[21:26:50.945] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:11:0) after 4m21s
[21:31:12.009] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:11:0)
[21:31:12.039] Build status: STARTED
[21:31:12.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:12:0) after 1m4s
[21:32:16.050] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:12:0)
[21:32:16.085] Build status: STARTED
[21:32:16.085] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:13:0) after 4m58s
[21:37:14.080] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:13:0)
[21:37:14.103] Build status: STARTED
[21:37:14.104] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:14:0) after 7m27s
[21:44:41.195] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:14:0)
[21:44:41.282] Build status: STARTED
[21:44:41.283] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:15:0) after 3m37s
[21:48:18.351] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:15:0)
[21:48:18.367] Build status: STARTED
[21:48:18.368] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:16:0) after 6m35s
[21:54:53.567] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:16:0)
[21:54:53.581] Build status: STARTED
[21:54:53.581] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:17:0) after 3m8s
[21:58:01.609] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:17:0)
[21:58:01.629] Build status: STARTED
[21:58:01.629] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:18:0) after 3m18s
[22:01:19.647] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:18:0)
[22:01:19.672] Build status: STARTED
[22:01:19.672] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:19:0) after 1m18s
[22:02:37.842] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:19:0)
[22:02:37.872] Build status: STARTED
[22:02:37.872] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:20:0) after 8m16s
[22:10:53.981] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:20:0)
[22:10:53.996] Build status: STARTED
[22:10:53.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:21:0) after 8m53s
[22:19:47.079] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:21:0)
[22:19:47.099] Build status: STARTED
[22:19:47.099] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:22:0) after 2m15s
[22:22:02.245] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:22:0)
[22:22:02.260] Build status: STARTED
[22:22:02.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:23:0) after 6m31s
[22:28:33.329] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:23:0)
[22:28:33.347] Build status: STARTED
[22:28:33.347] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:24:0) after 7m0s
[22:35:33.321] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:24:0)
[22:35:33.341] Build status: STARTED
[22:35:33.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:25:0) after 7m36s
[22:43:09.457] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:25:0)
[22:43:09.473] Build status: STARTED
[22:43:09.473] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:26:0) after 7m25s
[22:50:34.489] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:26:0)
[22:50:34.507] Build status: STARTED
[22:50:34.507] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:27:0) after 2m36s
[22:53:10.541] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:27:0)
[22:53:10.597] Build status: STARTED
[22:53:10.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:28:0) after 3m23s
[22:56:33.628] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:28:0)
[22:56:33.654] Build status: STARTED
[22:56:33.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:29:0) after 4m8s
[23:00:41.679] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:29:0)
[23:00:41.735] Build status: STARTED
[23:00:41.735] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:30:0) after 6m37s
[23:07:18.793] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:30:0)
[23:07:18.816] Build status: STARTED
[23:07:18.816] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:31:0) after 4m20s
[23:11:39.499] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:31:0)
[23:11:39.516] Build status: STARTED
[23:11:39.516] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:32:0) after 4m20s
[23:15:59.534] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:32:0)
[23:16:00.587] Build status: STARTED
[23:16:00.587] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:33:0) after 6m28s
[23:22:28.602] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:33:0)
[23:22:28.635] Build status: STARTED
[23:22:28.635] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:34:0) after 8m44s
[23:31:12.657] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:34:0)
[23:31:12.676] Build status: STARTED
[23:31:12.676] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:35:0) after 1m1s
[23:32:13.711] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:35:0)
[23:32:13.737] Build status: STARTED
[23:32:13.737] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:36:0) after 7m9s
[23:39:22.773] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:36:0)
[23:39:22.791] Build status: STARTED
[23:39:22.791] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:37:0) after 1m9s
[23:40:31.861] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:37:0)
[23:40:31.896] Build status: STARTED
[23:40:31.896] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:38:0) after 2m14s
[23:42:46.022] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:38:0)
[23:42:46.131] Build status: STARTED
[23:42:46.131] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:39:0) after 4m35s
[23:47:21.220] Handling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:39:0)
[23:47:21.237] Build status: STARTED
[23:47:21.237] Scheduling timer "check-buildbucket-build-status" (chromium/mac-official:8853022862028097680:40:0) after 9m47s
[23:53:50.401] Received PubSub notification, asking Buildbucket for the build status
[23:53:50.416] Build:
{
"id": "8687592800174625233",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-official"
},
"number": 13968,
"createdBy": "project:chromium",
"createTime": "2026-03-11T21:01:37.285246656Z",
"startTime": "2026-03-11T21:01:43.495052562Z",
"endTime": "2026-03-11T23:53:50.167646822Z",
"updateTime": "2026-03-11T23:53:50.167646822Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "41a7246b98ce021dba52d5b24679d223d8d60e80",
"ref": "refs/heads/main"
}
}
}
[23:53:50.416] Invocation finished in 2h52m14.281962527s with status FAILED