[02:25:55.467] New invocation is queued and will start shortly
[02:25:55.467] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[02:25:56.903] Starting the invocation (attempt 1)
[02:25:56.929] Ignoring gitiles_ref tag without the buildset tag
[02:25:56.929] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:25:56.929] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:25:56.930] Buildbucket request:
{
"requestId": "8840953060912287280",
"builder": {
"project": "pigweed",
"bucket": "zephyr.dev.ci",
"builder": "zephyr-mac-arm"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8840953060912287280",
"job": "pigweed/zephyr.dev.ci-zephyr-mac-arm",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "a8d6454c-4863-45a1-b60d-cbf951f5fca0",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8675523373748343665"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8840953060912287280"
},
{
"key": "scheduler_job_id",
"value": "pigweed/zephyr.dev.ci-zephyr-mac-arm"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:25:57.497] Scheduled build:
{
"id": "8675522998651188289",
"builder": {
"project": "pigweed",
"bucket": "zephyr.dev.ci",
"builder": "zephyr-mac-arm"
},
"createdBy": "project:pigweed",
"createTime": "2026-07-23T02:25:57.002919556Z",
"updateTime": "2026-07-23T02:25:57.002919556Z",
"status": "SCHEDULED",
"input": {
}
}
[02:25:57.497] Task URL: https://cr-buildbucket.appspot.com/build/8675522998651188289
[02:25:57.497] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:2:0) after 9m50s
[02:25:58.393] Received PubSub notification, asking Buildbucket for the build status
[02:25:58.414] Build status: SCHEDULED
[02:35:47.514] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:2:0)
[02:35:47.536] Build status: SCHEDULED
[02:35:47.536] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:4:0) after 5m53s
[02:41:40.764] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:4:0)
[02:41:40.782] Build status: SCHEDULED
[02:41:40.782] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:5:0) after 5m36s
[02:47:16.796] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:5:0)
[02:47:16.828] Build status: SCHEDULED
[02:47:16.828] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:6:0) after 3m5s
[02:50:21.941] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:6:0)
[02:50:21.957] Build status: SCHEDULED
[02:50:21.957] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:7:0) after 3m0s
[02:53:22.012] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:7:0)
[02:53:22.037] Build status: SCHEDULED
[02:53:22.037] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:8:0) after 1m58s
[02:55:20.168] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:8:0)
[02:55:20.189] Build status: SCHEDULED
[02:55:20.189] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:9:0) after 9m24s
[03:04:44.209] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:9:0)
[03:04:44.236] Build status: SCHEDULED
[03:04:44.236] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:10:0) after 6m47s
[03:11:31.336] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:10:0)
[03:11:31.399] Build status: SCHEDULED
[03:11:31.399] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:11:0) after 1m23s
[03:12:54.443] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:11:0)
[03:12:54.521] Build status: SCHEDULED
[03:12:54.521] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:12:0) after 9m49s
[03:22:43.613] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:12:0)
[03:22:43.632] Build status: SCHEDULED
[03:22:43.633] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:13:0) after 5m33s
[03:28:16.725] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:13:0)
[03:28:16.745] Build status: SCHEDULED
[03:28:16.745] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:14:0) after 3m56s
[03:32:12.836] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:14:0)
[03:32:12.870] Build status: SCHEDULED
[03:32:12.870] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:15:0) after 9m14s
[03:41:26.884] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:15:0)
[03:41:26.902] Build status: SCHEDULED
[03:41:26.902] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:16:0) after 9m57s
[03:51:23.915] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:16:0)
[03:51:23.941] Build status: SCHEDULED
[03:51:23.941] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:17:0) after 4m26s
[03:55:49.955] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:17:0)
[03:55:49.973] Build status: SCHEDULED
[03:55:49.973] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:18:0) after 2m9s
[03:57:58.990] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:18:0)
[03:57:59.015] Build status: SCHEDULED
[03:57:59.015] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:19:0) after 6m39s
[04:04:38.061] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:19:0)
[04:04:38.079] Build status: SCHEDULED
[04:04:38.079] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:20:0) after 6m2s
[04:10:40.143] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:20:0)
[04:10:40.157] Build status: SCHEDULED
[04:10:40.157] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:21:0) after 6m16s
[04:16:56.161] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:21:0)
[04:16:56.179] Build status: SCHEDULED
[04:16:56.179] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:22:0) after 1m54s
[04:18:50.192] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:22:0)
[04:18:50.209] Build status: SCHEDULED
[04:18:50.209] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:23:0) after 7m0s
[04:25:50.222] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:23:0)
[04:25:50.239] Build status: SCHEDULED
[04:25:50.239] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:24:0) after 1m35s
[04:27:25.205] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:24:0)
[04:27:25.232] Build status: SCHEDULED
[04:27:25.232] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:25:0) after 6m29s
[04:33:54.296] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:25:0)
[04:33:54.317] Build status: SCHEDULED
[04:33:54.317] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:26:0) after 9m23s
[04:43:17.347] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:26:0)
[04:43:17.368] Build status: SCHEDULED
[04:43:17.368] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:27:0) after 2m21s
[04:45:38.384] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:27:0)
[04:45:38.411] Build status: SCHEDULED
[04:45:38.411] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:28:0) after 5m50s
[04:51:28.425] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:28:0)
[04:51:28.445] Build status: SCHEDULED
[04:51:28.445] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:29:0) after 8m27s
[04:59:55.629] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:29:0)
[04:59:55.652] Build status: SCHEDULED
[04:59:55.652] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:30:0) after 7m42s
[05:07:37.663] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:30:0)
[05:07:37.685] Build status: SCHEDULED
[05:07:37.685] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:31:0) after 3m28s
[05:11:05.746] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:31:0)
[05:11:08.696] Build status: SCHEDULED
[05:11:08.696] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:32:0) after 3m8s
[05:14:16.787] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:32:0)
[05:14:16.818] Build status: SCHEDULED
[05:14:16.818] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:33:0) after 4m23s
[05:18:39.881] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:33:0)
[05:18:39.902] Build status: SCHEDULED
[05:18:39.902] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:34:0) after 5m23s
[05:24:02.916] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:34:0)
[05:24:02.968] Build status: SCHEDULED
[05:24:02.968] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:35:0) after 6m44s
[05:30:47.014] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:35:0)
[05:30:47.048] Build status: SCHEDULED
[05:30:47.048] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:36:0) after 2m23s
[05:33:10.164] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:36:0)
[05:33:10.183] Build status: SCHEDULED
[05:33:10.183] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:37:0) after 2m5s
[05:35:15.204] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:37:0)
[05:35:15.231] Build status: SCHEDULED
[05:35:15.231] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:38:0) after 1m47s
[05:37:02.245] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:38:0)
[05:37:02.321] Build status: SCHEDULED
[05:37:02.321] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:39:0) after 4m22s
[05:41:24.376] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:39:0)
[05:41:24.402] Build status: SCHEDULED
[05:41:24.402] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:40:0) after 6m23s
[05:47:47.433] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:40:0)
[05:47:47.450] Build status: SCHEDULED
[05:47:47.450] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:41:0) after 9m3s
[05:56:50.463] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:41:0)
[05:56:50.492] Build status: SCHEDULED
[05:56:50.493] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:42:0) after 3m49s
[06:00:39.552] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:42:0)
[06:00:39.569] Build status: SCHEDULED
[06:00:39.569] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:43:0) after 3m3s
[06:03:42.596] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:43:0)
[06:03:42.619] Build status: SCHEDULED
[06:03:42.619] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:44:0) after 2m25s
[06:06:07.634] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:44:0)
[06:06:07.651] Build status: SCHEDULED
[06:06:07.651] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:45:0) after 2m19s
[06:06:14.909] Received PubSub notification, asking Buildbucket for the build status
[06:06:14.928] Build status: STARTED
[06:08:26.666] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:45:0)
[06:08:26.758] Build status: STARTED
[06:08:26.758] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:47:0) after 3m44s
[06:12:10.804] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:47:0)
[06:12:10.997] Build status: STARTED
[06:12:10.997] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:48:0) after 2m16s
[06:14:27.042] Handling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:48:0)
[06:14:27.122] Build status: STARTED
[06:14:27.123] Scheduling timer "check-buildbucket-build-status" (pigweed/zephyr.dev.ci-zephyr-mac-arm:8840953060912287280:49:0) after 9m43s
[06:16:48.120] Received PubSub notification, asking Buildbucket for the build status
[06:16:48.178] Build:
{
"id": "8675522998651188289",
"builder": {
"project": "pigweed",
"bucket": "zephyr.dev.ci",
"builder": "zephyr-mac-arm"
},
"createdBy": "project:pigweed",
"createTime": "2026-07-23T02:25:57.002919556Z",
"startTime": "2026-07-23T06:06:14.745774875Z",
"endTime": "2026-07-23T06:16:47.823823561Z",
"updateTime": "2026-07-23T06:16:47.823823561Z",
"status": "FAILURE",
"input": {
}
}
[06:16:48.178] Invocation finished in 3h50m52.716301377s with status FAILED