[03:17:19.162] New invocation is queued and will start shortly
[03:17:20.283] Starting the invocation (attempt 1)
[03:17:20.318] Ignoring gitiles_ref tag without the buildset tag
[03:17:20.318] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:17:20.318] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:17:20.318] Buildbucket request:
{
"requestId": "8840859230456361408",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "roll-commenter-pigweed"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8840859230456361408",
"job": "pigweed/pigweed.dev.ci-roll-commenter-pigweed",
"triggers": [
{
"cron": {
"generation": "4816"
},
"id": "cron:v1:4816"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8840859230456361408"
},
{
"key": "scheduler_job_id",
"value": "pigweed/pigweed.dev.ci-roll-commenter-pigweed"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:17:20.666] Scheduled build:
{
"id": "8675429168529360817",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "roll-commenter-pigweed"
},
"createdBy": "project:pigweed",
"createTime": "2026-07-24T03:17:20.379878049Z",
"updateTime": "2026-07-24T03:17:20.379878049Z",
"status": "SCHEDULED",
"input": {
}
}
[03:17:20.666] Task URL: https://cr-buildbucket.appspot.com/build/8675429168529360817
[03:17:20.666] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:2:0) after 9m10s
[03:17:21.662] Received PubSub notification, asking Buildbucket for the build status
[03:17:21.679] Build status: SCHEDULED
[03:26:30.779] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:2:0)
[03:26:30.797] Build status: SCHEDULED
[03:26:30.797] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:4:0) after 1m27s
[03:27:57.844] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:4:0)
[03:27:57.906] Build status: SCHEDULED
[03:27:57.906] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:5:0) after 5m36s
[03:33:33.972] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:5:0)
[03:33:33.987] Build status: SCHEDULED
[03:33:33.987] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:6:0) after 9m44s
[03:43:18.071] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:6:0)
[03:43:18.096] Build status: SCHEDULED
[03:43:18.096] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:7:0) after 8m3s
[03:51:21.111] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:7:0)
[03:51:21.129] Build status: SCHEDULED
[03:51:21.129] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:8:0) after 2m8s
[03:53:29.141] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:8:0)
[03:53:29.158] Build status: SCHEDULED
[03:53:29.158] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:9:0) after 4m0s
[03:57:29.244] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:9:0)
[03:57:29.275] Build status: SCHEDULED
[03:57:29.275] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:10:0) after 1m19s
[03:58:48.289] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:10:0)
[03:58:48.364] Build status: SCHEDULED
[03:58:48.364] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:11:0) after 5m3s
[04:03:51.408] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:11:0)
[04:03:51.430] Build status: SCHEDULED
[04:03:51.430] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:12:0) after 3m24s
[04:07:15.449] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:12:0)
[04:07:15.497] Build status: SCHEDULED
[04:07:15.497] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:13:0) after 7m40s
[04:14:55.598] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:13:0)
[04:14:55.615] Build status: SCHEDULED
[04:14:55.615] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:14:0) after 7m9s
[04:22:04.628] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:14:0)
[04:22:04.648] Build status: SCHEDULED
[04:22:04.648] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:15:0) after 7m6s
[04:29:10.697] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:15:0)
[04:29:10.723] Build status: SCHEDULED
[04:29:10.723] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:16:0) after 1m24s
[04:30:34.799] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:16:0)
[04:30:34.830] Build status: SCHEDULED
[04:30:34.830] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:17:0) after 8m35s
[04:39:09.842] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:17:0)
[04:39:09.860] Build status: SCHEDULED
[04:39:09.860] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:18:0) after 2m58s
[04:42:07.875] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:18:0)
[04:42:07.894] Build status: SCHEDULED
[04:42:07.895] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:19:0) after 8m36s
[04:50:43.909] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:19:0)
[04:50:43.925] Build status: SCHEDULED
[04:50:43.925] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:20:0) after 8m54s
[04:59:37.999] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:20:0)
[04:59:38.038] Build status: SCHEDULED
[04:59:38.038] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:21:0) after 9m8s
[05:08:46.036] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:21:0)
[05:08:46.090] Build status: SCHEDULED
[05:08:46.090] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:22:0) after 3m6s
[05:11:52.105] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:22:0)
[05:11:52.133] Build status: SCHEDULED
[05:11:52.133] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:23:0) after 4m2s
[05:15:54.124] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:23:0)
[05:15:54.145] Build status: SCHEDULED
[05:15:54.145] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:24:0) after 8m49s
[05:24:43.224] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:24:0)
[05:24:43.248] Build status: SCHEDULED
[05:24:43.248] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:25:0) after 3m23s
[05:28:06.406] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:25:0)
[05:28:06.449] Build status: SCHEDULED
[05:28:06.450] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:26:0) after 7m23s
[05:35:29.512] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:26:0)
[05:35:29.533] Build status: SCHEDULED
[05:35:29.533] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:27:0) after 2m4s
[05:37:33.548] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:27:0)
[05:37:33.573] Build status: SCHEDULED
[05:37:33.573] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:28:0) after 6m42s
[05:44:15.613] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:28:0)
[05:44:15.640] Build status: SCHEDULED
[05:44:15.640] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:29:0) after 1m57s
[05:46:12.611] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:29:0)
[05:46:12.649] Build status: SCHEDULED
[05:46:12.649] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:30:0) after 3m37s
[05:49:49.660] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:30:0)
[05:49:49.681] Build status: SCHEDULED
[05:49:49.681] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:31:0) after 3m58s
[05:53:47.771] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:31:0)
[05:53:47.788] Build status: SCHEDULED
[05:53:47.788] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:32:0) after 2m38s
[05:56:25.831] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:32:0)
[05:56:25.850] Build status: SCHEDULED
[05:56:25.850] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:33:0) after 8m6s
[06:04:31.864] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:33:0)
[06:04:31.918] Build status: SCHEDULED
[06:04:31.918] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:34:0) after 3m52s
[06:08:23.902] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:34:0)
[06:08:23.921] Build status: SCHEDULED
[06:08:23.921] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:35:0) after 9m5s
[06:17:28.922] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:35:0)
[06:17:29.015] Build status: SCHEDULED
[06:17:29.015] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:36:0) after 9m1s
[06:26:30.133] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:36:0)
[06:26:30.192] Build status: SCHEDULED
[06:26:30.192] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:37:0) after 1m57s
[06:28:27.180] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:37:0)
[06:28:27.199] Build status: SCHEDULED
[06:28:27.199] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:38:0) after 1m51s
[06:30:18.314] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:38:0)
[06:30:18.331] Build status: SCHEDULED
[06:30:18.331] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:39:0) after 9m29s
[06:39:47.373] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:39:0)
[06:39:47.390] Build status: SCHEDULED
[06:39:47.390] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:40:0) after 8m32s
[06:48:19.390] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:40:0)
[06:48:19.409] Build status: SCHEDULED
[06:48:19.409] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:41:0) after 2m48s
[06:51:07.529] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:41:0)
[06:51:07.547] Build status: SCHEDULED
[06:51:07.547] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:42:0) after 8m26s
[06:56:32.383] Received PubSub notification, asking Buildbucket for the build status
[06:56:32.410] Build status: STARTED
[06:59:33.563] Handling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:42:0)
[06:59:33.583] Build status: STARTED
[06:59:33.583] Scheduling timer "check-buildbucket-build-status" (pigweed/pigweed.dev.ci-roll-commenter-pigweed:8840859230456361408:44:0) after 8m14s
[07:00:23.552] Received PubSub notification, asking Buildbucket for the build status
[07:00:23.569] Build:
{
"id": "8675429168529360817",
"builder": {
"project": "pigweed",
"bucket": "pigweed.dev.ci",
"builder": "roll-commenter-pigweed"
},
"createdBy": "project:pigweed",
"createTime": "2026-07-24T03:17:20.379878049Z",
"startTime": "2026-07-24T06:56:32.080719558Z",
"endTime": "2026-07-24T07:00:23.185675274Z",
"updateTime": "2026-07-24T07:00:23.185675274Z",
"status": "FAILURE",
"input": {
}
}
[07:00:23.569] Invocation finished in 3h43m4.410405775s with status FAILED