[05:00:02.178] New invocation is queued and will start shortly
[05:00:03.915] Starting the invocation (attempt 1)
[05:00:03.941] Ignoring gitiles_ref tag without the buildset tag
[05:00:03.941] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:00:03.941] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:00:03.942] Buildbucket request:
{
"requestId": "8835326353117869776",
"builder": {
"project": "dawn",
"bucket": "ci",
"builder": "cts-roller"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8835326353117869776",
"job": "dawn/cts-roller",
"triggers": [
{
"cron": {
"generation": "3016"
},
"id": "cron:v1:3016"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835326353117869776"
},
{
"key": "scheduler_job_id",
"value": "dawn/cts-roller"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:00:04.357] Scheduled build:
{
"id": "8669896290491316801",
"builder": {
"project": "dawn",
"bucket": "ci",
"builder": "cts-roller"
},
"createdBy": "project:dawn",
"createTime": "2026-09-23T05:00:04.060775863Z",
"updateTime": "2026-09-23T05:00:04.060775863Z",
"status": "SCHEDULED",
"input": {
}
}
[05:00:04.357] Task URL: https://cr-buildbucket.appspot.com/build/8669896290491316801
[05:00:04.357] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:2:0) after 9m13s
[05:00:46.741] Received PubSub notification, asking Buildbucket for the build status
[05:00:46.770] Build status: STARTED
[05:01:07.626] Received PubSub notification, asking Buildbucket for the build status
[05:01:07.656] Build status: STARTED
[05:09:17.373] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:2:0)
[05:09:17.394] Build status: STARTED
[05:09:17.394] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:5:0) after 9m15s
[05:18:32.474] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:5:0)
[05:18:32.579] Build status: STARTED
[05:18:32.579] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:6:0) after 7m25s
[05:25:57.594] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:6:0)
[05:25:57.645] Build status: STARTED
[05:25:57.645] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:7:0) after 6m38s
[05:32:35.732] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:7:0)
[05:32:35.803] Build status: STARTED
[05:32:35.803] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:8:0) after 8m53s
[05:41:28.900] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:8:0)
[05:41:28.920] Build status: STARTED
[05:41:28.920] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:9:0) after 3m13s
[05:44:41.935] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:9:0)
[05:44:41.956] Build status: STARTED
[05:44:41.956] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:10:0) after 1m21s
[05:46:02.970] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:10:0)
[05:46:03.040] Build status: STARTED
[05:46:03.040] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:11:0) after 6m49s
[05:52:52.091] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:11:0)
[05:52:52.117] Build status: STARTED
[05:52:52.118] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:12:0) after 2m29s
[05:55:21.153] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:12:0)
[05:55:21.173] Build status: STARTED
[05:55:21.173] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:13:0) after 7m8s
[06:02:29.238] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:13:0)
[06:02:29.259] Build status: STARTED
[06:02:29.259] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:14:0) after 2m6s
[06:04:35.290] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:14:0)
[06:04:35.316] Build status: STARTED
[06:04:35.317] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:15:0) after 9m51s
[06:14:26.430] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:15:0)
[06:14:26.467] Build status: STARTED
[06:14:26.467] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:16:0) after 5m56s
[06:20:22.481] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:16:0)
[06:20:22.535] Build status: STARTED
[06:20:22.535] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:17:0) after 6m14s
[06:26:36.565] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:17:0)
[06:26:36.593] Build status: STARTED
[06:26:36.593] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:18:0) after 4m49s
[06:31:25.609] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:18:0)
[06:31:25.629] Build status: STARTED
[06:31:25.629] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:19:0) after 7m16s
[06:38:41.713] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:19:0)
[06:38:41.747] Build status: STARTED
[06:38:41.747] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:20:0) after 6m1s
[06:44:42.737] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:20:0)
[06:44:42.791] Build status: STARTED
[06:44:42.791] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:21:0) after 8m44s
[06:53:26.844] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:21:0)
[06:53:26.862] Build status: STARTED
[06:53:26.862] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:22:0) after 9m48s
[07:03:14.881] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:22:0)
[07:03:14.900] Build status: STARTED
[07:03:14.900] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:23:0) after 4m7s
[07:07:22.004] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:23:0)
[07:07:22.034] Build status: STARTED
[07:07:22.034] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:24:0) after 7m52s
[07:15:14.061] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:24:0)
[07:15:14.097] Build status: STARTED
[07:15:14.097] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:25:0) after 2m29s
[07:17:43.110] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:25:0)
[07:17:43.204] Build status: STARTED
[07:17:43.204] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:26:0) after 6m44s
[07:24:27.269] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:26:0)
[07:24:27.290] Build status: STARTED
[07:24:27.290] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:27:0) after 2m7s
[07:26:34.304] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:27:0)
[07:26:34.330] Build status: STARTED
[07:26:34.330] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:28:0) after 8m23s
[07:34:57.334] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:28:0)
[07:34:57.356] Build status: STARTED
[07:34:57.356] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:29:0) after 6m21s
[07:41:18.432] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:29:0)
[07:41:18.451] Build status: STARTED
[07:41:18.451] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:30:0) after 9m34s
[07:50:52.466] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:30:0)
[07:50:54.776] Build status: STARTED
[07:50:54.776] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:31:0) after 4m13s
[07:55:07.822] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:31:0)
[07:55:07.860] Build status: STARTED
[07:55:07.860] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:32:0) after 7m55s
[08:03:02.894] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:32:0)
[08:03:02.926] Build status: STARTED
[08:03:02.926] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:33:0) after 4m52s
[08:07:54.923] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:33:0)
[08:07:54.951] Build status: STARTED
[08:07:54.951] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:34:0) after 3m25s
[08:11:20.239] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:34:0)
[08:11:20.331] Build status: STARTED
[08:11:20.331] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:35:0) after 3m51s
[08:15:11.493] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:35:0)
[08:15:11.528] Build status: STARTED
[08:15:11.528] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:36:0) after 4m56s
[08:20:07.616] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:36:0)
[08:20:07.669] Build status: STARTED
[08:20:07.669] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:37:0) after 5m36s
[08:25:43.708] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:37:0)
[08:25:43.732] Build status: STARTED
[08:25:43.732] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:38:0) after 1m44s
[08:27:27.747] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:38:0)
[08:27:27.767] Build status: STARTED
[08:27:27.767] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:39:0) after 7m44s
[08:35:11.857] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:39:0)
[08:35:11.895] Build status: STARTED
[08:35:11.895] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:40:0) after 1m44s
[08:36:55.913] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:40:0)
[08:36:55.933] Build status: STARTED
[08:36:55.933] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:41:0) after 3m47s
[08:40:43.001] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:41:0)
[08:40:43.036] Build status: STARTED
[08:40:43.036] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:42:0) after 5m4s
[08:45:47.052] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:42:0)
[08:45:47.074] Build status: STARTED
[08:45:47.074] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:43:0) after 6m12s
[08:51:59.089] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:43:0)
[08:51:59.110] Build status: STARTED
[08:51:59.110] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:44:0) after 3m10s
[08:55:09.129] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:44:0)
[08:55:09.165] Build status: STARTED
[08:55:09.165] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:45:0) after 6m57s
[09:02:06.294] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:45:0)
[09:02:06.315] Build status: STARTED
[09:02:06.315] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:46:0) after 3m53s
[09:05:59.451] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:46:0)
[09:05:59.467] Build status: STARTED
[09:05:59.467] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:47:0) after 6m16s
[09:12:15.540] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:47:0)
[09:12:15.618] Build status: STARTED
[09:12:15.618] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:48:0) after 5m0s
[09:17:15.703] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:48:0)
[09:17:15.730] Build status: STARTED
[09:17:15.730] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:49:0) after 1m24s
[09:18:39.802] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:49:0)
[09:18:39.829] Build status: STARTED
[09:18:39.829] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:50:0) after 8m37s
[09:27:16.890] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:50:0)
[09:27:16.917] Build status: STARTED
[09:27:16.917] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:51:0) after 3m53s
[09:31:09.965] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:51:0)
[09:31:09.986] Build status: STARTED
[09:31:09.986] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:52:0) after 5m33s
[09:36:43.101] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:52:0)
[09:36:43.160] Build status: STARTED
[09:36:43.160] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:53:0) after 1m37s
[09:38:20.148] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:53:0)
[09:38:20.218] Build status: STARTED
[09:38:20.218] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:54:0) after 3m44s
[09:42:04.278] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:54:0)
[09:42:04.469] Build status: STARTED
[09:42:04.469] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:55:0) after 2m51s
[09:44:55.505] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:55:0)
[09:44:55.616] Build status: STARTED
[09:44:55.616] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:56:0) after 8m16s
[09:53:11.681] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:56:0)
[09:53:11.700] Build status: STARTED
[09:53:11.700] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:57:0) after 7m38s
[10:00:49.717] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:57:0)
[10:00:49.739] Build status: STARTED
[10:00:49.739] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:58:0) after 1m1s
[10:01:50.892] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:58:0)
[10:01:50.926] Build status: STARTED
[10:01:50.926] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:59:0) after 5m16s
[10:07:06.943] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:59:0)
[10:07:07.003] Build status: STARTED
[10:07:07.003] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:60:0) after 9m13s
[10:16:20.019] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:60:0)
[10:16:20.042] Build status: STARTED
[10:16:20.042] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:61:0) after 6m28s
[10:22:48.178] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:61:0)
[10:22:48.251] Build status: STARTED
[10:22:48.251] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:62:0) after 8m50s
[10:31:38.254] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:62:0)
[10:31:38.384] Build status: STARTED
[10:31:38.384] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:63:0) after 9m43s
[10:41:21.460] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:63:0)
[10:41:21.549] Build status: STARTED
[10:41:21.549] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:64:0) after 4m9s
[10:45:30.569] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:64:0)
[10:45:30.588] Build status: STARTED
[10:45:30.588] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:65:0) after 3m56s
[10:49:26.669] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:65:0)
[10:49:26.691] Build status: STARTED
[10:49:26.691] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:66:0) after 1m0s
[10:50:26.715] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:66:0)
[10:50:26.739] Build status: STARTED
[10:50:26.739] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:67:0) after 4m45s
[10:55:11.763] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:67:0)
[10:55:11.887] Build status: STARTED
[10:55:11.887] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:68:0) after 8m16s
[11:03:27.904] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:68:0)
[11:03:27.935] Build status: STARTED
[11:03:27.935] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:69:0) after 8m26s
[11:11:53.981] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:69:0)
[11:11:54.023] Build status: STARTED
[11:11:54.023] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:70:0) after 6m28s
[11:18:22.093] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:70:0)
[11:18:22.128] Build status: STARTED
[11:18:22.128] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:71:0) after 3m30s
[11:21:52.192] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:71:0)
[11:21:52.214] Build status: STARTED
[11:21:52.214] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:72:0) after 7m39s
[11:29:31.238] Handling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:72:0)
[11:29:31.257] Build status: STARTED
[11:29:31.257] Scheduling timer "check-buildbucket-build-status" (dawn/cts-roller:8835326353117869776:73:0) after 9m15s
[11:35:35.481] Received PubSub notification, asking Buildbucket for the build status
[11:35:35.503] Build:
{
"id": "8669896290491316801",
"builder": {
"project": "dawn",
"bucket": "ci",
"builder": "cts-roller"
},
"createdBy": "project:dawn",
"createTime": "2026-09-23T05:00:04.060775863Z",
"startTime": "2026-09-23T05:00:22.664552605Z",
"endTime": "2026-09-23T11:35:35.192441904Z",
"updateTime": "2026-09-23T11:35:35.192441904Z",
"status": "FAILURE",
"input": {
}
}
[11:35:35.503] Invocation finished in 6h35m33.331548959s with status FAILED