[21:35:52.401] New invocation is queued and will start shortly
[21:35:52.401] Triggered by user:rerunner@pigweed-service-accounts.iam.gserviceaccount.com
[21:35:53.678] Starting the invocation (attempt 1)
[21:35:53.705] Ignoring gitiles_ref tag without the buildset tag
[21:35:53.705] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:35:53.706] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:35:53.706] Buildbucket request:
{
"requestId": "8863711147923643776",
"builder": {
"project": "pigweed",
"bucket": "examples.dev.ci",
"builder": "examples-envtest-mac"
},
"properties": {
"$recipe_engine/scheduler": {
"hostname": "luci-scheduler.appspot.com",
"invocation": "8863711147923643776",
"job": "pigweed/examples.dev.ci-examples-envtest-mac",
"triggers": [
{
"buildbucket": {
"tags": [
"parent_buildername:rerunner",
"user_agent:rerunner"
]
},
"id": "10800c4d-0102-4d91-aac6-f9c3a24f43a1",
"title": "rerunner/0",
"url": "https://cr-buildbucket.appspot.com/build/8698281308059733521"
}
]
}
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8863711147923643776"
},
{
"key": "scheduler_job_id",
"value": "pigweed/examples.dev.ci-examples-envtest-mac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
},
{
"key": "parent_buildername",
"value": "rerunner"
},
{
"key": "user_agent",
"value": "rerunner"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:35:54.034] Scheduled build:
{
"id": "8698281085833539761",
"builder": {
"project": "pigweed",
"bucket": "examples.dev.ci",
"builder": "examples-envtest-mac"
},
"createdBy": "project:pigweed",
"createTime": "2025-11-13T21:35:53.766955348Z",
"updateTime": "2025-11-13T21:35:53.766955348Z",
"status": "SCHEDULED",
"input": {
},
"canary": true
}
[21:35:54.034] Task URL: https://cr-buildbucket.appspot.com/build/8698281085833539761
[21:35:54.034] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:2:0) after 7m51s
[21:35:54.967] Received PubSub notification, asking Buildbucket for the build status
[21:35:54.996] Build status: SCHEDULED
[21:43:45.057] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:2:0)
[21:43:45.078] Build status: SCHEDULED
[21:43:45.078] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:4:0) after 4m9s
[21:47:54.143] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:4:0)
[21:47:54.164] Build status: SCHEDULED
[21:47:54.164] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:5:0) after 7m56s
[21:55:50.268] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:5:0)
[21:55:50.297] Build status: SCHEDULED
[21:55:50.297] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:6:0) after 3m25s
[21:59:15.334] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:6:0)
[21:59:15.351] Build status: SCHEDULED
[21:59:15.351] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:7:0) after 3m40s
[22:02:55.361] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:7:0)
[22:02:55.389] Build status: SCHEDULED
[22:02:55.389] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:8:0) after 9m57s
[22:12:52.381] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:8:0)
[22:12:52.411] Build status: SCHEDULED
[22:12:52.411] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:9:0) after 3m22s
[22:16:14.441] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:9:0)
[22:16:14.460] Build status: SCHEDULED
[22:16:14.460] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:10:0) after 2m28s
[22:18:42.472] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:10:0)
[22:18:42.546] Build status: SCHEDULED
[22:18:42.546] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:11:0) after 3m52s
[22:22:34.587] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:11:0)
[22:22:34.606] Build status: SCHEDULED
[22:22:34.606] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:12:0) after 9m4s
[22:31:38.810] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:12:0)
[22:31:38.824] Build status: SCHEDULED
[22:31:38.825] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:13:0) after 4m18s
[22:35:56.988] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:13:0)
[22:35:57.004] Build status: SCHEDULED
[22:35:57.004] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:14:0) after 7m2s
[22:42:59.015] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:14:0)
[22:42:59.052] Build status: SCHEDULED
[22:42:59.052] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:15:0) after 6m31s
[22:49:30.063] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:15:0)
[22:49:30.085] Build status: SCHEDULED
[22:49:30.085] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:16:0) after 1m23s
[22:50:53.148] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:16:0)
[22:50:53.186] Build status: SCHEDULED
[22:50:53.186] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:17:0) after 7m46s
[22:58:39.204] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:17:0)
[22:58:39.220] Build status: SCHEDULED
[22:58:39.220] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:18:0) after 1m39s
[23:00:18.233] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:18:0)
[23:00:18.385] Build status: SCHEDULED
[23:00:18.385] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:19:0) after 9m31s
[23:09:49.441] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:19:0)
[23:09:49.461] Build status: SCHEDULED
[23:09:49.461] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:20:0) after 7m28s
[23:17:17.475] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:20:0)
[23:17:17.534] Build status: SCHEDULED
[23:17:17.534] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:21:0) after 8m21s
[23:25:38.625] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:21:0)
[23:25:38.641] Build status: SCHEDULED
[23:25:38.641] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:22:0) after 2m16s
[23:27:54.704] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:22:0)
[23:27:54.741] Build status: SCHEDULED
[23:27:54.741] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:23:0) after 1m55s
[23:29:49.754] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:23:0)
[23:29:49.768] Build status: SCHEDULED
[23:29:49.768] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:24:0) after 2m16s
[23:32:05.779] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:24:0)
[23:32:05.801] Build status: SCHEDULED
[23:32:05.801] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:25:0) after 7m11s
[23:39:16.943] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:25:0)
[23:39:16.959] Build status: SCHEDULED
[23:39:16.960] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:26:0) after 2m43s
[23:41:59.973] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:26:0)
[23:41:59.998] Build status: SCHEDULED
[23:41:59.999] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:27:0) after 5m53s
[23:47:53.071] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:27:0)
[23:47:53.088] Build status: SCHEDULED
[23:47:53.088] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:28:0) after 1m35s
[23:49:28.104] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:28:0)
[23:49:28.127] Build status: SCHEDULED
[23:49:28.127] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:29:0) after 5m23s
[23:54:51.168] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:29:0)
[23:54:51.199] Build status: SCHEDULED
[23:54:51.199] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:30:0) after 5m56s
[00:00:47.262] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:30:0)
[00:00:47.289] Build status: SCHEDULED
[00:00:47.289] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:31:0) after 4m57s
[00:05:44.345] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:31:0)
[00:05:44.391] Build status: SCHEDULED
[00:05:44.391] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:32:0) after 6m49s
[00:12:33.557] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:32:0)
[00:12:33.576] Build status: SCHEDULED
[00:12:33.576] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:33:0) after 2m17s
[00:14:50.770] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:33:0)
[00:14:50.786] Build status: SCHEDULED
[00:14:50.786] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:34:0) after 4m15s
[00:19:05.839] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:34:0)
[00:19:05.871] Build status: SCHEDULED
[00:19:05.871] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:35:0) after 4m17s
[00:23:22.890] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:35:0)
[00:23:22.928] Build status: SCHEDULED
[00:23:22.928] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:36:0) after 4m33s
[00:27:55.976] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:36:0)
[00:27:56.004] Build status: SCHEDULED
[00:27:56.004] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:37:0) after 8m2s
[00:35:58.069] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:37:0)
[00:35:58.085] Build status: SCHEDULED
[00:35:58.086] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:38:0) after 5m45s
[00:41:43.150] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:38:0)
[00:41:43.177] Build status: SCHEDULED
[00:41:43.177] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:39:0) after 2m56s
[00:44:39.193] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:39:0)
[00:44:39.216] Build status: SCHEDULED
[00:44:39.216] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:40:0) after 5m22s
[00:50:01.231] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:40:0)
[00:50:01.255] Build status: SCHEDULED
[00:50:01.255] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:41:0) after 2m32s
[00:52:33.288] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:41:0)
[00:52:33.305] Build status: SCHEDULED
[00:52:33.305] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:42:0) after 6m38s
[00:59:11.354] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:42:0)
[00:59:11.371] Build status: SCHEDULED
[00:59:11.371] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:43:0) after 8m45s
[01:07:56.525] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:43:0)
[01:07:56.543] Build status: SCHEDULED
[01:07:56.543] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:44:0) after 5m50s
[01:13:46.607] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:44:0)
[01:13:46.623] Build status: SCHEDULED
[01:13:46.623] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:45:0) after 5m54s
[01:19:40.636] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:45:0)
[01:19:40.655] Build status: SCHEDULED
[01:19:40.655] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:46:0) after 1m5s
[01:20:45.670] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:46:0)
[01:20:45.687] Build status: SCHEDULED
[01:20:45.687] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:47:0) after 1m39s
[01:22:24.704] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:47:0)
[01:22:24.718] Build status: SCHEDULED
[01:22:24.718] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:48:0) after 5m55s
[01:28:19.809] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:48:0)
[01:28:19.832] Build status: SCHEDULED
[01:28:19.832] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:49:0) after 2m55s
[01:31:14.847] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:49:0)
[01:31:14.865] Build status: SCHEDULED
[01:31:14.865] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:50:0) after 2m15s
[01:33:29.920] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:50:0)
[01:33:29.941] Build status: SCHEDULED
[01:33:29.941] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:51:0) after 7m2s
[01:40:31.939] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:51:0)
[01:40:31.955] Build status: SCHEDULED
[01:40:31.956] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:52:0) after 8m5s
[01:48:37.110] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:52:0)
[01:48:37.131] Build status: SCHEDULED
[01:48:37.131] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:53:0) after 8m45s
[01:57:22.143] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:53:0)
[01:57:22.163] Build status: SCHEDULED
[01:57:22.163] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:54:0) after 1m52s
[01:59:14.231] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:54:0)
[01:59:14.249] Build status: SCHEDULED
[01:59:14.249] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:55:0) after 7m12s
[02:06:26.262] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:55:0)
[02:06:26.290] Build status: SCHEDULED
[02:06:26.290] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:56:0) after 5m22s
[02:11:48.356] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:56:0)
[02:11:48.377] Build status: SCHEDULED
[02:11:48.377] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:57:0) after 5m39s
[02:17:27.430] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:57:0)
[02:17:27.459] Build status: SCHEDULED
[02:17:27.459] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:58:0) after 9m39s
[02:27:06.524] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:58:0)
[02:27:06.540] Build status: SCHEDULED
[02:27:06.540] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:59:0) after 7m12s
[02:34:18.553] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:59:0)
[02:34:18.572] Build status: SCHEDULED
[02:34:18.572] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:60:0) after 5m3s
[02:39:21.589] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:60:0)
[02:39:21.679] Build status: SCHEDULED
[02:39:21.679] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:61:0) after 6m20s
[02:45:41.744] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:61:0)
[02:45:41.762] Build status: SCHEDULED
[02:45:41.762] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:62:0) after 1m48s
[02:47:29.759] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:62:0)
[02:47:29.777] Build status: SCHEDULED
[02:47:29.777] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:63:0) after 8m22s
[02:55:51.802] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:63:0)
[02:55:51.818] Build status: SCHEDULED
[02:55:51.818] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:64:0) after 2m20s
[02:58:11.832] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:64:0)
[02:58:11.859] Build status: SCHEDULED
[02:58:11.859] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:65:0) after 9m58s
[03:08:10.104] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:65:0)
[03:08:10.182] Build status: SCHEDULED
[03:08:10.182] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:66:0) after 8m51s
[03:17:01.463] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:66:0)
[03:17:01.478] Build status: SCHEDULED
[03:17:01.478] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:67:0) after 5m28s
[03:22:29.551] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:67:0)
[03:22:29.569] Build status: SCHEDULED
[03:22:29.569] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:68:0) after 9m0s
[03:31:29.687] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:68:0)
[03:31:29.703] Build status: SCHEDULED
[03:31:29.703] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:69:0) after 8m8s
[03:39:37.858] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:69:0)
[03:39:37.873] Build status: SCHEDULED
[03:39:37.873] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:70:0) after 9m1s
[03:48:39.287] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:70:0)
[03:48:39.305] Build status: SCHEDULED
[03:48:39.305] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:71:0) after 1m53s
[03:50:32.320] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:71:0)
[03:50:32.354] Build status: SCHEDULED
[03:50:32.355] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:72:0) after 5m7s
[03:55:39.373] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:72:0)
[03:55:39.395] Build status: SCHEDULED
[03:55:39.395] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:73:0) after 7m41s
[04:03:20.786] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:73:0)
[04:03:20.807] Build status: SCHEDULED
[04:03:20.807] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:74:0) after 9m51s
[04:13:11.912] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:74:0)
[04:13:11.931] Build status: SCHEDULED
[04:13:11.931] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:75:0) after 9m46s
[04:22:57.971] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:75:0)
[04:22:58.141] Build status: SCHEDULED
[04:22:58.141] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:76:0) after 3m11s
[04:26:09.207] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:76:0)
[04:26:09.223] Build status: SCHEDULED
[04:26:09.223] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:77:0) after 4m34s
[04:30:43.301] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:77:0)
[04:30:43.316] Build status: SCHEDULED
[04:30:43.316] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:78:0) after 6m49s
[04:37:32.350] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:78:0)
[04:37:32.425] Build status: SCHEDULED
[04:37:32.425] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:79:0) after 9m43s
[04:47:15.490] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:79:0)
[04:47:15.551] Build status: SCHEDULED
[04:47:15.551] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:80:0) after 6m35s
[04:53:50.616] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:80:0)
[04:53:50.633] Build status: SCHEDULED
[04:53:50.633] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:81:0) after 1m3s
[04:54:53.615] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:81:0)
[04:54:53.634] Build status: SCHEDULED
[04:54:53.634] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:82:0) after 2m4s
[04:56:57.706] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:82:0)
[04:56:57.721] Build status: SCHEDULED
[04:56:57.722] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:83:0) after 9m29s
[05:06:26.741] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:83:0)
[05:06:26.756] Build status: SCHEDULED
[05:06:26.756] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:84:0) after 4m20s
[05:10:46.772] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:84:0)
[05:10:46.802] Build status: SCHEDULED
[05:10:46.802] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:85:0) after 1m46s
[05:12:32.817] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:85:0)
[05:12:32.832] Build status: SCHEDULED
[05:12:32.832] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:86:0) after 8m20s
[05:20:52.849] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:86:0)
[05:20:52.867] Build status: SCHEDULED
[05:20:52.867] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:87:0) after 2m39s
[05:23:31.921] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:87:0)
[05:23:31.953] Build status: SCHEDULED
[05:23:31.953] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:88:0) after 4m29s
[05:28:00.970] Handling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:88:0)
[05:28:01.006] Build status: SCHEDULED
[05:28:01.006] Scheduling timer "check-buildbucket-build-status" (pigweed/examples.dev.ci-examples-envtest-mac:8863711147923643776:89:0) after 7m6s
[05:29:43.747] Received PubSub notification, asking Buildbucket for the build status
[05:29:43.797] Build status: STARTED
[05:31:19.101] Received PubSub notification, asking Buildbucket for the build status
[05:31:19.116] Build:
{
"id": "8698281085833539761",
"builder": {
"project": "pigweed",
"bucket": "examples.dev.ci",
"builder": "examples-envtest-mac"
},
"createdBy": "project:pigweed",
"createTime": "2025-11-13T21:35:53.766955348Z",
"startTime": "2025-11-14T05:29:43.319564706Z",
"endTime": "2025-11-14T05:31:18.562966097Z",
"updateTime": "2025-11-14T05:31:18.562966097Z",
"status": "INFRA_FAILURE",
"input": {
},
"canary": true
}
[05:31:19.116] Invocation finished in 7h55m26.727123973s with status FAILED