[23:07:14.656] New invocation is queued and will start shortly
[23:07:15.782] Starting the invocation (attempt 1)
[23:07:15.808] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/527713865f4647a589a8b6f3ff5ff231fb17b8dc"
[23:07:15.808] Popped gitiles commit info from properties and tags
[23:07:15.808] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:07:15.808] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:07:15.808] Buildbucket request:
{
"requestId": "8867238681054370944",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "527713865f4647a589a8b6f3ff5ff231fb17b8dc",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8867238681054370944"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTMac"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:07:16.290] Scheduled build:
{
"id": "8701808619134414721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 38112,
"createdBy": "project:chromium",
"createTime": "2025-10-05T23:07:15.856615643Z",
"updateTime": "2025-10-05T23:07:15.856615643Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "527713865f4647a589a8b6f3ff5ff231fb17b8dc",
"ref": "refs/heads/main"
}
}
}
[23:07:16.290] Task URL: https://cr-buildbucket.appspot.com/build/8701808619134414721
[23:07:16.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:2:0) after 5m34s
[23:07:16.428] Received PubSub notification, asking Buildbucket for the build status
[23:07:16.441] Build status: SCHEDULED
[23:08:23.850] Received PubSub notification, asking Buildbucket for the build status
[23:08:23.863] Build status: STARTED
[23:12:50.406] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:2:0)
[23:12:50.422] Build status: STARTED
[23:12:50.422] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:5:0) after 5m39s
[23:18:29.456] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:5:0)
[23:18:29.472] Build status: STARTED
[23:18:29.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:6:0) after 1m48s
[23:20:17.548] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:6:0)
[23:20:17.569] Build status: STARTED
[23:20:17.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:7:0) after 3m34s
[23:23:51.589] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:7:0)
[23:23:51.609] Build status: STARTED
[23:23:51.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:8:0) after 9m1s
[23:32:52.700] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:8:0)
[23:32:52.716] Build status: STARTED
[23:32:52.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:9:0) after 3m29s
[23:36:21.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:9:0)
[23:36:21.768] Build status: STARTED
[23:36:21.768] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:10:0) after 2m18s
[23:38:39.914] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:10:0)
[23:38:39.944] Build status: STARTED
[23:38:39.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:11:0) after 4m37s
[23:43:16.960] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:11:0)
[23:43:16.980] Build status: STARTED
[23:43:16.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:12:0) after 6m59s
[23:50:16.107] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:12:0)
[23:50:16.147] Build status: STARTED
[23:50:16.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:13:0) after 6m19s
[23:56:35.122] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:13:0)
[23:56:35.137] Build status: STARTED
[23:56:35.137] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:14:0) after 5m40s
[00:02:15.153] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:14:0)
[00:02:15.166] Build status: STARTED
[00:02:15.166] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:15:0) after 5m56s
[00:08:11.323] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:15:0)
[00:08:11.346] Build status: STARTED
[00:08:11.346] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:16:0) after 9m11s
[00:17:22.358] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:16:0)
[00:17:22.414] Build status: STARTED
[00:17:22.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:17:0) after 6m56s
[00:24:18.474] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:17:0)
[00:24:18.488] Build status: STARTED
[00:24:18.488] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:18:0) after 7m36s
[00:31:54.503] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:18:0)
[00:31:54.534] Build status: STARTED
[00:31:54.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:19:0) after 9m9s
[00:41:03.551] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:19:0)
[00:41:03.565] Build status: STARTED
[00:41:03.565] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:20:0) after 3m55s
[00:44:58.654] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:20:0)
[00:44:58.669] Build status: STARTED
[00:44:58.669] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:21:0) after 3m47s
[00:48:46.031] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:21:0)
[00:48:46.047] Build status: STARTED
[00:48:46.047] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:22:0) after 5m20s
[00:54:06.094] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:22:0)
[00:54:06.115] Build status: STARTED
[00:54:06.115] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:23:0) after 7m12s
[01:01:18.159] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:23:0)
[01:01:18.179] Build status: STARTED
[01:01:18.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:24:0) after 7m55s
[01:09:13.192] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:24:0)
[01:09:13.245] Build status: STARTED
[01:09:13.245] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:25:0) after 5m49s
[01:15:02.418] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:25:0)
[01:15:02.445] Build status: STARTED
[01:15:02.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:26:0) after 4m20s
[01:19:22.463] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:26:0)
[01:19:22.486] Build status: STARTED
[01:19:22.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:27:0) after 5m11s
[01:24:33.501] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:27:0)
[01:24:33.518] Build status: STARTED
[01:24:33.518] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:28:0) after 5m53s
[01:30:26.538] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:28:0)
[01:30:26.552] Build status: STARTED
[01:30:26.552] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:29:0) after 8m19s
[01:38:45.588] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:29:0)
[01:38:45.648] Build status: STARTED
[01:38:45.648] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:30:0) after 2m12s
[01:40:57.662] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:30:0)
[01:40:57.683] Build status: STARTED
[01:40:57.684] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:31:0) after 9m7s
[01:50:04.697] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:31:0)
[01:50:04.739] Build status: STARTED
[01:50:04.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:32:0) after 5m51s
[01:55:55.754] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:32:0)
[01:55:55.776] Build status: STARTED
[01:55:55.777] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:33:0) after 3m52s
[01:59:47.809] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:33:0)
[01:59:47.826] Build status: STARTED
[01:59:47.826] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:34:0) after 1m3s
[02:00:51.096] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:34:0)
[02:00:51.117] Build status: STARTED
[02:00:51.117] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:35:0) after 3m52s
[02:04:43.131] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:35:0)
[02:04:43.305] Build status: STARTED
[02:04:43.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:36:0) after 5m16s
[02:09:59.321] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:36:0)
[02:09:59.344] Build status: STARTED
[02:09:59.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:37:0) after 3m1s
[02:13:00.363] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:37:0)
[02:13:00.427] Build status: STARTED
[02:13:00.427] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:38:0) after 1m54s
[02:14:54.439] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:38:0)
[02:14:54.463] Build status: STARTED
[02:14:54.463] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:39:0) after 5m24s
[02:20:18.477] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:39:0)
[02:20:18.587] Build status: STARTED
[02:20:18.587] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:40:0) after 1m59s
[02:22:17.751] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:40:0)
[02:22:17.765] Build status: STARTED
[02:22:17.765] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:41:0) after 6m45s
[02:29:02.777] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:41:0)
[02:29:02.789] Build status: STARTED
[02:29:02.789] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:42:0) after 3m31s
[02:32:33.866] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:42:0)
[02:32:33.887] Build status: STARTED
[02:32:33.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:43:0) after 4m21s
[02:36:55.012] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:43:0)
[02:36:55.027] Build status: STARTED
[02:36:55.027] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:44:0) after 8m39s
[02:45:34.039] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:44:0)
[02:45:34.057] Build status: STARTED
[02:45:34.057] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:45:0) after 2m16s
[02:47:50.072] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:45:0)
[02:47:50.089] Build status: STARTED
[02:47:50.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:46:0) after 7m21s
[02:55:11.109] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:46:0)
[02:55:11.127] Build status: STARTED
[02:55:11.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:47:0) after 7m56s
[03:03:07.144] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:47:0)
[03:03:07.160] Build status: STARTED
[03:03:07.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:48:0) after 2m42s
[03:05:49.341] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:48:0)
[03:05:49.356] Build status: STARTED
[03:05:49.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:49:0) after 5m31s
[03:11:20.374] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:49:0)
[03:11:20.390] Build status: STARTED
[03:11:20.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:50:0) after 3m12s
[03:14:32.981] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:50:0)
[03:14:32.996] Build status: STARTED
[03:14:32.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:51:0) after 1m14s
[03:15:47.295] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:51:0)
[03:15:47.342] Build status: STARTED
[03:15:47.342] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:52:0) after 5m39s
[03:21:26.486] Handling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:52:0)
[03:21:26.499] Build status: STARTED
[03:21:26.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTMac:8867238681054370944:53:0) after 7m13s
[03:28:11.349] Received PubSub notification, asking Buildbucket for the build status
[03:28:11.369] Build:
{
"id": "8701808619134414721",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTMac"
},
"number": 38112,
"createdBy": "project:chromium",
"createTime": "2025-10-05T23:07:15.856615643Z",
"startTime": "2025-10-05T23:08:23.373293221Z",
"endTime": "2025-10-06T03:28:05.931255990Z",
"updateTime": "2025-10-06T03:28:05.931255990Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "527713865f4647a589a8b6f3ff5ff231fb17b8dc",
"ref": "refs/heads/main"
}
}
}
[03:28:11.369] Invocation finished in 4h20m56.726976234s with status FAILED