[16:59:56.412] New invocation is queued and will start shortly
[16:59:58.341] Starting the invocation (attempt 1)
[16:59:58.373] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/c86b4bd732c3d5c1d19cc255baecf756bf11663f"
[16:59:58.373] Popped gitiles commit info from properties and tags
[16:59:58.373] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:59:58.374] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:59:58.374] Buildbucket request:
{
"requestId": "8866265223198234064",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c86b4bd732c3d5c1d19cc255baecf756bf11663f",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8866265223198234064"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:59:58.881] Scheduled build:
{
"id": "8700835160409757937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 4129,
"createdBy": "project:chromium",
"createTime": "2025-10-16T16:59:58.440312086Z",
"updateTime": "2025-10-16T16:59:58.440312086Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c86b4bd732c3d5c1d19cc255baecf756bf11663f",
"ref": "refs/heads/main"
}
}
}
[16:59:58.882] Task URL: https://cr-buildbucket.appspot.com/build/8700835160409757937
[16:59:58.882] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:2:0) after 6m13s
[16:59:59.917] Received PubSub notification, asking Buildbucket for the build status
[16:59:59.940] Build status: SCHEDULED
[17:00:52.479] Received PubSub notification, asking Buildbucket for the build status
[17:00:52.500] Build status: STARTED
[17:06:11.908] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:2:0)
[17:06:11.988] Build status: STARTED
[17:06:11.988] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:5:0) after 1m27s
[17:07:39.082] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:5:0)
[17:07:39.117] Build status: STARTED
[17:07:39.117] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:6:0) after 5m58s
[17:13:37.169] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:6:0)
[17:13:37.184] Build status: STARTED
[17:13:37.184] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:7:0) after 7m37s
[17:21:14.231] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:7:0)
[17:21:14.251] Build status: STARTED
[17:21:14.251] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:8:0) after 3m24s
[17:24:38.323] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:8:0)
[17:24:38.393] Build status: STARTED
[17:24:38.393] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:9:0) after 2m34s
[17:27:12.439] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:9:0)
[17:27:12.452] Build status: STARTED
[17:27:12.452] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:10:0) after 1m45s
[17:28:57.469] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:10:0)
[17:28:57.648] Build status: STARTED
[17:28:57.648] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:11:0) after 2m37s
[17:31:34.716] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:11:0)
[17:31:34.735] Build status: STARTED
[17:31:34.735] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:12:0) after 3m4s
[17:34:38.799] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:12:0)
[17:34:38.817] Build status: STARTED
[17:34:38.817] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:13:0) after 6m50s
[17:41:28.849] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:13:0)
[17:41:28.867] Build status: STARTED
[17:41:28.867] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:14:0) after 4m52s
[17:46:20.986] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:14:0)
[17:46:21.152] Build status: STARTED
[17:46:21.152] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:15:0) after 4m35s
[17:50:56.123] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:15:0)
[17:50:56.138] Build status: STARTED
[17:50:56.138] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:16:0) after 1m1s
[17:51:57.124] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:16:0)
[17:51:57.175] Build status: STARTED
[17:51:57.175] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:17:0) after 7m7s
[17:59:04.193] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:17:0)
[17:59:04.257] Build status: STARTED
[17:59:04.257] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:18:0) after 3m23s
[18:02:27.303] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:18:0)
[18:02:27.317] Build status: STARTED
[18:02:27.317] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:19:0) after 6m6s
[18:08:33.315] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:19:0)
[18:08:33.331] Build status: STARTED
[18:08:33.332] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:20:0) after 5m59s
[18:14:32.352] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:20:0)
[18:14:32.383] Build status: STARTED
[18:14:32.383] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:21:0) after 6m48s
[18:21:20.425] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:21:0)
[18:21:20.452] Build status: STARTED
[18:21:20.452] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:22:0) after 7m24s
[18:28:44.476] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:22:0)
[18:28:44.493] Build status: STARTED
[18:28:44.493] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:23:0) after 4m31s
[18:33:15.588] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:23:0)
[18:33:15.606] Build status: STARTED
[18:33:15.606] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:24:0) after 8m52s
[18:42:07.598] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:24:0)
[18:42:07.617] Build status: STARTED
[18:42:07.617] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:25:0) after 6m34s
[18:48:41.686] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:25:0)
[18:48:41.698] Build status: STARTED
[18:48:41.698] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:26:0) after 8m38s
[18:57:19.751] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:26:0)
[18:57:19.774] Build status: STARTED
[18:57:19.774] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:27:0) after 3m19s
[19:00:38.771] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:27:0)
[19:00:38.826] Build status: STARTED
[19:00:38.826] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:28:0) after 7m13s
[19:07:51.844] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:28:0)
[19:07:51.881] Build status: STARTED
[19:07:51.881] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:29:0) after 4m10s
[19:12:02.023] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:29:0)
[19:12:02.040] Build status: STARTED
[19:12:02.040] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:30:0) after 2m49s
[19:14:51.020] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:30:0)
[19:14:51.042] Build status: STARTED
[19:14:51.042] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:31:0) after 3m25s
[19:18:16.071] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:31:0)
[19:18:16.098] Build status: STARTED
[19:18:16.098] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:32:0) after 8m17s
[19:26:33.121] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:32:0)
[19:26:33.227] Build status: STARTED
[19:26:33.227] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:33:0) after 6m56s
[19:33:29.274] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:33:0)
[19:33:29.288] Build status: STARTED
[19:33:29.288] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:34:0) after 7m36s
[19:41:05.452] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:34:0)
[19:41:05.472] Build status: STARTED
[19:41:05.472] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:35:0) after 3m12s
[19:44:17.490] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:35:0)
[19:44:17.504] Build status: STARTED
[19:44:17.504] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:36:0) after 5m4s
[19:49:21.535] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:36:0)
[19:49:21.556] Build status: STARTED
[19:49:21.556] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:37:0) after 1m20s
[19:50:41.577] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:37:0)
[19:50:41.610] Build status: STARTED
[19:50:41.610] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:38:0) after 6m0s
[19:56:41.629] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:38:0)
[19:56:41.645] Build status: STARTED
[19:56:41.645] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:39:0) after 7m11s
[20:03:52.932] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:39:0)
[20:03:52.949] Build status: STARTED
[20:03:52.949] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:40:0) after 5m13s
[20:09:05.979] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:40:0)
[20:09:06.125] Build status: STARTED
[20:09:06.125] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:41:0) after 5m58s
[20:15:04.145] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:41:0)
[20:15:04.170] Build status: STARTED
[20:15:04.170] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:42:0) after 5m6s
[20:20:10.209] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:42:0)
[20:20:10.257] Build status: STARTED
[20:20:10.257] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:43:0) after 3m8s
[20:23:18.289] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:43:0)
[20:23:18.339] Build status: STARTED
[20:23:18.339] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:44:0) after 9m1s
[20:32:19.443] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:44:0)
[20:32:19.459] Build status: STARTED
[20:32:19.459] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:45:0) after 7m23s
[20:39:42.555] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:45:0)
[20:39:42.571] Build status: STARTED
[20:39:42.571] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:46:0) after 3m31s
[20:43:13.616] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:46:0)
[20:43:13.632] Build status: STARTED
[20:43:13.632] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:47:0) after 7m41s
[20:50:54.683] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:47:0)
[20:50:54.728] Build status: STARTED
[20:50:54.728] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:48:0) after 1m32s
[20:52:26.746] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:48:0)
[20:52:26.815] Build status: STARTED
[20:52:26.815] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:49:0) after 2m39s
[20:55:05.840] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:49:0)
[20:55:05.854] Build status: STARTED
[20:55:05.854] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:50:0) after 1m28s
[20:56:33.914] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:50:0)
[20:56:33.949] Build status: STARTED
[20:56:33.949] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:51:0) after 3m17s
[20:59:51.016] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:51:0)
[20:59:51.050] Build status: STARTED
[20:59:51.050] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:52:0) after 8m2s
[21:07:53.122] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:52:0)
[21:07:53.141] Build status: STARTED
[21:07:53.141] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:53:0) after 3m42s
[21:11:35.160] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:53:0)
[21:11:35.177] Build status: STARTED
[21:11:35.177] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:54:0) after 4m16s
[21:15:51.342] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:54:0)
[21:15:51.363] Build status: STARTED
[21:15:51.363] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:55:0) after 1m42s
[21:17:33.391] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:55:0)
[21:17:33.417] Build status: STARTED
[21:17:33.417] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:56:0) after 1m37s
[21:19:10.471] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:56:0)
[21:19:10.491] Build status: STARTED
[21:19:10.491] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:57:0) after 5m38s
[21:24:48.509] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:57:0)
[21:24:48.527] Build status: STARTED
[21:24:48.527] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:58:0) after 1m46s
[21:26:34.548] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:58:0)
[21:26:34.565] Build status: STARTED
[21:26:34.565] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8866265223198234064:59:0) after 7m9s
[21:31:35.675] Received PubSub notification, asking Buildbucket for the build status
[21:31:35.700] Build:
{
"id": "8700835160409757937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 4129,
"createdBy": "project:chromium",
"createTime": "2025-10-16T16:59:58.440312086Z",
"startTime": "2025-10-16T17:00:52.299525448Z",
"endTime": "2025-10-16T21:31:34.949569090Z",
"updateTime": "2025-10-16T21:31:34.949569090Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "c86b4bd732c3d5c1d19cc255baecf756bf11663f",
"ref": "refs/heads/main"
}
}
}
[21:31:35.700] Invocation finished in 4h31m39.302844856s with status FAILED