[23:27:28.270] New invocation is queued and will start shortly
[23:27:30.549] Starting the invocation (attempt 1)
[23:27:30.586] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/f85cc55b19b31a22474c737e83efd73056817f49"
[23:27:30.587] Popped gitiles commit info from properties and tags
[23:27:30.587] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:27:30.587] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:27:30.587] Buildbucket request:
{
"requestId": "8873216808268815872",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f85cc55b19b31a22474c737e83efd73056817f49",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8873216808268815872"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:27:31.200] Scheduled build:
{
"id": "8707786745112571521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 3591,
"createdBy": "project:chromium",
"createTime": "2025-07-31T23:27:30.651688097Z",
"updateTime": "2025-07-31T23:27:30.651688097Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f85cc55b19b31a22474c737e83efd73056817f49",
"ref": "refs/heads/main"
}
}
}
[23:27:31.200] Task URL: https://cr-buildbucket.appspot.com/build/8707786745112571521
[23:27:31.200] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:2:0) after 7m22s
[23:27:32.178] Received PubSub notification, asking Buildbucket for the build status
[23:27:32.192] Build status: SCHEDULED
[23:28:11.178] Received PubSub notification, asking Buildbucket for the build status
[23:28:11.209] Build status: STARTED
[23:34:53.241] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:2:0)
[23:34:53.258] Build status: STARTED
[23:34:53.258] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:5:0) after 8m14s
[23:43:07.302] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:5:0)
[23:43:07.325] Build status: STARTED
[23:43:07.325] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:6:0) after 3m44s
[23:46:51.347] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:6:0)
[23:46:51.382] Build status: STARTED
[23:46:51.382] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:7:0) after 5m2s
[23:51:53.395] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:7:0)
[23:51:53.417] Build status: STARTED
[23:51:53.418] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:8:0) after 2m19s
[23:54:12.677] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:8:0)
[23:54:12.830] Build status: STARTED
[23:54:12.830] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:9:0) after 9m59s
[00:04:11.868] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:9:0)
[00:04:11.881] Build status: STARTED
[00:04:11.881] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:10:0) after 5m25s
[00:09:36.931] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:10:0)
[00:09:36.950] Build status: STARTED
[00:09:36.950] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:11:0) after 1m1s
[00:10:37.996] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:11:0)
[00:10:38.015] Build status: STARTED
[00:10:38.015] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:12:0) after 4m46s
[00:15:24.070] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:12:0)
[00:15:24.086] Build status: STARTED
[00:15:24.086] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:13:0) after 1m30s
[00:16:54.153] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:13:0)
[00:16:54.178] Build status: STARTED
[00:16:54.178] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:14:0) after 8m1s
[00:24:55.230] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:14:0)
[00:24:55.250] Build status: STARTED
[00:24:55.250] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:15:0) after 6m14s
[00:31:09.278] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:15:0)
[00:31:09.313] Build status: STARTED
[00:31:09.313] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:16:0) after 9m8s
[00:40:17.342] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:16:0)
[00:40:17.406] Build status: STARTED
[00:40:17.406] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:17:0) after 5m32s
[00:45:49.431] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:17:0)
[00:45:49.463] Build status: STARTED
[00:45:49.463] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:18:0) after 3m42s
[00:49:31.611] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:18:0)
[00:49:31.632] Build status: STARTED
[00:49:31.632] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:19:0) after 6m43s
[00:56:14.660] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:19:0)
[00:56:14.678] Build status: STARTED
[00:56:14.678] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:20:0) after 7m10s
[01:03:24.804] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:20:0)
[01:03:24.830] Build status: STARTED
[01:03:24.830] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:21:0) after 8m16s
[01:11:40.813] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:21:0)
[01:11:40.830] Build status: STARTED
[01:11:40.830] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:22:0) after 4m14s
[01:15:54.858] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:22:0)
[01:15:54.879] Build status: STARTED
[01:15:54.879] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:23:0) after 2m16s
[01:18:10.949] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:23:0)
[01:18:10.980] Build status: STARTED
[01:18:10.980] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:24:0) after 1m42s
[01:19:53.005] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:24:0)
[01:19:53.065] Build status: STARTED
[01:19:53.065] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:25:0) after 2m57s
[01:22:50.094] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:25:0)
[01:22:50.112] Build status: STARTED
[01:22:50.112] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:26:0) after 7m27s
[01:30:17.144] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:26:0)
[01:30:17.164] Build status: STARTED
[01:30:17.164] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:27:0) after 1m25s
[01:31:42.299] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:27:0)
[01:31:42.324] Build status: STARTED
[01:31:42.324] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:28:0) after 4m53s
[01:36:35.354] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:28:0)
[01:36:35.388] Build status: STARTED
[01:36:35.388] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:29:0) after 6m8s
[01:42:43.416] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:29:0)
[01:42:43.539] Build status: STARTED
[01:42:43.540] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:30:0) after 9m2s
[01:51:45.881] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:30:0)
[01:51:45.910] Build status: STARTED
[01:51:45.910] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:31:0) after 8m52s
[02:00:37.933] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:31:0)
[02:00:37.980] Build status: STARTED
[02:00:37.980] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:32:0) after 9m25s
[02:10:03.211] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:32:0)
[02:10:03.240] Build status: STARTED
[02:10:03.240] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:33:0) after 8m16s
[02:18:19.478] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:33:0)
[02:18:19.503] Build status: STARTED
[02:18:19.503] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:34:0) after 1m31s
[02:19:50.704] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:34:0)
[02:19:50.720] Build status: STARTED
[02:19:50.720] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:35:0) after 8m47s
[02:28:37.747] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:35:0)
[02:28:37.785] Build status: STARTED
[02:28:37.785] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:36:0) after 4m49s
[02:33:26.806] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:36:0)
[02:33:26.831] Build status: STARTED
[02:33:26.831] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:37:0) after 6m33s
[02:39:59.901] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:37:0)
[02:39:59.920] Build status: STARTED
[02:39:59.920] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:38:0) after 3m6s
[02:43:05.953] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:38:0)
[02:43:05.972] Build status: STARTED
[02:43:05.972] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:39:0) after 1m45s
[02:44:51.001] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:39:0)
[02:44:51.026] Build status: STARTED
[02:44:51.026] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:40:0) after 8m16s
[02:53:08.302] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:40:0)
[02:53:08.320] Build status: STARTED
[02:53:08.320] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:41:0) after 3m30s
[02:56:38.351] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:41:0)
[02:56:38.373] Build status: STARTED
[02:56:38.373] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:42:0) after 5m6s
[03:01:44.423] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:42:0)
[03:01:44.441] Build status: STARTED
[03:01:44.441] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:43:0) after 6m28s
[03:08:12.503] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:43:0)
[03:08:12.522] Build status: STARTED
[03:08:12.522] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:44:0) after 5m5s
[03:13:17.536] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:44:0)
[03:13:17.554] Build status: STARTED
[03:13:17.555] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:45:0) after 8m51s
[03:22:08.581] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:45:0)
[03:22:08.605] Build status: STARTED
[03:22:08.605] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:46:0) after 5m25s
[03:27:33.632] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:46:0)
[03:27:33.649] Build status: STARTED
[03:27:33.649] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:47:0) after 4m52s
[03:32:25.712] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:47:0)
[03:32:25.732] Build status: STARTED
[03:32:25.732] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:48:0) after 7m3s
[03:39:28.764] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:48:0)
[03:39:28.783] Build status: STARTED
[03:39:28.783] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:49:0) after 6m57s
[03:46:25.815] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:49:0)
[03:46:25.833] Build status: STARTED
[03:46:25.833] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:50:0) after 5m45s
[03:52:10.942] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:50:0)
[03:52:10.961] Build status: STARTED
[03:52:10.961] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:51:0) after 5m19s
[03:57:30.035] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:51:0)
[03:57:30.056] Build status: STARTED
[03:57:30.056] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:52:0) after 1m13s
[03:58:43.132] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:52:0)
[03:58:43.157] Build status: STARTED
[03:58:43.157] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8873216808268815872:53:0) after 6m20s
[03:59:16.223] Received PubSub notification, asking Buildbucket for the build status
[03:59:16.246] Build:
{
"id": "8707786745112571521",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 3591,
"createdBy": "project:chromium",
"createTime": "2025-07-31T23:27:30.651688097Z",
"startTime": "2025-07-31T23:28:10.976293757Z",
"endTime": "2025-08-01T03:59:15.657271267Z",
"updateTime": "2025-08-01T03:59:15.657271267Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "f85cc55b19b31a22474c737e83efd73056817f49",
"ref": "refs/heads/main"
}
}
}
[03:59:16.246] Invocation finished in 4h31m47.989188508s with status FAILED