[04:04:54.117] New invocation is queued and will start shortly
[04:04:55.183] Starting the invocation (attempt 1)
[04:04:55.205] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d4f3282c5fe668a22249914f37a1d6bc7b776bf6"
[04:04:55.205] Popped gitiles commit info from properties and tags
[04:04:55.205] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:04:55.205] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:04:55.205] Buildbucket request:
{
"requestId": "8862327717863316400",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4f3282c5fe668a22249914f37a1d6bc7b776bf6",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8862327717863316400"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:04:55.788] Scheduled build:
{
"id": "8696897655990590369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 4391,
"createdBy": "project:chromium",
"createTime": "2025-11-29T04:04:55.276313614Z",
"updateTime": "2025-11-29T04:04:55.276313614Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4f3282c5fe668a22249914f37a1d6bc7b776bf6",
"ref": "refs/heads/main"
}
}
}
[04:04:55.789] Task URL: https://cr-buildbucket.appspot.com/build/8696897655990590369
[04:04:55.789] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:2:0) after 8m44s
[04:04:56.752] Received PubSub notification, asking Buildbucket for the build status
[04:04:56.778] Build status: SCHEDULED
[04:05:36.427] Received PubSub notification, asking Buildbucket for the build status
[04:05:36.452] Build status: STARTED
[04:13:40.280] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:2:0)
[04:13:40.313] Build status: STARTED
[04:13:40.313] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:5:0) after 6m10s
[04:19:50.319] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:5:0)
[04:19:50.333] Build status: STARTED
[04:19:50.333] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:6:0) after 5m3s
[04:24:53.346] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:6:0)
[04:24:53.407] Build status: STARTED
[04:24:53.407] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:7:0) after 8m1s
[04:32:54.558] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:7:0)
[04:32:54.660] Build status: STARTED
[04:32:54.660] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:8:0) after 6m0s
[04:38:54.894] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:8:0)
[04:38:54.908] Build status: STARTED
[04:38:54.908] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:9:0) after 5m47s
[04:44:42.043] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:9:0)
[04:44:42.070] Build status: STARTED
[04:44:42.070] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:10:0) after 3m52s
[04:48:34.325] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:10:0)
[04:48:34.354] Build status: STARTED
[04:48:34.354] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:11:0) after 3m1s
[04:51:35.368] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:11:0)
[04:51:35.390] Build status: STARTED
[04:51:35.390] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:12:0) after 5m28s
[04:57:03.548] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:12:0)
[04:57:03.661] Build status: STARTED
[04:57:03.661] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:13:0) after 6m51s
[05:03:54.806] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:13:0)
[05:03:54.823] Build status: STARTED
[05:03:54.823] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:14:0) after 4m53s
[05:08:47.981] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:14:0)
[05:08:47.994] Build status: STARTED
[05:08:47.994] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:15:0) after 2m10s
[05:10:58.128] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:15:0)
[05:10:58.145] Build status: STARTED
[05:10:58.145] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:16:0) after 5m4s
[05:16:02.176] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:16:0)
[05:16:02.195] Build status: STARTED
[05:16:02.195] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:17:0) after 4m31s
[05:20:33.162] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:17:0)
[05:20:33.191] Build status: STARTED
[05:20:33.191] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:18:0) after 2m0s
[05:22:33.306] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:18:0)
[05:22:33.403] Build status: STARTED
[05:22:33.403] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:19:0) after 4m55s
[05:27:28.418] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:19:0)
[05:27:28.439] Build status: STARTED
[05:27:28.439] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:20:0) after 4m9s
[05:31:37.476] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:20:0)
[05:31:37.492] Build status: STARTED
[05:31:37.492] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:21:0) after 1m18s
[05:32:55.500] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:21:0)
[05:32:55.531] Build status: STARTED
[05:32:55.531] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:22:0) after 5m48s
[05:38:43.546] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:22:0)
[05:38:43.589] Build status: STARTED
[05:38:43.589] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:23:0) after 3m11s
[05:41:54.721] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:23:0)
[05:41:54.733] Build status: STARTED
[05:41:54.733] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:24:0) after 1m7s
[05:43:01.756] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:24:0)
[05:43:01.771] Build status: STARTED
[05:43:01.771] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:25:0) after 9m9s
[05:52:10.922] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:25:0)
[05:52:11.198] Build status: STARTED
[05:52:11.198] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:26:0) after 5m9s
[05:57:20.372] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:26:0)
[05:57:20.387] Build status: STARTED
[05:57:20.387] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:27:0) after 1m54s
[05:59:14.401] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:27:0)
[05:59:14.422] Build status: STARTED
[05:59:14.422] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:28:0) after 2m3s
[06:01:17.504] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:28:0)
[06:01:17.521] Build status: STARTED
[06:01:17.521] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:29:0) after 3m50s
[06:05:07.633] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:29:0)
[06:05:07.693] Build status: STARTED
[06:05:07.693] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:30:0) after 6m45s
[06:11:52.796] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:30:0)
[06:11:52.810] Build status: STARTED
[06:11:52.810] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:31:0) after 9m27s
[06:21:19.878] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:31:0)
[06:21:19.894] Build status: STARTED
[06:21:19.895] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:32:0) after 2m40s
[06:23:59.937] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:32:0)
[06:23:59.950] Build status: STARTED
[06:23:59.951] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:33:0) after 7m15s
[06:31:15.288] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:33:0)
[06:31:15.309] Build status: STARTED
[06:31:15.309] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:34:0) after 7m59s
[06:39:14.455] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:34:0)
[06:39:14.478] Build status: STARTED
[06:39:14.478] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:35:0) after 8m0s
[06:47:14.596] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:35:0)
[06:47:14.609] Build status: STARTED
[06:47:14.609] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:36:0) after 7m38s
[06:54:52.840] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:36:0)
[06:54:52.854] Build status: STARTED
[06:54:52.854] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:37:0) after 7m29s
[07:02:21.871] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:37:0)
[07:02:21.883] Build status: STARTED
[07:02:21.883] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:38:0) after 2m20s
[07:04:41.899] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:38:0)
[07:04:41.914] Build status: STARTED
[07:04:41.914] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:39:0) after 2m21s
[07:07:02.927] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:39:0)
[07:07:02.950] Build status: STARTED
[07:07:02.950] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:40:0) after 8m26s
[07:15:28.969] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:40:0)
[07:15:29.005] Build status: STARTED
[07:15:29.005] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:41:0) after 6m5s
[07:21:34.018] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:41:0)
[07:21:34.056] Build status: STARTED
[07:21:34.056] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:42:0) after 2m43s
[07:24:17.067] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:42:0)
[07:24:17.082] Build status: STARTED
[07:24:17.082] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:43:0) after 7m34s
[07:31:51.094] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:43:0)
[07:31:51.107] Build status: STARTED
[07:31:51.107] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:44:0) after 4m36s
[07:36:27.187] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:44:0)
[07:36:27.207] Build status: STARTED
[07:36:27.207] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:45:0) after 5m20s
[07:41:47.234] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:45:0)
[07:41:47.255] Build status: STARTED
[07:41:47.255] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:46:0) after 7m36s
[07:49:23.294] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:46:0)
[07:49:23.307] Build status: STARTED
[07:49:23.307] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:47:0) after 7m29s
[07:56:52.319] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:47:0)
[07:56:52.344] Build status: STARTED
[07:56:52.344] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:48:0) after 4m51s
[08:01:43.460] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:48:0)
[08:01:43.478] Build status: STARTED
[08:01:43.478] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:49:0) after 5m43s
[08:07:26.491] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:49:0)
[08:07:26.516] Build status: STARTED
[08:07:26.516] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8862327717863316400:50:0) after 5m36s
[08:12:09.776] Received PubSub notification, asking Buildbucket for the build status
[08:12:09.805] Build:
{
"id": "8696897655990590369",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 4391,
"createdBy": "project:chromium",
"createTime": "2025-11-29T04:04:55.276313614Z",
"startTime": "2025-11-29T04:05:36.290160009Z",
"endTime": "2025-11-29T08:12:08.773098625Z",
"updateTime": "2025-11-29T08:12:08.773098625Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d4f3282c5fe668a22249914f37a1d6bc7b776bf6",
"ref": "refs/heads/main"
}
}
}
[08:12:09.805] Invocation finished in 4h7m15.69950463s with status FAILED