[23:15:47.738] New invocation is queued and will start shortly
[23:15:49.051] Starting the invocation (attempt 1)
[23:15:49.076] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/81bc0fcf320574a7b7e0f9f41da7b83a868af95a"
[23:15:49.076] Popped gitiles commit info from properties and tags
[23:15:49.076] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:15:49.076] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:15:49.077] Buildbucket request:
{
"requestId": "8857272476740569024",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "81bc0fcf320574a7b7e0f9f41da7b83a868af95a",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8857272476740569024"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:15:49.669] Scheduled build:
{
"id": "8691842414600380705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 4689,
"createdBy": "project:chromium",
"createTime": "2026-01-23T23:15:49.153287504Z",
"updateTime": "2026-01-23T23:15:49.153287504Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "81bc0fcf320574a7b7e0f9f41da7b83a868af95a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[23:15:49.669] Task URL: https://cr-buildbucket.appspot.com/build/8691842414600380705
[23:15:49.669] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:2:0) after 3m59s
[23:15:50.798] Received PubSub notification, asking Buildbucket for the build status
[23:15:50.814] Build status: SCHEDULED
[23:16:38.813] Received PubSub notification, asking Buildbucket for the build status
[23:16:38.827] Build status: STARTED
[23:19:48.707] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:2:0)
[23:19:48.733] Build status: STARTED
[23:19:48.733] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:5:0) after 6m45s
[23:26:33.750] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:5:0)
[23:26:33.766] Build status: STARTED
[23:26:33.766] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:6:0) after 6m39s
[23:33:12.836] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:6:0)
[23:33:12.860] Build status: STARTED
[23:33:12.860] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:7:0) after 1m37s
[23:34:49.838] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:7:0)
[23:34:49.858] Build status: STARTED
[23:34:49.858] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:8:0) after 1m19s
[23:36:08.877] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:8:0)
[23:36:08.903] Build status: STARTED
[23:36:08.903] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:9:0) after 9m25s
[23:45:33.985] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:9:0)
[23:45:34.014] Build status: STARTED
[23:45:34.015] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:10:0) after 5m5s
[23:50:39.059] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:10:0)
[23:50:39.099] Build status: STARTED
[23:50:39.099] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:11:0) after 5m38s
[23:56:17.126] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:11:0)
[23:56:17.196] Build status: STARTED
[23:56:17.196] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:12:0) after 7m48s
[00:04:05.337] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:12:0)
[00:04:05.388] Build status: STARTED
[00:04:05.388] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:13:0) after 3m21s
[00:07:26.377] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:13:0)
[00:07:26.399] Build status: STARTED
[00:07:26.399] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:14:0) after 5m45s
[00:13:11.420] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:14:0)
[00:13:11.441] Build status: STARTED
[00:13:11.441] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:15:0) after 1m16s
[00:14:27.574] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:15:0)
[00:14:27.587] Build status: STARTED
[00:14:27.587] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:16:0) after 4m37s
[00:19:04.596] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:16:0)
[00:19:04.619] Build status: STARTED
[00:19:04.619] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:17:0) after 9m47s
[00:28:51.672] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:17:0)
[00:28:51.699] Build status: STARTED
[00:28:51.699] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:18:0) after 5m24s
[00:34:15.749] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:18:0)
[00:34:15.761] Build status: STARTED
[00:34:15.761] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:19:0) after 1m39s
[00:35:54.851] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:19:0)
[00:35:54.866] Build status: STARTED
[00:35:54.866] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:20:0) after 9m51s
[00:45:45.937] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:20:0)
[00:45:46.019] Build status: STARTED
[00:45:46.019] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:21:0) after 9m0s
[00:54:46.087] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:21:0)
[00:54:46.102] Build status: STARTED
[00:54:46.102] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:22:0) after 5m21s
[01:00:07.122] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:22:0)
[01:00:07.196] Build status: STARTED
[01:00:07.196] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:23:0) after 3m26s
[01:03:33.221] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:23:0)
[01:03:33.242] Build status: STARTED
[01:03:33.242] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:24:0) after 4m4s
[01:07:37.317] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:24:0)
[01:07:37.406] Build status: STARTED
[01:07:37.407] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:25:0) after 2m2s
[01:09:39.426] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:25:0)
[01:09:39.438] Build status: STARTED
[01:09:39.438] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:26:0) after 2m55s
[01:12:34.484] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:26:0)
[01:12:34.542] Build status: STARTED
[01:12:34.542] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:27:0) after 4m54s
[01:17:28.620] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:27:0)
[01:17:28.635] Build status: STARTED
[01:17:28.635] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:28:0) after 3m5s
[01:20:33.702] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:28:0)
[01:20:33.718] Build status: STARTED
[01:20:33.718] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:29:0) after 6m12s
[01:26:45.789] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:29:0)
[01:26:45.802] Build status: STARTED
[01:26:45.802] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:30:0) after 1m9s
[01:27:54.888] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:30:0)
[01:27:54.906] Build status: STARTED
[01:27:54.906] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:31:0) after 8m15s
[01:36:09.927] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:31:0)
[01:36:09.942] Build status: STARTED
[01:36:09.942] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:32:0) after 8m38s
[01:44:47.973] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:32:0)
[01:44:47.997] Build status: STARTED
[01:44:47.997] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:33:0) after 6m24s
[01:51:12.095] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:33:0)
[01:51:12.113] Build status: STARTED
[01:51:12.114] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:34:0) after 2m2s
[01:53:14.185] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:34:0)
[01:53:14.534] Build status: STARTED
[01:53:14.534] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:35:0) after 5m56s
[01:59:10.577] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:35:0)
[01:59:10.596] Build status: STARTED
[01:59:10.596] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:36:0) after 1m19s
[02:00:29.620] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:36:0)
[02:00:29.636] Build status: STARTED
[02:00:29.636] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:37:0) after 7m24s
[02:07:53.694] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:37:0)
[02:07:53.804] Build status: STARTED
[02:07:53.804] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:38:0) after 1m15s
[02:09:08.873] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:38:0)
[02:09:08.886] Build status: STARTED
[02:09:08.886] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:39:0) after 7m8s
[02:16:16.962] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:39:0)
[02:16:16.982] Build status: STARTED
[02:16:16.982] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:40:0) after 4m19s
[02:20:36.057] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:40:0)
[02:20:36.073] Build status: STARTED
[02:20:36.073] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:41:0) after 7m29s
[02:28:05.234] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:41:0)
[02:28:05.285] Build status: STARTED
[02:28:05.285] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:42:0) after 4m11s
[02:32:16.336] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:42:0)
[02:32:16.395] Build status: STARTED
[02:32:16.395] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:43:0) after 4m15s
[02:36:31.420] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:43:0)
[02:36:31.433] Build status: STARTED
[02:36:31.433] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:44:0) after 6m38s
[02:43:09.457] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:44:0)
[02:43:09.473] Build status: STARTED
[02:43:09.473] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:45:0) after 2m14s
[02:45:23.499] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:45:0)
[02:45:23.516] Build status: STARTED
[02:45:23.516] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:46:0) after 3m25s
[02:48:48.660] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:46:0)
[02:48:48.677] Build status: STARTED
[02:48:48.677] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:47:0) after 3m21s
[02:52:09.753] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:47:0)
[02:52:09.784] Build status: STARTED
[02:52:09.784] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:48:0) after 8m46s
[03:00:55.826] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:48:0)
[03:00:55.899] Build status: STARTED
[03:00:55.899] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:49:0) after 6m1s
[03:06:56.923] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:49:0)
[03:06:57.104] Build status: STARTED
[03:06:57.104] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:50:0) after 2m51s
[03:09:48.162] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:50:0)
[03:09:48.176] Build status: STARTED
[03:09:48.176] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:51:0) after 9m42s
[03:19:30.149] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:51:0)
[03:19:30.163] Build status: STARTED
[03:19:30.163] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:52:0) after 9m14s
[03:28:44.261] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:52:0)
[03:28:44.277] Build status: STARTED
[03:28:44.277] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:53:0) after 7m30s
[03:36:14.408] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:53:0)
[03:36:14.420] Build status: STARTED
[03:36:14.421] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:54:0) after 1m33s
[03:37:47.444] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:54:0)
[03:37:47.467] Build status: STARTED
[03:37:47.467] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:55:0) after 7m55s
[03:45:42.490] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:55:0)
[03:45:42.505] Build status: STARTED
[03:45:42.505] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:56:0) after 3m48s
[03:49:30.528] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:56:0)
[03:49:30.547] Build status: STARTED
[03:49:30.548] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:57:0) after 2m31s
[03:52:01.563] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:57:0)
[03:52:01.577] Build status: STARTED
[03:52:01.577] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:58:0) after 7m34s
[03:59:35.636] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:58:0)
[03:59:35.662] Build status: STARTED
[03:59:35.662] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:59:0) after 4m44s
[04:04:19.694] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:59:0)
[04:04:19.708] Build status: STARTED
[04:04:19.708] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:60:0) after 7m3s
[04:11:22.730] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:60:0)
[04:11:22.754] Build status: STARTED
[04:11:22.754] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8857272476740569024:61:0) after 7m40s
[04:18:55.525] Received PubSub notification, asking Buildbucket for the build status
[04:18:55.631] Build:
{
"id": "8691842414600380705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 4689,
"createdBy": "project:chromium",
"createTime": "2026-01-23T23:15:49.153287504Z",
"startTime": "2026-01-23T23:16:38.644210981Z",
"endTime": "2026-01-24T04:18:55.220391517Z",
"updateTime": "2026-01-24T04:18:55.220391517Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "81bc0fcf320574a7b7e0f9f41da7b83a868af95a",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:18:55.631] Invocation finished in 5h3m7.902920025s with status FAILED