[01:18:34.703] New invocation is queued and will start shortly
[01:18:35.769] Starting the invocation (attempt 1)
[01:18:35.801] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/afdd9f70367b19f0b1e92fa2510adc91c245f732"
[01:18:35.801] Popped gitiles commit info from properties and tags
[01:18:35.801] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:18:35.801] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:18:35.802] Buildbucket request:
{
"requestId": "8846121325045093248",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "afdd9f70367b19f0b1e92fa2510adc91c245f732",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8846121325045093248"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:18:36.660] Scheduled build:
{
"id": "8680691262884364705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 5413,
"createdBy": "project:chromium",
"createTime": "2026-05-27T01:18:36.143863116Z",
"updateTime": "2026-05-27T01:18:36.143863116Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "afdd9f70367b19f0b1e92fa2510adc91c245f732",
"ref": "refs/heads/main"
}
},
"canary": true
}
[01:18:36.660] Task URL: https://cr-buildbucket.appspot.com/build/8680691262884364705
[01:18:36.661] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:2:0) after 6m51s
[01:18:37.675] Received PubSub notification, asking Buildbucket for the build status
[01:18:37.692] Build status: SCHEDULED
[01:19:31.448] Received PubSub notification, asking Buildbucket for the build status
[01:19:31.475] Build status: STARTED
[01:25:27.678] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:2:0)
[01:25:27.704] Build status: STARTED
[01:25:27.705] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:5:0) after 3m13s
[01:28:40.779] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:5:0)
[01:28:40.798] Build status: STARTED
[01:28:40.798] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:6:0) after 3m13s
[01:31:53.865] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:6:0)
[01:31:53.938] Build status: STARTED
[01:31:53.938] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:7:0) after 6m22s
[01:38:15.922] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:7:0)
[01:38:15.943] Build status: STARTED
[01:38:15.943] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:8:0) after 3m56s
[01:42:11.962] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:8:0)
[01:42:11.981] Build status: STARTED
[01:42:11.981] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:9:0) after 2m42s
[01:44:54.042] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:9:0)
[01:44:54.057] Build status: STARTED
[01:44:54.057] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:10:0) after 9m12s
[01:54:06.347] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:10:0)
[01:54:06.435] Build status: STARTED
[01:54:06.435] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:11:0) after 5m39s
[01:59:45.458] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:11:0)
[01:59:45.490] Build status: STARTED
[01:59:45.490] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:12:0) after 1m34s
[02:01:19.465] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:12:0)
[02:01:19.483] Build status: STARTED
[02:01:19.483] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:13:0) after 9m30s
[02:10:49.545] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:13:0)
[02:10:49.561] Build status: STARTED
[02:10:49.561] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:14:0) after 4m22s
[02:15:11.658] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:14:0)
[02:15:11.727] Build status: STARTED
[02:15:11.728] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:15:0) after 6m47s
[02:21:58.775] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:15:0)
[02:21:58.952] Build status: STARTED
[02:21:58.952] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:16:0) after 4m39s
[02:26:37.952] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:16:0)
[02:26:37.970] Build status: STARTED
[02:26:37.970] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:17:0) after 3m45s
[02:30:22.960] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:17:0)
[02:30:22.986] Build status: STARTED
[02:30:22.986] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:18:0) after 3m32s
[02:33:55.005] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:18:0)
[02:33:55.035] Build status: STARTED
[02:33:55.036] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:19:0) after 1m10s
[02:35:05.058] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:19:0)
[02:35:05.076] Build status: STARTED
[02:35:05.076] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:20:0) after 8m5s
[02:43:10.094] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:20:0)
[02:43:10.117] Build status: STARTED
[02:43:10.117] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:21:0) after 2m58s
[02:46:08.116] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:21:0)
[02:46:09.295] Build status: STARTED
[02:46:09.295] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:22:0) after 5m37s
[02:51:46.312] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:22:0)
[02:51:46.335] Build status: STARTED
[02:51:46.335] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:23:0) after 9m42s
[03:01:28.344] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:23:0)
[03:01:28.366] Build status: STARTED
[03:01:28.366] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:24:0) after 9m47s
[03:11:15.438] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:24:0)
[03:11:15.541] Build status: STARTED
[03:11:15.541] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:25:0) after 8m47s
[03:20:02.522] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:25:0)
[03:20:02.615] Build status: STARTED
[03:20:02.615] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:26:0) after 9m59s
[03:30:01.636] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:26:0)
[03:30:01.657] Build status: STARTED
[03:30:01.657] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:27:0) after 4m25s
[03:34:26.673] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:27:0)
[03:34:26.701] Build status: STARTED
[03:34:26.701] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:28:0) after 1m0s
[03:35:26.721] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:28:0)
[03:35:26.739] Build status: STARTED
[03:35:26.739] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:29:0) after 6m4s
[03:41:30.760] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:29:0)
[03:41:30.820] Build status: STARTED
[03:41:30.820] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:30:0) after 1m35s
[03:43:05.931] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:30:0)
[03:43:05.947] Build status: STARTED
[03:43:05.947] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:31:0) after 7m47s
[03:50:52.963] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:31:0)
[03:50:53.039] Build status: STARTED
[03:50:53.039] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:32:0) after 1m15s
[03:52:08.081] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:32:0)
[03:52:08.148] Build status: STARTED
[03:52:08.148] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:33:0) after 7m9s
[03:59:17.187] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:33:0)
[03:59:17.208] Build status: STARTED
[03:59:17.208] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:34:0) after 3m47s
[04:03:04.334] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:34:0)
[04:03:04.381] Build status: STARTED
[04:03:04.381] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:35:0) after 8m4s
[04:11:08.399] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:35:0)
[04:11:08.417] Build status: STARTED
[04:11:08.417] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:36:0) after 6m11s
[04:17:19.565] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:36:0)
[04:17:19.589] Build status: STARTED
[04:17:19.589] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:37:0) after 5m51s
[04:23:10.622] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:37:0)
[04:23:10.645] Build status: STARTED
[04:23:10.645] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:38:0) after 2m19s
[04:25:29.661] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:38:0)
[04:25:29.681] Build status: STARTED
[04:25:29.681] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:39:0) after 7m6s
[04:32:35.716] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:39:0)
[04:32:35.730] Build status: STARTED
[04:32:35.730] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:40:0) after 5m31s
[04:38:06.859] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:40:0)
[04:38:06.937] Build status: STARTED
[04:38:06.937] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:41:0) after 7m29s
[04:45:36.004] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:41:0)
[04:45:36.027] Build status: STARTED
[04:45:36.027] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:42:0) after 4m3s
[04:49:39.124] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:42:0)
[04:49:39.146] Build status: STARTED
[04:49:39.146] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:43:0) after 5m1s
[04:54:40.183] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:43:0)
[04:54:40.204] Build status: STARTED
[04:54:40.204] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:44:0) after 6m6s
[05:00:46.242] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:44:0)
[05:00:46.276] Build status: STARTED
[05:00:46.276] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:45:0) after 2m1s
[05:02:47.300] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:45:0)
[05:02:47.318] Build status: STARTED
[05:02:47.318] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:46:0) after 2m6s
[05:04:53.339] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:46:0)
[05:04:53.355] Build status: STARTED
[05:04:53.356] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:47:0) after 7m51s
[05:12:44.401] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:47:0)
[05:12:44.417] Build status: STARTED
[05:12:44.417] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:48:0) after 9m30s
[05:22:14.438] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:48:0)
[05:22:14.457] Build status: STARTED
[05:22:14.457] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:49:0) after 7m49s
[05:30:03.612] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:49:0)
[05:30:03.628] Build status: STARTED
[05:30:03.628] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:50:0) after 5m36s
[05:35:39.735] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:50:0)
[05:35:39.761] Build status: STARTED
[05:35:39.761] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:51:0) after 3m47s
[05:39:26.787] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:51:0)
[05:39:26.815] Build status: STARTED
[05:39:26.815] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:52:0) after 6m44s
[05:46:10.833] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:52:0)
[05:46:10.860] Build status: STARTED
[05:46:10.860] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:53:0) after 3m53s
[05:50:03.981] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:53:0)
[05:50:03.998] Build status: STARTED
[05:50:03.998] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:54:0) after 1m39s
[05:51:43.062] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:54:0)
[05:51:43.092] Build status: STARTED
[05:51:43.092] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:55:0) after 9m9s
[06:00:52.167] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:55:0)
[06:00:52.187] Build status: STARTED
[06:00:52.187] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:56:0) after 9m4s
[06:09:56.191] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:56:0)
[06:09:56.229] Build status: STARTED
[06:09:56.229] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:57:0) after 5m51s
[06:15:47.251] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:57:0)
[06:15:47.437] Build status: STARTED
[06:15:47.437] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8846121325045093248:58:0) after 7m21s
[06:22:00.795] Received PubSub notification, asking Buildbucket for the build status
[06:22:00.822] Build:
{
"id": "8680691262884364705",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 5413,
"createdBy": "project:chromium",
"createTime": "2026-05-27T01:18:36.143863116Z",
"startTime": "2026-05-27T01:19:30.858711823Z",
"endTime": "2026-05-27T06:22:00.266347453Z",
"updateTime": "2026-05-27T06:22:00.266347453Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "afdd9f70367b19f0b1e92fa2510adc91c245f732",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:22:00.822] Invocation finished in 5h3m26.123581517s with status FAILED