[00:18:48.968] New invocation is queued and will start shortly
[00:18:50.835] Starting the invocation (attempt 1)
[00:18:50.866] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/1134dfa5343c7cc6e7fb5e09e7789fee3648a5b3"
[00:18:50.866] Popped gitiles commit info from properties and tags
[00:18:50.866] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[00:18:50.866] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[00:18:50.866] Buildbucket request:
{
"requestId": "8874119547585823648",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1134dfa5343c7cc6e7fb5e09e7789fee3648a5b3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874119547585823648"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[00:18:51.566] Scheduled build:
{
"id": "8708689484733422817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 3527,
"createdBy": "project:chromium",
"createTime": "2025-07-22T00:18:51.060782886Z",
"updateTime": "2025-07-22T00:18:51.060782886Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1134dfa5343c7cc6e7fb5e09e7789fee3648a5b3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[00:18:51.566] Task URL: https://cr-buildbucket.appspot.com/build/8708689484733422817
[00:18:51.566] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:2:0) after 3m47s
[00:18:52.551] Received PubSub notification, asking Buildbucket for the build status
[00:18:52.582] Build status: SCHEDULED
[00:19:42.133] Received PubSub notification, asking Buildbucket for the build status
[00:19:42.171] Build status: STARTED
[00:22:38.599] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:2:0)
[00:22:38.627] Build status: STARTED
[00:22:38.627] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:5:0) after 8m57s
[00:31:35.652] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:5:0)
[00:31:35.675] Build status: STARTED
[00:31:35.675] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:6:0) after 7m24s
[00:38:59.802] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:6:0)
[00:38:59.829] Build status: STARTED
[00:38:59.829] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:7:0) after 4m42s
[00:43:41.952] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:7:0)
[00:43:42.030] Build status: STARTED
[00:43:42.030] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:8:0) after 4m19s
[00:48:01.071] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:8:0)
[00:48:01.093] Build status: STARTED
[00:48:01.093] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:9:0) after 9m41s
[00:57:42.271] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:9:0)
[00:57:42.300] Build status: STARTED
[00:57:42.300] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:10:0) after 2m43s
[01:00:25.392] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:10:0)
[01:00:25.409] Build status: STARTED
[01:00:25.409] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:11:0) after 9m13s
[01:09:38.481] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:11:0)
[01:09:38.520] Build status: STARTED
[01:09:38.520] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:12:0) after 1m36s
[01:11:14.602] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:12:0)
[01:11:14.643] Build status: STARTED
[01:11:14.643] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:13:0) after 9m3s
[01:20:17.669] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:13:0)
[01:20:17.690] Build status: STARTED
[01:20:17.690] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:14:0) after 5m34s
[01:25:51.757] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:14:0)
[01:25:51.786] Build status: STARTED
[01:25:51.786] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:15:0) after 1m21s
[01:27:12.763] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:15:0)
[01:27:12.792] Build status: STARTED
[01:27:12.792] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:16:0) after 4m35s
[01:31:47.829] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:16:0)
[01:31:47.846] Build status: STARTED
[01:31:47.846] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:17:0) after 9m33s
[01:41:20.871] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:17:0)
[01:41:20.889] Build status: STARTED
[01:41:20.889] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:18:0) after 9m10s
[01:50:30.914] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:18:0)
[01:50:30.949] Build status: STARTED
[01:50:30.949] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:19:0) after 1m35s
[01:52:05.975] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:19:0)
[01:52:05.998] Build status: STARTED
[01:52:05.998] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:20:0) after 4m1s
[01:56:07.037] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:20:0)
[01:56:07.056] Build status: STARTED
[01:56:07.056] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:21:0) after 2m16s
[01:58:23.151] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:21:0)
[01:58:23.186] Build status: STARTED
[01:58:23.186] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:22:0) after 6m33s
[02:04:56.232] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:22:0)
[02:04:56.264] Build status: STARTED
[02:04:56.264] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:23:0) after 4m16s
[02:09:12.300] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:23:0)
[02:09:12.331] Build status: STARTED
[02:09:12.331] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:24:0) after 3m0s
[02:12:12.371] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:24:0)
[02:12:12.427] Build status: STARTED
[02:12:12.427] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:25:0) after 7m32s
[02:19:44.512] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:25:0)
[02:19:44.540] Build status: STARTED
[02:19:44.540] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:26:0) after 5m34s
[02:25:19.051] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:26:0)
[02:25:19.089] Build status: STARTED
[02:25:19.089] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:27:0) after 7m59s
[02:33:18.113] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:27:0)
[02:33:18.140] Build status: STARTED
[02:33:18.140] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:28:0) after 7m19s
[02:40:37.326] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:28:0)
[02:40:37.386] Build status: STARTED
[02:40:37.386] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:29:0) after 2m18s
[02:42:55.726] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:29:0)
[02:42:55.770] Build status: STARTED
[02:42:55.770] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:30:0) after 5m27s
[02:48:23.037] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:30:0)
[02:48:23.052] Build status: STARTED
[02:48:23.052] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:31:0) after 2m58s
[02:51:21.189] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:31:0)
[02:51:21.209] Build status: STARTED
[02:51:21.209] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:32:0) after 5m30s
[02:56:51.634] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:32:0)
[02:56:51.653] Build status: STARTED
[02:56:51.653] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:33:0) after 2m59s
[02:59:50.725] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:33:0)
[02:59:50.745] Build status: STARTED
[02:59:50.745] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:34:0) after 9m23s
[03:09:13.777] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:34:0)
[03:09:13.861] Build status: STARTED
[03:09:13.861] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:35:0) after 3m55s
[03:13:09.118] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:35:0)
[03:13:09.137] Build status: STARTED
[03:13:09.137] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:36:0) after 1m16s
[03:14:25.237] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:36:0)
[03:14:25.253] Build status: STARTED
[03:14:25.253] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:37:0) after 9m23s
[03:23:48.311] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:37:0)
[03:23:48.331] Build status: STARTED
[03:23:48.331] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:38:0) after 2m4s
[03:25:52.354] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:38:0)
[03:25:52.382] Build status: STARTED
[03:25:52.382] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:39:0) after 9m56s
[03:35:48.392] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:39:0)
[03:35:48.410] Build status: STARTED
[03:35:48.411] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:40:0) after 3m52s
[03:39:40.491] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:40:0)
[03:39:40.521] Build status: STARTED
[03:39:40.521] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:41:0) after 1m10s
[03:40:50.532] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:41:0)
[03:40:50.553] Build status: STARTED
[03:40:50.553] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:42:0) after 6m42s
[03:47:32.900] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:42:0)
[03:47:32.925] Build status: STARTED
[03:47:32.925] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:43:0) after 9m21s
[03:56:53.950] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:43:0)
[03:56:53.966] Build status: STARTED
[03:56:53.967] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:44:0) after 5m17s
[04:02:11.334] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:44:0)
[04:02:11.362] Build status: STARTED
[04:02:11.362] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:45:0) after 8m7s
[04:10:18.668] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:45:0)
[04:10:18.693] Build status: STARTED
[04:10:18.693] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:46:0) after 9m26s
[04:19:44.715] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:46:0)
[04:19:44.738] Build status: STARTED
[04:19:44.738] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:47:0) after 7m46s
[04:27:30.771] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:47:0)
[04:27:30.807] Build status: STARTED
[04:27:30.807] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:48:0) after 1m26s
[04:28:56.896] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:48:0)
[04:28:56.963] Build status: STARTED
[04:28:56.964] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:49:0) after 1m51s
[04:30:48.040] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:49:0)
[04:30:48.065] Build status: STARTED
[04:30:48.065] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:50:0) after 7m21s
[04:38:09.080] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:50:0)
[04:38:09.113] Build status: STARTED
[04:38:09.113] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:51:0) after 8m32s
[04:46:41.253] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:51:0)
[04:46:41.297] Build status: STARTED
[04:46:41.297] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:52:0) after 4m44s
[04:51:25.451] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:52:0)
[04:51:25.471] Build status: STARTED
[04:51:25.471] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:53:0) after 9m39s
[05:01:04.506] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:53:0)
[05:01:04.528] Build status: STARTED
[05:01:04.529] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:54:0) after 8m24s
[05:09:28.609] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:54:0)
[05:09:28.627] Build status: STARTED
[05:09:28.627] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:55:0) after 3m10s
[05:12:38.671] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:55:0)
[05:12:38.721] Build status: STARTED
[05:12:38.721] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:56:0) after 9m17s
[05:21:55.844] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:56:0)
[05:21:55.881] Build status: STARTED
[05:21:55.881] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874119547585823648:57:0) after 9m56s
[05:22:02.343] Received PubSub notification, asking Buildbucket for the build status
[05:22:02.394] Build:
{
"id": "8708689484733422817",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 3527,
"createdBy": "project:chromium",
"createTime": "2025-07-22T00:18:51.060782886Z",
"startTime": "2025-07-22T00:19:41.196209145Z",
"endTime": "2025-07-22T05:22:01.904367571Z",
"updateTime": "2025-07-22T05:22:01.904367571Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "1134dfa5343c7cc6e7fb5e09e7789fee3648a5b3",
"ref": "refs/heads/main"
}
},
"canary": true
}
[05:22:02.394] Invocation finished in 5h3m13.438273776s with status FAILED