[14:54:00.408] New invocation is queued and will start shortly
[14:54:01.568] Starting the invocation (attempt 1)
[14:54:01.602] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/0d528e31469bcf86ca6064930ad06ac44cb00556"
[14:54:01.602] Popped gitiles commit info from properties and tags
[14:54:01.602] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[14:54:01.602] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[14:54:01.602] Buildbucket request:
{
"requestId": "8874517470182626592",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d528e31469bcf86ca6064930ad06ac44cb00556",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874517470182626592"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-mte-arm64-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[14:54:02.226] Scheduled build:
{
"id": "8709087408191008097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 3502,
"createdBy": "project:chromium",
"createTime": "2025-07-17T14:54:01.679719606Z",
"updateTime": "2025-07-17T14:54:01.679719606Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d528e31469bcf86ca6064930ad06ac44cb00556",
"ref": "refs/heads/main"
}
},
"canary": true
}
[14:54:02.226] Task URL: https://cr-buildbucket.appspot.com/build/8709087408191008097
[14:54:02.226] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:2:0) after 2m9s
[14:54:03.281] Received PubSub notification, asking Buildbucket for the build status
[14:54:03.318] Build status: SCHEDULED
[14:54:07.620] Received PubSub notification, asking Buildbucket for the build status
[14:54:07.646] Build status: STARTED
[14:56:11.354] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:2:0)
[14:56:11.376] Build status: STARTED
[14:56:11.376] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:5:0) after 6m0s
[15:02:11.503] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:5:0)
[15:02:11.529] Build status: STARTED
[15:02:11.529] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:6:0) after 9m34s
[15:11:45.584] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:6:0)
[15:11:45.641] Build status: STARTED
[15:11:45.641] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:7:0) after 8m23s
[15:20:08.651] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:7:0)
[15:20:08.672] Build status: STARTED
[15:20:08.672] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:8:0) after 4m45s
[15:24:53.705] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:8:0)
[15:24:53.726] Build status: STARTED
[15:24:53.727] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:9:0) after 2m6s
[15:26:59.714] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:9:0)
[15:26:59.743] Build status: STARTED
[15:26:59.743] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:10:0) after 9m12s
[15:36:11.921] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:10:0)
[15:36:11.940] Build status: STARTED
[15:36:11.940] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:11:0) after 7m43s
[15:43:55.018] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:11:0)
[15:43:55.052] Build status: STARTED
[15:43:55.052] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:12:0) after 8m58s
[15:52:53.058] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:12:0)
[15:52:53.177] Build status: STARTED
[15:52:53.177] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:13:0) after 3m27s
[15:56:20.195] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:13:0)
[15:56:20.217] Build status: STARTED
[15:56:20.217] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:14:0) after 8m11s
[16:04:31.244] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:14:0)
[16:04:31.268] Build status: STARTED
[16:04:31.268] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:15:0) after 2m1s
[16:06:32.297] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:15:0)
[16:06:32.318] Build status: STARTED
[16:06:32.318] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:16:0) after 9m29s
[16:16:01.464] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:16:0)
[16:16:01.509] Build status: STARTED
[16:16:01.509] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:17:0) after 9m43s
[16:25:44.538] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:17:0)
[16:25:44.556] Build status: STARTED
[16:25:44.556] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:18:0) after 5m51s
[16:31:35.612] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:18:0)
[16:31:35.671] Build status: STARTED
[16:31:35.671] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:19:0) after 5m41s
[16:37:16.702] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:19:0)
[16:37:16.724] Build status: STARTED
[16:37:16.724] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:20:0) after 2m49s
[16:40:05.917] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:20:0)
[16:40:05.942] Build status: STARTED
[16:40:05.942] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:21:0) after 6m46s
[16:46:52.016] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:21:0)
[16:46:52.039] Build status: STARTED
[16:46:52.039] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:22:0) after 6m43s
[16:53:35.041] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:22:0)
[16:53:35.061] Build status: STARTED
[16:53:35.061] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:23:0) after 6m8s
[16:59:43.095] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:23:0)
[16:59:43.113] Build status: STARTED
[16:59:43.113] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:24:0) after 4m15s
[17:03:58.172] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:24:0)
[17:03:58.194] Build status: STARTED
[17:03:58.194] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:25:0) after 2m43s
[17:06:41.248] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:25:0)
[17:06:41.267] Build status: STARTED
[17:06:41.267] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:26:0) after 9m23s
[17:16:04.398] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:26:0)
[17:16:04.427] Build status: STARTED
[17:16:04.427] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:27:0) after 7m4s
[17:23:08.481] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:27:0)
[17:23:08.506] Build status: STARTED
[17:23:08.506] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:28:0) after 8m21s
[17:31:29.612] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:28:0)
[17:31:29.642] Build status: STARTED
[17:31:29.642] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:29:0) after 1m10s
[17:32:39.827] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:29:0)
[17:32:39.846] Build status: STARTED
[17:32:39.846] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:30:0) after 2m56s
[17:35:35.926] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:30:0)
[17:35:35.950] Build status: STARTED
[17:35:35.950] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:31:0) after 7m59s
[17:43:35.024] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:31:0)
[17:43:35.044] Build status: STARTED
[17:43:35.044] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:32:0) after 1m24s
[17:44:59.077] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:32:0)
[17:44:59.097] Build status: STARTED
[17:44:59.097] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:33:0) after 9m53s
[17:54:52.166] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:33:0)
[17:54:52.195] Build status: STARTED
[17:54:52.195] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:34:0) after 8m43s
[18:03:35.228] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:34:0)
[18:03:35.249] Build status: STARTED
[18:03:35.249] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:35:0) after 5m2s
[18:08:37.321] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:35:0)
[18:08:37.342] Build status: STARTED
[18:08:37.342] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:36:0) after 8m58s
[18:17:35.388] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:36:0)
[18:17:35.406] Build status: STARTED
[18:17:35.406] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:37:0) after 2m35s
[18:20:10.483] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:37:0)
[18:20:10.507] Build status: STARTED
[18:20:10.507] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:38:0) after 2m31s
[18:22:41.583] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:38:0)
[18:22:41.602] Build status: STARTED
[18:22:41.602] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:39:0) after 9m48s
[18:32:29.631] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:39:0)
[18:32:29.656] Build status: STARTED
[18:32:29.656] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:40:0) after 7m6s
[18:39:35.705] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:40:0)
[18:39:35.727] Build status: STARTED
[18:39:35.727] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:41:0) after 6m5s
[18:45:40.761] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:41:0)
[18:45:40.801] Build status: STARTED
[18:45:40.801] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:42:0) after 4m35s
[18:50:15.883] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:42:0)
[18:50:15.904] Build status: STARTED
[18:50:15.904] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:43:0) after 1m17s
[18:51:32.905] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:43:0)
[18:51:32.937] Build status: STARTED
[18:51:32.938] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:44:0) after 6m18s
[18:57:50.980] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:44:0)
[18:57:50.996] Build status: STARTED
[18:57:50.996] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:45:0) after 8m42s
[19:06:33.021] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:45:0)
[19:06:33.079] Build status: STARTED
[19:06:33.079] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:46:0) after 1m29s
[19:08:02.104] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:46:0)
[19:08:02.125] Build status: STARTED
[19:08:02.125] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:47:0) after 6m17s
[19:14:19.155] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:47:0)
[19:14:19.179] Build status: STARTED
[19:14:19.179] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:48:0) after 8m22s
[19:22:41.223] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:48:0)
[19:22:41.283] Build status: STARTED
[19:22:41.283] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:49:0) after 8m58s
[19:31:39.411] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:49:0)
[19:31:39.565] Build status: STARTED
[19:31:39.565] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:50:0) after 8m48s
[19:40:27.637] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:50:0)
[19:40:27.715] Build status: STARTED
[19:40:27.715] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:51:0) after 3m33s
[19:44:00.757] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:51:0)
[19:44:00.807] Build status: STARTED
[19:44:00.808] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:52:0) after 3m24s
[19:47:24.901] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:52:0)
[19:47:24.920] Build status: STARTED
[19:47:24.920] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:53:0) after 3m18s
[19:50:42.996] Handling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:53:0)
[19:50:43.012] Build status: STARTED
[19:50:43.012] Scheduling timer "check-buildbucket-build-status" (chromium/android-mte-arm64-rel:8874517470182626592:54:0) after 7m43s
[19:55:59.616] Received PubSub notification, asking Buildbucket for the build status
[19:55:59.636] Build:
{
"id": "8709087408191008097",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-mte-arm64-rel"
},
"number": 3502,
"createdBy": "project:chromium",
"createTime": "2025-07-17T14:54:01.679719606Z",
"startTime": "2025-07-17T14:54:07.417997581Z",
"endTime": "2025-07-17T19:55:59.190463121Z",
"updateTime": "2025-07-17T19:55:59.190463121Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "0d528e31469bcf86ca6064930ad06ac44cb00556",
"ref": "refs/heads/main"
}
},
"canary": true
}
[19:55:59.636] Invocation finished in 5h1m59.239699493s with status FAILED