[02:52:02.558] New invocation is queued and will start shortly
[02:52:03.624] Starting the invocation (attempt 1)
[02:52:03.658] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/ab62aa36e97e1d0f54d257db72cca843d9154ed5"
[02:52:03.658] Popped gitiles commit info from properties and tags
[02:52:03.658] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:52:03.658] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:52:03.658] Buildbucket request:
{
"requestId": "8992882530360963392",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ab62aa36e97e1d0f54d257db72cca843d9154ed5",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8992882530360963392"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-arm64-proguard-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:52:04.113] Scheduled build:
{
"id": "8827452468476098401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 5844,
"createdBy": "project:chromium",
"createTime": "2021-12-19T02:52:03.725720631Z",
"updateTime": "2021-12-19T02:52:03.725720631Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ab62aa36e97e1d0f54d257db72cca843d9154ed5",
"ref": "refs/heads/main"
}
}
}
[02:52:04.113] Task URL: https://cr-buildbucket.appspot.com/build/8827452468476098401
[02:52:04.113] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:2:0) after 1m59s
[02:54:03.125] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:2:0)
[02:54:03.152] Build status: SCHEDULED
[02:54:03.152] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:3:0) after 2m45s
[02:56:48.137] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:3:0)
[02:56:48.156] Build status: SCHEDULED
[02:56:48.156] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:4:0) after 2m42s
[02:59:30.173] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:4:0)
[02:59:30.194] Build status: SCHEDULED
[02:59:30.194] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:5:0) after 2m12s
[03:01:42.354] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:5:0)
[03:01:42.382] Build status: SCHEDULED
[03:01:42.382] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:6:0) after 7m20s
[03:09:02.397] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:6:0)
[03:09:02.557] Build status: SCHEDULED
[03:09:02.557] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:7:0) after 9m16s
[03:09:56.750] Received PubSub notification, asking Buildbucket for the build status
[03:09:56.769] Build status: STARTED
[03:18:18.575] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:7:0)
[03:18:18.592] Build status: STARTED
[03:18:18.593] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:9:0) after 6m25s
[03:24:43.608] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:9:0)
[03:24:43.635] Build status: STARTED
[03:24:43.635] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:10:0) after 6m25s
[03:31:08.787] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:10:0)
[03:31:08.816] Build status: STARTED
[03:31:08.816] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:11:0) after 2m9s
[03:33:17.834] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:11:0)
[03:33:17.852] Build status: STARTED
[03:33:17.852] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:12:0) after 8m34s
[03:41:51.870] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:12:0)
[03:41:51.922] Build status: STARTED
[03:41:51.922] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:13:0) after 9m48s
[03:51:39.961] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:13:0)
[03:51:39.996] Build status: STARTED
[03:51:39.996] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:14:0) after 7m2s
[03:58:42.010] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:14:0)
[03:58:42.037] Build status: STARTED
[03:58:42.037] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:15:0) after 8m22s
[04:07:04.060] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:15:0)
[04:07:04.089] Build status: STARTED
[04:07:04.089] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:16:0) after 8m42s
[04:15:46.115] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:16:0)
[04:15:46.152] Build status: STARTED
[04:15:46.152] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:17:0) after 7m33s
[04:23:19.168] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:17:0)
[04:23:19.199] Build status: STARTED
[04:23:19.199] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:18:0) after 4m26s
[04:27:45.216] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:18:0)
[04:27:45.259] Build status: STARTED
[04:27:45.259] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:19:0) after 1m48s
[04:29:33.275] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:19:0)
[04:29:33.306] Build status: STARTED
[04:29:33.306] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:20:0) after 3m31s
[04:33:04.423] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:20:0)
[04:33:04.440] Build status: STARTED
[04:33:04.440] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:21:0) after 2m55s
[04:35:59.460] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:21:0)
[04:35:59.488] Build status: STARTED
[04:35:59.488] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:22:0) after 8m1s
[04:44:00.495] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:22:0)
[04:44:00.511] Build status: STARTED
[04:44:00.511] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:23:0) after 4m6s
[04:48:06.528] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:23:0)
[04:48:06.551] Build status: STARTED
[04:48:06.551] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:24:0) after 5m55s
[04:54:02.419] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:24:0)
[04:54:02.451] Build status: STARTED
[04:54:02.451] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:25:0) after 4m33s
[04:58:35.501] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:25:0)
[04:58:35.538] Build status: STARTED
[04:58:35.538] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:26:0) after 4m53s
[05:03:28.562] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:26:0)
[05:03:28.606] Build status: STARTED
[05:03:28.606] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:27:0) after 7m9s
[05:10:37.622] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:27:0)
[05:10:37.649] Build status: STARTED
[05:10:37.649] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:28:0) after 9m33s
[05:20:10.669] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:28:0)
[05:20:10.689] Build status: STARTED
[05:20:10.689] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:29:0) after 7m58s
[05:28:08.712] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:29:0)
[05:28:08.732] Build status: STARTED
[05:28:08.732] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:30:0) after 3m27s
[05:31:35.750] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:30:0)
[05:31:35.776] Build status: STARTED
[05:31:35.776] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:31:0) after 5m20s
[05:36:55.859] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:31:0)
[05:36:55.882] Build status: STARTED
[05:36:55.882] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:32:0) after 6m59s
[05:43:55.733] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:32:0)
[05:43:55.752] Build status: STARTED
[05:43:55.752] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:33:0) after 9m33s
[05:53:28.851] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:33:0)
[05:53:28.884] Build status: STARTED
[05:53:28.885] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:34:0) after 1m33s
[05:55:01.905] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:34:0)
[05:55:01.948] Build status: STARTED
[05:55:01.948] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:35:0) after 3m21s
[05:58:23.096] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:35:0)
[05:58:23.117] Build status: STARTED
[05:58:23.117] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:36:0) after 8m24s
[06:06:47.187] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:36:0)
[06:06:47.223] Build status: STARTED
[06:06:47.223] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:37:0) after 8m22s
[06:15:09.243] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:37:0)
[06:15:09.272] Build status: STARTED
[06:15:09.272] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:38:0) after 7m3s
[06:22:12.295] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:38:0)
[06:22:12.326] Build status: STARTED
[06:22:12.326] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:39:0) after 2m52s
[06:25:04.349] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:39:0)
[06:25:04.381] Build status: STARTED
[06:25:04.381] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:40:0) after 8m26s
[06:33:30.410] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:40:0)
[06:33:30.430] Build status: STARTED
[06:33:30.430] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:41:0) after 7m49s
[06:41:19.454] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:41:0)
[06:41:19.477] Build status: STARTED
[06:41:19.477] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:42:0) after 6m39s
[06:47:58.619] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:42:0)
[06:47:58.665] Build status: STARTED
[06:47:58.665] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:43:0) after 9m41s
[06:57:39.838] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:43:0)
[06:57:39.858] Build status: STARTED
[06:57:39.858] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:44:0) after 8m22s
[07:06:02.156] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:44:0)
[07:06:02.175] Build status: STARTED
[07:06:02.175] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:45:0) after 5m46s
[07:11:48.339] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:45:0)
[07:11:48.366] Build status: STARTED
[07:11:48.366] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:46:0) after 7m36s
[07:19:24.385] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:46:0)
[07:19:24.422] Build status: STARTED
[07:19:24.422] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:47:0) after 8m38s
[07:28:02.972] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:47:0)
[07:28:02.995] Build status: STARTED
[07:28:02.995] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:48:0) after 5m18s
[07:33:21.015] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:48:0)
[07:33:21.034] Build status: STARTED
[07:33:21.035] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:49:0) after 4m32s
[07:37:53.108] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:49:0)
[07:37:53.125] Build status: STARTED
[07:37:53.125] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:50:0) after 7m32s
[07:45:25.241] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:50:0)
[07:45:25.320] Build status: STARTED
[07:45:25.320] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:51:0) after 1m10s
[07:46:35.363] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:51:0)
[07:46:35.395] Build status: STARTED
[07:46:35.395] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:52:0) after 5m25s
[07:52:00.418] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:52:0)
[07:52:00.446] Build status: STARTED
[07:52:00.446] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:53:0) after 2m36s
[07:54:36.463] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:53:0)
[07:54:36.480] Build status: STARTED
[07:54:36.480] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:54:0) after 9m8s
[08:03:44.486] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:54:0)
[08:03:44.511] Build status: STARTED
[08:03:44.511] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:55:0) after 9m59s
[08:13:43.527] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:55:0)
[08:13:43.546] Build status: STARTED
[08:13:43.546] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:56:0) after 8m25s
[08:22:08.778] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:56:0)
[08:22:08.808] Build status: STARTED
[08:22:08.808] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:57:0) after 6m8s
[08:28:16.832] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:57:0)
[08:28:16.853] Build status: STARTED
[08:28:16.853] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:58:0) after 6m16s
[08:34:32.871] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:58:0)
[08:34:32.899] Build status: STARTED
[08:34:32.899] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:59:0) after 3m57s
[08:38:29.894] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:59:0)
[08:38:29.922] Build status: STARTED
[08:38:29.922] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:60:0) after 5m47s
[08:44:17.076] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:60:0)
[08:44:17.103] Build status: STARTED
[08:44:17.103] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:61:0) after 4m35s
[08:48:52.121] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:61:0)
[08:48:52.191] Build status: STARTED
[08:48:52.191] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8992882530360963392:62:0) after 5m34s
[08:51:48.045] Received PubSub notification, asking Buildbucket for the build status
[08:51:48.100] Build:
{
"id": "8827452468476098401",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 5844,
"createdBy": "project:chromium",
"createTime": "2021-12-19T02:52:03.725720631Z",
"startTime": "2021-12-19T03:09:55.695268Z",
"endTime": "2021-12-19T08:51:47.718540415Z",
"updateTime": "2021-12-19T08:51:47.718540415Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "ab62aa36e97e1d0f54d257db72cca843d9154ed5",
"ref": "refs/heads/main"
}
}
}
[08:51:48.100] Invocation finished in 5h59m45.555706487s with status FAILED