[23:20:08.162] New invocation is queued and will start shortly
[23:20:09.320] Starting the invocation (attempt 1)
[23:20:09.353] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/5347517dc9170efe5e84f8072c86126092d6182c"
[23:20:09.353] Popped gitiles commit info from properties and tags
[23:20:09.353] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[23:20:09.355] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[23:20:09.355] Buildbucket request:
{
"requestId": "8993711235073333808",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5347517dc9170efe5e84f8072c86126092d6182c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8993711235073333808"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-arm64-proguard-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[23:20:09.968] Scheduled build:
{
"id": "8828281173077917633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 5784,
"createdBy": "project:chromium",
"createTime": "2021-12-09T23:20:09.430585487Z",
"updateTime": "2021-12-09T23:20:09.430585487Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5347517dc9170efe5e84f8072c86126092d6182c",
"ref": "refs/heads/main"
}
}
}
[23:20:09.968] Task URL: https://cr-buildbucket.appspot.com/build/8828281173077917633
[23:20:09.968] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:2:0) after 1m18s
[23:21:27.947] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:2:0)
[23:21:27.974] Build status: SCHEDULED
[23:21:27.974] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:3:0) after 1m19s
[23:22:47.339] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:3:0)
[23:22:47.377] Build status: SCHEDULED
[23:22:47.377] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:4:0) after 1m50s
[23:24:37.498] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:4:0)
[23:24:37.564] Build status: SCHEDULED
[23:24:37.564] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:5:0) after 6m51s
[23:25:05.197] Received PubSub notification, asking Buildbucket for the build status
[23:25:05.222] Build status: STARTED
[23:31:28.592] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:5:0)
[23:31:28.669] Build status: STARTED
[23:31:28.669] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:7:0) after 7m30s
[23:38:58.789] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:7:0)
[23:38:58.812] Build status: STARTED
[23:38:58.812] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:8:0) after 7m14s
[23:46:12.933] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:8:0)
[23:46:12.977] Build status: STARTED
[23:46:12.977] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:9:0) after 2m37s
[23:48:50.059] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:9:0)
[23:48:50.077] Build status: STARTED
[23:48:50.077] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:10:0) after 2m10s
[23:51:00.140] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:10:0)
[23:51:00.172] Build status: STARTED
[23:51:00.172] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:11:0) after 9m57s
[00:00:57.175] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:11:0)
[00:00:57.303] Build status: STARTED
[00:00:57.303] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:12:0) after 1m7s
[00:02:04.386] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:12:0)
[00:02:04.448] Build status: STARTED
[00:02:04.448] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:13:0) after 8m53s
[00:10:57.632] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:13:0)
[00:10:57.656] Build status: STARTED
[00:10:57.656] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:14:0) after 8m52s
[00:19:49.738] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:14:0)
[00:19:49.769] Build status: STARTED
[00:19:49.769] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:15:0) after 8m6s
[00:27:55.993] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:15:0)
[00:27:56.037] Build status: STARTED
[00:27:56.037] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:16:0) after 2m39s
[00:30:35.160] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:16:0)
[00:30:35.350] Build status: STARTED
[00:30:35.350] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:17:0) after 7m27s
[00:38:02.626] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:17:0)
[00:38:02.653] Build status: STARTED
[00:38:02.653] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:18:0) after 2m52s
[00:40:54.676] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:18:0)
[00:40:54.695] Build status: STARTED
[00:40:54.695] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:19:0) after 3m11s
[00:44:05.823] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:19:0)
[00:44:05.943] Build status: STARTED
[00:44:05.943] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:20:0) after 6m48s
[00:50:54.119] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:20:0)
[00:50:54.142] Build status: STARTED
[00:50:54.142] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:21:0) after 4m43s
[00:55:37.349] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:21:0)
[00:55:37.373] Build status: STARTED
[00:55:37.373] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:22:0) after 6m50s
[01:02:27.400] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:22:0)
[01:02:27.423] Build status: STARTED
[01:02:27.423] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:23:0) after 1m17s
[01:03:44.408] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:23:0)
[01:03:44.475] Build status: STARTED
[01:03:44.475] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:24:0) after 9m7s
[01:12:51.637] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:24:0)
[01:12:51.777] Build status: STARTED
[01:12:51.777] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:25:0) after 8m36s
[01:21:28.037] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:25:0)
[01:21:28.060] Build status: STARTED
[01:21:28.060] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:26:0) after 5m42s
[01:27:10.204] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:26:0)
[01:27:10.244] Build status: STARTED
[01:27:10.244] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:27:0) after 7m18s
[01:34:28.273] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:27:0)
[01:34:28.310] Build status: STARTED
[01:34:28.310] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:28:0) after 6m21s
[01:40:49.472] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:28:0)
[01:40:49.493] Build status: STARTED
[01:40:49.493] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:29:0) after 4m31s
[01:45:20.539] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:29:0)
[01:45:20.578] Build status: STARTED
[01:45:20.578] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:30:0) after 7m27s
[01:52:47.704] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:30:0)
[01:52:47.725] Build status: STARTED
[01:52:47.725] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:31:0) after 4m55s
[01:57:42.925] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:31:0)
[01:57:42.945] Build status: STARTED
[01:57:42.945] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:32:0) after 1m55s
[01:59:38.516] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:32:0)
[01:59:38.536] Build status: STARTED
[01:59:38.536] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:33:0) after 8m15s
[02:07:53.664] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:33:0)
[02:07:53.869] Build status: STARTED
[02:07:53.869] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:34:0) after 6m16s
[02:14:09.893] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:34:0)
[02:14:09.917] Build status: STARTED
[02:14:09.917] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:35:0) after 9m13s
[02:23:23.263] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:35:0)
[02:23:23.286] Build status: STARTED
[02:23:23.286] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:36:0) after 3m23s
[02:26:46.382] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:36:0)
[02:26:46.403] Build status: STARTED
[02:26:46.403] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:37:0) after 4m12s
[02:30:58.434] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:37:0)
[02:30:58.471] Build status: STARTED
[02:30:58.471] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:38:0) after 1m13s
[02:32:11.655] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:38:0)
[02:32:11.764] Build status: STARTED
[02:32:11.764] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:39:0) after 1m43s
[02:33:54.796] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:39:0)
[02:33:54.862] Build status: STARTED
[02:33:54.862] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:40:0) after 8m1s
[02:41:55.896] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:40:0)
[02:41:55.961] Build status: STARTED
[02:41:55.961] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:41:0) after 7m0s
[02:48:55.981] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:41:0)
[02:48:56.010] Build status: STARTED
[02:48:56.010] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:42:0) after 4m27s
[02:53:23.044] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:42:0)
[02:53:23.067] Build status: STARTED
[02:53:23.067] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:43:0) after 2m39s
[02:56:02.119] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:43:0)
[02:56:02.140] Build status: STARTED
[02:56:02.140] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:44:0) after 7m47s
[03:03:49.168] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:44:0)
[03:03:49.189] Build status: STARTED
[03:03:49.189] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:45:0) after 3m21s
[03:07:10.232] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:45:0)
[03:07:10.255] Build status: STARTED
[03:07:10.255] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:46:0) after 5m2s
[03:12:12.500] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:46:0)
[03:12:12.530] Build status: STARTED
[03:12:12.530] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:47:0) after 6m47s
[03:19:00.181] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:47:0)
[03:19:00.206] Build status: STARTED
[03:19:00.206] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:48:0) after 5m22s
[03:24:22.237] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:48:0)
[03:24:22.257] Build status: STARTED
[03:24:22.257] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:49:0) after 9m16s
[03:33:38.326] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:49:0)
[03:33:38.346] Build status: STARTED
[03:33:38.346] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:50:0) after 6m47s
[03:40:25.498] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:50:0)
[03:40:25.519] Build status: STARTED
[03:40:25.519] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:51:0) after 4m5s
[03:44:30.641] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:51:0)
[03:44:30.668] Build status: STARTED
[03:44:30.668] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:52:0) after 1m36s
[03:46:06.697] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:52:0)
[03:46:06.749] Build status: STARTED
[03:46:06.749] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:53:0) after 9m0s
[03:55:06.861] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:53:0)
[03:55:06.898] Build status: STARTED
[03:55:06.898] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:54:0) after 6m9s
[04:01:15.932] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:54:0)
[04:01:15.964] Build status: STARTED
[04:01:15.964] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:55:0) after 8m17s
[04:09:33.003] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:55:0)
[04:09:33.041] Build status: STARTED
[04:09:33.041] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:56:0) after 1m38s
[04:11:11.184] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:56:0)
[04:11:11.222] Build status: STARTED
[04:11:11.222] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:57:0) after 8m32s
[04:19:43.204] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:57:0)
[04:19:43.222] Build status: STARTED
[04:19:43.222] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:58:0) after 5m19s
[04:25:02.714] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:58:0)
[04:25:02.736] Build status: STARTED
[04:25:02.736] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:59:0) after 7m24s
[04:32:26.759] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:59:0)
[04:32:26.792] Build status: STARTED
[04:32:26.792] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:60:0) after 6m42s
[04:39:08.900] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:60:0)
[04:39:08.944] Build status: STARTED
[04:39:08.944] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:61:0) after 4m44s
[04:43:53.037] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:61:0)
[04:43:53.075] Build status: STARTED
[04:43:53.075] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:62:0) after 5m37s
[04:49:30.097] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:62:0)
[04:49:30.120] Build status: STARTED
[04:49:30.120] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:63:0) after 9m10s
[04:58:40.143] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:63:0)
[04:58:40.172] Build status: STARTED
[04:58:40.172] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8993711235073333808:64:0) after 7m25s
[05:00:48.773] Received PubSub notification, asking Buildbucket for the build status
[05:00:48.810] Build:
{
"id": "8828281173077917633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 5784,
"createdBy": "project:chromium",
"createTime": "2021-12-09T23:20:09.430585487Z",
"startTime": "2021-12-09T23:25:04.743659Z",
"endTime": "2021-12-10T05:00:48.102331827Z",
"updateTime": "2021-12-10T05:00:48.102331827Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "5347517dc9170efe5e84f8072c86126092d6182c",
"ref": "refs/heads/main"
}
}
}
[05:00:48.810] Invocation finished in 5h40m40.666171763s with status FAILED