[19:16:50.294] New invocation is queued and will start shortly
[19:16:51.329] Starting the invocation (attempt 1)
[19:16:51.386] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/292fdca1fe98e1b6dae57fe005d530ca24854bd3"
[19:16:51.386] Popped gitiles commit info from properties and tags
[19:16:51.386] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[19:16:51.386] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[19:16:51.386] Buildbucket request:
{
"requestId": "8995357287438771264",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "292fdca1fe98e1b6dae57fe005d530ca24854bd3",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8995357287438771264"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-arm64-proguard-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[19:16:52.281] Scheduled build:
{
"id": "8829927225341730257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 5671,
"createdBy": "project:chromium",
"createTime": "2021-11-21T19:16:51.663512464Z",
"updateTime": "2021-11-21T19:16:51.663512464Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "292fdca1fe98e1b6dae57fe005d530ca24854bd3",
"ref": "refs/heads/main"
}
}
}
[19:16:52.281] Task URL: https://cr-buildbucket.appspot.com/build/8829927225341730257
[19:16:52.281] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:2:0) after 7m46s
[19:16:54.816] Received PubSub notification, asking Buildbucket for the build status
[19:16:54.892] Build status: STARTED
[19:24:38.536] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:2:0)
[19:24:38.566] Build status: STARTED
[19:24:38.566] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:4:0) after 5m21s
[19:29:59.589] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:4:0)
[19:29:59.622] Build status: STARTED
[19:29:59.622] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:5:0) after 1m45s
[19:31:44.639] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:5:0)
[19:31:44.672] Build status: STARTED
[19:31:44.672] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:6:0) after 3m37s
[19:35:21.769] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:6:0)
[19:35:21.806] Build status: STARTED
[19:35:21.806] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:7:0) after 9m20s
[19:44:41.848] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:7:0)
[19:44:41.882] Build status: STARTED
[19:44:41.882] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:8:0) after 5m9s
[19:49:51.159] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:8:0)
[19:49:51.194] Build status: STARTED
[19:49:51.194] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:9:0) after 4m6s
[19:53:57.233] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:9:0)
[19:53:57.305] Build status: STARTED
[19:53:57.305] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:10:0) after 6m50s
[20:00:47.369] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:10:0)
[20:00:47.404] Build status: STARTED
[20:00:47.404] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:11:0) after 5m42s
[20:06:29.447] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:11:0)
[20:06:29.492] Build status: STARTED
[20:06:29.492] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:12:0) after 1m21s
[20:07:50.524] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:12:0)
[20:07:50.555] Build status: STARTED
[20:07:50.555] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:13:0) after 1m25s
[20:09:15.758] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:13:0)
[20:09:15.807] Build status: STARTED
[20:09:15.807] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:14:0) after 9m31s
[20:18:47.057] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:14:0)
[20:18:47.091] Build status: STARTED
[20:18:47.091] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:15:0) after 7m31s
[20:26:18.112] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:15:0)
[20:26:18.142] Build status: STARTED
[20:26:18.143] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:16:0) after 4m2s
[20:30:20.163] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:16:0)
[20:30:20.238] Build status: STARTED
[20:30:20.238] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:17:0) after 7m3s
[20:37:23.406] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:17:0)
[20:37:23.441] Build status: STARTED
[20:37:23.441] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:18:0) after 5m48s
[20:43:11.415] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:18:0)
[20:43:11.468] Build status: STARTED
[20:43:11.468] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:19:0) after 8m35s
[20:51:46.591] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:19:0)
[20:51:46.684] Build status: STARTED
[20:51:46.684] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:20:0) after 4m51s
[20:56:37.726] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:20:0)
[20:56:37.860] Build status: STARTED
[20:56:37.860] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:21:0) after 9m45s
[21:06:22.899] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:21:0)
[21:06:22.981] Build status: STARTED
[21:06:22.981] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:22:0) after 5m52s
[21:12:15.492] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:22:0)
[21:12:15.540] Build status: STARTED
[21:12:15.540] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:23:0) after 7m31s
[21:19:46.562] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:23:0)
[21:19:46.666] Build status: STARTED
[21:19:46.666] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:24:0) after 3m48s
[21:23:34.995] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:24:0)
[21:23:35.079] Build status: STARTED
[21:23:35.079] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:25:0) after 9m36s
[21:33:11.379] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:25:0)
[21:33:11.590] Build status: STARTED
[21:33:11.590] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:26:0) after 5m10s
[21:38:21.609] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:26:0)
[21:38:21.685] Build status: STARTED
[21:38:21.685] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:27:0) after 4m37s
[21:42:58.706] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:27:0)
[21:42:58.733] Build status: STARTED
[21:42:58.733] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:28:0) after 8m12s
[21:51:11.355] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:28:0)
[21:51:11.412] Build status: STARTED
[21:51:11.412] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:29:0) after 2m1s
[21:53:12.432] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:29:0)
[21:53:12.498] Build status: STARTED
[21:53:12.498] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:30:0) after 2m11s
[21:55:23.519] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:30:0)
[21:55:23.544] Build status: STARTED
[21:55:23.544] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:31:0) after 1m43s
[21:57:06.963] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:31:0)
[21:57:06.998] Build status: STARTED
[21:57:06.998] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:32:0) after 2m57s
[22:00:04.019] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:32:0)
[22:00:04.046] Build status: STARTED
[22:00:04.046] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:33:0) after 5m17s
[22:05:21.067] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:33:0)
[22:05:21.096] Build status: STARTED
[22:05:21.096] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:34:0) after 8m42s
[22:14:03.123] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:34:0)
[22:14:03.188] Build status: STARTED
[22:14:03.188] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:35:0) after 5m42s
[22:19:45.208] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:35:0)
[22:19:45.235] Build status: STARTED
[22:19:45.235] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:36:0) after 3m37s
[22:23:22.257] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:36:0)
[22:23:22.306] Build status: STARTED
[22:23:22.306] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:37:0) after 7m32s
[22:30:54.339] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:37:0)
[22:30:54.371] Build status: STARTED
[22:30:54.371] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:38:0) after 9m41s
[22:40:35.393] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:38:0)
[22:40:35.465] Build status: STARTED
[22:40:35.465] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:39:0) after 4m3s
[22:44:38.436] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:39:0)
[22:44:38.466] Build status: STARTED
[22:44:38.466] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:40:0) after 7m40s
[22:52:19.062] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:40:0)
[22:52:19.152] Build status: STARTED
[22:52:19.152] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:41:0) after 7m50s
[23:00:09.345] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:41:0)
[23:00:09.389] Build status: STARTED
[23:00:09.389] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:42:0) after 8m20s
[23:08:29.413] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:42:0)
[23:08:29.451] Build status: STARTED
[23:08:29.451] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:43:0) after 8m34s
[23:17:03.737] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:43:0)
[23:17:03.765] Build status: STARTED
[23:17:03.765] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:44:0) after 1m7s
[23:18:10.783] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:44:0)
[23:18:11.003] Build status: STARTED
[23:18:11.003] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:45:0) after 3m51s
[23:22:02.192] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:45:0)
[23:22:02.222] Build status: STARTED
[23:22:02.222] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:46:0) after 6m50s
[23:28:52.252] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:46:0)
[23:28:52.294] Build status: STARTED
[23:28:52.294] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:47:0) after 2m41s
[23:31:33.754] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:47:0)
[23:31:33.781] Build status: STARTED
[23:31:33.781] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:48:0) after 1m34s
[23:33:07.803] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:48:0)
[23:33:07.853] Build status: STARTED
[23:33:07.853] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:49:0) after 8m55s
[23:42:03.001] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:49:0)
[23:42:03.060] Build status: STARTED
[23:42:03.060] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:50:0) after 7m23s
[23:49:26.116] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:50:0)
[23:49:26.151] Build status: STARTED
[23:49:26.151] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:51:0) after 1m18s
[23:50:44.278] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:51:0)
[23:50:44.310] Build status: STARTED
[23:50:44.310] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:52:0) after 8m16s
[23:59:00.402] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:52:0)
[23:59:00.451] Build status: STARTED
[23:59:00.451] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:53:0) after 5m56s
[00:04:57.009] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:53:0)
[00:04:57.044] Build status: STARTED
[00:04:57.044] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:54:0) after 1m27s
[00:06:24.629] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:54:0)
[00:06:24.658] Build status: STARTED
[00:06:24.658] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:55:0) after 2m5s
[00:08:30.088] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:55:0)
[00:08:30.120] Build status: STARTED
[00:08:30.120] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:56:0) after 7m15s
[00:15:45.402] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:56:0)
[00:15:45.435] Build status: STARTED
[00:15:45.435] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:57:0) after 3m18s
[00:19:03.675] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:57:0)
[00:19:03.705] Build status: STARTED
[00:19:03.705] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:58:0) after 7m2s
[00:26:06.510] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:58:0)
[00:26:06.550] Build status: STARTED
[00:26:06.550] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8995357287438771264:59:0) after 7m57s
[00:28:40.656] Received PubSub notification, asking Buildbucket for the build status
[00:28:40.690] Build:
{
"id": "8829927225341730257",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 5671,
"createdBy": "project:chromium",
"createTime": "2021-11-21T19:16:51.663512464Z",
"startTime": "2021-11-21T19:16:54.143383Z",
"endTime": "2021-11-22T00:28:39.709106266Z",
"updateTime": "2021-11-22T00:28:39.709106266Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "292fdca1fe98e1b6dae57fe005d530ca24854bd3",
"ref": "refs/heads/main"
}
}
}
[00:28:40.690] Invocation finished in 5h11m50.41091971s with status FAILED