[21:48:15.425] New invocation is queued and will start shortly
[21:48:16.665] Starting the invocation (attempt 1)
[21:48:16.697] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/9a371bcd1eca0e3ae4eb2a0370ab86723aee90bb"
[21:48:16.697] Popped gitiles commit info from properties and tags
[21:48:16.697] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[21:48:16.697] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[21:48:16.697] Buildbucket request:
{
"requestId": "8848580675409001632",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a371bcd1eca0e3ae4eb2a0370ab86723aee90bb",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8848580675409001632"
},
{
"key": "scheduler_job_id",
"value": "chromium/android-arm64-proguard-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[21:48:17.103] Scheduled build:
{
"id": "8683150613377189873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 16016,
"createdBy": "project:chromium",
"createTime": "2026-04-29T21:48:16.742031359Z",
"updateTime": "2026-04-29T21:48:16.742031359Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a371bcd1eca0e3ae4eb2a0370ab86723aee90bb",
"ref": "refs/heads/main"
}
},
"canary": true
}
[21:48:17.103] Task URL: https://cr-buildbucket.appspot.com/build/8683150613377189873
[21:48:17.103] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:2:0) after 7m21s
[21:48:18.066] Received PubSub notification, asking Buildbucket for the build status
[21:48:18.086] Build status: SCHEDULED
[21:48:24.582] Received PubSub notification, asking Buildbucket for the build status
[21:48:24.602] Build status: STARTED
[21:55:38.269] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:2:0)
[21:55:38.282] Build status: STARTED
[21:55:38.282] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:5:0) after 7m32s
[22:03:10.419] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:5:0)
[22:03:10.442] Build status: STARTED
[22:03:10.443] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:6:0) after 6m1s
[22:09:11.465] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:6:0)
[22:09:11.492] Build status: STARTED
[22:09:11.492] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:7:0) after 3m35s
[22:12:46.587] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:7:0)
[22:12:46.604] Build status: STARTED
[22:12:46.604] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:8:0) after 1m1s
[22:13:47.772] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:8:0)
[22:13:47.794] Build status: STARTED
[22:13:47.794] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:9:0) after 8m13s
[22:22:00.864] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:9:0)
[22:22:00.937] Build status: STARTED
[22:22:00.937] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:10:0) after 7m4s
[22:29:04.997] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:10:0)
[22:29:05.012] Build status: STARTED
[22:29:05.012] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:11:0) after 5m50s
[22:34:55.146] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:11:0)
[22:34:55.162] Build status: STARTED
[22:34:55.162] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:12:0) after 6m22s
[22:41:17.219] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:12:0)
[22:41:17.238] Build status: STARTED
[22:41:17.238] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:13:0) after 5m19s
[22:46:36.505] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:13:0)
[22:46:36.539] Build status: STARTED
[22:46:36.539] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:14:0) after 8m23s
[22:54:59.686] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:14:0)
[22:54:59.704] Build status: STARTED
[22:54:59.704] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:15:0) after 6m30s
[23:01:29.785] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:15:0)
[23:01:29.811] Build status: STARTED
[23:01:29.811] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:16:0) after 7m12s
[23:08:42.029] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:16:0)
[23:08:42.047] Build status: STARTED
[23:08:42.047] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:17:0) after 1m49s
[23:10:31.117] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:17:0)
[23:10:31.216] Build status: STARTED
[23:10:31.216] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:18:0) after 1m42s
[23:12:13.375] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:18:0)
[23:12:13.396] Build status: STARTED
[23:12:13.396] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:19:0) after 7m53s
[23:20:06.555] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:19:0)
[23:20:06.578] Build status: STARTED
[23:20:06.578] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:20:0) after 9m1s
[23:29:07.630] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:20:0)
[23:29:07.655] Build status: STARTED
[23:29:07.655] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:21:0) after 6m5s
[23:35:12.714] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:21:0)
[23:35:12.731] Build status: STARTED
[23:35:12.731] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:22:0) after 6m24s
[23:41:36.855] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:22:0)
[23:41:36.876] Build status: STARTED
[23:41:36.876] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:23:0) after 3m42s
[23:45:18.923] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:23:0)
[23:45:18.944] Build status: STARTED
[23:45:18.944] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:24:0) after 4m24s
[23:49:43.151] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:24:0)
[23:49:43.192] Build status: STARTED
[23:49:43.192] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:25:0) after 2m16s
[23:51:59.391] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:25:0)
[23:51:59.412] Build status: STARTED
[23:51:59.412] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:26:0) after 6m44s
[23:58:43.465] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:26:0)
[23:58:43.483] Build status: STARTED
[23:58:43.483] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:27:0) after 8m12s
[00:06:55.606] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:27:0)
[00:06:55.703] Build status: STARTED
[00:06:55.703] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:28:0) after 4m46s
[00:11:41.833] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:28:0)
[00:11:41.856] Build status: STARTED
[00:11:41.856] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:29:0) after 1m51s
[00:13:32.979] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:29:0)
[00:13:33.011] Build status: STARTED
[00:13:33.011] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:30:0) after 9m2s
[00:22:35.232] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:30:0)
[00:22:35.295] Build status: STARTED
[00:22:35.295] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:31:0) after 8m53s
[00:31:28.541] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:31:0)
[00:31:28.559] Build status: STARTED
[00:31:28.559] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:32:0) after 2m33s
[00:34:01.583] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:32:0)
[00:34:01.600] Build status: STARTED
[00:34:01.600] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:33:0) after 4m50s
[00:38:51.802] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:33:0)
[00:38:51.818] Build status: STARTED
[00:38:51.818] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:34:0) after 4m33s
[00:43:24.844] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:34:0)
[00:43:24.861] Build status: STARTED
[00:43:24.861] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:35:0) after 4m37s
[00:48:01.898] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:35:0)
[00:48:01.977] Build status: STARTED
[00:48:01.977] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:36:0) after 3m59s
[00:52:01.164] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:36:0)
[00:52:01.344] Build status: STARTED
[00:52:01.344] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:37:0) after 1m38s
[00:53:39.351] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:37:0)
[00:53:39.447] Build status: STARTED
[00:53:39.447] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:38:0) after 7m1s
[01:00:40.643] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:38:0)
[01:00:40.673] Build status: STARTED
[01:00:40.673] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:39:0) after 8m35s
[01:09:15.883] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:39:0)
[01:09:15.899] Build status: STARTED
[01:09:15.899] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:40:0) after 3m57s
[01:13:13.002] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:40:0)
[01:13:13.024] Build status: STARTED
[01:13:13.024] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:41:0) after 5m58s
[01:19:11.044] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:41:0)
[01:19:11.069] Build status: STARTED
[01:19:11.070] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:42:0) after 8m35s
[01:27:46.091] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:42:0)
[01:27:46.112] Build status: STARTED
[01:27:46.112] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:43:0) after 3m52s
[01:31:38.193] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:43:0)
[01:31:38.215] Build status: STARTED
[01:31:38.215] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:44:0) after 6m29s
[01:38:07.340] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:44:0)
[01:38:07.357] Build status: STARTED
[01:38:07.357] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:45:0) after 8m39s
[01:46:46.507] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:45:0)
[01:46:46.524] Build status: STARTED
[01:46:46.524] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:46:0) after 6m18s
[01:53:04.569] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:46:0)
[01:53:04.591] Build status: STARTED
[01:53:04.591] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:47:0) after 3m41s
[01:56:45.592] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:47:0)
[01:56:45.607] Build status: STARTED
[01:56:45.608] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:48:0) after 1m44s
[01:58:29.714] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:48:0)
[01:58:29.850] Build status: STARTED
[01:58:29.850] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:49:0) after 1m44s
[02:00:13.864] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:49:0)
[02:00:13.889] Build status: STARTED
[02:00:13.889] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:50:0) after 9m46s
[02:09:59.938] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:50:0)
[02:09:59.966] Build status: STARTED
[02:09:59.966] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:51:0) after 9m37s
[02:19:37.045] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:51:0)
[02:19:37.074] Build status: STARTED
[02:19:37.074] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:52:0) after 8m41s
[02:28:18.111] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:52:0)
[02:28:18.129] Build status: STARTED
[02:28:18.129] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:53:0) after 6m26s
[02:34:44.173] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:53:0)
[02:34:44.476] Build status: STARTED
[02:34:44.476] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:54:0) after 3m9s
[02:37:53.494] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:54:0)
[02:37:53.511] Build status: STARTED
[02:37:53.511] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:55:0) after 7m41s
[02:45:34.635] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:55:0)
[02:45:34.659] Build status: STARTED
[02:45:34.660] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:56:0) after 5m40s
[02:51:14.691] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:56:0)
[02:51:14.709] Build status: STARTED
[02:51:14.709] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:57:0) after 3m25s
[02:54:39.774] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:57:0)
[02:54:39.796] Build status: STARTED
[02:54:39.796] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:58:0) after 4m12s
[02:58:51.852] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:58:0)
[02:58:51.877] Build status: STARTED
[02:58:51.878] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:59:0) after 3m0s
[03:01:51.879] Handling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:59:0)
[03:01:51.895] Build status: STARTED
[03:01:51.895] Scheduling timer "check-buildbucket-build-status" (chromium/android-arm64-proguard-rel:8848580675409001632:60:0) after 9m16s
[03:05:59.537] Received PubSub notification, asking Buildbucket for the build status
[03:05:59.554] Build:
{
"id": "8683150613377189873",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "android-arm64-proguard-rel"
},
"number": 16016,
"createdBy": "project:chromium",
"createTime": "2026-04-29T21:48:16.742031359Z",
"startTime": "2026-04-29T21:48:24.296245665Z",
"endTime": "2026-04-30T03:05:58.961208179Z",
"updateTime": "2026-04-30T03:05:58.961208179Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "9a371bcd1eca0e3ae4eb2a0370ab86723aee90bb",
"ref": "refs/heads/main"
}
},
"canary": true
}
[03:05:59.555] Invocation finished in 5h17m44.133586322s with status FAILED