[05:51:10.938] New invocation is queued and will start shortly
[05:51:12.526] Starting the invocation (attempt 1)
[05:51:12.552] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d6c00db2b4e894ae2c89f3d36559442bd65ddf44"
[05:51:12.552] Popped gitiles commit info from properties and tags
[05:51:12.552] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[05:51:12.552] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[05:51:12.552] Buildbucket request:
{
"requestId": "8835323135288031456",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d6c00db2b4e894ae2c89f3d36559442bd65ddf44",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8835323135288031456"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[05:51:13.411] Scheduled build:
{
"id": "8669893072783498865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 28515,
"createdBy": "project:chromium",
"createTime": "2026-09-23T05:51:12.705411115Z",
"updateTime": "2026-09-23T05:51:12.705411115Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d6c00db2b4e894ae2c89f3d36559442bd65ddf44",
"ref": "refs/heads/main"
}
}
}
[05:51:13.411] Task URL: https://cr-buildbucket.appspot.com/build/8669893072783498865
[05:51:13.411] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:2:0) after 8m37s
[05:51:17.791] Received PubSub notification, asking Buildbucket for the build status
[05:51:17.809] Build status: SCHEDULED
[05:59:50.427] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:2:0)
[05:59:50.447] Build status: SCHEDULED
[05:59:50.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:4:0) after 8m3s
[06:07:53.467] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:4:0)
[06:07:53.547] Build status: SCHEDULED
[06:07:53.547] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:5:0) after 4m27s
[06:12:20.613] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:5:0)
[06:12:20.651] Build status: SCHEDULED
[06:12:20.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:6:0) after 1m55s
[06:14:15.723] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:6:0)
[06:14:15.740] Build status: SCHEDULED
[06:14:15.740] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:7:0) after 2m41s
[06:16:12.685] Received PubSub notification, asking Buildbucket for the build status
[06:16:12.716] Build status: STARTED
[06:16:56.759] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:7:0)
[06:16:56.783] Build status: STARTED
[06:16:56.783] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:9:0) after 4m6s
[06:21:02.775] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:9:0)
[06:21:02.793] Build status: STARTED
[06:21:02.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:10:0) after 1m8s
[06:22:10.823] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:10:0)
[06:22:10.898] Build status: STARTED
[06:22:10.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:11:0) after 8m36s
[06:30:46.928] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:11:0)
[06:30:46.965] Build status: STARTED
[06:30:46.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:12:0) after 5m32s
[06:36:19.208] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:12:0)
[06:36:19.239] Build status: STARTED
[06:36:19.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:13:0) after 7m55s
[06:44:14.303] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:13:0)
[06:44:14.322] Build status: STARTED
[06:44:14.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:14:0) after 3m43s
[06:47:57.343] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:14:0)
[06:47:57.370] Build status: STARTED
[06:47:57.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:15:0) after 4m27s
[06:52:24.443] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:15:0)
[06:52:24.458] Build status: STARTED
[06:52:24.458] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:16:0) after 4m58s
[06:57:22.431] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:16:0)
[06:57:22.466] Build status: STARTED
[06:57:22.466] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:17:0) after 2m27s
[06:59:49.459] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:17:0)
[06:59:49.479] Build status: STARTED
[06:59:49.479] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:18:0) after 5m25s
[07:05:14.580] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:18:0)
[07:05:14.600] Build status: STARTED
[07:05:14.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:19:0) after 6m45s
[07:11:59.616] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:19:0)
[07:11:59.641] Build status: STARTED
[07:11:59.641] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:20:0) after 2m12s
[07:14:11.748] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:20:0)
[07:14:11.779] Build status: STARTED
[07:14:11.779] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:21:0) after 9m14s
[07:23:25.795] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:21:0)
[07:23:25.816] Build status: STARTED
[07:23:25.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:22:0) after 3m53s
[07:27:18.833] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:22:0)
[07:27:18.851] Build status: STARTED
[07:27:18.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:23:0) after 1m57s
[07:29:15.870] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:23:0)
[07:29:15.887] Build status: STARTED
[07:29:15.887] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:24:0) after 2m57s
[07:32:12.945] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:24:0)
[07:32:13.029] Build status: STARTED
[07:32:13.029] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:25:0) after 9m47s
[07:42:00.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:25:0)
[07:42:00.079] Build status: STARTED
[07:42:00.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:26:0) after 3m31s
[07:45:31.106] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:26:0)
[07:45:31.126] Build status: STARTED
[07:45:31.126] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:27:0) after 7m31s
[07:53:02.143] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:27:0)
[07:53:02.405] Build status: STARTED
[07:53:02.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:28:0) after 5m52s
[07:58:54.421] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:28:0)
[07:58:54.448] Build status: STARTED
[07:58:54.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:29:0) after 6m44s
[08:05:38.469] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:29:0)
[08:05:38.490] Build status: STARTED
[08:05:38.491] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:30:0) after 7m15s
[08:12:53.508] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:30:0)
[08:12:53.530] Build status: STARTED
[08:12:53.530] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:31:0) after 6m28s
[08:19:21.505] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:31:0)
[08:19:21.523] Build status: STARTED
[08:19:21.523] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:32:0) after 7m13s
[08:26:34.720] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:32:0)
[08:26:34.738] Build status: STARTED
[08:26:34.738] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:33:0) after 5m42s
[08:32:16.756] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:33:0)
[08:32:16.822] Build status: STARTED
[08:32:16.822] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:34:0) after 1m40s
[08:33:56.960] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:34:0)
[08:33:56.982] Build status: STARTED
[08:33:56.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:35:0) after 1m59s
[08:35:56.000] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:35:0)
[08:35:56.016] Build status: STARTED
[08:35:56.016] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:36:0) after 3m40s
[08:39:36.080] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:36:0)
[08:39:36.160] Build status: STARTED
[08:39:36.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:37:0) after 6m51s
[08:46:27.287] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:37:0)
[08:46:27.304] Build status: STARTED
[08:46:27.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:38:0) after 9m59s
[08:56:26.320] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:38:0)
[08:56:26.339] Build status: STARTED
[08:56:26.339] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:39:0) after 5m25s
[09:01:51.358] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:39:0)
[09:01:51.374] Build status: STARTED
[09:01:51.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:40:0) after 5m2s
[09:06:53.452] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:40:0)
[09:06:53.478] Build status: STARTED
[09:06:53.478] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:41:0) after 3m29s
[09:10:22.495] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:41:0)
[09:10:22.520] Build status: STARTED
[09:10:22.520] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:42:0) after 3m5s
[09:13:27.542] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:42:0)
[09:13:27.564] Build status: STARTED
[09:13:27.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:43:0) after 9m34s
[09:23:01.649] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:43:0)
[09:23:01.672] Build status: STARTED
[09:23:01.672] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:44:0) after 6m21s
[09:29:22.691] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:44:0)
[09:29:22.713] Build status: STARTED
[09:29:22.713] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:45:0) after 1m59s
[09:31:21.742] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:45:0)
[09:31:21.761] Build status: STARTED
[09:31:21.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:46:0) after 6m52s
[09:38:13.899] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:46:0)
[09:38:13.917] Build status: STARTED
[09:38:13.917] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:47:0) after 8m59s
[09:47:12.933] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:47:0)
[09:47:12.950] Build status: STARTED
[09:47:12.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:48:0) after 2m45s
[09:49:58.018] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:48:0)
[09:49:58.042] Build status: STARTED
[09:49:58.042] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:49:0) after 6m8s
[09:56:06.059] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:49:0)
[09:56:06.077] Build status: STARTED
[09:56:06.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:50:0) after 6m39s
[10:02:45.237] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:50:0)
[10:02:45.254] Build status: STARTED
[10:02:45.254] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8835323135288031456:51:0) after 4m7s
[10:03:20.664] Received PubSub notification, asking Buildbucket for the build status
[10:03:20.692] Build:
{
"id": "8669893072783498865",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 28515,
"createdBy": "project:chromium",
"createTime": "2026-09-23T05:51:12.705411115Z",
"startTime": "2026-09-23T06:16:12.484581201Z",
"endTime": "2026-09-23T10:03:20.384929974Z",
"updateTime": "2026-09-23T10:03:20.384929974Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d6c00db2b4e894ae2c89f3d36559442bd65ddf44",
"ref": "refs/heads/main"
}
}
}
[10:03:20.692] Invocation finished in 4h12m9.758658495s with status FAILED