[01:38:06.228] New invocation is queued and will start shortly
[01:38:07.273] Starting the invocation (attempt 1)
[01:38:07.302] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/e98e93acc822f6a8ed6de07f794cb779e4e435a0"
[01:38:07.302] Popped gitiles commit info from properties and tags
[01:38:07.302] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:38:07.304] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:38:07.304] Buildbucket request:
{
"requestId": "8834342490983990320",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e98e93acc822f6a8ed6de07f794cb779e4e435a0",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8834342490983990320"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:38:07.930] Scheduled build:
{
"id": "8668912429126789937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 28848,
"createdBy": "project:chromium",
"createTime": "2026-10-04T01:38:07.374658016Z",
"updateTime": "2026-10-04T01:38:07.374658016Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e98e93acc822f6a8ed6de07f794cb779e4e435a0",
"ref": "refs/heads/main"
}
}
}
[01:38:07.930] Task URL: https://cr-buildbucket.appspot.com/build/8668912429126789937
[01:38:07.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:2:0) after 2m17s
[01:38:08.813] Received PubSub notification, asking Buildbucket for the build status
[01:38:08.830] Build status: SCHEDULED
[01:39:32.856] Received PubSub notification, asking Buildbucket for the build status
[01:39:32.877] Build status: STARTED
[01:40:24.937] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:2:0)
[01:40:24.982] Build status: STARTED
[01:40:24.982] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:5:0) after 2m19s
[01:42:43.991] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:5:0)
[01:42:44.009] Build status: STARTED
[01:42:44.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:6:0) after 2m35s
[01:45:18.998] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:6:0)
[01:45:19.015] Build status: STARTED
[01:45:19.015] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:7:0) after 9m56s
[01:55:15.031] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:7:0)
[01:55:15.059] Build status: STARTED
[01:55:15.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:8:0) after 2m58s
[01:58:13.136] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:8:0)
[01:58:13.167] Build status: STARTED
[01:58:13.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:9:0) after 8m28s
[02:06:41.188] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:9:0)
[02:06:41.209] Build status: STARTED
[02:06:41.209] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:10:0) after 6m40s
[02:13:21.226] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:10:0)
[02:13:21.247] Build status: STARTED
[02:13:21.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:11:0) after 5m0s
[02:18:21.260] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:11:0)
[02:18:21.279] Build status: STARTED
[02:18:21.279] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:12:0) after 6m31s
[02:24:52.345] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:12:0)
[02:24:52.418] Build status: STARTED
[02:24:52.418] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:13:0) after 4m3s
[02:28:55.443] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:13:0)
[02:28:55.521] Build status: STARTED
[02:28:55.521] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:14:0) after 1m8s
[02:30:03.637] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:14:0)
[02:30:03.665] Build status: STARTED
[02:30:03.665] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:15:0) after 7m41s
[02:37:44.685] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:15:0)
[02:37:44.708] Build status: STARTED
[02:37:44.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:16:0) after 7m11s
[02:44:55.725] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:16:0)
[02:44:55.742] Build status: STARTED
[02:44:55.742] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:17:0) after 2m52s
[02:47:47.761] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:17:0)
[02:47:47.787] Build status: STARTED
[02:47:47.787] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:18:0) after 8m57s
[02:56:44.784] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:18:0)
[02:56:44.819] Build status: STARTED
[02:56:44.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:19:0) after 9m24s
[03:06:08.808] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:19:0)
[03:06:08.830] Build status: STARTED
[03:06:08.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:20:0) after 3m48s
[03:09:56.863] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:20:0)
[03:09:56.930] Build status: STARTED
[03:09:56.930] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:21:0) after 6m39s
[03:16:35.974] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:21:0)
[03:16:35.998] Build status: STARTED
[03:16:35.998] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:22:0) after 4m4s
[03:20:40.015] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:22:0)
[03:20:40.034] Build status: STARTED
[03:20:40.034] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:23:0) after 5m9s
[03:25:49.048] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:23:0)
[03:25:49.070] Build status: STARTED
[03:25:49.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:24:0) after 6m5s
[03:31:54.091] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:24:0)
[03:31:54.121] Build status: STARTED
[03:31:54.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:25:0) after 2m33s
[03:34:27.187] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:25:0)
[03:34:27.206] Build status: STARTED
[03:34:27.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:26:0) after 4m19s
[03:38:46.234] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:26:0)
[03:38:46.257] Build status: STARTED
[03:38:46.257] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:27:0) after 3m58s
[03:42:44.319] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:27:0)
[03:42:44.416] Build status: STARTED
[03:42:44.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:28:0) after 1m50s
[03:44:34.748] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:28:0)
[03:44:34.773] Build status: STARTED
[03:44:34.773] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:29:0) after 7m12s
[03:51:46.933] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:29:0)
[03:51:47.006] Build status: STARTED
[03:51:47.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:30:0) after 1m14s
[03:53:01.023] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:30:0)
[03:53:01.044] Build status: STARTED
[03:53:01.044] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:31:0) after 5m7s
[03:58:08.414] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:31:0)
[03:58:08.436] Build status: STARTED
[03:58:08.436] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:32:0) after 6m21s
[04:04:29.502] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:32:0)
[04:04:29.526] Build status: STARTED
[04:04:29.526] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:33:0) after 4m47s
[04:09:16.543] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:33:0)
[04:09:16.568] Build status: STARTED
[04:09:16.569] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:34:0) after 2m32s
[04:11:48.633] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:34:0)
[04:11:48.673] Build status: STARTED
[04:11:48.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:35:0) after 7m42s
[04:19:30.689] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:35:0)
[04:19:30.708] Build status: STARTED
[04:19:30.708] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:36:0) after 4m51s
[04:24:21.723] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:36:0)
[04:24:21.852] Build status: STARTED
[04:24:21.852] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:37:0) after 2m6s
[04:26:27.864] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:37:0)
[04:26:27.900] Build status: STARTED
[04:26:27.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:38:0) after 6m56s
[04:33:23.901] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:38:0)
[04:33:23.957] Build status: STARTED
[04:33:23.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:39:0) after 1m20s
[04:34:44.012] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:39:0)
[04:34:44.028] Build status: STARTED
[04:34:44.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:40:0) after 3m18s
[04:38:02.024] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:40:0)
[04:38:02.052] Build status: STARTED
[04:38:02.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:41:0) after 1m51s
[04:39:53.043] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:41:0)
[04:39:53.162] Build status: STARTED
[04:39:53.162] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:42:0) after 4m35s
[04:44:28.199] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:42:0)
[04:44:28.219] Build status: STARTED
[04:44:28.219] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:43:0) after 8m23s
[04:52:51.276] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:43:0)
[04:52:51.292] Build status: STARTED
[04:52:51.292] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:44:0) after 9m16s
[05:02:07.309] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:44:0)
[05:02:07.338] Build status: STARTED
[05:02:07.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:45:0) after 8m46s
[05:10:53.387] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:45:0)
[05:10:53.405] Build status: STARTED
[05:10:53.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:46:0) after 6m59s
[05:17:52.499] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:46:0)
[05:17:52.517] Build status: STARTED
[05:17:52.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:47:0) after 9m1s
[05:26:53.650] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:47:0)
[05:26:53.670] Build status: STARTED
[05:26:53.670] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:48:0) after 9m41s
[05:36:34.736] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:48:0)
[05:36:34.761] Build status: STARTED
[05:36:34.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:49:0) after 7m37s
[05:44:11.856] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:49:0)
[05:44:11.899] Build status: STARTED
[05:44:11.900] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:50:0) after 4m13s
[05:48:24.916] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:50:0)
[05:48:25.012] Build status: STARTED
[05:48:25.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:51:0) after 4m40s
[05:53:05.037] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:51:0)
[05:53:05.072] Build status: STARTED
[05:53:05.072] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:52:0) after 9m31s
[06:02:36.096] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:52:0)
[06:02:36.114] Build status: STARTED
[06:02:36.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:53:0) after 2m42s
[06:05:18.231] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:53:0)
[06:05:18.247] Build status: STARTED
[06:05:18.247] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:54:0) after 2m36s
[06:07:54.276] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:54:0)
[06:07:54.299] Build status: STARTED
[06:07:54.299] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:55:0) after 3m36s
[06:11:30.338] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:55:0)
[06:11:30.374] Build status: STARTED
[06:11:30.374] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:56:0) after 2m26s
[06:13:56.395] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:56:0)
[06:13:56.411] Build status: STARTED
[06:13:56.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:57:0) after 4m37s
[06:18:33.528] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:57:0)
[06:18:33.561] Build status: STARTED
[06:18:33.561] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:58:0) after 9m24s
[06:27:57.619] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:58:0)
[06:27:57.680] Build status: STARTED
[06:27:57.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:59:0) after 5m0s
[06:32:57.697] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:59:0)
[06:32:57.721] Build status: STARTED
[06:32:57.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:60:0) after 6m3s
[06:39:00.734] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:60:0)
[06:39:00.748] Build status: STARTED
[06:39:00.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:61:0) after 7m48s
[06:46:48.824] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:61:0)
[06:46:48.842] Build status: STARTED
[06:46:48.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:62:0) after 3m57s
[06:50:46.062] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:62:0)
[06:50:46.083] Build status: STARTED
[06:50:46.083] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:63:0) after 3m25s
[06:54:11.321] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:63:0)
[06:54:11.344] Build status: STARTED
[06:54:11.344] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:64:0) after 2m19s
[06:56:30.417] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:64:0)
[06:56:30.435] Build status: STARTED
[06:56:30.435] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:65:0) after 4m9s
[07:00:39.468] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:65:0)
[07:00:39.498] Build status: STARTED
[07:00:39.498] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8834342490983990320:66:0) after 3m50s
[07:03:27.427] Received PubSub notification, asking Buildbucket for the build status
[07:03:27.447] Build:
{
"id": "8668912429126789937",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 28848,
"createdBy": "project:chromium",
"createTime": "2026-10-04T01:38:07.374658016Z",
"startTime": "2026-10-04T01:39:32.270637714Z",
"endTime": "2026-10-04T07:03:27.131894958Z",
"updateTime": "2026-10-04T07:03:27.131894958Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "e98e93acc822f6a8ed6de07f794cb779e4e435a0",
"ref": "refs/heads/main"
}
}
}
[07:03:27.448] Invocation finished in 5h25m21.227219693s with status FAILED