[09:42:40.364] New invocation is queued and will start shortly
[09:42:41.475] Starting the invocation (attempt 1)
[09:42:41.498] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/3b2da078e55b406b68baf15ef288688972df4e36"
[09:42:41.499] Popped gitiles commit info from properties and tags
[09:42:41.499] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:42:41.499] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:42:41.499] Buildbucket request:
{
"requestId": "8841922149718210672",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b2da078e55b406b68baf15ef288688972df4e36",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8841922149718210672"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:42:41.979] Scheduled build:
{
"id": "8676492087793014417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 27499,
"createdBy": "project:chromium",
"createTime": "2026-07-12T09:42:41.577385440Z",
"updateTime": "2026-07-12T09:42:41.577385440Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b2da078e55b406b68baf15ef288688972df4e36",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:42:41.979] Task URL: https://cr-buildbucket.appspot.com/build/8676492087793014417
[09:42:41.979] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:2:0) after 2m54s
[09:42:42.931] Received PubSub notification, asking Buildbucket for the build status
[09:42:42.974] Build status: SCHEDULED
[09:44:56.772] Received PubSub notification, asking Buildbucket for the build status
[09:44:56.793] Build status: STARTED
[09:45:35.999] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:2:0)
[09:45:36.036] Build status: STARTED
[09:45:36.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:5:0) after 2m13s
[09:47:49.092] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:5:0)
[09:47:49.143] Build status: STARTED
[09:47:49.143] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:6:0) after 3m4s
[09:50:53.109] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:6:0)
[09:50:53.181] Build status: STARTED
[09:50:53.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:7:0) after 1m31s
[09:52:24.204] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:7:0)
[09:52:24.240] Build status: STARTED
[09:52:24.240] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:8:0) after 3m28s
[09:55:52.259] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:8:0)
[09:55:52.278] Build status: STARTED
[09:55:52.278] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:9:0) after 6m44s
[10:02:36.342] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:9:0)
[10:02:36.362] Build status: STARTED
[10:02:36.362] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:10:0) after 5m20s
[10:07:56.697] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:10:0)
[10:07:56.714] Build status: STARTED
[10:07:56.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:11:0) after 3m24s
[10:11:20.848] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:11:0)
[10:11:20.865] Build status: STARTED
[10:11:20.865] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:12:0) after 5m27s
[10:16:47.972] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:12:0)
[10:16:47.996] Build status: STARTED
[10:16:47.996] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:13:0) after 6m36s
[10:23:24.108] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:13:0)
[10:23:24.133] Build status: STARTED
[10:23:24.133] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:14:0) after 7m8s
[10:30:32.149] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:14:0)
[10:30:32.248] Build status: STARTED
[10:30:32.248] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:15:0) after 5m0s
[10:35:32.335] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:15:0)
[10:35:32.351] Build status: STARTED
[10:35:32.351] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:16:0) after 1m27s
[10:36:59.456] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:16:0)
[10:36:59.472] Build status: STARTED
[10:36:59.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:17:0) after 9m46s
[10:46:45.526] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:17:0)
[10:46:45.588] Build status: STARTED
[10:46:45.588] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:18:0) after 6m58s
[10:53:43.743] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:18:0)
[10:53:43.758] Build status: STARTED
[10:53:43.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:19:0) after 3m45s
[10:57:29.028] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:19:0)
[10:57:29.045] Build status: STARTED
[10:57:29.046] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:20:0) after 5m48s
[11:03:17.248] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:20:0)
[11:03:17.393] Build status: STARTED
[11:03:17.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:21:0) after 9m33s
[11:12:50.544] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:21:0)
[11:12:50.558] Build status: STARTED
[11:12:50.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:22:0) after 6m45s
[11:19:35.573] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:22:0)
[11:19:35.595] Build status: STARTED
[11:19:35.595] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:23:0) after 2m3s
[11:21:38.613] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:23:0)
[11:21:38.716] Build status: STARTED
[11:21:38.716] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:24:0) after 2m11s
[11:23:49.715] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:24:0)
[11:23:49.734] Build status: STARTED
[11:23:49.734] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:25:0) after 6m16s
[11:30:05.748] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:25:0)
[11:30:05.815] Build status: STARTED
[11:30:05.815] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:26:0) after 4m38s
[11:34:44.161] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:26:0)
[11:34:44.178] Build status: STARTED
[11:34:44.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:27:0) after 7m7s
[11:41:51.325] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:27:0)
[11:41:51.501] Build status: STARTED
[11:41:51.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:28:0) after 7m32s
[11:49:23.946] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:28:0)
[11:49:23.964] Build status: STARTED
[11:49:23.964] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:29:0) after 4m54s
[11:54:17.992] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:29:0)
[11:54:18.009] Build status: STARTED
[11:54:18.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:30:0) after 6m36s
[12:00:54.311] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:30:0)
[12:00:54.348] Build status: STARTED
[12:00:54.348] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:31:0) after 8m11s
[12:09:05.365] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:31:0)
[12:09:05.391] Build status: STARTED
[12:09:05.391] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:32:0) after 9m45s
[12:18:50.507] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:32:0)
[12:18:50.524] Build status: STARTED
[12:18:50.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:33:0) after 8m48s
[12:27:38.608] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:33:0)
[12:27:38.630] Build status: STARTED
[12:27:38.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:34:0) after 6m13s
[12:33:51.647] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:34:0)
[12:33:51.668] Build status: STARTED
[12:33:51.668] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:35:0) after 3m15s
[12:37:06.932] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:35:0)
[12:37:06.951] Build status: STARTED
[12:37:06.951] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:36:0) after 3m3s
[12:40:09.976] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:36:0)
[12:40:09.993] Build status: STARTED
[12:40:09.993] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:37:0) after 2m4s
[12:42:14.002] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:37:0)
[12:42:14.061] Build status: STARTED
[12:42:14.061] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:38:0) after 7m11s
[12:49:25.374] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:38:0)
[12:49:25.475] Build status: STARTED
[12:49:25.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:39:0) after 3m8s
[12:52:33.487] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:39:0)
[12:52:33.619] Build status: STARTED
[12:52:33.619] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:40:0) after 4m18s
[12:56:51.691] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:40:0)
[12:56:51.710] Build status: STARTED
[12:56:51.710] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:41:0) after 9m16s
[13:06:07.960] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:41:0)
[13:06:07.983] Build status: STARTED
[13:06:07.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:42:0) after 1m23s
[13:07:31.098] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:42:0)
[13:07:31.120] Build status: STARTED
[13:07:31.120] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:43:0) after 6m42s
[13:14:13.137] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:43:0)
[13:14:13.157] Build status: STARTED
[13:14:13.157] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:44:0) after 9m9s
[13:23:22.336] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:44:0)
[13:23:22.356] Build status: STARTED
[13:23:22.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:45:0) after 4m47s
[13:28:09.585] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:45:0)
[13:28:09.600] Build status: STARTED
[13:28:09.600] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:46:0) after 1m19s
[13:29:28.653] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:46:0)
[13:29:28.671] Build status: STARTED
[13:29:28.671] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:47:0) after 9m47s
[13:39:15.870] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:47:0)
[13:39:15.890] Build status: STARTED
[13:39:15.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:48:0) after 9m2s
[13:48:17.972] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:48:0)
[13:48:17.990] Build status: STARTED
[13:48:17.990] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:49:0) after 3m25s
[13:51:43.061] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:49:0)
[13:51:43.079] Build status: STARTED
[13:51:43.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:50:0) after 7m6s
[13:58:49.195] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:50:0)
[13:58:49.218] Build status: STARTED
[13:58:49.218] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:51:0) after 5m1s
[14:03:50.233] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:51:0)
[14:03:50.256] Build status: STARTED
[14:03:50.256] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:52:0) after 6m43s
[14:10:33.272] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:52:0)
[14:10:33.310] Build status: STARTED
[14:10:33.310] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:53:0) after 6m45s
[14:17:18.359] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:53:0)
[14:17:18.382] Build status: STARTED
[14:17:18.382] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:54:0) after 7m17s
[14:24:35.472] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:54:0)
[14:24:35.511] Build status: STARTED
[14:24:35.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:55:0) after 1m51s
[14:26:26.676] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:55:0)
[14:26:26.695] Build status: STARTED
[14:26:26.695] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:56:0) after 2m35s
[14:29:02.101] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:56:0)
[14:29:02.121] Build status: STARTED
[14:29:02.121] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:57:0) after 4m11s
[14:33:13.500] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:57:0)
[14:33:13.534] Build status: STARTED
[14:33:13.534] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:58:0) after 5m39s
[14:38:52.550] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:58:0)
[14:38:52.566] Build status: STARTED
[14:38:52.566] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:59:0) after 1m10s
[14:40:02.623] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:59:0)
[14:40:02.667] Build status: STARTED
[14:40:02.667] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:60:0) after 8m29s
[14:48:31.682] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:60:0)
[14:48:31.700] Build status: STARTED
[14:48:31.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:61:0) after 2m53s
[14:51:24.790] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:61:0)
[14:51:24.856] Build status: STARTED
[14:51:24.856] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:62:0) after 1m4s
[14:52:29.135] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:62:0)
[14:52:29.184] Build status: STARTED
[14:52:29.184] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:63:0) after 9m55s
[15:02:24.257] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:63:0)
[15:02:24.277] Build status: STARTED
[15:02:24.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:64:0) after 3m36s
[15:06:00.318] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:64:0)
[15:06:00.334] Build status: STARTED
[15:06:00.334] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8841922149718210672:65:0) after 6m44s
[15:06:14.499] Received PubSub notification, asking Buildbucket for the build status
[15:06:14.526] Build:
{
"id": "8676492087793014417",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 27499,
"createdBy": "project:chromium",
"createTime": "2026-07-12T09:42:41.577385440Z",
"startTime": "2026-07-12T09:44:54.897268475Z",
"endTime": "2026-07-12T15:06:14.238206720Z",
"updateTime": "2026-07-12T15:06:14.238206720Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "3b2da078e55b406b68baf15ef288688972df4e36",
"ref": "refs/heads/main"
}
},
"canary": true
}
[15:06:14.526] Invocation finished in 5h23m34.168258919s with status FAILED