[01:15:59.054] New invocation is queued and will start shortly
[01:16:00.635] Starting the invocation (attempt 1)
[01:16:00.666] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/267ecf240ea16349e148b4fee6d029d3f1b6c687"
[01:16:00.667] Popped gitiles commit info from properties and tags
[01:16:00.667] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[01:16:00.667] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[01:16:00.668] Buildbucket request:
{
"requestId": "8833437912965896240",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "267ecf240ea16349e148b4fee6d029d3f1b6c687",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8833437912965896240"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[01:16:01.288] Scheduled build:
{
"id": "8668007850522665841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 29033,
"createdBy": "project:chromium",
"createTime": "2026-10-14T01:16:00.756208347Z",
"updateTime": "2026-10-14T01:16:00.756208347Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "267ecf240ea16349e148b4fee6d029d3f1b6c687",
"ref": "refs/heads/main"
}
}
}
[01:16:01.288] Task URL: https://cr-buildbucket.appspot.com/build/8668007850522665841
[01:16:01.289] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:2:0) after 6m55s
[01:16:02.439] Received PubSub notification, asking Buildbucket for the build status
[01:16:02.609] Build status: SCHEDULED
[01:18:57.873] Received PubSub notification, asking Buildbucket for the build status
[01:18:57.897] Build status: STARTED
[01:22:56.427] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:2:0)
[01:22:56.452] Build status: STARTED
[01:22:56.452] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:5:0) after 2m11s
[01:25:07.600] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:5:0)
[01:25:07.640] Build status: STARTED
[01:25:07.640] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:6:0) after 8m8s
[01:33:15.806] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:6:0)
[01:33:16.018] Build status: STARTED
[01:33:16.018] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:7:0) after 4m13s
[01:37:29.103] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:7:0)
[01:37:29.130] Build status: STARTED
[01:37:29.130] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:8:0) after 2m30s
[01:39:59.294] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:8:0)
[01:39:59.311] Build status: STARTED
[01:39:59.311] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:9:0) after 4m16s
[01:44:15.346] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:9:0)
[01:44:15.396] Build status: STARTED
[01:44:15.396] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:10:0) after 2m39s
[01:46:54.439] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:10:0)
[01:46:54.457] Build status: STARTED
[01:46:54.457] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:11:0) after 8m10s
[01:55:04.540] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:11:0)
[01:55:04.586] Build status: STARTED
[01:55:04.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:12:0) after 8m41s
[02:03:45.693] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:12:0)
[02:03:45.712] Build status: STARTED
[02:03:45.712] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:13:0) after 8m3s
[02:11:48.746] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:13:0)
[02:11:48.766] Build status: STARTED
[02:11:48.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:14:0) after 9m13s
[02:21:01.873] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:14:0)
[02:21:01.898] Build status: STARTED
[02:21:01.898] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:15:0) after 1m42s
[02:22:44.000] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:15:0)
[02:22:44.053] Build status: STARTED
[02:22:44.054] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:16:0) after 7m45s
[02:30:29.261] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:16:0)
[02:30:29.330] Build status: STARTED
[02:30:29.330] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:17:0) after 8m53s
[02:39:22.441] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:17:0)
[02:39:22.486] Build status: STARTED
[02:39:22.487] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:18:0) after 8m7s
[02:47:29.637] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:18:0)
[02:47:29.654] Build status: STARTED
[02:47:29.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:19:0) after 3m13s
[02:50:42.702] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:19:0)
[02:50:42.726] Build status: STARTED
[02:50:42.726] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:20:0) after 4m20s
[02:55:02.936] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:20:0)
[02:55:02.954] Build status: STARTED
[02:55:02.954] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:21:0) after 7m57s
[03:02:59.971] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:21:0)
[03:03:00.024] Build status: STARTED
[03:03:00.024] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:22:0) after 6m38s
[03:09:38.143] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:22:0)
[03:09:38.177] Build status: STARTED
[03:09:38.178] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:23:0) after 4m37s
[03:14:15.385] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:23:0)
[03:14:15.405] Build status: STARTED
[03:14:15.405] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:24:0) after 9m23s
[03:23:38.451] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:24:0)
[03:23:38.484] Build status: STARTED
[03:23:38.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:25:0) after 5m2s
[03:28:40.593] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:25:0)
[03:28:40.612] Build status: STARTED
[03:28:40.612] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:26:0) after 6m27s
[03:35:07.703] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:26:0)
[03:35:07.760] Build status: STARTED
[03:35:07.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:27:0) after 9m20s
[03:44:27.853] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:27:0)
[03:44:27.884] Build status: STARTED
[03:44:27.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:28:0) after 6m11s
[03:50:39.005] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:28:0)
[03:50:39.159] Build status: STARTED
[03:50:39.160] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:29:0) after 4m55s
[03:55:34.215] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:29:0)
[03:55:34.239] Build status: STARTED
[03:55:34.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:30:0) after 7m18s
[04:02:52.328] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:30:0)
[04:02:52.371] Build status: STARTED
[04:02:52.371] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:31:0) after 4m16s
[04:07:08.568] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:31:0)
[04:07:08.586] Build status: STARTED
[04:07:08.586] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:32:0) after 4m21s
[04:11:29.654] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:32:0)
[04:11:29.693] Build status: STARTED
[04:11:29.707] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:33:0) after 9m10s
[04:20:39.808] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:33:0)
[04:20:39.833] Build status: STARTED
[04:20:39.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:34:0) after 3m48s
[04:24:27.911] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:34:0)
[04:24:27.931] Build status: STARTED
[04:24:27.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:35:0) after 6m16s
[04:30:43.971] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:35:0)
[04:30:44.006] Build status: STARTED
[04:30:44.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:36:0) after 5m10s
[04:35:54.053] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:36:0)
[04:35:54.086] Build status: STARTED
[04:35:54.086] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:37:0) after 6m15s
[04:42:09.114] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:37:0)
[04:42:09.129] Build status: STARTED
[04:42:09.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:38:0) after 3m34s
[04:45:43.168] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:38:0)
[04:45:43.188] Build status: STARTED
[04:45:43.188] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:39:0) after 8m6s
[04:53:49.220] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:39:0)
[04:53:49.238] Build status: STARTED
[04:53:49.239] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:40:0) after 7m3s
[05:00:52.376] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:40:0)
[05:00:52.423] Build status: STARTED
[05:00:52.423] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:41:0) after 9m44s
[05:10:36.526] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:41:0)
[05:10:36.546] Build status: STARTED
[05:10:36.546] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:42:0) after 6m9s
[05:16:45.616] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:42:0)
[05:16:45.637] Build status: STARTED
[05:16:45.637] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:43:0) after 7m57s
[05:24:42.667] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:43:0)
[05:24:42.688] Build status: STARTED
[05:24:42.688] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:44:0) after 1m31s
[05:26:13.724] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:44:0)
[05:26:13.851] Build status: STARTED
[05:26:13.851] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:45:0) after 3m43s
[05:29:56.952] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:45:0)
[05:29:56.981] Build status: STARTED
[05:29:56.981] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:46:0) after 4m30s
[05:34:27.112] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:46:0)
[05:34:27.141] Build status: STARTED
[05:34:27.141] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:47:0) after 2m40s
[05:37:07.223] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:47:0)
[05:37:07.262] Build status: STARTED
[05:37:07.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:48:0) after 2m44s
[05:39:51.305] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:48:0)
[05:39:51.326] Build status: STARTED
[05:39:51.326] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:49:0) after 3m29s
[05:43:20.424] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:49:0)
[05:43:20.442] Build status: STARTED
[05:43:20.442] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:50:0) after 9m44s
[05:53:04.475] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:50:0)
[05:53:04.500] Build status: STARTED
[05:53:04.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:51:0) after 8m26s
[06:01:30.521] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:51:0)
[06:01:30.540] Build status: STARTED
[06:01:30.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:52:0) after 8m8s
[06:09:38.575] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:52:0)
[06:09:38.593] Build status: STARTED
[06:09:38.593] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:53:0) after 6m11s
[06:15:49.703] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:53:0)
[06:15:49.722] Build status: STARTED
[06:15:49.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:54:0) after 7m47s
[06:23:36.764] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:54:0)
[06:23:36.785] Build status: STARTED
[06:23:36.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:55:0) after 8m45s
[06:32:21.939] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:55:0)
[06:32:21.965] Build status: STARTED
[06:32:21.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:56:0) after 1m35s
[06:33:57.038] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:56:0)
[06:33:57.066] Build status: STARTED
[06:33:57.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:57:0) after 4m18s
[06:38:15.099] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:57:0)
[06:38:15.150] Build status: STARTED
[06:38:15.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:58:0) after 1m37s
[06:39:52.240] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:58:0)
[06:39:52.262] Build status: STARTED
[06:39:52.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:59:0) after 8m42s
[06:48:34.353] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:59:0)
[06:48:34.378] Build status: STARTED
[06:48:34.378] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:60:0) after 5m49s
[06:54:23.488] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:60:0)
[06:54:23.517] Build status: STARTED
[06:54:23.517] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:61:0) after 5m52s
[07:00:15.696] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:61:0)
[07:00:15.729] Build status: STARTED
[07:00:15.729] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8833437912965896240:62:0) after 7m4s
[07:00:56.988] Received PubSub notification, asking Buildbucket for the build status
[07:00:57.006] Build:
{
"id": "8668007850522665841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 29033,
"createdBy": "project:chromium",
"createTime": "2026-10-14T01:16:00.756208347Z",
"startTime": "2026-10-14T01:18:57.681623733Z",
"endTime": "2026-10-14T07:00:44.624931539Z",
"updateTime": "2026-10-14T07:00:44.624931539Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "267ecf240ea16349e148b4fee6d029d3f1b6c687",
"ref": "refs/heads/main"
}
}
}
[07:00:57.006] Invocation finished in 5h44m57.962378857s with status FAILED