[22:48:45.614] New invocation is queued and will start shortly
[22:48:46.662] Starting the invocation (attempt 1)
[22:48:46.693] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/72750737b3547c24c43ec61fe491a3bafe1223cd"
[22:48:46.693] Popped gitiles commit info from properties and tags
[22:48:46.693] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[22:48:46.693] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[22:48:46.693] Buildbucket request:
{
"requestId": "8853106717204949504",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "72750737b3547c24c43ec61fe491a3bafe1223cd",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8853106717204949504"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidOfficial"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[22:48:47.164] Scheduled build:
{
"id": "8687676655362674913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 26346,
"createdBy": "project:chromium",
"createTime": "2026-03-10T22:48:46.746763856Z",
"updateTime": "2026-03-10T22:48:46.746763856Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "72750737b3547c24c43ec61fe491a3bafe1223cd",
"ref": "refs/heads/main"
}
}
}
[22:48:47.164] Task URL: https://cr-buildbucket.appspot.com/build/8687676655362674913
[22:48:47.164] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:2:0) after 3m50s
[22:48:48.113] Received PubSub notification, asking Buildbucket for the build status
[22:48:48.131] Build status: SCHEDULED
[22:48:52.179] Received PubSub notification, asking Buildbucket for the build status
[22:48:52.216] Build status: STARTED
[22:52:37.186] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:2:0)
[22:52:37.206] Build status: STARTED
[22:52:37.207] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:5:0) after 6m13s
[22:58:50.274] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:5:0)
[22:58:50.297] Build status: STARTED
[22:58:50.297] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:6:0) after 9m31s
[23:08:21.315] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:6:0)
[23:08:21.336] Build status: STARTED
[23:08:21.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:7:0) after 4m6s
[23:12:27.354] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:7:0)
[23:12:27.415] Build status: STARTED
[23:12:27.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:8:0) after 8m23s
[23:20:50.401] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:8:0)
[23:20:50.419] Build status: STARTED
[23:20:50.419] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:9:0) after 6m58s
[23:27:48.434] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:9:0)
[23:27:48.500] Build status: STARTED
[23:27:48.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:10:0) after 9m49s
[23:37:37.514] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:10:0)
[23:37:37.537] Build status: STARTED
[23:37:37.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:11:0) after 2m15s
[23:39:52.519] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:11:0)
[23:39:52.535] Build status: STARTED
[23:39:52.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:12:0) after 6m26s
[23:46:18.567] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:12:0)
[23:46:18.652] Build status: STARTED
[23:46:18.652] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:13:0) after 9m25s
[23:55:43.683] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:13:0)
[23:55:43.696] Build status: STARTED
[23:55:43.696] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:14:0) after 7m3s
[00:02:46.710] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:14:0)
[00:02:46.745] Build status: STARTED
[00:02:46.745] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:15:0) after 4m29s
[00:07:15.766] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:15:0)
[00:07:15.791] Build status: STARTED
[00:07:15.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:16:0) after 4m10s
[00:11:25.817] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:16:0)
[00:11:25.896] Build status: STARTED
[00:11:25.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:17:0) after 1m11s
[00:12:36.910] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:17:0)
[00:12:36.924] Build status: STARTED
[00:12:36.924] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:18:0) after 4m55s
[00:17:31.938] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:18:0)
[00:17:31.957] Build status: STARTED
[00:17:31.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:19:0) after 2m9s
[00:19:40.975] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:19:0)
[00:19:40.988] Build status: STARTED
[00:19:40.988] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:20:0) after 8m0s
[00:27:41.012] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:20:0)
[00:27:41.028] Build status: STARTED
[00:27:41.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:21:0) after 3m39s
[00:31:20.044] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:21:0)
[00:31:20.071] Build status: STARTED
[00:31:20.071] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:22:0) after 6m45s
[00:38:05.337] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:22:0)
[00:38:05.356] Build status: STARTED
[00:38:05.356] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:23:0) after 6m25s
[00:44:30.805] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:23:0)
[00:44:30.828] Build status: STARTED
[00:44:30.828] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:24:0) after 1m17s
[00:45:47.843] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:24:0)
[00:45:47.860] Build status: STARTED
[00:45:47.860] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:25:0) after 6m31s
[00:52:18.876] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:25:0)
[00:52:18.891] Build status: STARTED
[00:52:18.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:26:0) after 3m54s
[00:56:12.904] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:26:0)
[00:56:12.919] Build status: STARTED
[00:56:12.919] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:27:0) after 8m6s
[01:04:19.006] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:27:0)
[01:04:19.035] Build status: STARTED
[01:04:19.036] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:28:0) after 2m12s
[01:06:31.108] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:28:0)
[01:06:31.127] Build status: STARTED
[01:06:31.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:29:0) after 7m24s
[01:13:55.194] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:29:0)
[01:13:55.215] Build status: STARTED
[01:13:55.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:30:0) after 7m52s
[01:21:47.231] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:30:0)
[01:21:47.265] Build status: STARTED
[01:21:47.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:31:0) after 9m20s
[01:31:07.285] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:31:0)
[01:31:07.305] Build status: STARTED
[01:31:07.305] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:32:0) after 6m36s
[01:37:43.376] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:32:0)
[01:37:43.413] Build status: STARTED
[01:37:43.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:33:0) after 8m31s
[01:46:14.485] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:33:0)
[01:46:14.505] Build status: STARTED
[01:46:14.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:34:0) after 6m47s
[01:53:01.522] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:34:0)
[01:53:01.539] Build status: STARTED
[01:53:01.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:35:0) after 2m0s
[01:55:01.605] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:35:0)
[01:55:01.625] Build status: STARTED
[01:55:01.625] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:36:0) after 7m17s
[02:02:18.648] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:36:0)
[02:02:18.664] Build status: STARTED
[02:02:18.664] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:37:0) after 9m16s
[02:11:34.683] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:37:0)
[02:11:34.700] Build status: STARTED
[02:11:34.700] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:38:0) after 8m0s
[02:19:34.810] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:38:0)
[02:19:34.830] Build status: STARTED
[02:19:34.830] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:39:0) after 3m18s
[02:22:52.899] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:39:0)
[02:22:52.965] Build status: STARTED
[02:22:52.965] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:40:0) after 9m25s
[02:32:17.988] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:40:0)
[02:32:18.013] Build status: STARTED
[02:32:18.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:41:0) after 9m36s
[02:41:54.031] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:41:0)
[02:41:54.050] Build status: STARTED
[02:41:54.050] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:42:0) after 7m7s
[02:49:01.118] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:42:0)
[02:49:01.136] Build status: STARTED
[02:49:01.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:43:0) after 7m31s
[02:56:32.154] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:43:0)
[02:56:32.168] Build status: STARTED
[02:56:32.168] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:44:0) after 9m33s
[03:06:05.276] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:44:0)
[03:06:05.291] Build status: STARTED
[03:06:05.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:45:0) after 8m17s
[03:14:22.277] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:45:0)
[03:14:22.298] Build status: STARTED
[03:14:22.298] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:46:0) after 8m13s
[03:22:35.316] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:46:0)
[03:22:35.366] Build status: STARTED
[03:22:35.366] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:47:0) after 4m17s
[03:26:52.361] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:47:0)
[03:26:52.385] Build status: STARTED
[03:26:52.385] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:48:0) after 1m32s
[03:28:24.363] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:48:0)
[03:28:24.401] Build status: STARTED
[03:28:24.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:49:0) after 4m46s
[03:33:10.480] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:49:0)
[03:33:10.501] Build status: STARTED
[03:33:10.501] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:50:0) after 7m42s
[03:40:52.546] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:50:0)
[03:40:52.563] Build status: STARTED
[03:40:52.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:51:0) after 4m42s
[03:45:34.630] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:51:0)
[03:45:34.658] Build status: STARTED
[03:45:34.658] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:52:0) after 4m22s
[03:49:56.774] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:52:0)
[03:49:56.790] Build status: STARTED
[03:49:56.790] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:53:0) after 2m8s
[03:52:04.814] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:53:0)
[03:52:04.832] Build status: STARTED
[03:52:04.832] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:54:0) after 8m59s
[04:01:03.851] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:54:0)
[04:01:03.869] Build status: STARTED
[04:01:03.869] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:55:0) after 1m51s
[04:02:55.086] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:55:0)
[04:02:55.102] Build status: STARTED
[04:02:55.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:56:0) after 5m2s
[04:07:57.131] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:56:0)
[04:07:57.179] Build status: STARTED
[04:07:57.179] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:57:0) after 8m30s
[04:16:27.175] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:57:0)
[04:16:27.193] Build status: STARTED
[04:16:27.193] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:58:0) after 9m2s
[04:25:29.210] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:58:0)
[04:25:29.276] Build status: STARTED
[04:25:29.277] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:59:0) after 3m11s
[04:28:40.345] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:59:0)
[04:28:40.361] Build status: STARTED
[04:28:40.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:60:0) after 6m26s
[04:35:06.433] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:60:0)
[04:35:06.476] Build status: STARTED
[04:35:06.476] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:61:0) after 1m38s
[04:36:44.539] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:61:0)
[04:36:44.579] Build status: STARTED
[04:36:44.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:62:0) after 3m2s
[04:39:46.601] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:62:0)
[04:39:46.620] Build status: STARTED
[04:39:46.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:63:0) after 5m29s
[04:45:15.640] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:63:0)
[04:45:15.655] Build status: STARTED
[04:45:15.655] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:64:0) after 8m44s
[04:53:59.665] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:64:0)
[04:53:59.680] Build status: STARTED
[04:53:59.680] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidOfficial:8853106717204949504:65:0) after 9m23s
[05:02:58.603] Received PubSub notification, asking Buildbucket for the build status
[05:02:58.637] Build:
{
"id": "8687676655362674913",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidOfficial"
},
"number": 26346,
"createdBy": "project:chromium",
"createTime": "2026-03-10T22:48:46.746763856Z",
"startTime": "2026-03-10T22:48:52.039581800Z",
"endTime": "2026-03-11T05:02:58.174356040Z",
"updateTime": "2026-03-11T05:02:58.174356040Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "72750737b3547c24c43ec61fe491a3bafe1223cd",
"ref": "refs/heads/main"
}
}
}
[05:02:58.637] Invocation finished in 6h14m13.031712106s with status FAILED