[06:53:26.137] New invocation is queued and will start shortly
[06:53:27.236] Starting the invocation (attempt 1)
[06:53:27.259] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa0288e88eeaafab180cd96c9aec472e3e795c4e"
[06:53:27.260] Popped gitiles commit info from properties and tags
[06:53:27.260] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:53:27.260] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:53:27.260] Buildbucket request:
{
"requestId": "8850992493839693600",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa0288e88eeaafab180cd96c9aec472e3e795c4e",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8850992493839693600"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:53:27.943] Scheduled build:
{
"id": "8685562431888412849",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18176,
"createdBy": "project:chromium",
"createTime": "2026-04-03T06:53:27.373960211Z",
"updateTime": "2026-04-03T06:53:27.373960211Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa0288e88eeaafab180cd96c9aec472e3e795c4e",
"ref": "refs/heads/main"
}
}
}
[06:53:27.943] Task URL: https://cr-buildbucket.appspot.com/build/8685562431888412849
[06:53:27.943] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:2:0) after 9m22s
[06:53:28.789] Received PubSub notification, asking Buildbucket for the build status
[06:53:28.805] Build status: SCHEDULED
[06:54:59.310] Received PubSub notification, asking Buildbucket for the build status
[06:54:59.325] Build status: STARTED
[07:02:50.389] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:2:0)
[07:02:50.413] Build status: STARTED
[07:02:50.414] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:5:0) after 1m14s
[07:04:04.695] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:5:0)
[07:04:04.722] Build status: STARTED
[07:04:04.722] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:6:0) after 9m32s
[07:13:36.749] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:6:0)
[07:13:36.842] Build status: STARTED
[07:13:36.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:7:0) after 4m45s
[07:18:21.862] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:7:0)
[07:18:21.923] Build status: STARTED
[07:18:21.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:8:0) after 5m8s
[07:23:29.992] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:8:0)
[07:23:30.012] Build status: STARTED
[07:23:30.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:9:0) after 4m32s
[07:28:02.104] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:9:0)
[07:28:02.148] Build status: STARTED
[07:28:02.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:10:0) after 9m19s
[07:37:21.215] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:10:0)
[07:37:21.238] Build status: STARTED
[07:37:21.238] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:11:0) after 3m7s
[07:40:28.258] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:11:0)
[07:40:28.282] Build status: STARTED
[07:40:28.282] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:12:0) after 5m2s
[07:45:30.723] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:12:0)
[07:45:30.743] Build status: STARTED
[07:45:30.743] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:13:0) after 6m42s
[07:52:12.759] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:13:0)
[07:52:12.776] Build status: STARTED
[07:52:12.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:14:0) after 2m4s
[07:54:16.947] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:14:0)
[07:54:16.961] Build status: STARTED
[07:54:16.961] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:15:0) after 4m14s
[07:58:31.076] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:15:0)
[07:58:31.095] Build status: STARTED
[07:58:31.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:16:0) after 2m52s
[08:01:23.236] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:16:0)
[08:01:23.273] Build status: STARTED
[08:01:23.273] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:17:0) after 9m53s
[08:11:16.401] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:17:0)
[08:11:16.433] Build status: STARTED
[08:11:16.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:18:0) after 1m47s
[08:13:03.461] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:18:0)
[08:13:03.485] Build status: STARTED
[08:13:03.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:19:0) after 6m23s
[08:19:26.503] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:19:0)
[08:19:26.524] Build status: STARTED
[08:19:26.524] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:20:0) after 1m29s
[08:20:55.546] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:20:0)
[08:20:55.563] Build status: STARTED
[08:20:55.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:21:0) after 5m49s
[08:26:44.582] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:21:0)
[08:26:44.673] Build status: STARTED
[08:26:44.673] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:22:0) after 3m48s
[08:30:32.920] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:22:0)
[08:30:32.945] Build status: STARTED
[08:30:32.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:23:0) after 8m54s
[08:39:27.015] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:23:0)
[08:39:27.032] Build status: STARTED
[08:39:27.032] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:24:0) after 5m16s
[08:44:43.058] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:24:0)
[08:44:43.079] Build status: STARTED
[08:44:43.079] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:25:0) after 5m59s
[08:50:42.113] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:25:0)
[08:50:42.129] Build status: STARTED
[08:50:42.129] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:26:0) after 7m9s
[08:57:51.197] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:26:0)
[08:57:51.212] Build status: STARTED
[08:57:51.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:27:0) after 9m25s
[09:07:16.319] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:27:0)
[09:07:16.336] Build status: STARTED
[09:07:16.336] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:28:0) after 4m24s
[09:11:40.330] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:28:0)
[09:11:40.419] Build status: STARTED
[09:11:40.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:29:0) after 1m52s
[09:13:32.440] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:29:0)
[09:13:32.456] Build status: STARTED
[09:13:32.456] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:30:0) after 7m8s
[09:20:40.475] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:30:0)
[09:20:40.508] Build status: STARTED
[09:20:40.508] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:31:0) after 1m20s
[09:22:00.534] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:31:0)
[09:22:00.610] Build status: STARTED
[09:22:00.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:32:0) after 6m53s
[09:28:53.613] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:32:0)
[09:28:53.629] Build status: STARTED
[09:28:53.629] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:33:0) after 6m31s
[09:35:24.664] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:33:0)
[09:35:24.693] Build status: STARTED
[09:35:24.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:34:0) after 8m32s
[09:43:57.156] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:34:0)
[09:43:57.174] Build status: STARTED
[09:43:57.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:35:0) after 6m22s
[09:50:20.292] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:35:0)
[09:50:20.353] Build status: STARTED
[09:50:20.353] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:36:0) after 3m15s
[09:53:35.731] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:36:0)
[09:53:35.748] Build status: STARTED
[09:53:35.748] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:37:0) after 7m25s
[10:01:00.975] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:37:0)
[10:01:01.007] Build status: STARTED
[10:01:01.007] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:38:0) after 9m40s
[10:10:41.060] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:38:0)
[10:10:41.110] Build status: STARTED
[10:10:41.110] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:39:0) after 6m15s
[10:16:56.366] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:39:0)
[10:16:56.412] Build status: STARTED
[10:16:56.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:40:0) after 4m34s
[10:21:30.427] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:40:0)
[10:21:30.444] Build status: STARTED
[10:21:30.444] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:41:0) after 3m17s
[10:24:47.459] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:41:0)
[10:24:47.474] Build status: STARTED
[10:24:47.474] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:42:0) after 3m52s
[10:28:39.592] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:42:0)
[10:28:39.618] Build status: STARTED
[10:28:39.618] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:43:0) after 7m10s
[10:35:49.638] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:43:0)
[10:35:49.657] Build status: STARTED
[10:35:49.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:44:0) after 3m53s
[10:39:43.836] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:44:0)
[10:39:43.855] Build status: STARTED
[10:39:43.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:45:0) after 3m25s
[10:43:08.879] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:45:0)
[10:43:08.920] Build status: STARTED
[10:43:08.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:46:0) after 4m20s
[10:47:28.936] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:46:0)
[10:47:28.957] Build status: STARTED
[10:47:28.957] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:47:0) after 9m19s
[10:56:48.153] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:47:0)
[10:56:48.174] Build status: STARTED
[10:56:48.174] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:48:0) after 6m20s
[11:03:08.190] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:48:0)
[11:03:08.215] Build status: STARTED
[11:03:08.215] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:49:0) after 3m7s
[11:06:15.230] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:49:0)
[11:06:15.265] Build status: STARTED
[11:06:15.265] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:50:0) after 2m20s
[11:08:35.281] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:50:0)
[11:08:35.303] Build status: STARTED
[11:08:35.303] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:51:0) after 4m36s
[11:13:11.368] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:51:0)
[11:13:11.395] Build status: STARTED
[11:13:11.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:52:0) after 4m48s
[11:17:59.414] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:52:0)
[11:17:59.445] Build status: STARTED
[11:17:59.445] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:53:0) after 3m10s
[11:21:09.586] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:53:0)
[11:21:09.607] Build status: STARTED
[11:21:09.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:54:0) after 3m1s
[11:24:10.741] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:54:0)
[11:24:10.757] Build status: STARTED
[11:24:10.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:55:0) after 8m19s
[11:32:29.772] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:55:0)
[11:32:29.799] Build status: STARTED
[11:32:29.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:56:0) after 2m39s
[11:35:09.004] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:56:0)
[11:35:09.022] Build status: STARTED
[11:35:09.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:57:0) after 3m40s
[11:38:49.376] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:57:0)
[11:38:49.402] Build status: STARTED
[11:38:49.402] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:58:0) after 8m55s
[11:47:44.416] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:58:0)
[11:47:44.468] Build status: STARTED
[11:47:44.468] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:59:0) after 2m3s
[11:49:47.487] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:59:0)
[11:49:47.537] Build status: STARTED
[11:49:47.537] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8850992493839693600:60:0) after 4m11s
[11:52:01.605] Received PubSub notification, asking Buildbucket for the build status
[11:52:01.649] Build:
{
"id": "8685562431888412849",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18176,
"createdBy": "project:chromium",
"createTime": "2026-04-03T06:53:27.373960211Z",
"startTime": "2026-04-03T06:54:57.971923416Z",
"endTime": "2026-04-03T11:52:01.180170377Z",
"updateTime": "2026-04-03T11:52:01.180170377Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa0288e88eeaafab180cd96c9aec472e3e795c4e",
"ref": "refs/heads/main"
}
}
}
[11:52:01.649] Invocation finished in 4h58m35.52104326s with status FAILED