[09:55:26.940] New invocation is queued and will start shortly
[09:55:28.002] Starting the invocation (attempt 1)
[09:55:28.030] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fc3fd3b2e8eeecdcdf28b42cecc3f898cedd52aa"
[09:55:28.030] Popped gitiles commit info from properties and tags
[09:55:28.030] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[09:55:28.031] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[09:55:28.032] Buildbucket request:
{
"requestId": "8851887012207852736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc3fd3b2e8eeecdcdf28b42cecc3f898cedd52aa",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8851887012207852736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTAndroidCoverage x86"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[09:55:28.503] Scheduled build:
{
"id": "8686456950347093841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18112,
"createdBy": "project:chromium",
"createTime": "2026-03-24T09:55:28.093404617Z",
"updateTime": "2026-03-24T09:55:28.093404617Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc3fd3b2e8eeecdcdf28b42cecc3f898cedd52aa",
"ref": "refs/heads/main"
}
}
}
[09:55:28.503] Task URL: https://cr-buildbucket.appspot.com/build/8686456950347093841
[09:55:28.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:2:0) after 5m15s
[09:55:29.330] Received PubSub notification, asking Buildbucket for the build status
[09:55:29.350] Build status: SCHEDULED
[09:56:44.846] Received PubSub notification, asking Buildbucket for the build status
[09:56:44.862] Build status: STARTED
[10:00:43.482] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:2:0)
[10:00:43.613] Build status: STARTED
[10:00:43.613] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:5:0) after 2m44s
[10:03:27.641] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:5:0)
[10:03:27.657] Build status: STARTED
[10:03:27.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:6:0) after 8m46s
[10:12:13.787] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:6:0)
[10:12:13.833] Build status: STARTED
[10:12:13.833] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:7:0) after 5m27s
[10:17:40.899] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:7:0)
[10:17:40.916] Build status: STARTED
[10:17:40.916] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:8:0) after 2m43s
[10:20:23.933] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:8:0)
[10:20:23.954] Build status: STARTED
[10:20:23.955] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:9:0) after 3m9s
[10:23:32.970] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:9:0)
[10:23:32.984] Build status: STARTED
[10:23:32.984] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:10:0) after 9m20s
[10:32:53.045] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:10:0)
[10:32:53.059] Build status: STARTED
[10:32:53.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:11:0) after 3m47s
[10:36:40.131] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:11:0)
[10:36:40.147] Build status: STARTED
[10:36:40.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:12:0) after 2m10s
[10:38:50.218] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:12:0)
[10:38:50.243] Build status: STARTED
[10:38:50.243] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:13:0) after 6m54s
[10:45:44.300] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:13:0)
[10:45:44.313] Build status: STARTED
[10:45:44.313] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:14:0) after 4m0s
[10:49:44.341] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:14:0)
[10:49:44.365] Build status: STARTED
[10:49:44.365] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:15:0) after 6m17s
[10:56:01.380] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:15:0)
[10:56:01.417] Build status: STARTED
[10:56:01.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:16:0) after 3m51s
[10:59:52.477] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:16:0)
[10:59:52.492] Build status: STARTED
[10:59:52.492] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:17:0) after 3m6s
[11:02:58.513] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:17:0)
[11:02:58.539] Build status: STARTED
[11:02:58.539] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:18:0) after 4m54s
[11:07:52.557] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:18:0)
[11:07:52.579] Build status: STARTED
[11:07:52.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:19:0) after 8m19s
[11:16:11.642] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:19:0)
[11:16:11.657] Build status: STARTED
[11:16:11.657] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:20:0) after 8m12s
[11:24:23.718] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:20:0)
[11:24:23.757] Build status: STARTED
[11:24:23.757] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:21:0) after 1m24s
[11:25:47.777] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:21:0)
[11:25:47.795] Build status: STARTED
[11:25:47.795] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:22:0) after 2m3s
[11:27:50.971] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:22:0)
[11:27:50.991] Build status: STARTED
[11:27:50.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:23:0) after 2m5s
[11:29:56.029] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:23:0)
[11:29:56.051] Build status: STARTED
[11:29:56.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:24:0) after 1m20s
[11:31:16.164] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:24:0)
[11:31:16.187] Build status: STARTED
[11:31:16.187] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:25:0) after 1m30s
[11:32:46.207] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:25:0)
[11:32:46.228] Build status: STARTED
[11:32:46.228] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:26:0) after 4m42s
[11:37:28.245] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:26:0)
[11:37:28.262] Build status: STARTED
[11:37:28.262] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:27:0) after 2m39s
[11:40:07.327] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:27:0)
[11:40:07.352] Build status: STARTED
[11:40:07.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:28:0) after 2m19s
[11:42:26.394] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:28:0)
[11:42:26.415] Build status: STARTED
[11:42:26.415] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:29:0) after 5m18s
[11:47:44.432] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:29:0)
[11:47:44.451] Build status: STARTED
[11:47:44.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:30:0) after 3m12s
[11:50:56.564] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:30:0)
[11:50:56.610] Build status: STARTED
[11:50:56.610] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:31:0) after 9m39s
[12:00:35.658] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:31:0)
[12:00:35.693] Build status: STARTED
[12:00:35.693] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:32:0) after 9m30s
[12:10:05.735] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:32:0)
[12:10:05.758] Build status: STARTED
[12:10:05.758] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:33:0) after 4m21s
[12:14:26.850] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:33:0)
[12:14:26.870] Build status: STARTED
[12:14:26.870] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:34:0) after 1m5s
[12:15:31.890] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:34:0)
[12:15:31.909] Build status: STARTED
[12:15:31.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:35:0) after 4m45s
[12:20:16.920] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:35:0)
[12:20:17.020] Build status: STARTED
[12:20:17.020] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:36:0) after 6m44s
[12:27:01.106] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:36:0)
[12:27:01.138] Build status: STARTED
[12:27:01.138] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:37:0) after 9m3s
[12:36:04.168] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:37:0)
[12:36:07.730] Build status: STARTED
[12:36:07.730] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:38:0) after 6m33s
[12:42:40.766] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:38:0)
[12:42:40.793] Build status: STARTED
[12:42:40.793] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:39:0) after 2m33s
[12:45:13.877] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:39:0)
[12:45:13.896] Build status: STARTED
[12:45:13.896] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:40:0) after 5m31s
[12:50:44.970] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:40:0)
[12:50:44.989] Build status: STARTED
[12:50:44.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:41:0) after 7m21s
[12:58:06.032] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:41:0)
[12:58:06.048] Build status: STARTED
[12:58:06.048] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:42:0) after 6m18s
[13:04:24.101] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:42:0)
[13:04:24.127] Build status: STARTED
[13:04:24.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:43:0) after 4m30s
[13:08:54.136] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:43:0)
[13:08:54.155] Build status: STARTED
[13:08:54.155] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:44:0) after 8m15s
[13:17:09.321] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:44:0)
[13:17:09.338] Build status: STARTED
[13:17:09.338] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:45:0) after 4m14s
[13:21:23.407] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:45:0)
[13:21:23.447] Build status: STARTED
[13:21:23.447] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:46:0) after 3m5s
[13:24:28.517] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:46:0)
[13:24:28.538] Build status: STARTED
[13:24:28.538] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:47:0) after 4m39s
[13:29:07.558] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:47:0)
[13:29:07.573] Build status: STARTED
[13:29:07.573] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:48:0) after 9m44s
[13:38:51.624] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:48:0)
[13:38:51.733] Build status: STARTED
[13:38:51.733] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:49:0) after 2m58s
[13:41:49.902] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:49:0)
[13:41:49.931] Build status: STARTED
[13:41:49.931] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:50:0) after 2m13s
[13:44:03.035] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:50:0)
[13:44:03.100] Build status: STARTED
[13:44:03.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:51:0) after 9m41s
[13:53:44.189] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:51:0)
[13:53:44.213] Build status: STARTED
[13:53:44.213] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:52:0) after 2m54s
[13:56:38.271] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:52:0)
[13:56:38.288] Build status: STARTED
[13:56:38.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:53:0) after 2m13s
[13:58:51.352] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:53:0)
[13:58:51.393] Build status: STARTED
[13:58:51.393] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:54:0) after 2m2s
[14:00:53.457] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:54:0)
[14:00:53.472] Build status: STARTED
[14:00:53.472] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:55:0) after 8m5s
[14:08:58.492] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:55:0)
[14:08:58.507] Build status: STARTED
[14:08:58.507] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:56:0) after 9m55s
[14:18:53.526] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:56:0)
[14:18:53.543] Build status: STARTED
[14:18:53.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:57:0) after 7m6s
[14:25:59.550] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:57:0)
[14:25:59.564] Build status: STARTED
[14:25:59.564] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:58:0) after 7m47s
[14:33:46.596] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:58:0)
[14:33:46.621] Build status: STARTED
[14:33:46.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:59:0) after 2m46s
[14:36:32.695] Handling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:59:0)
[14:36:32.714] Build status: STARTED
[14:36:32.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTAndroidCoverage x86:8851887012207852736:60:0) after 9m55s
[14:37:08.581] Received PubSub notification, asking Buildbucket for the build status
[14:37:08.601] Build:
{
"id": "8686456950347093841",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTAndroidCoverage x86"
},
"number": 18112,
"createdBy": "project:chromium",
"createTime": "2026-03-24T09:55:28.093404617Z",
"startTime": "2026-03-24T09:56:44.684272943Z",
"endTime": "2026-03-24T14:37:08.325392661Z",
"updateTime": "2026-03-24T14:37:08.325392661Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fc3fd3b2e8eeecdcdf28b42cecc3f898cedd52aa",
"ref": "refs/heads/main"
}
}
}
[14:37:08.601] Invocation finished in 4h41m41.665485267s with status FAILED