[04:00:07.499] New invocation is queued and will start shortly
[04:00:09.756] Starting the invocation (attempt 1)
[04:00:09.793] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/911d9e9f7f1aff73769627fa16252a005d113e91"
[04:00:09.793] Popped gitiles commit info from properties and tags
[04:00:09.793] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:09.793] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:09.794] Buildbucket request:
{
"requestId": "8938791858052140704",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "911d9e9f7f1aff73769627fa16252a005d113e91",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8938791858052140704"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-lacros-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:10.811] Scheduled build:
{
"id": "8773361794748163793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 2805,
"createdBy": "project:chromium",
"createTime": "2023-08-08T04:00:10.016734584Z",
"updateTime": "2023-08-08T04:00:10.016734584Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "911d9e9f7f1aff73769627fa16252a005d113e91",
"ref": "refs/heads/main"
}
}
}
[04:00:10.811] Task URL: https://cr-buildbucket.appspot.com/build/8773361794748163793
[04:00:10.811] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:2:0) after 2m32s
[04:00:12.109] Received PubSub notification, asking Buildbucket for the build status
[04:00:12.128] Build status: SCHEDULED
[04:01:09.025] Received PubSub notification, asking Buildbucket for the build status
[04:01:09.049] Build status: STARTED
[04:02:42.828] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:2:0)
[04:02:42.859] Build status: STARTED
[04:02:42.859] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:5:0) after 3m28s
[04:06:10.876] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:5:0)
[04:06:10.905] Build status: STARTED
[04:06:10.905] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:6:0) after 7m47s
[04:13:58.029] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:6:0)
[04:13:58.070] Build status: STARTED
[04:13:58.070] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:7:0) after 4m39s
[04:18:37.230] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:7:0)
[04:18:37.399] Build status: STARTED
[04:18:37.399] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:8:0) after 3m48s
[04:22:25.457] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:8:0)
[04:22:25.483] Build status: STARTED
[04:22:25.483] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:9:0) after 5m20s
[04:27:45.512] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:9:0)
[04:27:45.546] Build status: STARTED
[04:27:45.546] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:10:0) after 5m13s
[04:32:58.565] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:10:0)
[04:32:58.584] Build status: STARTED
[04:32:58.584] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:11:0) after 4m20s
[04:37:18.600] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:11:0)
[04:37:18.621] Build status: STARTED
[04:37:18.621] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:12:0) after 7m11s
[04:44:29.747] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:12:0)
[04:44:29.764] Build status: STARTED
[04:44:29.764] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:13:0) after 1m53s
[04:46:22.783] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:13:0)
[04:46:22.856] Build status: STARTED
[04:46:22.856] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:14:0) after 3m25s
[04:49:47.970] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:14:0)
[04:49:47.986] Build status: STARTED
[04:49:47.986] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:15:0) after 1m36s
[04:51:24.033] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:15:0)
[04:51:24.053] Build status: STARTED
[04:51:24.053] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:16:0) after 8m13s
[04:59:37.075] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:16:0)
[04:59:37.098] Build status: STARTED
[04:59:37.098] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:17:0) after 7m9s
[05:06:46.555] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:17:0)
[05:06:46.575] Build status: STARTED
[05:06:46.575] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:18:0) after 6m18s
[05:13:04.749] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:18:0)
[05:13:04.778] Build status: STARTED
[05:13:04.778] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:19:0) after 7m10s
[05:20:14.814] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:19:0)
[05:20:14.831] Build status: STARTED
[05:20:14.831] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:20:0) after 6m33s
[05:26:47.849] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:20:0)
[05:26:47.866] Build status: STARTED
[05:26:47.866] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:21:0) after 2m56s
[05:29:44.230] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:21:0)
[05:29:44.250] Build status: STARTED
[05:29:44.250] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:22:0) after 5m46s
[05:35:30.285] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:22:0)
[05:35:30.303] Build status: STARTED
[05:35:30.303] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:23:0) after 9m31s
[05:45:01.351] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:23:0)
[05:45:01.375] Build status: STARTED
[05:45:01.375] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:24:0) after 9m48s
[05:54:49.393] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:24:0)
[05:54:49.409] Build status: STARTED
[05:54:49.409] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:25:0) after 7m12s
[06:02:01.426] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:25:0)
[06:02:01.452] Build status: STARTED
[06:02:01.452] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:26:0) after 2m14s
[06:04:15.522] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:26:0)
[06:04:15.538] Build status: STARTED
[06:04:15.538] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:27:0) after 9m10s
[06:13:25.573] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:27:0)
[06:13:25.599] Build status: STARTED
[06:13:25.599] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:28:0) after 6m47s
[06:20:12.629] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:28:0)
[06:20:12.653] Build status: STARTED
[06:20:12.653] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:29:0) after 2m8s
[06:22:20.683] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:29:0)
[06:22:20.702] Build status: STARTED
[06:22:20.702] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:30:0) after 8m33s
[06:30:53.765] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:30:0)
[06:30:53.782] Build status: STARTED
[06:30:53.782] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:31:0) after 1m38s
[06:32:31.899] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:31:0)
[06:32:31.923] Build status: STARTED
[06:32:31.923] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:32:0) after 6m36s
[06:39:08.286] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:32:0)
[06:39:08.305] Build status: STARTED
[06:39:08.305] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:33:0) after 2m41s
[06:41:49.453] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:33:0)
[06:41:49.475] Build status: STARTED
[06:41:49.475] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:34:0) after 3m26s
[06:45:15.561] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:34:0)
[06:45:15.634] Build status: STARTED
[06:45:15.634] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:35:0) after 3m50s
[06:49:05.673] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:35:0)
[06:49:05.690] Build status: STARTED
[06:49:05.690] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:36:0) after 8m18s
[06:57:23.813] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:36:0)
[06:57:23.833] Build status: STARTED
[06:57:23.833] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:37:0) after 1m36s
[06:58:59.848] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:37:0)
[06:58:59.880] Build status: STARTED
[06:58:59.880] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:38:0) after 8m48s
[07:07:47.965] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:38:0)
[07:07:47.984] Build status: STARTED
[07:07:47.984] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:39:0) after 8m18s
[07:16:06.483] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:39:0)
[07:16:06.513] Build status: STARTED
[07:16:06.513] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:40:0) after 3m3s
[07:19:09.605] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:40:0)
[07:19:09.629] Build status: STARTED
[07:19:09.629] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:41:0) after 5m8s
[07:24:17.777] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:41:0)
[07:24:17.815] Build status: STARTED
[07:24:17.815] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:42:0) after 4m52s
[07:29:09.978] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:42:0)
[07:29:09.997] Build status: STARTED
[07:29:09.997] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:43:0) after 6m35s
[07:35:45.135] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:43:0)
[07:35:45.154] Build status: STARTED
[07:35:45.154] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:44:0) after 1m3s
[07:36:48.289] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:44:0)
[07:36:48.307] Build status: STARTED
[07:36:48.307] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:45:0) after 5m41s
[07:42:29.345] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:45:0)
[07:42:29.393] Build status: STARTED
[07:42:29.393] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:46:0) after 7m27s
[07:49:56.429] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:46:0)
[07:49:56.457] Build status: STARTED
[07:49:56.457] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:47:0) after 4m36s
[07:54:32.506] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:47:0)
[07:54:32.568] Build status: STARTED
[07:54:32.568] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:48:0) after 1m35s
[07:56:07.596] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:48:0)
[07:56:07.618] Build status: STARTED
[07:56:07.618] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:49:0) after 8m35s
[08:04:42.808] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:49:0)
[08:04:42.845] Build status: STARTED
[08:04:42.845] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:50:0) after 1m40s
[08:06:22.886] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:50:0)
[08:06:22.907] Build status: STARTED
[08:06:22.907] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:51:0) after 6m19s
[08:12:41.929] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:51:0)
[08:12:41.951] Build status: STARTED
[08:12:41.951] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:52:0) after 6m37s
[08:19:19.073] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:52:0)
[08:19:19.096] Build status: STARTED
[08:19:19.096] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:53:0) after 7m54s
[08:27:13.218] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:53:0)
[08:27:13.241] Build status: STARTED
[08:27:13.241] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:54:0) after 3m38s
[08:30:51.269] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:54:0)
[08:30:51.292] Build status: STARTED
[08:30:51.292] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:55:0) after 3m24s
[08:34:15.452] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:55:0)
[08:34:15.474] Build status: STARTED
[08:34:15.474] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:56:0) after 1m17s
[08:35:32.573] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:56:0)
[08:35:32.683] Build status: STARTED
[08:35:32.683] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:57:0) after 5m17s
[08:40:49.713] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:57:0)
[08:40:49.729] Build status: STARTED
[08:40:49.729] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:58:0) after 1m31s
[08:42:20.743] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:58:0)
[08:42:20.760] Build status: STARTED
[08:42:20.760] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8938791858052140704:59:0) after 7m50s
[08:50:09.617] Received PubSub notification, asking Buildbucket for the build status
[08:50:09.637] Build:
{
"id": "8773361794748163793",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 2805,
"createdBy": "project:chromium",
"createTime": "2023-08-08T04:00:10.016734584Z",
"startTime": "2023-08-08T04:01:07.629875Z",
"endTime": "2023-08-08T08:50:09.214959874Z",
"updateTime": "2023-08-08T08:50:09.214959874Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "911d9e9f7f1aff73769627fa16252a005d113e91",
"ref": "refs/heads/main"
}
}
}
[08:50:09.637] Invocation finished in 4h50m2.15462103s with status FAILED