[04:00:08.380] New invocation is queued and will start shortly
[04:00:09.492] Starting the invocation (attempt 1)
[04:00:09.525] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/129c4286e949bb64704aae5fb8b5c84c8881f35c"
[04:00:09.525] Popped gitiles commit info from properties and tags
[04:00:09.525] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:09.525] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:09.525] Buildbucket request:
{
"requestId": "8917320376089652416",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "129c4286e949bb64704aae5fb8b5c84c8881f35c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8917320376089652416"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-lacros-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:10.126] Scheduled build:
{
"id": "8751890314130243601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 3042,
"createdBy": "project:chromium",
"createTime": "2024-04-01T04:00:09.617422893Z",
"updateTime": "2024-04-01T04:00:09.617422893Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "129c4286e949bb64704aae5fb8b5c84c8881f35c",
"ref": "refs/heads/main"
}
}
}
[04:00:10.127] Task URL: https://cr-buildbucket.appspot.com/build/8751890314130243601
[04:00:10.127] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:2:0) after 5m5s
[04:00:11.097] Received PubSub notification, asking Buildbucket for the build status
[04:00:11.147] Build status: SCHEDULED
[04:00:13.877] Received PubSub notification, asking Buildbucket for the build status
[04:00:13.904] Build status: STARTED
[04:05:15.255] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:2:0)
[04:05:15.279] Build status: STARTED
[04:05:15.279] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:5:0) after 4m54s
[04:10:09.318] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:5:0)
[04:10:09.349] Build status: STARTED
[04:10:09.349] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:6:0) after 9m22s
[04:19:31.369] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:6:0)
[04:19:31.402] Build status: STARTED
[04:19:31.402] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:7:0) after 9m11s
[04:28:42.429] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:7:0)
[04:28:42.471] Build status: STARTED
[04:28:42.471] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:8:0) after 6m44s
[04:35:26.531] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:8:0)
[04:35:26.556] Build status: STARTED
[04:35:26.556] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:9:0) after 8m17s
[04:43:43.584] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:9:0)
[04:43:43.613] Build status: STARTED
[04:43:43.613] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:10:0) after 7m10s
[04:50:53.709] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:10:0)
[04:50:53.735] Build status: STARTED
[04:50:53.735] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:11:0) after 7m7s
[04:58:00.762] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:11:0)
[04:58:00.792] Build status: STARTED
[04:58:00.792] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:12:0) after 2m44s
[05:00:44.857] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:12:0)
[05:00:44.879] Build status: STARTED
[05:00:44.879] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:13:0) after 5m28s
[05:06:12.902] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:13:0)
[05:06:12.987] Build status: STARTED
[05:06:12.987] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:14:0) after 5m33s
[05:11:46.015] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:14:0)
[05:11:46.039] Build status: STARTED
[05:11:46.039] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:15:0) after 3m9s
[05:14:55.072] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:15:0)
[05:14:55.093] Build status: STARTED
[05:14:55.093] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:16:0) after 4m48s
[05:19:43.071] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:16:0)
[05:19:43.088] Build status: STARTED
[05:19:43.088] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:17:0) after 1m44s
[05:21:27.432] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:17:0)
[05:21:27.460] Build status: STARTED
[05:21:27.461] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:18:0) after 1m0s
[05:22:27.460] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:18:0)
[05:22:27.489] Build status: STARTED
[05:22:27.489] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:19:0) after 4m24s
[05:26:51.508] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:19:0)
[05:26:51.524] Build status: STARTED
[05:26:51.525] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:20:0) after 6m26s
[05:33:17.734] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:20:0)
[05:33:17.754] Build status: STARTED
[05:33:17.754] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:21:0) after 6m0s
[05:39:17.866] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:21:0)
[05:39:17.897] Build status: STARTED
[05:39:17.897] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:22:0) after 1m15s
[05:40:32.991] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:22:0)
[05:40:33.009] Build status: STARTED
[05:40:33.009] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:23:0) after 3m50s
[05:44:23.037] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:23:0)
[05:44:23.102] Build status: STARTED
[05:44:23.102] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:24:0) after 5m52s
[05:50:15.345] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:24:0)
[05:50:15.376] Build status: STARTED
[05:50:15.376] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:25:0) after 7m59s
[05:58:14.410] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:25:0)
[05:58:14.486] Build status: STARTED
[05:58:14.486] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:26:0) after 3m16s
[06:01:30.535] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:26:0)
[06:01:30.569] Build status: STARTED
[06:01:30.569] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:27:0) after 6m17s
[06:07:47.711] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:27:0)
[06:07:47.735] Build status: STARTED
[06:07:47.735] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:28:0) after 2m58s
[06:10:45.868] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:28:0)
[06:10:45.896] Build status: STARTED
[06:10:45.896] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:29:0) after 7m50s
[06:18:35.957] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:29:0)
[06:18:35.982] Build status: STARTED
[06:18:35.982] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:30:0) after 9m2s
[06:27:38.203] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:30:0)
[06:27:38.226] Build status: STARTED
[06:27:38.226] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:31:0) after 5m48s
[06:33:26.229] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:31:0)
[06:33:26.256] Build status: STARTED
[06:33:26.256] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:32:0) after 7m37s
[06:41:03.302] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:32:0)
[06:41:03.318] Build status: STARTED
[06:41:03.318] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:33:0) after 3m45s
[06:44:48.447] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:33:0)
[06:44:48.484] Build status: STARTED
[06:44:48.485] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:34:0) after 3m20s
[06:48:08.622] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:34:0)
[06:48:08.642] Build status: STARTED
[06:48:08.642] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:35:0) after 5m36s
[06:53:44.670] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:35:0)
[06:53:44.689] Build status: STARTED
[06:53:44.689] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:36:0) after 9m57s
[07:03:41.836] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:36:0)
[07:03:41.993] Build status: STARTED
[07:03:41.993] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:37:0) after 5m27s
[07:09:09.041] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:37:0)
[07:09:09.058] Build status: STARTED
[07:09:09.058] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:38:0) after 8m54s
[07:18:03.076] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:38:0)
[07:18:03.109] Build status: STARTED
[07:18:03.109] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:39:0) after 4m42s
[07:22:45.163] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:39:0)
[07:22:45.182] Build status: STARTED
[07:22:45.182] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:40:0) after 2m10s
[07:24:55.203] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:40:0)
[07:24:55.218] Build status: STARTED
[07:24:55.218] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:41:0) after 3m56s
[07:28:51.235] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:41:0)
[07:28:51.257] Build status: STARTED
[07:28:51.257] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:42:0) after 9m0s
[07:37:51.280] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:42:0)
[07:37:51.306] Build status: STARTED
[07:37:51.306] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:43:0) after 3m20s
[07:41:11.373] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:43:0)
[07:41:11.445] Build status: STARTED
[07:41:11.445] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:44:0) after 9m45s
[07:50:56.468] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:44:0)
[07:50:56.489] Build status: STARTED
[07:50:56.489] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:45:0) after 3m44s
[07:54:40.507] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:45:0)
[07:54:40.525] Build status: STARTED
[07:54:40.526] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:46:0) after 8m19s
[08:02:59.710] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:46:0)
[08:02:59.765] Build status: STARTED
[08:02:59.765] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:47:0) after 4m10s
[08:07:10.009] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:47:0)
[08:07:10.030] Build status: STARTED
[08:07:10.030] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:48:0) after 2m20s
[08:09:30.051] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:48:0)
[08:09:30.083] Build status: STARTED
[08:09:30.083] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:49:0) after 3m0s
[08:12:30.117] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:49:0)
[08:12:30.146] Build status: STARTED
[08:12:30.146] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:50:0) after 7m54s
[08:20:24.281] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:50:0)
[08:20:24.336] Build status: STARTED
[08:20:24.336] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:51:0) after 2m20s
[08:22:44.561] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:51:0)
[08:22:44.581] Build status: STARTED
[08:22:44.581] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:52:0) after 3m41s
[08:26:25.564] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:52:0)
[08:26:25.619] Build status: STARTED
[08:26:25.619] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:53:0) after 9m9s
[08:35:34.721] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:53:0)
[08:35:34.775] Build status: STARTED
[08:35:34.776] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:54:0) after 2m33s
[08:38:07.947] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:54:0)
[08:38:07.974] Build status: STARTED
[08:38:07.974] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:55:0) after 5m24s
[08:43:32.291] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:55:0)
[08:43:32.381] Build status: STARTED
[08:43:32.381] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:56:0) after 9m53s
[08:53:25.586] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:56:0)
[08:53:25.700] Build status: STARTED
[08:53:25.700] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:57:0) after 8m22s
[09:01:47.839] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:57:0)
[09:01:47.861] Build status: STARTED
[09:01:47.861] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:58:0) after 7m13s
[09:09:00.852] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:58:0)
[09:09:00.889] Build status: STARTED
[09:09:00.889] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:59:0) after 9m16s
[09:18:16.914] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:59:0)
[09:18:16.947] Build status: STARTED
[09:18:16.947] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8917320376089652416:60:0) after 1m35s
[09:18:48.975] Received PubSub notification, asking Buildbucket for the build status
[09:18:49.013] Build:
{
"id": "8751890314130243601",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 3042,
"createdBy": "project:chromium",
"createTime": "2024-04-01T04:00:09.617422893Z",
"startTime": "2024-04-01T04:00:12.783334Z",
"endTime": "2024-04-01T09:18:32.208938Z",
"updateTime": "2024-04-01T09:18:32.208938Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "129c4286e949bb64704aae5fb8b5c84c8881f35c",
"ref": "refs/heads/main"
}
}
}
[09:18:49.013] Invocation finished in 5h18m40.648768623s with status FAILED