[04:00:06.549] New invocation is queued and will start shortly
[04:00:07.703] Starting the invocation (attempt 1)
[04:00:07.734] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/fa06840ac2b030124250f3768367dca1bf21f972"
[04:00:07.734] Popped gitiles commit info from properties and tags
[04:00:07.734] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:07.734] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:07.735] Buildbucket request:
{
"requestId": "8941600365001491120",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa06840ac2b030124250f3768367dca1bf21f972",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8941600365001491120"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-lacros-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:08.728] Scheduled build:
{
"id": "8776170302881063857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 2774,
"createdBy": "project:chromium",
"createTime": "2023-07-08T04:00:07.943202007Z",
"updateTime": "2023-07-08T04:00:07.943202007Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa06840ac2b030124250f3768367dca1bf21f972",
"ref": "refs/heads/main"
}
},
"canary": true
}
[04:00:08.728] Task URL: https://cr-buildbucket.appspot.com/build/8776170302881063857
[04:00:08.728] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:2:0) after 9m57s
[04:01:09.508] Received PubSub notification, asking Buildbucket for the build status
[04:01:09.548] Build status: STARTED
[04:10:05.760] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:2:0)
[04:10:05.794] Build status: STARTED
[04:10:05.794] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:4:0) after 7m59s
[04:18:04.820] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:4:0)
[04:18:04.840] Build status: STARTED
[04:18:04.840] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:5:0) after 1m19s
[04:19:23.866] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:5:0)
[04:19:23.885] Build status: STARTED
[04:19:23.885] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:6:0) after 9m13s
[04:28:37.126] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:6:0)
[04:28:37.151] Build status: STARTED
[04:28:37.152] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:7:0) after 7m36s
[04:36:13.174] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:7:0)
[04:36:13.190] Build status: STARTED
[04:36:13.190] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:8:0) after 9m13s
[04:45:26.213] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:8:0)
[04:45:26.274] Build status: STARTED
[04:45:26.274] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:9:0) after 2m54s
[04:48:20.388] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:9:0)
[04:48:20.410] Build status: STARTED
[04:48:20.410] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:10:0) after 5m19s
[04:53:39.435] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:10:0)
[04:53:39.453] Build status: STARTED
[04:53:39.453] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:11:0) after 2m12s
[04:55:51.471] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:11:0)
[04:55:51.493] Build status: STARTED
[04:55:51.493] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:12:0) after 2m43s
[04:58:34.521] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:12:0)
[04:58:34.672] Build status: STARTED
[04:58:34.673] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:13:0) after 8m30s
[05:07:05.024] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:13:0)
[05:07:05.057] Build status: STARTED
[05:07:05.057] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:14:0) after 2m2s
[05:09:07.081] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:14:0)
[05:09:07.097] Build status: STARTED
[05:09:07.097] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:15:0) after 7m1s
[05:16:08.210] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:15:0)
[05:16:08.226] Build status: STARTED
[05:16:08.226] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:16:0) after 2m56s
[05:19:04.368] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:16:0)
[05:19:04.389] Build status: STARTED
[05:19:04.389] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:17:0) after 4m46s
[05:23:50.427] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:17:0)
[05:23:50.453] Build status: STARTED
[05:23:50.453] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:18:0) after 4m19s
[05:28:09.479] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:18:0)
[05:28:09.494] Build status: STARTED
[05:28:09.494] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:19:0) after 4m20s
[05:32:29.520] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:19:0)
[05:32:29.536] Build status: STARTED
[05:32:29.536] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:20:0) after 1m36s
[05:34:05.653] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:20:0)
[05:34:05.669] Build status: STARTED
[05:34:05.669] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:21:0) after 4m40s
[05:38:45.693] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:21:0)
[05:38:45.713] Build status: STARTED
[05:38:45.713] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:22:0) after 5m28s
[05:44:13.843] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:22:0)
[05:44:13.860] Build status: STARTED
[05:44:13.860] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:23:0) after 7m56s
[05:52:09.934] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:23:0)
[05:52:09.949] Build status: STARTED
[05:52:09.949] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:24:0) after 2m58s
[05:55:07.968] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:24:0)
[05:55:07.990] Build status: STARTED
[05:55:07.990] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:25:0) after 8m27s
[06:03:35.012] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:25:0)
[06:03:35.053] Build status: STARTED
[06:03:35.053] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:26:0) after 9m56s
[06:13:31.069] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:26:0)
[06:13:31.094] Build status: STARTED
[06:13:31.094] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:27:0) after 2m30s
[06:16:01.113] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:27:0)
[06:16:01.132] Build status: STARTED
[06:16:01.132] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:28:0) after 3m35s
[06:19:36.149] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:28:0)
[06:19:36.229] Build status: STARTED
[06:19:36.229] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:29:0) after 5m28s
[06:25:04.615] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:29:0)
[06:25:04.630] Build status: STARTED
[06:25:04.630] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:30:0) after 3m21s
[06:28:25.725] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:30:0)
[06:28:25.742] Build status: STARTED
[06:28:25.742] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:31:0) after 3m3s
[06:31:29.215] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:31:0)
[06:31:29.308] Build status: STARTED
[06:31:29.308] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:32:0) after 4m24s
[06:35:53.950] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:32:0)
[06:35:53.973] Build status: STARTED
[06:35:53.973] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:33:0) after 7m23s
[06:43:17.044] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:33:0)
[06:43:17.071] Build status: STARTED
[06:43:17.071] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:34:0) after 5m50s
[06:49:07.234] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:34:0)
[06:49:07.260] Build status: STARTED
[06:49:07.260] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:35:0) after 4m30s
[06:53:37.271] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:35:0)
[06:53:37.287] Build status: STARTED
[06:53:37.288] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:36:0) after 8m43s
[07:02:20.409] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:36:0)
[07:02:20.439] Build status: STARTED
[07:02:20.439] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:37:0) after 4m42s
[07:07:02.452] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:37:0)
[07:07:02.502] Build status: STARTED
[07:07:02.502] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:38:0) after 2m26s
[07:09:28.529] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:38:0)
[07:09:28.544] Build status: STARTED
[07:09:28.544] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:39:0) after 9m9s
[07:18:37.570] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:39:0)
[07:18:37.590] Build status: STARTED
[07:18:37.590] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:40:0) after 3m22s
[07:21:59.609] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:40:0)
[07:21:59.866] Build status: STARTED
[07:21:59.866] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:41:0) after 9m9s
[07:31:08.961] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:41:0)
[07:31:08.990] Build status: STARTED
[07:31:08.990] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:42:0) after 5m46s
[07:36:55.006] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:42:0)
[07:36:55.085] Build status: STARTED
[07:36:55.085] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:43:0) after 8m45s
[07:45:40.307] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:43:0)
[07:45:40.325] Build status: STARTED
[07:45:40.325] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:44:0) after 5m18s
[07:50:58.431] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:44:0)
[07:50:58.456] Build status: STARTED
[07:50:58.456] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:45:0) after 2m33s
[07:53:31.688] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:45:0)
[07:53:31.703] Build status: STARTED
[07:53:31.703] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:46:0) after 7m45s
[08:01:16.720] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:46:0)
[08:01:16.741] Build status: STARTED
[08:01:16.741] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:47:0) after 2m34s
[08:03:50.953] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:47:0)
[08:03:50.978] Build status: STARTED
[08:03:50.978] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:48:0) after 5m33s
[08:09:24.478] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:48:0)
[08:09:24.494] Build status: STARTED
[08:09:24.494] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:49:0) after 8m42s
[08:18:06.639] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:49:0)
[08:18:06.661] Build status: STARTED
[08:18:06.661] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:50:0) after 7m32s
[08:25:38.780] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:50:0)
[08:25:38.796] Build status: STARTED
[08:25:38.796] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:51:0) after 1m9s
[08:26:47.812] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:51:0)
[08:26:47.832] Build status: STARTED
[08:26:47.832] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:52:0) after 8m9s
[08:34:56.874] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:52:0)
[08:34:56.892] Build status: STARTED
[08:34:56.892] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:53:0) after 5m46s
[08:40:43.014] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:53:0)
[08:40:43.047] Build status: STARTED
[08:40:43.047] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:54:0) after 7m40s
[08:48:23.234] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:54:0)
[08:48:23.260] Build status: STARTED
[08:48:23.260] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:55:0) after 7m29s
[08:55:52.516] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:55:0)
[08:55:52.550] Build status: STARTED
[08:55:52.550] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:56:0) after 1m45s
[08:57:37.568] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:56:0)
[08:57:37.593] Build status: STARTED
[08:57:37.593] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:57:0) after 6m17s
[09:03:54.617] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:57:0)
[09:03:54.640] Build status: STARTED
[09:03:54.640] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:58:0) after 9m2s
[09:12:56.680] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:58:0)
[09:12:56.701] Build status: STARTED
[09:12:56.701] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:59:0) after 7m19s
[09:20:15.817] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:59:0)
[09:20:15.836] Build status: STARTED
[09:20:15.836] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:60:0) after 8m9s
[09:28:25.015] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:60:0)
[09:28:25.108] Build status: STARTED
[09:28:25.108] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8941600365001491120:61:0) after 7m58s
[09:29:00.301] Received PubSub notification, asking Buildbucket for the build status
[09:29:00.316] Build:
{
"id": "8776170302881063857",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 2774,
"createdBy": "project:chromium",
"createTime": "2023-07-08T04:00:07.943202007Z",
"startTime": "2023-07-08T04:01:08.897871Z",
"endTime": "2023-07-08T09:28:59.986225490Z",
"updateTime": "2023-07-08T09:28:59.986225490Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "fa06840ac2b030124250f3768367dca1bf21f972",
"ref": "refs/heads/main"
}
},
"canary": true
}
[09:29:00.316] Invocation finished in 5h28m53.778837592s with status FAILED