[04:00:19.741] New invocation is queued and will start shortly
[04:00:22.638] Starting the invocation (attempt 1)
[04:00:22.669] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/04af57b6b554cef235f3c32d42a295f8ed0628e9"
[04:00:22.669] Popped gitiles commit info from properties and tags
[04:00:22.669] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:00:22.669] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:00:22.669] Buildbucket request:
{
"requestId": "8934805578705299776",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "04af57b6b554cef235f3c32d42a295f8ed0628e9",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8934805578705299776"
},
{
"key": "scheduler_job_id",
"value": "chromium/linux-lacros-code-coverage"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:00:23.698] Scheduled build:
{
"id": "8769375514851198497",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 2849,
"createdBy": "project:chromium",
"createTime": "2023-09-21T04:00:22.772346635Z",
"updateTime": "2023-09-21T04:00:22.772346635Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "04af57b6b554cef235f3c32d42a295f8ed0628e9",
"ref": "refs/heads/main"
}
}
}
[04:00:23.699] Task URL: https://cr-buildbucket.appspot.com/build/8769375514851198497
[04:00:23.699] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:2:0) after 9m52s
[04:00:27.942] Received PubSub notification, asking Buildbucket for the build status
[04:00:27.996] Build status: SCHEDULED
[04:10:15.765] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:2:0)
[04:10:15.807] Build status: SCHEDULED
[04:10:15.807] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:4:0) after 5m29s
[04:15:44.821] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:4:0)
[04:15:44.844] Build status: SCHEDULED
[04:15:44.844] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:5:0) after 2m23s
[04:18:07.814] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:5:0)
[04:18:07.832] Build status: SCHEDULED
[04:18:07.832] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:6:0) after 9m22s
[04:27:29.909] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:6:0)
[04:27:29.933] Build status: SCHEDULED
[04:27:29.933] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:7:0) after 8m49s
[04:36:18.953] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:7:0)
[04:36:18.975] Build status: SCHEDULED
[04:36:18.975] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:8:0) after 4m29s
[04:40:47.994] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:8:0)
[04:40:48.014] Build status: SCHEDULED
[04:40:48.014] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:9:0) after 8m25s
[04:49:13.283] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:9:0)
[04:49:13.330] Build status: SCHEDULED
[04:49:13.330] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:10:0) after 2m18s
[04:51:31.445] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:10:0)
[04:51:31.469] Build status: SCHEDULED
[04:51:31.469] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:11:0) after 6m16s
[04:57:47.505] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:11:0)
[04:57:47.527] Build status: SCHEDULED
[04:57:47.527] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:12:0) after 9m32s
[05:07:19.994] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:12:0)
[05:07:20.044] Build status: SCHEDULED
[05:07:20.044] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:13:0) after 3m25s
[05:10:45.343] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:13:0)
[05:10:45.367] Build status: SCHEDULED
[05:10:45.367] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:14:0) after 5m3s
[05:12:36.337] Received PubSub notification, asking Buildbucket for the build status
[05:12:36.352] Build status: STARTED
[05:15:48.444] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:14:0)
[05:15:48.503] Build status: STARTED
[05:15:48.503] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:16:0) after 1m9s
[05:16:57.695] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:16:0)
[05:16:57.738] Build status: STARTED
[05:16:57.738] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:17:0) after 3m41s
[05:20:38.775] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:17:0)
[05:20:38.796] Build status: STARTED
[05:20:38.796] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:18:0) after 1m0s
[05:21:38.858] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:18:0)
[05:21:38.883] Build status: STARTED
[05:21:38.883] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:19:0) after 8m34s
[05:30:13.164] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:19:0)
[05:30:13.193] Build status: STARTED
[05:30:13.193] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:20:0) after 5m46s
[05:35:59.263] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:20:0)
[05:35:59.281] Build status: STARTED
[05:35:59.281] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:21:0) after 1m9s
[05:37:08.531] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:21:0)
[05:37:08.588] Build status: STARTED
[05:37:08.588] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:22:0) after 7m19s
[05:44:27.705] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:22:0)
[05:44:27.734] Build status: STARTED
[05:44:27.734] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:23:0) after 1m24s
[05:45:52.339] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:23:0)
[05:45:52.398] Build status: STARTED
[05:45:52.398] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:24:0) after 8m20s
[05:54:12.428] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:24:0)
[05:54:12.449] Build status: STARTED
[05:54:12.449] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:25:0) after 4m22s
[05:58:34.594] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:25:0)
[05:58:34.623] Build status: STARTED
[05:58:34.623] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:26:0) after 5m43s
[06:04:17.619] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:26:0)
[06:04:17.640] Build status: STARTED
[06:04:17.640] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:27:0) after 8m59s
[06:13:17.044] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:27:0)
[06:13:17.060] Build status: STARTED
[06:13:17.060] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:28:0) after 3m8s
[06:16:25.218] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:28:0)
[06:16:25.236] Build status: STARTED
[06:16:25.236] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:29:0) after 3m44s
[06:20:09.713] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:29:0)
[06:20:09.736] Build status: STARTED
[06:20:09.736] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:30:0) after 3m34s
[06:23:43.864] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:30:0)
[06:23:43.883] Build status: STARTED
[06:23:43.883] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:31:0) after 6m8s
[06:29:52.011] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:31:0)
[06:29:52.046] Build status: STARTED
[06:29:52.046] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:32:0) after 5m41s
[06:35:33.179] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:32:0)
[06:35:33.206] Build status: STARTED
[06:35:33.206] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:33:0) after 7m41s
[06:43:14.255] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:33:0)
[06:43:14.275] Build status: STARTED
[06:43:14.275] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:34:0) after 8m37s
[06:51:51.375] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:34:0)
[06:51:51.399] Build status: STARTED
[06:51:51.399] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:35:0) after 3m31s
[06:55:22.446] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:35:0)
[06:55:22.466] Build status: STARTED
[06:55:22.466] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:36:0) after 5m36s
[07:00:58.536] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:36:0)
[07:00:58.554] Build status: STARTED
[07:00:58.554] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:37:0) after 6m7s
[07:07:05.672] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:37:0)
[07:07:05.694] Build status: STARTED
[07:07:05.694] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:38:0) after 7m31s
[07:14:36.841] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:38:0)
[07:14:36.882] Build status: STARTED
[07:14:36.882] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:39:0) after 6m0s
[07:20:36.915] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:39:0)
[07:20:36.939] Build status: STARTED
[07:20:36.939] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:40:0) after 1m0s
[07:21:36.955] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:40:0)
[07:21:36.989] Build status: STARTED
[07:21:36.989] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:41:0) after 6m42s
[07:28:19.239] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:41:0)
[07:28:19.256] Build status: STARTED
[07:28:19.256] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:42:0) after 3m35s
[07:31:54.370] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:42:0)
[07:31:54.387] Build status: STARTED
[07:31:54.387] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:43:0) after 6m58s
[07:38:52.589] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:43:0)
[07:38:52.608] Build status: STARTED
[07:38:52.608] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:44:0) after 1m31s
[07:40:24.063] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:44:0)
[07:40:24.089] Build status: STARTED
[07:40:24.089] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:45:0) after 7m12s
[07:47:36.336] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:45:0)
[07:47:36.354] Build status: STARTED
[07:47:36.354] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:46:0) after 9m21s
[07:56:57.468] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:46:0)
[07:56:57.488] Build status: STARTED
[07:56:57.489] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:47:0) after 4m50s
[08:01:47.585] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:47:0)
[08:01:47.608] Build status: STARTED
[08:01:47.608] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:48:0) after 5m42s
[08:07:29.682] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:48:0)
[08:07:29.704] Build status: STARTED
[08:07:29.704] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:49:0) after 5m49s
[08:13:18.832] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:49:0)
[08:13:18.921] Build status: STARTED
[08:13:18.921] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:50:0) after 5m36s
[08:18:54.943] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:50:0)
[08:18:54.965] Build status: STARTED
[08:18:54.965] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:51:0) after 2m46s
[08:21:41.072] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:51:0)
[08:21:41.104] Build status: STARTED
[08:21:41.104] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:52:0) after 8m32s
[08:30:13.241] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:52:0)
[08:30:13.322] Build status: STARTED
[08:30:13.322] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:53:0) after 1m52s
[08:32:05.346] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:53:0)
[08:32:05.364] Build status: STARTED
[08:32:05.364] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:54:0) after 5m1s
[08:37:06.453] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:54:0)
[08:37:06.472] Build status: STARTED
[08:37:06.472] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:55:0) after 2m2s
[08:39:08.505] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:55:0)
[08:39:08.675] Build status: STARTED
[08:39:08.675] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:56:0) after 5m54s
[08:45:02.731] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:56:0)
[08:45:02.752] Build status: STARTED
[08:45:02.752] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:57:0) after 8m30s
[08:53:33.203] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:57:0)
[08:53:33.225] Build status: STARTED
[08:53:33.225] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:58:0) after 6m59s
[09:00:32.265] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:58:0)
[09:00:32.288] Build status: STARTED
[09:00:32.288] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:59:0) after 6m41s
[09:07:13.578] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:59:0)
[09:07:13.624] Build status: STARTED
[09:07:13.624] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:60:0) after 6m7s
[09:13:20.637] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:60:0)
[09:13:20.657] Build status: STARTED
[09:13:20.657] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:61:0) after 8m27s
[09:21:47.710] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:61:0)
[09:21:47.729] Build status: STARTED
[09:21:47.729] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:62:0) after 2m2s
[09:23:49.762] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:62:0)
[09:23:49.785] Build status: STARTED
[09:23:49.785] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:63:0) after 9m15s
[09:33:05.015] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:63:0)
[09:33:05.178] Build status: STARTED
[09:33:05.178] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:64:0) after 5m43s
[09:38:48.195] Handling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:64:0)
[09:38:48.214] Build status: STARTED
[09:38:48.214] Scheduling timer "check-buildbucket-build-status" (chromium/linux-lacros-code-coverage:8934805578705299776:65:0) after 6m58s
[09:44:08.598] Received PubSub notification, asking Buildbucket for the build status
[09:44:08.636] Build:
{
"id": "8769375514851198497",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "linux-lacros-code-coverage"
},
"number": 2849,
"createdBy": "project:chromium",
"createTime": "2023-09-21T04:00:22.772346635Z",
"startTime": "2023-09-21T05:12:35.768939Z",
"endTime": "2023-09-21T09:44:08.098200484Z",
"updateTime": "2023-09-21T09:44:08.098200484Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "04af57b6b554cef235f3c32d42a295f8ed0628e9",
"ref": "refs/heads/main"
}
}
}
[09:44:08.636] Invocation finished in 5h43m48.92325552s with status FAILED