[02:00:18.440] New invocation is queued and will start shortly
[02:00:19.545] Starting the invocation (attempt 1)
[02:00:19.570] Ignoring gitiles_ref tag without the buildset tag
[02:00:19.570] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:00:19.570] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:00:19.570] Buildbucket request:
{
"requestId": "8933635369232298784",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8933635369232298784"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-lsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:00:20.601] Scheduled build:
{
"id": "8768205307330575633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 346,
"createdBy": "project:chromium",
"createTime": "2023-10-04T02:00:19.629536616Z",
"updateTime": "2023-10-04T02:00:19.629536616Z",
"status": "SCHEDULED",
"input": {
}
}
[02:00:20.601] Task URL: https://cr-buildbucket.appspot.com/build/8768205307330575633
[02:00:20.601] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:2:0) after 3m32s
[02:00:21.392] Received PubSub notification, asking Buildbucket for the build status
[02:00:21.420] Build status: SCHEDULED
[02:00:45.667] Received PubSub notification, asking Buildbucket for the build status
[02:00:45.689] Build status: STARTED
[02:03:52.737] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:2:0)
[02:03:52.763] Build status: STARTED
[02:03:52.763] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:5:0) after 7m32s
[02:11:24.924] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:5:0)
[02:11:24.951] Build status: STARTED
[02:11:24.951] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:6:0) after 3m9s
[02:14:33.970] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:6:0)
[02:14:33.988] Build status: STARTED
[02:14:33.988] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:7:0) after 5m10s
[02:19:44.101] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:7:0)
[02:19:44.127] Build status: STARTED
[02:19:44.127] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:8:0) after 4m36s
[02:24:20.169] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:8:0)
[02:24:20.225] Build status: STARTED
[02:24:20.225] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:9:0) after 9m54s
[02:34:14.239] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:9:0)
[02:34:14.260] Build status: STARTED
[02:34:14.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:10:0) after 7m58s
[02:42:12.362] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:10:0)
[02:42:12.399] Build status: STARTED
[02:42:12.399] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:11:0) after 7m52s
[02:50:04.434] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:11:0)
[02:50:04.461] Build status: STARTED
[02:50:04.461] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:12:0) after 7m54s
[02:57:58.462] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:12:0)
[02:57:58.479] Build status: STARTED
[02:57:58.479] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:13:0) after 6m55s
[03:04:53.801] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:13:0)
[03:04:53.822] Build status: STARTED
[03:04:53.822] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:14:0) after 8m46s
[03:13:40.073] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:14:0)
[03:13:40.138] Build status: STARTED
[03:13:40.138] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:15:0) after 5m21s
[03:19:01.522] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:15:0)
[03:19:01.541] Build status: STARTED
[03:19:01.541] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:16:0) after 6m50s
[03:25:51.564] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:16:0)
[03:25:51.643] Build status: STARTED
[03:25:51.643] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:17:0) after 1m12s
[03:27:03.696] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:17:0)
[03:27:03.717] Build status: STARTED
[03:27:03.717] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:18:0) after 4m51s
[03:31:54.858] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:18:0)
[03:31:54.880] Build status: STARTED
[03:31:54.880] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:19:0) after 1m13s
[03:33:08.122] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:19:0)
[03:33:08.161] Build status: STARTED
[03:33:08.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:20:0) after 6m46s
[03:39:54.180] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:20:0)
[03:39:54.197] Build status: STARTED
[03:39:54.197] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:21:0) after 9m2s
[03:48:56.213] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:21:0)
[03:48:56.241] Build status: STARTED
[03:48:56.241] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:22:0) after 4m46s
[03:53:42.238] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:22:0)
[03:53:42.257] Build status: STARTED
[03:53:42.257] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:23:0) after 5m7s
[03:58:49.275] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:23:0)
[03:58:49.395] Build status: STARTED
[03:58:49.395] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:24:0) after 7m41s
[04:06:30.577] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:24:0)
[04:06:30.597] Build status: STARTED
[04:06:30.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:25:0) after 2m2s
[04:08:32.625] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:25:0)
[04:08:32.640] Build status: STARTED
[04:08:32.640] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:26:0) after 6m40s
[04:15:12.715] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:26:0)
[04:15:12.736] Build status: STARTED
[04:15:12.736] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:27:0) after 2m11s
[04:17:23.752] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:27:0)
[04:17:23.774] Build status: STARTED
[04:17:23.774] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:28:0) after 7m15s
[04:24:38.788] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:28:0)
[04:24:38.820] Build status: STARTED
[04:24:38.821] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:29:0) after 3m22s
[04:28:00.841] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:29:0)
[04:28:00.890] Build status: STARTED
[04:28:00.890] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:30:0) after 6m4s
[04:34:05.173] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:30:0)
[04:34:05.345] Build status: STARTED
[04:34:05.345] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:31:0) after 7m26s
[04:41:31.378] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:31:0)
[04:41:31.398] Build status: STARTED
[04:41:31.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:32:0) after 9m34s
[04:51:05.832] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:32:0)
[04:51:05.853] Build status: STARTED
[04:51:05.853] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:33:0) after 2m6s
[04:53:11.963] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:33:0)
[04:53:11.981] Build status: STARTED
[04:53:11.981] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:34:0) after 4m25s
[04:57:37.254] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:34:0)
[04:57:37.272] Build status: STARTED
[04:57:37.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:35:0) after 9m40s
[05:07:17.290] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:35:0)
[05:07:17.341] Build status: STARTED
[05:07:17.341] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:36:0) after 8m44s
[05:16:01.472] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:36:0)
[05:16:01.493] Build status: STARTED
[05:16:01.493] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:37:0) after 5m6s
[05:21:07.561] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:37:0)
[05:21:07.581] Build status: STARTED
[05:21:07.581] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:38:0) after 4m27s
[05:25:34.689] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:38:0)
[05:25:34.719] Build status: STARTED
[05:25:34.719] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:39:0) after 2m3s
[05:27:37.879] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:39:0)
[05:27:37.896] Build status: STARTED
[05:27:37.897] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:40:0) after 9m50s
[05:37:27.917] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:40:0)
[05:37:27.931] Build status: STARTED
[05:37:27.931] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:41:0) after 3m44s
[05:41:12.063] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:41:0)
[05:41:12.083] Build status: STARTED
[05:41:12.083] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:42:0) after 9m6s
[05:50:18.123] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:42:0)
[05:50:18.145] Build status: STARTED
[05:50:18.145] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:43:0) after 3m50s
[05:54:08.186] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:43:0)
[05:54:08.212] Build status: STARTED
[05:54:08.212] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:44:0) after 2m2s
[05:56:10.294] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:44:0)
[05:56:10.318] Build status: STARTED
[05:56:10.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:45:0) after 7m35s
[06:03:45.673] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:45:0)
[06:03:45.694] Build status: STARTED
[06:03:45.694] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:46:0) after 8m0s
[06:11:45.693] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:46:0)
[06:11:45.738] Build status: STARTED
[06:11:45.738] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:47:0) after 5m58s
[06:17:43.757] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:47:0)
[06:17:43.780] Build status: STARTED
[06:17:43.780] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:48:0) after 1m34s
[06:19:17.804] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:48:0)
[06:19:17.822] Build status: STARTED
[06:19:17.822] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:49:0) after 8m43s
[06:28:01.031] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:49:0)
[06:28:01.053] Build status: STARTED
[06:28:01.053] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:50:0) after 9m50s
[06:37:51.065] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:50:0)
[06:37:51.255] Build status: STARTED
[06:37:51.255] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:51:0) after 2m12s
[06:40:03.309] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:51:0)
[06:40:03.333] Build status: STARTED
[06:40:03.333] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:52:0) after 5m44s
[06:45:47.351] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:52:0)
[06:45:47.371] Build status: STARTED
[06:45:47.371] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:53:0) after 3m7s
[06:48:54.420] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:53:0)
[06:48:54.442] Build status: STARTED
[06:48:54.442] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:54:0) after 8m36s
[06:57:30.619] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:54:0)
[06:57:30.666] Build status: STARTED
[06:57:30.666] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:55:0) after 2m49s
[07:00:19.837] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:55:0)
[07:00:19.857] Build status: STARTED
[07:00:19.857] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:56:0) after 7m29s
[07:07:48.947] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:56:0)
[07:07:48.990] Build status: STARTED
[07:07:48.990] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:57:0) after 5m38s
[07:13:27.015] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:57:0)
[07:13:27.038] Build status: STARTED
[07:13:27.038] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:58:0) after 5m17s
[07:18:44.178] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:58:0)
[07:18:44.200] Build status: STARTED
[07:18:44.200] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:59:0) after 6m0s
[07:24:44.264] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:59:0)
[07:24:44.302] Build status: STARTED
[07:24:44.302] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:60:0) after 8m16s
[07:33:00.323] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:60:0)
[07:33:00.344] Build status: STARTED
[07:33:00.344] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:61:0) after 3m30s
[07:36:30.668] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:61:0)
[07:36:30.695] Build status: STARTED
[07:36:30.695] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:62:0) after 3m20s
[07:39:50.805] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:62:0)
[07:39:50.827] Build status: STARTED
[07:39:50.827] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:63:0) after 1m59s
[07:41:50.017] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:63:0)
[07:41:50.035] Build status: STARTED
[07:41:50.035] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:64:0) after 6m24s
[07:48:14.138] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:64:0)
[07:48:14.161] Build status: STARTED
[07:48:14.161] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:65:0) after 8m13s
[07:56:27.268] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:65:0)
[07:56:27.301] Build status: STARTED
[07:56:27.301] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:66:0) after 3m33s
[08:00:00.321] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:66:0)
[08:00:00.361] Build status: STARTED
[08:00:00.361] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8933635369232298784:67:0) after 2m37s
[08:01:55.548] Received PubSub notification, asking Buildbucket for the build status
[08:01:55.568] Build:
{
"id": "8768205307330575633",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 346,
"createdBy": "project:chromium",
"createTime": "2023-10-04T02:00:19.629536616Z",
"startTime": "2023-10-04T02:00:45.054860Z",
"endTime": "2023-10-04T08:01:55.164137829Z",
"updateTime": "2023-10-04T08:01:55.164137829Z",
"status": "FAILURE",
"input": {
}
}
[08:01:55.568] Invocation finished in 6h1m37.136091534s with status FAILED