[04:20:50.430] New invocation is queued and will start shortly
[04:20:51.465] Starting the invocation (attempt 1)
[04:20:51.496] Ignoring gitiles_ref tag without the buildset tag
[04:20:51.496] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[04:20:51.496] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[04:20:51.496] Buildbucket request:
{
"requestId": "8874104320732688096",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8874104320732688096"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-lsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[04:20:52.011] Scheduled build:
{
"id": "8708674258874986785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 931,
"createdBy": "project:chromium",
"createTime": "2025-07-22T04:20:51.570785406Z",
"updateTime": "2025-07-22T04:20:51.570785406Z",
"status": "SCHEDULED",
"input": {
}
}
[04:20:52.011] Task URL: https://cr-buildbucket.appspot.com/build/8708674258874986785
[04:20:52.011] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:2:0) after 1m12s
[04:20:52.505] Received PubSub notification, asking Buildbucket for the build status
[04:20:52.526] Build status: SCHEDULED
[04:20:55.120] Received PubSub notification, asking Buildbucket for the build status
[04:20:55.140] Build status: STARTED
[04:22:04.069] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:2:0)
[04:22:04.097] Build status: STARTED
[04:22:04.097] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:5:0) after 6m20s
[04:28:24.120] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:5:0)
[04:28:24.141] Build status: STARTED
[04:28:24.141] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:6:0) after 7m24s
[04:35:48.162] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:6:0)
[04:35:48.199] Build status: STARTED
[04:35:48.199] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:7:0) after 6m27s
[04:42:15.419] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:7:0)
[04:42:15.445] Build status: STARTED
[04:42:15.445] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:8:0) after 1m21s
[04:43:36.584] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:8:0)
[04:43:36.614] Build status: STARTED
[04:43:36.614] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:9:0) after 5m3s
[04:48:39.736] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:9:0)
[04:48:39.759] Build status: STARTED
[04:48:39.759] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:10:0) after 3m42s
[04:52:22.582] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:10:0)
[04:52:22.633] Build status: STARTED
[04:52:22.633] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:11:0) after 9m28s
[05:01:50.656] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:11:0)
[05:01:50.733] Build status: STARTED
[05:01:50.734] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:12:0) after 4m40s
[05:06:30.750] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:12:0)
[05:06:30.780] Build status: STARTED
[05:06:30.780] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:13:0) after 4m12s
[05:10:42.799] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:13:0)
[05:10:42.826] Build status: STARTED
[05:10:42.826] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:14:0) after 7m7s
[05:17:49.808] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:14:0)
[05:17:49.824] Build status: STARTED
[05:17:49.825] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:15:0) after 6m24s
[05:24:14.164] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:15:0)
[05:24:14.185] Build status: STARTED
[05:24:14.185] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:16:0) after 9m59s
[05:34:13.674] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:16:0)
[05:34:13.691] Build status: STARTED
[05:34:13.691] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:17:0) after 8m26s
[05:42:39.706] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:17:0)
[05:42:39.727] Build status: STARTED
[05:42:39.727] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:18:0) after 4m4s
[05:46:44.461] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:18:0)
[05:46:44.490] Build status: STARTED
[05:46:44.490] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:19:0) after 6m52s
[05:53:36.511] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:19:0)
[05:53:36.538] Build status: STARTED
[05:53:36.539] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:20:0) after 4m32s
[05:58:09.322] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:20:0)
[05:58:09.348] Build status: STARTED
[05:58:09.348] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:21:0) after 1m22s
[05:59:31.493] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:21:0)
[05:59:31.510] Build status: STARTED
[05:59:31.510] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:22:0) after 7m5s
[06:06:36.767] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:22:0)
[06:06:36.805] Build status: STARTED
[06:06:36.805] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:23:0) after 3m7s
[06:09:43.955] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:23:0)
[06:09:44.064] Build status: STARTED
[06:09:44.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:24:0) after 3m34s
[06:13:18.578] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:24:0)
[06:13:18.597] Build status: STARTED
[06:13:18.597] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:25:0) after 7m48s
[06:21:06.615] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:25:0)
[06:21:06.781] Build status: STARTED
[06:21:06.781] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:26:0) after 1m31s
[06:22:37.805] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:26:0)
[06:22:37.856] Build status: STARTED
[06:22:37.856] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:27:0) after 1m48s
[06:24:25.881] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:27:0)
[06:24:25.900] Build status: STARTED
[06:24:25.900] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:28:0) after 6m58s
[06:31:23.924] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:28:0)
[06:31:23.939] Build status: STARTED
[06:31:23.939] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:29:0) after 5m48s
[06:37:12.244] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:29:0)
[06:37:12.260] Build status: STARTED
[06:37:12.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:30:0) after 6m21s
[06:43:33.279] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:30:0)
[06:43:33.328] Build status: STARTED
[06:43:33.328] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:31:0) after 5m49s
[06:49:22.594] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:31:0)
[06:49:22.609] Build status: STARTED
[06:49:22.609] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:32:0) after 8m30s
[06:57:52.634] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:32:0)
[06:57:52.654] Build status: STARTED
[06:57:52.654] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:33:0) after 5m14s
[07:03:06.677] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:33:0)
[07:03:06.692] Build status: STARTED
[07:03:06.692] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:34:0) after 9m24s
[07:12:30.732] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:34:0)
[07:12:30.756] Build status: STARTED
[07:12:30.756] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:35:0) after 3m17s
[07:15:47.936] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:35:0)
[07:15:47.999] Build status: STARTED
[07:15:47.999] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:36:0) after 4m1s
[07:19:49.043] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:36:0)
[07:19:49.073] Build status: STARTED
[07:19:49.073] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:37:0) after 1m58s
[07:21:47.130] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:37:0)
[07:21:47.151] Build status: STARTED
[07:21:47.151] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:38:0) after 4m8s
[07:25:55.169] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:38:0)
[07:25:55.190] Build status: STARTED
[07:25:55.190] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:39:0) after 9m34s
[07:35:29.309] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:39:0)
[07:35:29.330] Build status: STARTED
[07:35:29.330] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:40:0) after 5m33s
[07:41:02.359] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:40:0)
[07:41:02.380] Build status: STARTED
[07:41:02.380] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:41:0) after 4m13s
[07:45:15.408] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:41:0)
[07:45:15.431] Build status: STARTED
[07:45:15.431] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:42:0) after 7m30s
[07:52:45.481] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:42:0)
[07:52:45.552] Build status: STARTED
[07:52:45.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:43:0) after 9m28s
[08:02:13.656] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:43:0)
[08:02:13.675] Build status: STARTED
[08:02:13.675] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:44:0) after 9m29s
[08:11:42.694] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:44:0)
[08:11:42.736] Build status: STARTED
[08:11:42.736] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:45:0) after 4m10s
[08:15:52.940] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:45:0)
[08:15:52.969] Build status: STARTED
[08:15:52.969] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:46:0) after 5m19s
[08:21:12.240] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:46:0)
[08:21:12.260] Build status: STARTED
[08:21:12.260] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:47:0) after 2m0s
[08:23:12.287] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:47:0)
[08:23:12.305] Build status: STARTED
[08:23:12.305] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:48:0) after 9m28s
[08:32:40.446] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:48:0)
[08:32:40.487] Build status: STARTED
[08:32:40.487] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:49:0) after 2m5s
[08:34:45.649] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:49:0)
[08:34:45.684] Build status: STARTED
[08:34:45.684] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:50:0) after 7m11s
[08:41:56.774] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:50:0)
[08:41:56.790] Build status: STARTED
[08:41:56.790] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:51:0) after 3m8s
[08:45:04.866] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:51:0)
[08:45:04.907] Build status: STARTED
[08:45:04.907] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:52:0) after 9m55s
[08:54:59.926] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:52:0)
[08:54:59.941] Build status: STARTED
[08:54:59.941] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:53:0) after 5m34s
[09:00:34.015] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:53:0)
[09:00:34.074] Build status: STARTED
[09:00:34.074] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:54:0) after 4m22s
[09:04:56.273] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:54:0)
[09:04:56.325] Build status: STARTED
[09:04:56.325] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:55:0) after 2m42s
[09:07:38.398] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:55:0)
[09:07:38.520] Build status: STARTED
[09:07:38.520] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:56:0) after 1m27s
[09:09:05.673] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:56:0)
[09:09:05.690] Build status: STARTED
[09:09:05.690] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:57:0) after 6m58s
[09:16:03.683] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:57:0)
[09:16:03.704] Build status: STARTED
[09:16:03.704] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:58:0) after 3m31s
[09:19:34.720] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:58:0)
[09:19:34.795] Build status: STARTED
[09:19:34.795] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:59:0) after 4m20s
[09:23:54.982] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:59:0)
[09:23:54.997] Build status: STARTED
[09:23:54.997] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:60:0) after 7m21s
[09:31:16.019] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:60:0)
[09:31:16.038] Build status: STARTED
[09:31:16.039] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:61:0) after 4m14s
[09:35:30.087] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:61:0)
[09:35:30.103] Build status: STARTED
[09:35:30.103] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:62:0) after 9m17s
[09:44:47.345] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:62:0)
[09:44:47.364] Build status: STARTED
[09:44:47.364] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:63:0) after 9m8s
[09:53:55.402] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:63:0)
[09:53:55.495] Build status: STARTED
[09:53:55.496] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:64:0) after 8m9s
[10:02:04.533] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:64:0)
[10:02:04.549] Build status: STARTED
[10:02:04.549] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:65:0) after 5m24s
[10:07:28.637] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:65:0)
[10:07:28.660] Build status: STARTED
[10:07:28.660] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:66:0) after 6m58s
[10:14:26.724] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:66:0)
[10:14:26.744] Build status: STARTED
[10:14:26.744] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8874104320732688096:67:0) after 6m48s
[10:15:07.780] Received PubSub notification, asking Buildbucket for the build status
[10:15:07.803] Build:
{
"id": "8708674258874986785",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 931,
"createdBy": "project:chromium",
"createTime": "2025-07-22T04:20:51.570785406Z",
"startTime": "2025-07-22T04:20:54.795951476Z",
"endTime": "2025-07-22T10:15:07.505590618Z",
"updateTime": "2025-07-22T10:15:07.505590618Z",
"status": "FAILURE",
"input": {
}
}
[10:15:07.803] Invocation finished in 5h54m17.387353937s with status FAILED