[08:09:58.166] New invocation is queued and will start shortly
[08:10:00.229] Starting the invocation (attempt 1)
[08:10:00.255] Ignoring gitiles_ref tag without the buildset tag
[08:10:00.256] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[08:10:00.256] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[08:10:00.256] Buildbucket request:
{
"requestId": "8926545548725158464",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"properties": {
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8926545548725158464"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-lsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[08:10:00.889] Scheduled build:
{
"id": "8761115485802247441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 408,
"createdBy": "project:chromium",
"createTime": "2023-12-21T08:10:00.329883868Z",
"updateTime": "2023-12-21T08:10:00.329883868Z",
"status": "SCHEDULED",
"input": {
}
}
[08:10:00.889] Task URL: https://cr-buildbucket.appspot.com/build/8761115485802247441
[08:10:00.889] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:2:0) after 8m15s
[08:10:01.782] Received PubSub notification, asking Buildbucket for the build status
[08:10:01.810] Build status: SCHEDULED
[08:10:02.106] Received PubSub notification, asking Buildbucket for the build status
[08:10:02.126] Build status: STARTED
[08:18:15.877] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:2:0)
[08:18:15.894] Build status: STARTED
[08:18:15.895] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:5:0) after 6m39s
[08:24:54.915] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:5:0)
[08:24:55.086] Build status: STARTED
[08:24:55.086] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:6:0) after 2m39s
[08:27:34.108] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:6:0)
[08:27:34.174] Build status: STARTED
[08:27:34.174] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:7:0) after 4m36s
[08:32:10.191] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:7:0)
[08:32:10.211] Build status: STARTED
[08:32:10.211] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:8:0) after 7m50s
[08:40:00.429] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:8:0)
[08:40:00.450] Build status: STARTED
[08:40:00.450] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:9:0) after 2m29s
[08:42:29.485] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:9:0)
[08:42:29.502] Build status: STARTED
[08:42:29.502] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:10:0) after 4m8s
[08:46:37.528] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:10:0)
[08:46:37.556] Build status: STARTED
[08:46:37.556] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:11:0) after 2m35s
[08:49:12.880] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:11:0)
[08:49:12.913] Build status: STARTED
[08:49:12.913] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:12:0) after 1m43s
[08:50:55.935] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:12:0)
[08:50:55.954] Build status: STARTED
[08:50:55.954] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:13:0) after 3m11s
[08:54:06.969] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:13:0)
[08:54:06.993] Build status: STARTED
[08:54:06.993] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:14:0) after 6m3s
[09:00:10.169] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:14:0)
[09:00:10.187] Build status: STARTED
[09:00:10.187] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:15:0) after 4m35s
[09:04:45.302] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:15:0)
[09:04:45.318] Build status: STARTED
[09:04:45.318] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:16:0) after 4m22s
[09:09:07.319] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:16:0)
[09:09:07.347] Build status: STARTED
[09:09:07.347] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:17:0) after 7m54s
[09:17:01.361] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:17:0)
[09:17:01.464] Build status: STARTED
[09:17:01.464] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:18:0) after 5m25s
[09:22:26.504] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:18:0)
[09:22:26.523] Build status: STARTED
[09:22:26.523] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:19:0) after 8m37s
[09:31:03.550] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:19:0)
[09:31:03.572] Build status: STARTED
[09:31:03.572] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:20:0) after 8m21s
[09:39:24.686] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:20:0)
[09:39:24.707] Build status: STARTED
[09:39:24.707] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:21:0) after 2m36s
[09:42:00.966] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:21:0)
[09:42:00.990] Build status: STARTED
[09:42:00.990] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:22:0) after 1m44s
[09:43:45.012] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:22:0)
[09:43:45.045] Build status: STARTED
[09:43:45.045] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:23:0) after 4m5s
[09:47:50.442] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:23:0)
[09:47:50.457] Build status: STARTED
[09:47:50.457] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:24:0) after 4m14s
[09:52:04.483] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:24:0)
[09:52:04.531] Build status: STARTED
[09:52:04.531] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:25:0) after 5m12s
[09:57:16.603] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:25:0)
[09:57:16.623] Build status: STARTED
[09:57:16.623] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:26:0) after 1m49s
[09:59:05.707] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:26:0)
[09:59:05.730] Build status: STARTED
[09:59:05.730] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:27:0) after 7m50s
[10:06:55.749] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:27:0)
[10:06:55.776] Build status: STARTED
[10:06:55.776] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:28:0) after 5m0s
[10:11:55.765] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:28:0)
[10:11:55.780] Build status: STARTED
[10:11:55.780] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:29:0) after 1m36s
[10:13:31.839] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:29:0)
[10:13:31.865] Build status: STARTED
[10:13:31.865] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:30:0) after 5m40s
[10:19:11.881] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:30:0)
[10:19:12.044] Build status: STARTED
[10:19:12.044] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:31:0) after 1m31s
[10:20:43.162] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:31:0)
[10:20:43.247] Build status: STARTED
[10:20:43.247] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:32:0) after 1m9s
[10:21:52.264] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:32:0)
[10:21:52.335] Build status: STARTED
[10:21:52.335] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:33:0) after 5m6s
[10:26:58.392] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:33:0)
[10:26:58.412] Build status: STARTED
[10:26:58.412] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:34:0) after 2m53s
[10:29:51.516] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:34:0)
[10:29:51.538] Build status: STARTED
[10:29:51.538] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:35:0) after 5m18s
[10:35:09.554] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:35:0)
[10:35:09.854] Build status: STARTED
[10:35:09.854] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:36:0) after 2m44s
[10:37:53.942] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:36:0)
[10:37:53.959] Build status: STARTED
[10:37:53.959] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:37:0) after 4m4s
[10:41:57.978] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:37:0)
[10:41:57.999] Build status: STARTED
[10:41:57.999] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:38:0) after 2m14s
[10:44:12.103] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:38:0)
[10:44:12.119] Build status: STARTED
[10:44:12.119] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:39:0) after 3m0s
[10:47:12.142] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:39:0)
[10:47:12.175] Build status: STARTED
[10:47:12.175] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:40:0) after 4m34s
[10:51:46.172] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:40:0)
[10:51:46.192] Build status: STARTED
[10:51:46.192] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:41:0) after 9m20s
[11:01:06.298] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:41:0)
[11:01:06.322] Build status: STARTED
[11:01:06.322] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:42:0) after 2m31s
[11:03:37.343] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:42:0)
[11:03:37.364] Build status: STARTED
[11:03:37.364] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:43:0) after 9m2s
[11:12:39.391] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:43:0)
[11:12:39.409] Build status: STARTED
[11:12:39.409] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:44:0) after 9m8s
[11:21:47.533] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:44:0)
[11:21:47.555] Build status: STARTED
[11:21:47.555] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:45:0) after 5m13s
[11:27:00.803] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:45:0)
[11:27:00.844] Build status: STARTED
[11:27:00.844] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:46:0) after 9m14s
[11:36:15.003] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:46:0)
[11:36:15.034] Build status: STARTED
[11:36:15.034] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:47:0) after 8m54s
[11:45:09.098] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:47:0)
[11:45:09.228] Build status: STARTED
[11:45:09.228] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:48:0) after 2m7s
[11:47:16.224] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:48:0)
[11:47:16.242] Build status: STARTED
[11:47:16.242] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:49:0) after 1m58s
[11:49:14.285] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:49:0)
[11:49:14.307] Build status: STARTED
[11:49:14.307] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:50:0) after 9m25s
[11:58:39.480] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:50:0)
[11:58:39.502] Build status: STARTED
[11:58:39.503] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:51:0) after 2m1s
[12:00:41.036] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:51:0)
[12:00:41.074] Build status: STARTED
[12:00:41.074] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:52:0) after 4m31s
[12:05:12.326] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:52:0)
[12:05:12.354] Build status: STARTED
[12:05:12.354] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:53:0) after 3m16s
[12:08:28.712] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:53:0)
[12:08:28.731] Build status: STARTED
[12:08:28.731] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:54:0) after 8m13s
[12:16:41.805] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:54:0)
[12:16:41.836] Build status: STARTED
[12:16:41.836] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:55:0) after 9m44s
[12:26:25.977] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:55:0)
[12:26:25.991] Build status: STARTED
[12:26:25.991] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:56:0) after 5m43s
[12:32:09.107] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:56:0)
[12:32:09.127] Build status: STARTED
[12:32:09.127] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:57:0) after 4m47s
[12:36:56.115] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:57:0)
[12:36:56.140] Build status: STARTED
[12:36:56.140] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:58:0) after 4m49s
[12:41:45.156] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:58:0)
[12:41:45.177] Build status: STARTED
[12:41:45.177] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:59:0) after 3m24s
[12:45:09.261] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:59:0)
[12:45:09.329] Build status: STARTED
[12:45:09.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:60:0) after 3m52s
[12:49:01.346] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:60:0)
[12:49:01.367] Build status: STARTED
[12:49:01.367] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:61:0) after 6m29s
[12:55:30.380] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:61:0)
[12:55:30.398] Build status: STARTED
[12:55:30.398] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:62:0) after 1m16s
[12:56:46.744] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:62:0)
[12:56:46.820] Build status: STARTED
[12:56:46.820] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8926545548725158464:63:0) after 7m50s
[13:02:16.353] Received PubSub notification, asking Buildbucket for the build status
[13:02:16.388] Build:
{
"id": "8761115485802247441",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 408,
"createdBy": "project:chromium",
"createTime": "2023-12-21T08:10:00.329883868Z",
"startTime": "2023-12-21T08:10:01.570694Z",
"endTime": "2023-12-21T13:02:15.726108Z",
"updateTime": "2023-12-21T13:02:15.726108Z",
"status": "FAILURE",
"input": {
}
}
[13:02:16.388] Invocation finished in 4h52m18.229892819s with status FAILED