[06:06:54.652] New invocation is queued and will start shortly
[06:06:55.785] Starting the invocation (attempt 1)
[06:06:55.819] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b5e09304f3943ecd6332d15c3926ae0a3185bb3c"
[06:06:55.819] Popped gitiles commit info from properties and tags
[06:06:55.819] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[06:06:55.819] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[06:06:55.819] Buildbucket request:
{
"requestId": "8949474323411127840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5e09304f3943ecd6332d15c3926ae0a3185bb3c",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8949474323411127840"
},
{
"key": "scheduler_job_id",
"value": "chromium/mac-lsan-fyi-rel"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[06:06:56.419] Scheduled build:
{
"id": "8784044261434727361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 28,
"createdBy": "project:chromium",
"createTime": "2023-04-12T06:06:55.901278006Z",
"updateTime": "2023-04-12T06:06:55.901278006Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5e09304f3943ecd6332d15c3926ae0a3185bb3c",
"ref": "refs/heads/main"
}
},
"canary": true
}
[06:06:56.419] Task URL: https://cr-buildbucket.appspot.com/build/8784044261434727361
[06:06:56.419] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:2:0) after 3m9s
[06:10:05.442] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:2:0)
[06:10:05.467] Build status: SCHEDULED
[06:10:05.467] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:3:0) after 9m30s
[06:19:35.544] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:3:0)
[06:19:35.569] Build status: SCHEDULED
[06:19:35.569] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:4:0) after 6m0s
[06:25:35.614] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:4:0)
[06:25:35.644] Build status: SCHEDULED
[06:25:35.644] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:5:0) after 8m17s
[06:33:52.764] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:5:0)
[06:33:52.786] Build status: SCHEDULED
[06:33:52.786] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:6:0) after 8m57s
[06:42:49.889] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:6:0)
[06:42:49.927] Build status: SCHEDULED
[06:42:49.927] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:7:0) after 6m55s
[06:45:22.671] Received PubSub notification, asking Buildbucket for the build status
[06:45:22.708] Build status: STARTED
[06:49:45.019] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:7:0)
[06:49:45.037] Build status: STARTED
[06:49:45.037] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:9:0) after 8m9s
[06:57:54.125] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:9:0)
[06:57:54.961] Build status: STARTED
[06:57:54.961] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:10:0) after 6m53s
[07:04:47.943] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:10:0)
[07:04:47.965] Build status: STARTED
[07:04:47.965] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:11:0) after 7m27s
[07:12:14.994] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:11:0)
[07:12:15.015] Build status: STARTED
[07:12:15.015] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:12:0) after 7m43s
[07:19:58.102] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:12:0)
[07:19:58.124] Build status: STARTED
[07:19:58.124] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:13:0) after 6m42s
[07:26:40.250] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:13:0)
[07:26:40.272] Build status: STARTED
[07:26:40.272] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:14:0) after 9m3s
[07:35:43.679] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:14:0)
[07:35:43.700] Build status: STARTED
[07:35:43.700] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:15:0) after 6m54s
[07:42:37.723] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:15:0)
[07:42:37.752] Build status: STARTED
[07:42:37.752] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:16:0) after 5m53s
[07:48:31.325] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:16:0)
[07:48:31.346] Build status: STARTED
[07:48:31.346] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:17:0) after 1m24s
[07:49:55.376] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:17:0)
[07:49:55.400] Build status: STARTED
[07:49:55.400] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:18:0) after 5m39s
[07:55:34.513] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:18:0)
[07:55:34.534] Build status: STARTED
[07:55:34.534] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:19:0) after 4m54s
[08:00:28.852] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:19:0)
[08:00:28.879] Build status: STARTED
[08:00:28.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:20:0) after 7m54s
[08:08:22.902] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:20:0)
[08:08:22.950] Build status: STARTED
[08:08:22.950] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:21:0) after 8m37s
[08:17:00.431] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:21:0)
[08:17:00.452] Build status: STARTED
[08:17:00.452] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:22:0) after 3m50s
[08:20:50.673] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:22:0)
[08:20:50.710] Build status: STARTED
[08:20:50.710] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:23:0) after 5m58s
[08:26:48.981] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:23:0)
[08:26:49.001] Build status: STARTED
[08:26:49.001] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:24:0) after 4m27s
[08:31:16.284] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:24:0)
[08:31:16.347] Build status: STARTED
[08:31:16.347] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:25:0) after 8m44s
[08:40:00.477] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:25:0)
[08:40:00.498] Build status: STARTED
[08:40:00.498] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:26:0) after 5m17s
[08:45:17.521] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:26:0)
[08:45:17.552] Build status: STARTED
[08:45:17.552] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:27:0) after 6m43s
[08:52:00.581] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:27:0)
[08:52:00.606] Build status: STARTED
[08:52:00.606] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:28:0) after 7m56s
[08:59:56.775] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:28:0)
[08:59:56.798] Build status: STARTED
[08:59:56.798] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:29:0) after 5m40s
[09:05:36.922] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:29:0)
[09:05:36.943] Build status: STARTED
[09:05:36.943] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:30:0) after 6m54s
[09:12:30.966] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:30:0)
[09:12:30.996] Build status: STARTED
[09:12:30.996] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:31:0) after 7m11s
[09:19:42.086] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:31:0)
[09:19:42.108] Build status: STARTED
[09:19:42.108] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:32:0) after 7m27s
[09:27:09.127] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:32:0)
[09:27:09.149] Build status: STARTED
[09:27:09.149] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:33:0) after 5m1s
[09:32:10.228] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:33:0)
[09:32:10.248] Build status: STARTED
[09:32:10.248] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:34:0) after 4m52s
[09:37:03.147] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:34:0)
[09:37:03.239] Build status: STARTED
[09:37:03.239] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:35:0) after 6m56s
[09:43:59.418] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:35:0)
[09:43:59.435] Build status: STARTED
[09:43:59.435] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:36:0) after 5m28s
[09:49:27.594] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:36:0)
[09:49:27.617] Build status: STARTED
[09:49:27.617] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:37:0) after 2m12s
[09:51:39.791] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:37:0)
[09:51:39.811] Build status: STARTED
[09:51:39.811] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:38:0) after 4m54s
[09:56:33.861] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:38:0)
[09:56:33.879] Build status: STARTED
[09:56:33.879] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:39:0) after 1m26s
[09:57:59.913] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:39:0)
[09:57:59.940] Build status: STARTED
[09:57:59.940] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:40:0) after 1m43s
[09:59:43.041] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:40:0)
[09:59:43.063] Build status: STARTED
[09:59:43.063] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:41:0) after 7m0s
[10:06:43.188] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:41:0)
[10:06:43.213] Build status: STARTED
[10:06:43.213] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:42:0) after 2m28s
[10:09:11.735] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:42:0)
[10:09:11.753] Build status: STARTED
[10:09:11.753] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:43:0) after 7m58s
[10:17:09.771] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:43:0)
[10:17:09.792] Build status: STARTED
[10:17:09.793] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:44:0) after 5m49s
[10:22:58.981] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:44:0)
[10:22:59.002] Build status: STARTED
[10:22:59.002] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:45:0) after 1m16s
[10:24:15.181] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:45:0)
[10:24:15.200] Build status: STARTED
[10:24:15.200] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:46:0) after 4m41s
[10:28:56.346] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:46:0)
[10:28:56.364] Build status: STARTED
[10:28:56.364] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:47:0) after 1m0s
[10:29:56.404] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:47:0)
[10:29:56.427] Build status: STARTED
[10:29:56.427] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:48:0) after 3m54s
[10:33:50.452] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:48:0)
[10:33:50.479] Build status: STARTED
[10:33:50.479] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:49:0) after 2m55s
[10:36:45.551] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:49:0)
[10:36:45.656] Build status: STARTED
[10:36:45.656] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:50:0) after 8m19s
[10:45:05.038] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:50:0)
[10:45:05.065] Build status: STARTED
[10:45:05.065] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:51:0) after 2m29s
[10:47:34.108] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:51:0)
[10:47:34.135] Build status: STARTED
[10:47:34.135] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:52:0) after 7m17s
[10:54:51.159] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:52:0)
[10:54:51.179] Build status: STARTED
[10:54:51.179] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:53:0) after 3m44s
[10:58:35.308] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:53:0)
[10:58:35.329] Build status: STARTED
[10:58:35.329] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:54:0) after 8m41s
[11:07:16.403] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:54:0)
[11:07:16.429] Build status: STARTED
[11:07:16.429] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:55:0) after 9m18s
[11:16:34.689] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:55:0)
[11:16:34.714] Build status: STARTED
[11:16:34.714] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:56:0) after 9m47s
[11:26:21.912] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:56:0)
[11:26:21.930] Build status: STARTED
[11:26:21.930] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:57:0) after 5m35s
[11:31:57.001] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:57:0)
[11:31:57.064] Build status: STARTED
[11:31:57.064] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:58:0) after 5m48s
[11:37:45.091] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:58:0)
[11:37:45.112] Build status: STARTED
[11:37:45.112] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:59:0) after 7m20s
[11:45:05.116] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:59:0)
[11:45:05.174] Build status: STARTED
[11:45:05.175] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:60:0) after 5m14s
[11:50:19.178] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:60:0)
[11:50:19.201] Build status: STARTED
[11:50:19.201] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:61:0) after 7m53s
[11:58:12.316] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:61:0)
[11:58:12.371] Build status: STARTED
[11:58:12.371] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:62:0) after 6m26s
[12:04:38.392] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:62:0)
[12:04:38.415] Build status: STARTED
[12:04:38.415] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:63:0) after 4m18s
[12:08:56.528] Handling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:63:0)
[12:08:56.546] Build status: STARTED
[12:08:56.546] Scheduling timer "check-buildbucket-build-status" (chromium/mac-lsan-fyi-rel:8949474323411127840:64:0) after 9m12s
[12:15:58.357] Received PubSub notification, asking Buildbucket for the build status
[12:15:58.376] Build:
{
"id": "8784044261434727361",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "mac-lsan-fyi-rel"
},
"number": 28,
"createdBy": "project:chromium",
"createTime": "2023-04-12T06:06:55.901278006Z",
"startTime": "2023-04-12T06:45:13.162551Z",
"endTime": "2023-04-12T12:15:58.054316081Z",
"updateTime": "2023-04-12T12:15:58.054316081Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b5e09304f3943ecd6332d15c3926ae0a3185bb3c",
"ref": "refs/heads/main"
}
},
"canary": true
}
[12:15:58.376] Invocation finished in 6h9m3.743831514s with status FAILED