server: free sampling contexts on exit (#7264)

* server: free sampling contexts on exit

This cleans up last leak found by the address sanitizer.

* fix whitespace

* fix whitespace
This commit is contained in:
Steve Grubb 2024-05-14 10:11:24 -04:00 committed by GitHub
parent 1265c670fd
commit 4f0263633b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -671,6 +671,13 @@ struct server_context {
model = nullptr;
}
// Clear any sampling context
for (server_slot & slot : slots) {
if (slot.ctx_sampling != nullptr) {
llama_sampling_free(slot.ctx_sampling);
}
}
llama_batch_free(batch);
}