Commit Graph

6 Commits

Author SHA1 Message Date
Georgi Gerganov
373d782d42
minor : comments + rename
ggml-ci
2023-10-16 18:17:31 +03:00
Georgi Gerganov
360a333145
common : add llama_batch_add() and llama_batch_clear() helpers 2023-10-16 12:41:33 +03:00
Georgi Gerganov
7e48e21b1f
examples : fix build after sampling refactoring
ggml-ci
2023-10-15 23:36:31 +03:00
Georgi Gerganov
4a7f43f28c
speculative : refactor sampling 2023-10-15 22:53:54 +03:00
Georgi Gerganov
5261aee8d8
sampling : one sequence per sampling context
ggml-ci
2023-10-12 20:36:44 +03:00
Kerfuffle
70c29da118
common : fix mirostat state when using multiple sequences (#3543)
* Fix mirostat state when using multiple sequences

* Fix mirostat by completely refactoring sampling!

* Try to fix zig build.

* Export function to fetch/create default sampler states

Code formatting cleanups and add some comments

Silence a warning about id not being used when logging is disabled

* Apply some renaming suggestions.

Fix comments that were out of sync with the pull.

* Use more consistant naming convention for sampling contexts
2023-10-11 22:35:46 +03:00