root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-26 03:14:35 +00:00
Code Issues Actions 7 Packages Projects Releases Wiki Activity
b4383
llama.cpp/examples/server/themes
History
Georgi Gerganov 644fd71b44
sampling : refactor + optimize penalties sampler (#10803) 
* sampling : refactor + optimize penalties sampler

ggml-ci

* common : apply ignore_eos as logit bias

ggml-ci

* batched : remove penalties sampler

* params : allow penalty_last_n == -1 to be equal to context size

ggml-ci

* common : by default, move the penalties at the end of the sampling chain

ggml-ci

* common : ignore all EOG tokens

Co-authored-by: Diego Devesa <slarengh@gmail.com>

* common : move back the penalties at the front of the sampling chain

ggml-ci

* readme : restore hint about --ignore-eos flag [no ci]

* llama : minor

ggml-ci

* webui : update

---------

Co-authored-by: Diego Devesa <slarengh@gmail.com>
2024-12-16 12:31:14 +02:00
..
buttons-top sampling : refactor + optimize penalties sampler (#10803) 2024-12-16 12:31:14 +02:00
wild sampling : refactor + optimize penalties sampler (#10803) 2024-12-16 12:31:14 +02:00
README.md server : add themes + favicon (#6848) 2024-05-08 22:12:06 +03:00

README.md

LLaMA.cpp Server Wild Theme

Simple themes directory of sample "public" directories. To try any of these add --path to your run like server --path=wild.

image