llama.cpp/examples/server/themes/buttons-top
Georgi Gerganov 644fd71b44
sampling : refactor + optimize penalties sampler (#10803)
* sampling : refactor + optimize penalties sampler

ggml-ci

* common : apply ignore_eos as logit bias

ggml-ci

* batched : remove penalties sampler

* params : allow penalty_last_n == -1 to be equal to context size

ggml-ci

* common : by default, move the penalties at the end of the sampling chain

ggml-ci

* common : ignore all EOG tokens

Co-authored-by: Diego Devesa <slarengh@gmail.com>

* common : move back the penalties at the front of the sampling chain

ggml-ci

* readme : restore hint about --ignore-eos flag [no ci]

* llama : minor

ggml-ci

* webui : update

---------

Co-authored-by: Diego Devesa <slarengh@gmail.com>
2024-12-16 12:31:14 +02:00
..
buttons_top.png server : add themes + favicon (#6848) 2024-05-08 22:12:06 +03:00
favicon.ico server : add themes + favicon (#6848) 2024-05-08 22:12:06 +03:00
index.html sampling : refactor + optimize penalties sampler (#10803) 2024-12-16 12:31:14 +02:00
README.md server : add themes + favicon (#6848) 2024-05-08 22:12:06 +03:00

LLaMA.cpp Server Buttons Top Theme

Simple tweaks to the UI. Chat buttons at the top of the page instead of bottom so you can hit Stop instead of chasing it down the page.

To use simply run server with --path=themes/buttons_top

image