llama.cpp/examples/speculative-simple
Georgi Gerganov f27ddc57d7
Some checks are pending
flake8 Lint / Lint (push) Waiting to run
speculative : add --draft-min CLI arg
2024-11-22 12:27:56 +02:00
..
CMakeLists.txt speculative : refactor and add a simpler example 2024-11-21 16:09:40 +02:00
README.md speculative : refactor and add a simpler example 2024-11-21 16:09:40 +02:00
speculative-simple.cpp speculative : add --draft-min CLI arg 2024-11-22 12:27:56 +02:00

llama.cpp/examples/speculative-simple

Demonstration of basic greedy speculative decoding