llama.cpp/examples/speculative/README.md
2023-11-29 11:00:17 +02:00

234 B

llama.cpp/examples/speculative

Demonstartion of speculative decoding and tree-based speculative decoding techniques

More info: