llama.cpp/examples/speculative
2023-09-19 17:00:42 +03:00
..
CMakeLists.txt speculative : PoC for speeding-up inference via speculative sampling (#2926) 2023-09-03 15:12:08 +03:00
speculative.cpp parallel : process system prompt once + configurable paramters + llama API 2023-09-19 17:00:42 +03:00