root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-26 11:24:35 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
sampling-greedy-with-probs
llama.cpp/examples/speculative
History
Georgi Gerganov bbfc62ac2f
sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs
2023-10-28 14:04:57 +03:00
..
CMakeLists.txt speculative : PoC for speeding-up inference via speculative sampling (#2926) 2023-09-03 15:12:08 +03:00
speculative.cpp sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs 2023-10-28 14:04:57 +03:00