root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-28 12:24:35 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
5a3369d8e8
llama.cpp/examples/parallel
History
Georgi Gerganov b2debf65f2
parallel : add disabled experimental batch chunking in powers of two
2023-09-20 20:14:05 +03:00
..
CMakeLists.txt parallel : example for serving multiple users in parallel 2023-09-18 20:37:28 +03:00
parallel.cpp parallel : add disabled experimental batch chunking in powers of two 2023-09-20 20:14:05 +03:00