root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-11 03:01:45 +00:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
712 Commits 365 Branches 2,917 Tags 345 MiB
5342dc075f
Commit Graph

5 Commits

Author SHA1 Message Date
mqy
5342dc075f tunning: support k_quants; disabled rope shapes (workaround); make cache thread safe; fixed shape comprison 2023-06-18 14:27:56 +08:00
mqy
21e9379707 tunning: add f16, todo: f32 failed with CL 2023-06-18 14:27:56 +08:00
mqy
7c05049f8b tunning: check GPU offloading before loading model 2023-06-18 14:27:56 +08:00
mqy
48016f685c bulk refactored task profile to support complete fallback; enable tune by default for ease of dev 2023-06-18 14:27:56 +08:00
mqy
213f133701 initial 2023-06-18 14:27:53 +08:00