root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-13 04:00:16 +00:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
3,218 Commits 364 Branches 2,920 Tags 354 MiB
2df373ac40
Commit Graph

2 Commits

Author SHA1 Message Date
0cc4m
45c0e2e4c1
Refactor Vulkan backend to allow multiple contexts (#7961) 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
 2024-06-23 10:21:25 +02:00
0cc4m
7c7836d9d4
Vulkan Shader Refactor, Memory Debugging Option (#7947) 
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
 2024-06-16 07:17:31 +02:00