root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-27 03:44:35 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity
43957ef203
llama.cpp/ggml/src/ggml-vulkan
History
Eve 0533e7fb38
vulkan: Dynamic subgroup size support for Q6_K mat_vec (#10536) 
* subgroup 64 version with subgroup add. 15% faster

scalable version

tested for subgroup sizes 16-128

* check for subgroup multiple of 16 and greater than 16

* subgroup sizes are always a power of 2 (https://github.com/KhronosGroup/GLSL/issues/45)

* force 16 sequential threads per block

* make 16 subgroup size a constant
2024-11-30 08:00:02 +01:00
..
vulkan-shaders vulkan: Dynamic subgroup size support for Q6_K mat_vec (#10536) 2024-11-30 08:00:02 +01:00
CMakeLists.txt ggml : add support for dynamic loading of backends (#10469) 2024-11-25 15:13:39 +01:00
ggml-vulkan.cpp vulkan: Dynamic subgroup size support for Q6_K mat_vec (#10536) 2024-11-30 08:00:02 +01:00