root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-25 19:04:35 +00:00
Code Issues Actions 7 Packages Projects Releases Wiki Activity
398105ff43
llama.cpp/vulkan-shaders
History
0cc4m 7c7836d9d4
Vulkan Shader Refactor, Memory Debugging Option (#7947) 
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
2024-06-16 07:17:31 +02:00
..
add.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
argsort.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
clamp.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
copy.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_f32.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_funcs.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q2_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q3_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q4_0.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q4_1.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q4_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q5_0.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q5_1.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q5_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q6_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q8_0.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
diag_mask_inf.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
div.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
gelu.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
generic_binary_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
generic_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
generic_unary_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
get_rows_quant.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
get_rows.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_split_k_reduce.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_base.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_nc.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_p021.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_q2_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_q3_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_q4_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_q5_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_q6_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
norm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
relu.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rms_norm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rope_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rope_neox.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rope_norm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
scale.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
silu.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
soft_max.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
square.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
sum_rows.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
types.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00