root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-13 14:29:52 +00:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
8854044561
llama.cpp/vulkan-shaders
History
0cc4m 45c0e2e4c1
Refactor Vulkan backend to allow multiple contexts (#7961) 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
2024-06-23 10:21:25 +02:00
..
add.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
argsort.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
clamp.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
copy.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_f32.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_funcs.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q2_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q3_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q4_0.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q4_1.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q4_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q5_0.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q5_1.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q5_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q6_k.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
dequant_q8_0.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
diag_mask_inf.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
div.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
gelu.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
generic_binary_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
generic_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
generic_unary_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
get_rows_quant.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
get_rows.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_split_k_reduce.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_base.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_nc.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_p021.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul_mat_vec_q2_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q3_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q4_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q5_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q6_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
mul.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
norm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
relu.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rms_norm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rope_head.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rope_neox.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
rope_norm.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
scale.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
silu.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
soft_max.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
square.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
sum_rows.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00
types.comp Vulkan Shader Refactor, Memory Debugging Option (#7947) 2024-06-16 07:17:31 +02:00