root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-09 18:21:45 +00:00
Code Issues Actions 15 Packages Projects Releases Wiki Activity
b3957
llama.cpp/ggml/src
History
leo-pony 6b8447352d
[CANN] Adapt to dynamically loadable backends mechanism (#9970) 
* [CANN] Adapt to dynamically loadable backends mechanism

* Fix the Bug: inference running result is garbled in debug running model for LM models who's type is Q4_0 class

* Handle the review comments of this pull request
2024-10-22 16:16:01 +08:00
..
ggml-amx add amx kernel for gemm (#8998) 2024-10-18 13:34:36 +08:00
ggml-cann cann: fix crash when llama-bench is running on multiple cann devices (#9627) 2024-09-25 11:30:38 +08:00
ggml-cuda Vectorize load instructions in dmmv f16 CUDA kernel (#9816) 2024-10-14 02:49:08 +02:00
ggml-sycl fix mul_mat_vec_q and *_vec_q error (#9939) 2024-10-21 14:26:09 +08:00
kompute@4565194ed7 llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
kompute-shaders ggml : move rope type enum to ggml.h (#8949) 2024-08-13 21:13:15 +02:00
llamafile ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
vulkan-shaders vulkan : argsort barriers must be under uniform control flow (ggml/951) 2024-09-29 21:15:37 +03:00
CMakeLists.txt add amx kernel for gemm (#8998) 2024-10-18 13:34:36 +08:00
ggml-aarch64.c ggml : add run-time detection of neon, i8mm and sve (#9331) 2024-09-28 15:06:16 +03:00
ggml-aarch64.h ggml : minor naming changes (#8433) 2024-07-12 10:46:02 +03:00
ggml-alloc.c ggml-alloc : remove buffer_id from leaf_alloc (ggml/987) 2024-10-16 11:28:01 +03:00
ggml-amx.cpp add amx kernel for gemm (#8998) 2024-10-18 13:34:36 +08:00
ggml-backend-impl.h ggml : add backend registry / device interfaces to BLAS backend (#9752) 2024-10-07 21:55:08 +02:00
ggml-backend.cpp [CANN] Adapt to dynamically loadable backends mechanism (#9970) 2024-10-22 16:16:01 +08:00
ggml-blas.cpp ggml : move more prints to the ggml log system (#9839) 2024-10-11 15:34:45 +02:00
ggml-cann.cpp [CANN] Adapt to dynamically loadable backends mechanism (#9970) 2024-10-22 16:16:01 +08:00
ggml-common.h ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151) 2024-09-05 21:48:47 -04:00
ggml-cpu-impl.h ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
ggml-cuda.cu ggml : move more prints to the ggml log system (#9839) 2024-10-11 15:34:45 +02:00
ggml-impl.h fix: use vm_allocate to allocate CPU backend buffer on macOS (#9875) 2024-10-17 00:36:51 +02:00
ggml-kompute.cpp ggml-backend : add device and backend reg interfaces (#9707) 2024-10-03 01:49:47 +02:00
ggml-metal.m ggml : add metal backend registry / device (#9713) 2024-10-07 18:27:51 +03:00
ggml-metal.metal metal : use F32 prec for K*Q in vec FA (#9595) 2024-09-23 11:27:47 +03:00
ggml-quants.c ggml : add run-time detection of neon, i8mm and sve (#9331) 2024-09-28 15:06:16 +03:00
ggml-quants.h ggml : add run-time detection of neon, i8mm and sve (#9331) 2024-09-28 15:06:16 +03:00
ggml-rpc.cpp rpc : pack only RPC structs (#9959) 2024-10-21 13:35:40 +03:00
ggml-sycl.cpp [SYCL] Add SYCL Backend registry, device and Event Interfaces (#9705) 2024-10-18 06:46:16 +01:00
ggml-vulkan.cpp vulkan : add backend registry / device interfaces (#9721) 2024-10-17 02:46:58 +02:00
ggml.c ggml : add asserts for type conversion in fattn kernels (#9971) 2024-10-21 16:20:46 +03:00