llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-15 15:29:53 +00:00

History

Georgi Gerganov ec450d3bbf Some checks are pending Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/full-cuda.Dockerfile platforms:linux/amd64 tag:full-cuda]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/full-musa.Dockerfile platforms:linux/amd64 tag:full-musa]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/full.Dockerfile platforms:linux/amd64,linux/arm64 tag:full]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-cli-cuda.Dockerfile platforms:linux/amd64 tag:light-cuda]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-cli-intel.Dockerfile platforms:linux/amd64 tag:light-intel]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-cli-musa.Dockerfile platforms:linux/amd64 tag:light-musa]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-cli.Dockerfile platforms:linux/amd64,linux/arm64 tag:light]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-server-cuda.Dockerfile platforms:linux/amd64 tag:server-cuda]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-server-intel.Dockerfile platforms:linux/amd64 tag:server-intel]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-server-musa.Dockerfile platforms:linux/amd64 tag:server-musa]) (push) Waiting to run Details Publish Docker image / Push Docker image to Docker Hub (map[dockerfile:.devops/llama-server.Dockerfile platforms:linux/amd64,linux/arm64 tag:server]) (push) Waiting to run Details Nix CI / nix-eval (macos-latest) (push) Waiting to run Details Nix CI / nix-eval (ubuntu-latest) (push) Waiting to run Details Nix CI / nix-build (macos-latest) (push) Waiting to run Details Nix CI / nix-build (ubuntu-latest) (push) Waiting to run Details flake8 Lint / Lint (push) Waiting to run Details metal : opt-in compile flag for BF16 (#10218 ) * metal : opt-in compile flag for BF16 ggml-ci * ci : use BF16 ggml-ci * swift : switch back to v12 * metal : has_float -> use_float ggml-ci * metal : fix BF16 check in MSL ggml-ci		2024-11-08 21:59:46 +02:00
..
ggml-amx	add amx kernel for gemm (#8998 )	2024-10-18 13:34:36 +08:00
ggml-cann	cann: fix crash when llama-bench is running on multiple cann devices (#9627 )	2024-09-25 11:30:38 +08:00
ggml-cuda	metal : optimize FA kernels (#10171 )	2024-11-08 13:47:22 +02:00
ggml-sycl	Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133 )	2024-11-07 15:19:10 +08:00
kompute@4565194ed7	llama : reorganize source code + improve CMake (#8006 )	2024-06-26 18:33:02 +03:00
kompute-shaders	kompute: add mul_mat_q4_k shader (#10097 )	2024-10-31 11:09:52 +02:00
llamafile	llamafile : extend sgemm.cpp support for Q5_0 models (#10010 )	2024-10-25 10:27:41 +03:00
vulkan-shaders	ggml: Add POOL2D OP for GPU acceleration to the Vulkan backend in the MobileVLM model. (#9763 )	2024-10-29 09:52:56 +01:00
CMakeLists.txt	metal : opt-in compile flag for BF16 (#10218 )	2024-11-08 21:59:46 +02:00
ggml-aarch64.c	ggml : move CPU backend to a separate file (#10144 )	2024-11-03 19:34:08 +01:00
ggml-aarch64.h	ggml : minor naming changes (#8433 )	2024-07-12 10:46:02 +03:00
ggml-alloc.c	ggml-alloc : remove buffer_id from leaf_alloc (ggml/987)	2024-10-16 11:28:01 +03:00
ggml-amx.cpp	llama : refactor model loader with backend registry (#10026 )	2024-10-30 02:01:23 +01:00
ggml-backend-impl.h	llama : refactor model loader with backend registry (#10026 )	2024-10-30 02:01:23 +01:00
ggml-backend.cpp	ggml : move CPU backend to a separate file (#10144 )	2024-11-03 19:34:08 +01:00
ggml-blas.cpp	llama : refactor model loader with backend registry (#10026 )	2024-10-30 02:01:23 +01:00
ggml-cann.cpp	CANN: adjust backend registry refactor. (#10158 )	2024-11-04 19:08:22 +08:00
ggml-common.h	ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151 )	2024-09-05 21:48:47 -04:00
ggml-cpu-impl.h	ggml : move common CPU backend impl to new header (#9509 )	2024-09-16 16:22:07 +02:00
ggml-cpu.c	fix q4_0_8_8 format for corrupted tokens issue (#10198 )	2024-11-07 09:02:08 +01:00
ggml-cuda.cu	metal : optimize FA kernels (#10171 )	2024-11-08 13:47:22 +02:00
ggml-impl.h	ggml : move CPU backend to a separate file (#10144 )	2024-11-03 19:34:08 +01:00
ggml-kompute.cpp	kompute: add mul_mat_q4_k shader (#10097 )	2024-10-31 11:09:52 +02:00
ggml-metal.m	metal : opt-in compile flag for BF16 (#10218 )	2024-11-08 21:59:46 +02:00
ggml-metal.metal	metal : opt-in compile flag for BF16 (#10218 )	2024-11-08 21:59:46 +02:00
ggml-quants.c	Q6_K AVX improvements (#10118 )	2024-11-04 23:06:31 +01:00
ggml-quants.h	ggml : add run-time detection of neon, i8mm and sve (#9331 )	2024-09-28 15:06:16 +03:00
ggml-rpc.cpp	ggml : move CPU backend to a separate file (#10144 )	2024-11-03 19:34:08 +01:00
ggml-sycl.cpp	Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133 )	2024-11-07 15:19:10 +08:00
ggml-vulkan.cpp	vulkan : improve ggml_vk_create_buffer error handling (#9898 )	2024-11-01 19:33:14 +01:00
ggml.c	metal : optimize FA kernels (#10171 )	2024-11-08 13:47:22 +02:00