Molly Sophia ee7136c6d1 llama: add support for QRWKV6 model architecture (#11001) ... llama: add support for QRWKV6 model architecture (#11001) * WIP: Add support for RWKV6Qwen2 Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * RWKV: Some graph simplification Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Add support for RWKV6Qwen2 with cpu and cuda GLA Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * RWKV6[QWEN2]: Concat lerp weights together to reduce cpu overhead Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Fix some typos Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * code format changes Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Fix wkv test & add gla test Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Fix cuda warning Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Update README.md Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Update ggml/src/ggml-cuda/gla.cu Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * Fix fused lerp weights loading with RWKV6 Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * better sanity check skipping for QRWKV6 in llama-quant thanks @compilade Signed-off-by: Molly Sophia <mollysophia379@gmail.com> Co-authored-by: compilade <git@compilade.net> --------- Signed-off-by: Molly Sophia <mollysophia379@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> Co-authored-by: compilade <git@compilade.net>		2025-01-10 09:58:08 +08:00
..
scripts	gguf-py : move scripts directory (#11116)	2025-01-08 20:54:58 +02:00
__init__.py	convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (#7499)	2024-07-18 20:40:15 +10:00
constants.py	llama: add support for QRWKV6 model architecture (#11001)	2025-01-10 09:58:08 +08:00
gguf_reader.py	gguf-py : numpy 2 newbyteorder fix (#9772)	2024-12-13 16:48:44 +02:00
gguf_writer.py	llama: add support for QRWKV6 model architecture (#11001)	2025-01-10 09:58:08 +08:00
gguf.py	gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)	2023-11-11 08:04:50 +03:00
lazy.py	gguf-py : simplify support for quant types (#8838)	2024-08-08 13:33:09 -04:00
metadata.py	fix gguf-py: Conversion error when multiple licenses are configured (#9807)	2024-11-24 01:09:22 +01:00
py.typed	convert : various script cleanups/fixes + merges and special token handling (#2842)	2023-08-30 11:25:50 +03:00
quants.py	ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151)	2024-09-05 21:48:47 -04:00
tensor_mapping.py	llama: add support for QRWKV6 model architecture (#11001)	2025-01-10 09:58:08 +08:00
utility.py	gguf-py : fix some metadata name extraction edge cases (#8591)	2024-07-20 21:58:49 -04:00
vocab.py	convert : handle tokenizer merges format from transformers 4.45 (#9696)	2024-10-03 17:22:15 +03:00