llama.cpp/gguf-py/gguf
compilade ee52225067
convert-hf : support direct Q8_0 conversion (#7234)
* convert-hf : support q8_0 conversion

* convert-hf : add missing ftype

This was messing with the checksums otherwise.

* convert-hf : add missing ftype to Baichuan and Xverse

I didn't notice these on my first pass.
2024-05-13 14:10:51 -04:00
..
__init__.py convert-hf : support direct Q8_0 conversion (#7234) 2024-05-13 14:10:51 -04:00
constants.py convert-hf : support bfloat16 conversion (#7158) 2024-05-11 11:06:26 -04:00
gguf_reader.py convert-hf : save memory with lazy evaluation (#7075) 2024-05-08 18:16:38 -04:00
gguf_writer.py convert-hf : support direct Q8_0 conversion (#7234) 2024-05-13 14:10:51 -04:00
gguf.py gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981) 2023-11-11 08:04:50 +03:00
lazy.py convert-hf : support direct Q8_0 conversion (#7234) 2024-05-13 14:10:51 -04:00
py.typed convert : various script cleanups/fixes + merges and special token handling (#2842) 2023-08-30 11:25:50 +03:00
quants.py convert-hf : support direct Q8_0 conversion (#7234) 2024-05-13 14:10:51 -04:00
tensor_mapping.py llama : add Jina Embeddings architecture (#6826) 2024-05-11 10:46:09 +03:00
vocab.py convert-hf : save memory with lazy evaluation (#7075) 2024-05-08 18:16:38 -04:00