toyer 905942abdb llama : support glm3 and glm4 (#8031) ... * add chatglm3-6b model support huggingface model: https://hf-mirror.com/THUDM/chatglm3-6b Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com> * remove .rotary_pos_emb.inv_freq and unuse code for chatglm3 model Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com> * fix lint error Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com> * optimize convert-hf-to-gguf.py for chatglm model Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com> * support glm-4-9b-chat Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com> * fix eos tokens to glm4 * remove unused log * add preprocess to chatglm3 and chatglm4 * add eos_id_list to llama.cpp * fix code style * fix code style * fix conflicts * fix conflicts * Revert "add eos_id_list to llama.cpp" This reverts commit 3a4d5790bf. * set <|endoftext|> as eos and <|user|> as eot * fix chat template bug * add comment to glm prefix and suffix * fix conflicts and add rope_ratio & ChatGLMForConditionalGeneration * fix chat template bug * fix codestyle * fix conflicts * modified the general name of glm model * fix conflicts * remove prefix and suffix * use normal glm4 chattempalte & use LLM_FFN_SWIGLU in phi3 * fix: resolve Flake8 errors in `convert-hf-to-gguf.py` - Fix E302 by adding two blank lines before top-level function definitions - Replace print statements to fix NP100 - Fix E303 by ensuring only one blank line between lines of code * fix rope ratio to solve incorrect answers * fix by comments --------- Signed-off-by: XingXing Qiao <qiaoxx@dingdao.com> Co-authored-by: XingXing Qiao <qiaoxx@dingdao.com> Co-authored-by: Umpire2018 <138990495+Umpire2018@users.noreply.github.com>		2024-07-07 15:52:10 +03:00
..
__init__.py	convert-hf : support direct Q8_0 conversion (#7234)	2024-05-13 14:10:51 -04:00
constants.py	llama : support glm3 and glm4 (#8031)	2024-07-07 15:52:10 +03:00
gguf_reader.py	Gguf dump start data offset via --data-offset and some extra refactor (#8054)	2024-06-25 22:03:25 +10:00
gguf_writer.py	llama : add OpenELM support (#7359)	2024-07-04 20:14:21 +03:00
gguf.py	gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)	2023-11-11 08:04:50 +03:00
lazy.py	convert-hf : support direct Q8_0 conversion (#7234)	2024-05-13 14:10:51 -04:00
py.typed	convert : various script cleanups/fixes + merges and special token handling (#2842)	2023-08-30 11:25:50 +03:00
quants.py	gguf-py : fix and simplify quantized shape round-trip (#7483)	2024-05-25 11:11:48 +10:00
tensor_mapping.py	llama : support glm3 and glm4 (#8031)	2024-07-07 15:52:10 +03:00
vocab.py	Move convert.py to examples/convert-legacy-llama.py (#7430)	2024-05-30 21:40:00 +10:00