Qin Yue Chen 8cf19d60dc gguf : support big endian platform (#3552) ... * check whether platform is 390x if yes->do not import immintrin.h * support s390x big endian * support --bigendian option for s390x 1. verified with baichuan7b-chat with float 16 on s390x 2. verified with baichuan7b-chat 3. verified with chinese-alpaca-2-13b-f16 * update format based on editor-config checker result * Update convert-baichuan-hf-to-gguf.py * 1. check in ggml.c if endianess is not match 2. update GGUF version 3. change get_pack_prefix to property 4. update information log * always use "GGUF" as beginng of GGUF file * Compare "GGUF" with file header char by char 1. Set GGUF_MAGIC to "GGUF" string instead of int value 2. Compare "GGUF" char by char to ensure its byte order 3. Move bytes swap code from convert.py to gguf.py write_tensor_data --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>		2023-10-20 14:19:40 +03:00
..
__init__.py	gguf : export objects to user code (#2780)	2023-08-25 12:43:41 +03:00
gguf.py	gguf : support big endian platform (#3552)	2023-10-20 14:19:40 +03:00
py.typed	convert : various script cleanups/fixes + merges and special token handling (#2842)	2023-08-30 11:25:50 +03:00