5 Commits

Author	SHA1	Message	Date
klosax	0790c121aa	constants.py : add layer norm eps	2023-07-30 14:46:36 +02:00
M. Yusuf Sarıgöz	d54f53ca51	gguf : add tokenization constants	2023-07-29 12:04:45 +03:00
M. Yusuf Sarıgöz	11ef380c2a	GGUF : write tensor (#2426) ... * WIP: Write tensor * GGUF : Support writing tensors in Python * refactor : rm unused import and upd todos * fix : fix errors upd writing example * rm example.gguf * gitignore *.gguf * undo formatting	2023-07-28 11:34:16 +03:00
Georgi Gerganov	158be8f7f4	gguf.py : some code style changes	2023-07-27 15:37:06 +03:00
M. Yusuf Sarıgöz	bae6b125f6	wip : implement GGUF (#2397) ... * Add LLAMA_DEFAULT_RMS_EPS so we can change the default (#2384) Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com> * WIP: python class to write GGUF, incomplete C apı for reading --------- Co-authored-by: Kawrakow <48489457+ikawrakow@users.noreply.github.com> Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>	2023-07-26 18:21:13 +03:00