Georgi Gerganov
|
758ff1bbb5
|
llama : refactor model loading code (#2620)
* llama : style formatting + remove helper methods
* llama : fix quantization using gguf tool
* llama : simplify gguf_file_saver
* llama : fix method names
* llama : simplify write_header()
* llama : no need to pass full file loader to the file saver
just gguf_ctx
* llama : gguf_file_saver write I32
* llama : refactor tensor names (#2622)
* gguf: update tensor names searched in quantization
* gguf : define tensor names as constants
* gguf : initial write API (not tested yet)
* gguf : write to file API (not tested)
* gguf : initial write API ready + example
* gguf : fix header write
* gguf : fixes + simplify example + add ggml_nbytes_pad()
* gguf : minor
* llama : replace gguf_file_saver with new gguf write API
* gguf : streaming support when writing files
* gguf : remove oboslete write methods
* gguf : remove obosolete gguf_get_arr_xxx API
* llama : simplify gguf_file_loader
* llama : move hparams and vocab from gguf_file_loader to llama_model_loader
* llama : merge gguf-util.h in llama.cpp
* llama : reorder definitions in .cpp to match .h
* llama : minor simplifications
* llama : refactor llama_model_loader (WIP)
wip : remove ggml_ctx from llama_model_loader
wip : merge gguf_file_loader in llama_model_loader
* llama : fix shape prints
* llama : fix Windows build + fix norm_rms_eps key
* llama : throw error on missing KV paris in model meta data
* llama : improve printing + log meta data
* llama : switch print order of meta data
---------
Co-authored-by: M. Yusuf Sarıgöz <yusufsarigoz@gmail.com>
|
2023-08-16 14:34:03 +03:00 |
|
Georgi Gerganov
|
7494c78428
|
llama : sync gguf-llama with llama (#2613)
* llama : sync gguf-llama with llama
* tests : fix build + warnings (test-tokenizer-1 still fails)
* tests : fix wstring_convert
* convert : fix layer names
* llama : sync gguf-llama.cpp
* convert : update HF converter to new tokenizer voodoo magics
|
2023-08-14 21:33:33 +03:00 |
|
Georgi Gerganov
|
f00780b2ee
|
llama : sync gguf-llama.cpp with latest llama.cpp (#2608)
* llama : sync gguf-llama.cpp with latest llama.cpp
* minor : indentation + assert
* llama : refactor gguf_buffer and gguf_ctx_buffer
* llama : minor
|
2023-08-14 16:28:44 +03:00 |
|
Georgi Gerganov
|
62490f1380
|
gguf : use UNIX line ending
|
2023-08-14 13:04:35 +03:00 |
|
M. Yusuf Sarıgöz
|
2f52008b20
|
gguf : rm references to old file magics
|
2023-08-12 07:24:46 +03:00 |
|
M. Yusuf Sarıgöz
|
f316b94c7c
|
gguf : rm deprecated function
|
2023-08-10 20:20:22 +03:00 |
|
M. Yusuf Sarıgöz
|
1c4d8bf981
|
gguf : start implementing libllama in GGUF (WIP)
|
2023-08-10 16:52:08 +03:00 |
|