Xuan Son Nguyen 97bdd26eee Refactor lora adapter support (#8332) ... * lora: load to devide buft * add patch tensor function * correct tensor patch * llama_lora_adapter_apply * correct ggml_backend_tensor_copy * add llm_build_mm * fix auto merge * update based on review comments * add convert script * no more transpose A * add f16 convert * add metadata check * add sanity check * fix ftype * add requirements * fix requirements * fix outfile * conversion: only allow selected models * fix types * cuda : do not use dmmv if the tensor does not have enough cols * llama : lora fixes * do not disable mmap with lora Co-authored-by: slaren <slarengh@gmail.com> * llm_build_lora_mm_id * convert_lora : MoE LoRA conversion support * convert_lora : prefer safetensors, similarly to convert_hf * convert_hf : simplify modify_tensors for InternLM2 * convert_lora : lazy conversion * llama : load and use alpha from LoRA adapters * llama : use llm_build_lora_mm in most model graphs * auto scale * Revert "auto scale" This reverts commit 42415a4874. * remove redundant params * Apply suggestions from code review Co-authored-by: slaren <slarengh@gmail.com> * change kv metadata * move add_type to __init__ * convert_hf : move add_type to main() * convert_lora : use the GGUFWriter from Model instead of overwriting it --------- Co-authored-by: slaren <slarengh@gmail.com> Co-authored-by: Francis Couture-Harpin <git@compilade.net>		2024-07-15 20:50:47 +02:00
..
cmake	llama : reorganize source code + improve CMake (#8006)	2024-06-26 18:33:02 +03:00
base64.hpp	llava : expose as a shared library for downstream projects (#3613)	2023-11-07 00:36:23 +03:00
build-info.cpp.in	build : link against build info instead of compiling against it (#3879)	2023-11-02 08:50:16 +02:00
CMakeLists.txt	llama : reorganize source code + improve CMake (#8006)	2024-06-26 18:33:02 +03:00
common.cpp	Refactor lora adapter support (#8332)	2024-07-15 20:50:47 +02:00
common.h	added support for Authorization Bearer tokens when downloading model (#8307)	2024-07-06 22:32:04 +02:00
console.cpp	check C++ code with -Wmissing-declarations (#3184)	2023-09-15 15:38:27 -04:00
console.h	gguf : new file format with flexible meta data (beta) (#2398)	2023-08-21 23:07:43 +03:00
grammar-parser.cpp	Added support for . (any character) token in grammar engine. (#6467)	2024-06-06 06:08:52 -07:00
grammar-parser.h	gguf : new file format with flexible meta data (beta) (#2398)	2023-08-21 23:07:43 +03:00
json-schema-to-grammar.cpp	json: restore default additionalProperties to false, fix some pattern escapes (#8180)	2024-06-28 09:26:45 +01:00
json-schema-to-grammar.h	JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)	2024-05-08 21:53:08 +02:00
json.hpp	json-schema-to-grammar improvements (+ added to server) (#5978)	2024-03-21 11:50:43 +00:00
log.h	infill : assert prefix/suffix tokens + remove old space logic (#8351)	2024-07-08 09:34:35 +03:00
ngram-cache.cpp	Fixed lookup compilation issues on Windows (#6273)	2024-03-24 14:21:17 +01:00
ngram-cache.h	lookup: complement data from context with general text statistics (#5479)	2024-03-23 01:24:36 +01:00
sampling.cpp	common : preallocate sampling token data vector (#8363)	2024-07-08 10:26:53 +03:00
sampling.h	common : normalize naming style (#7462)	2024-05-22 20:04:20 +03:00
stb_image.h	examples: support LLaVA v1.5 (multimodal model) (#3436)	2023-10-12 18:23:18 +03:00
train.cpp	train : change default FA argument (#7528)	2024-05-25 15:22:35 +03:00
train.h	sync : ggml (backend v2) (#3912)	2023-11-13 14:16:23 +02:00