fairydreaming 7c3f55c100 Add support for encoder-only T5 models (#8900) ... * gguf-py : add T5ENCODER model architecture * common : call llama_decode() during warmup only if the model has decoder * convert-hf : add T5EncoderModel * llama : add llama_model_has_decoder() API function * llama : split build_t5() into build_t5_encoder() and build_t5_decoder() * llama : add support for LLM_ARCH_T5ENCODER * llama-embedding : add support for LLAMA_POOLING_TYPE_NONE * llama-embedding : add support for encoder-only models --------- Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>		2024-08-10 11:43:26 +02:00
..
cmake	llama : reorganize source code + improve CMake (#8006)	2024-06-26 18:33:02 +03:00
base64.hpp	llava : expose as a shared library for downstream projects (#3613)	2023-11-07 00:36:23 +03:00
build-info.cpp.in	build : link against build info instead of compiling against it (#3879)	2023-11-02 08:50:16 +02:00
CMakeLists.txt	llama : reorganize source code + improve CMake (#8006)	2024-06-26 18:33:02 +03:00
common.cpp	Add support for encoder-only T5 models (#8900)	2024-08-10 11:43:26 +02:00
common.h	llama : better replace_all (cont) (#8926)	2024-08-09 18:23:52 +03:00
console.cpp	check C++ code with -Wmissing-declarations (#3184)	2023-09-15 15:38:27 -04:00
console.h	gguf : new file format with flexible meta data (beta) (#2398)	2023-08-21 23:07:43 +03:00
grammar-parser.cpp	Added support for . (any character) token in grammar engine. (#6467)	2024-06-06 06:08:52 -07:00
grammar-parser.h	gguf : new file format with flexible meta data (beta) (#2398)	2023-08-21 23:07:43 +03:00
json-schema-to-grammar.cpp	json: restore default additionalProperties to false, fix some pattern escapes (#8180)	2024-06-28 09:26:45 +01:00
json-schema-to-grammar.h	JSON: [key] -> .at(key), assert() -> GGML_ASSERT (#7143)	2024-05-08 21:53:08 +02:00
json.hpp	json-schema-to-grammar improvements (+ added to server) (#5978)	2024-03-21 11:50:43 +00:00
log.h	infill : assert prefix/suffix tokens + remove old space logic (#8351)	2024-07-08 09:34:35 +03:00
ngram-cache.cpp	Fixed lookup compilation issues on Windows (#6273)	2024-03-24 14:21:17 +01:00
ngram-cache.h	lookup: fibonacci hashing, fix crashes (#8548)	2024-07-17 23:35:44 +02:00
sampling.cpp	llama : move vocab, grammar and sampling into separate files (#8508)	2024-07-23 13:10:17 +03:00
sampling.h	common : normalize naming style (#7462)	2024-05-22 20:04:20 +03:00
stb_image.h	examples: support LLaVA v1.5 (multimodal model) (#3436)	2023-10-12 18:23:18 +03:00
train.cpp	train : change default FA argument (#7528)	2024-05-25 15:22:35 +03:00
train.h	sync : ggml (backend v2) (#3912)	2023-11-13 14:16:23 +02:00