llama.cpp/.flake8 at gg/imatrix-remove-assert - llama.cpp - Gitea: Git with a cup of tea

root/llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-27 20:04:35 +00:00

Douglas Hanley 2891c8aa9a

Add support for BERT embedding models (#5423 )

* BERT model graph construction (build_bert)
* WordPiece tokenizer (llm_tokenize_wpm)
* Add flag for non-causal attention models
* Allow for models that only output embeddings
* Support conversion of BERT models to GGUF
* Based on prior work by @xyzhang626 and @skeskinen

---------

Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-02-11 11:21:38 -05:00

4 lines

45 B

INI

Raw Permalink Blame History

	`[flake8]`
	`max-line-length = 125`
	`ignore = W503`