Changyeon Kim 2f3c1466ff llava: Add ACC OP for GPU acceleration to the Vulkan backend in the LLAVA CLIP model. (#8984) ... * llava: Add ACC OP for GPU acceleration to the Vulkan backend in the LLAVA CLIP model. - The CLIP model now prioritizes the Vulkan backend over the CPU when vulkan available. - A GGML_OP_ACC shader has been added. - The encoding performance of the CLIP model improved from 4.2s on the CPU to 0.9s on the GPU. Signed-off-by: Changyeon Kim <cyzero.kim@samsung.com> * fix-up coding style. Signed-off-by: Changyeon Kim <cyzero.kim@samsung.com> * Fix-up the missing initial parameter to resolve the compilation warning. Signed-off-by: Changyeon Kim <cyzero.kim@samsung.com> * [fix] Add missing parameters. Signed-off-by: Changyeon Kim <cyzero.kim@samsung.com> * [fix] Use nb1 and nb2 for dst. Signed-off-by: Changyeon Kim <cyzero.kim@samsung.com> * Fix check results ggml_acc call --------- Signed-off-by: Changyeon Kim <cyzero.kim@samsung.com> Co-authored-by: 0cc4m <picard12@live.de>		2024-08-20 21:00:00 +02:00
..
baby-llama	baby-llama : remove duplicate vector include	2024-08-04 13:24:59 +03:00
batched	batched: fix n_predict parameter (#8527)	2024-07-17 10:34:28 +03:00
batched-bench	batched-bench : handle empty -npl (#8839)	2024-08-04 13:55:03 +03:00
batched.swift	Detokenizer fixes (#8039)	2024-07-05 19:01:35 +02:00
benchmark	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
convert-llama2c-to-ggml	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
cvector-generator	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
deprecation-warning	examples : remove finetune and train-text-from-scratch (#8669)	2024-07-25 10:39:04 +02:00
embedding	Add support for encoder-only T5 models (#8900)	2024-08-10 11:43:26 +02:00
eval-callback	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
export-lora	export-lora : throw error if lora is quantized (#9002)	2024-08-13 11:41:14 +02:00
gbnf-validator	llama : move vocab, grammar and sampling into separate files (#8508)	2024-07-23 13:10:17 +03:00
gguf	gguf : handle null name during init (#8587)	2024-07-20 17:15:42 +03:00
gguf-hash	gguf-hash : update clib.json to point to original xxhash repo (#8491)	2024-07-16 10:14:16 +03:00
gguf-split	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
gritlm	llama : allow pooled embeddings on any model (#7477)	2024-06-21 08:38:22 +03:00
imatrix	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
infill	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
jeopardy	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
llama-bench	llama-bench : add support for getting cpu info on Windows (#8824)	2024-08-07 03:01:06 +02:00
llama.android	examples: fix android example cannot be generated continuously (#8621)	2024-07-22 09:54:42 +03:00
llama.swiftui	llama.swiftui: fix end of generation bug (#8268)	2024-07-20 16:09:37 +03:00
llava	llava: Add ACC OP for GPU acceleration to the Vulkan backend in the LLAVA CLIP model. (#8984)	2024-08-20 21:00:00 +02:00
lookahead	common : Changed tuple to struct (TODO fix) (#8823)	2024-08-05 18:14:10 +02:00
lookup	common : Changed tuple to struct (TODO fix) (#8823)	2024-08-05 18:14:10 +02:00
main	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
main-cmake-pkg	Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258)	2024-07-02 12:18:10 -04:00
parallel	common : Changed tuple to struct (TODO fix) (#8823)	2024-08-05 18:14:10 +02:00
passkey	passkey : add short intro to README.md [no-ci] (#8317)	2024-07-05 09:14:24 +03:00
perplexity	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
quantize	Fix inference example lacks required parameters (#9035)	2024-08-16 11:08:59 +02:00
quantize-stats	ggml : minor naming changes (#8433)	2024-07-12 10:46:02 +03:00
retrieval	retrieval : fix memory leak in retrieval query handling (#8955)	2024-08-15 10:40:12 +03:00
rpc	Merge commit from fork	2024-08-09 23:03:21 +03:00
save-load-state	common : Changed tuple to struct (TODO fix) (#8823)	2024-08-05 18:14:10 +02:00
server	server : refactor middleware and /health endpoint (#9056)	2024-08-16 17:19:05 +02:00
simple	simple : update name of executable to llama-simple (#8885)	2024-08-06 16:44:35 +02:00
speculative	common : Changed tuple to struct (TODO fix) (#8823)	2024-08-05 18:14:10 +02:00
sycl	[SYCL] Updated SYCL device filtering (#8901)	2024-08-07 11:25:36 +01:00
tokenize	common : remove duplicate function llama_should_add_bos_token (#8778)	2024-08-15 10:23:23 +03:00
base-translate.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
chat-13B.bat	Create chat-13B.bat (#592)	2023-03-29 20:21:09 +03:00
chat-13B.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
chat-persistent.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
chat-vicuna.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
chat.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
CMakeLists.txt	examples : remove finetune and train-text-from-scratch (#8669)	2024-07-25 10:39:04 +02:00
convert_legacy_llama.py	convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (#7499)	2024-07-18 20:40:15 +10:00
json_schema_pydantic_example.py	py : type-check all Python scripts with Pyright (#8341)	2024-07-07 15:04:39 -04:00
json_schema_to_grammar.py	py : type-check all Python scripts with Pyright (#8341)	2024-07-07 15:04:39 -04:00
llama.vim	llama.vim : added api key support (#5090)	2024-01-23 08:51:27 +02:00
llm.vim	llm.vim : stop generation at multiple linebreaks, bind to <F2> (#2879)	2023-08-30 09:50:55 +03:00
Miku.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
pydantic_models_to_grammar_examples.py	examples : Rewrite pydantic_models_to_grammar_examples.py (#8493)	2024-07-20 22:09:17 -04:00
pydantic_models_to_grammar.py	pydantic : replace uses of __annotations__ with get_type_hints (#8474)	2024-07-14 19:51:21 -04:00
reason-act.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
regex_to_grammar.py	py : switch to snake_case (#8305)	2024-07-05 07:53:33 +03:00
server_embd.py	py : type-check all Python scripts with Pyright (#8341)	2024-07-07 15:04:39 -04:00
server-llama2-13B.sh	build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)	2024-06-13 00:41:52 +01:00
ts-type-to-grammar.sh	JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)	2024-04-12 19:43:38 +01:00