mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-11 21:39:52 +00:00

History

Georgi Gerganov bf08e00643 llama : refactor k-shift implementation + KV defragmentation (#5691 ) * llama : refactor k-shift implementation ggml-ci * llama : rename llama_kv_cache_seq_shift to llama_kv_cache_seq_add * llama : cont k-shift refactoring + normalize type names ggml-ci * minor : fix MPI builds * llama : reuse n_rot from the build context ggml-ci * llama : revert enum name changes from this PR ggml-ci * llama : update llama_rope_type * llama : add comment about rope values * llama : fix build * passkey : apply kv cache updates explicitly ggml-ci * llama : change name to llama_kv_cache_update() * llama : add llama_kv_cache_seq_pos_max() * passkey : fix llama_kv_cache_seq_pos_max() usage * llama : some llama_kv_cell simplifications * llama : add llama_kv_cache_compress (EXPERIMENTAL) * llama : add alternative KV cache merging (EXPERIMENTAL) * llama : add llama_kv_cache_defrag * llama : comments * llama : remove llama_kv_cache_compress will add in a separate PR ggml-ci * llama : defragment via non-overlapping moves * llama : ggml_graph based defrag implementation ggml-ci * llama : switch the loop order in build_defrag * llama : add comments		2024-02-25 22:12:24 +02:00
..
CMakeLists.txt	examples : add passkey test (#3856 )	2024-01-08 11:14:04 +02:00
passkey.cpp	llama : refactor k-shift implementation + KV defragmentation (#5691 )	2024-02-25 22:12:24 +02:00
README.md	examples : add passkey test (#3856 )	2024-01-08 11:14:04 +02:00

llama.cpp/example/passkey

See the following PRs for more info:

make -j && ./passkey ./models/llama-7b-v2/ggml-model-f16.gguf 250