root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-09-23 13:36:20 +00:00
Code Issues Actions 15 Packages Projects Releases Wiki Activity
57744932c6
llama.cpp/examples/passkey
History
Georgi Gerganov b0034d93ce
examples : add passkey test (#3856) 
* examples : add passkey test

* passkey : better prints

* passkey : select pass key pos from CLI

* passkey : simplify n_past logic

* make : add passkey target

* passkey : add "self-extend"-like context extension (#4810)

* llama : "self-extend"-like context extension

* passkey : add comment

* passkey : add readme
2024-01-08 11:14:04 +02:00
..
CMakeLists.txt examples : add passkey test (#3856) 2024-01-08 11:14:04 +02:00
passkey.cpp examples : add passkey test (#3856) 2024-01-08 11:14:04 +02:00
README.md examples : add passkey test (#3856) 2024-01-08 11:14:04 +02:00

README.md

llama.cpp/example/passkey

See the following PRs for more info:

Usage

make -j && ./passkey ./models/llama-7b-v2/ggml-model-f16.gguf 250