mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-09-23 13:36:20 +00:00
61ecafa390
* passkey : add short intro to README.md [no-ci] This commit adds a short introduction to the README.md file in the examples/passkey directory. Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com> * Update examples/passkey/README.md --------- Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
16 lines
409 B
Markdown
16 lines
409 B
Markdown
# llama.cpp/example/passkey
|
|
|
|
A passkey retrieval task is an evaluation method used to measure a language
|
|
models ability to recall information from long contexts.
|
|
|
|
See the following PRs for more info:
|
|
|
|
- https://github.com/ggerganov/llama.cpp/pull/3856
|
|
- https://github.com/ggerganov/llama.cpp/pull/4810
|
|
|
|
### Usage
|
|
|
|
```bash
|
|
make -j && ./llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf --junk 250
|
|
```
|