mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-12-25 02:44:36 +00:00
df270ef745
- Add `struct llama_sampler` and `struct llama_sampler_i` - Add `llama_sampler_` API - Add `llama_sampler_chain_` API for chaining multiple samplers - Remove `LLAMA_API_INTERNAL` - Add `llama_perf_` API and remove old `llama_print_timings` and `llama_reset_timings` |
||
---|---|---|
.. | ||
CMakeLists.txt | ||
passkey.cpp | ||
README.md |
llama.cpp/example/passkey
A passkey retrieval task is an evaluation method used to measure a language models ability to recall information from long contexts.
See the following PRs for more info:
Usage
make -j && ./llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf --junk 250