root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-13 12:10:18 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
ochafik 2024-09-27 07:15:25 +01:00
parent e62b5de3cf
commit 86e4f99092
1 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
examples/agent/README.md
View File

@ -12,7 +12,17 @@
```
<details>
<summary>Instructions for meekai/functionary-small-v3.2 (experimental)</summary>
<summary>Instructions for NousResearch/Hermes-2-Pro-Llama-3-8B (needs template override)</summary>
```bash
./llama-server \
--jinja -fa \
-mu https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-8B-Q8_0.gguf \
--chat-template-file tests/chat/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja
```
<details>
<summary>Instructions for meekai/functionary-small-v3.2 (needs template override)</summary>
The template in the GGUF doesn't seem to support tool calls, but its bigger brother's template can be used: