From 86e4f99092a84224e576634574ebfd7cc249f739 Mon Sep 17 00:00:00 2001 From: ochafik Date: Fri, 27 Sep 2024 07:15:25 +0100 Subject: [PATCH] Update README.md --- examples/agent/README.md | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/examples/agent/README.md b/examples/agent/README.md index e09541649..631ab140e 100644 --- a/examples/agent/README.md +++ b/examples/agent/README.md @@ -12,7 +12,17 @@ ```
- Instructions for meekai/functionary-small-v3.2 (experimental) + Instructions for NousResearch/Hermes-2-Pro-Llama-3-8B (needs template override) + + ```bash + ./llama-server \ + --jinja -fa \ + -mu https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF/resolve/main/Hermes-2-Pro-Llama-3-8B-Q8_0.gguf \ + --chat-template-file tests/chat/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja + ``` + +
+ Instructions for meekai/functionary-small-v3.2 (needs template override) The template in the GGUF doesn't seem to support tool calls, but its bigger brother's template can be used: