root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-09-22 21:16:20 +00:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity

Updated Templates supported by llama_chat_apply_template (markdown)

Xuan Son Nguyen 2024-03-24 12:48:12 +01:00
parent acb78dbbf2
commit 1fdaecff7d
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
Templates-supported-by-llama_chat_apply_template.md

@ -20,6 +20,7 @@ VARIANTS_TO_TEST = [
'mlabonne/AlphaMonarch-7B',
'google/gemma-7b-it',
'OrionStarAI/Orion-14B-Chat',
'openbmb/MiniCPM-2B-dpo-fp32',
]
HISTORY = [
@ -125,6 +126,11 @@ Assistant: </s>response</s>Human: again
Assistant: </s>response</s>
```
```
Usage: ./server -m ... --chat-template minicpm
test<用户>hello<AI>response<用户>again<AI>response
```
Additionally, we also support zephyr template (I cannot find it on huggingface, but have seen in [this list](https://github.com/ggerganov/llama.cpp/blob/c8d847d57efdc0f9bbbf881d48c645e151b36fd8/examples/server/public/promptFormats.js) )
```