From 55ad42af845127bd0eb0c1f36f327ecec83f4bca Mon Sep 17 00:00:00 2001 From: Georgi Gerganov Date: Sat, 25 Mar 2023 20:36:52 +0200 Subject: [PATCH] Move chat scripts into "./examples" --- README.md | 7 +++++-- alpaca.sh => examples/alpaca.sh | 4 ++++ examples/{chatLLaMa => chat-13B.sh} | 0 chat.sh => examples/chat.sh | 4 ++++ 4 files changed, 13 insertions(+), 2 deletions(-) rename alpaca.sh => examples/alpaca.sh (89%) rename examples/{chatLLaMa => chat-13B.sh} (100%) rename chat.sh => examples/chat.sh (89%) diff --git a/README.md b/README.md index 8a84324b1..9ba6241da 100644 --- a/README.md +++ b/README.md @@ -179,7 +179,10 @@ Here is an example few-shot interaction, invoked with the command ```bash # default arguments using 7B model -./chat.sh +./examples/chat.sh + +# advanced chat with 13B model +./examples/chat-13B.sh # custom arguments using 13B model ./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt @@ -195,7 +198,7 @@ Note the use of `--color` to distinguish between user input and generated text. 2. Run the `main` tool like this: ``` -./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins +./examples/alpaca.sh ``` Sample run: diff --git a/alpaca.sh b/examples/alpaca.sh similarity index 89% rename from alpaca.sh rename to examples/alpaca.sh index d8a9f456a..4c9aa5077 100755 --- a/alpaca.sh +++ b/examples/alpaca.sh @@ -1,6 +1,10 @@ #!/bin/bash + # # Temporary script - will be removed in the future # +cd `dirname $0` +cd .. + ./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 diff --git a/examples/chatLLaMa b/examples/chat-13B.sh similarity index 100% rename from examples/chatLLaMa rename to examples/chat-13B.sh diff --git a/chat.sh b/examples/chat.sh similarity index 89% rename from chat.sh rename to examples/chat.sh index 5531315b3..2b6a63e3f 100755 --- a/chat.sh +++ b/examples/chat.sh @@ -1,6 +1,10 @@ #!/bin/bash + # # Temporary script - will be removed in the future # +cd `dirname $0` +cd .. + ./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt