root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-25 02:44:36 +00:00
Code Issues Actions 9 Packages Projects Releases Wiki Activity

Move chat scripts into "./examples"

Browse Source
This commit is contained in:
Georgi Gerganov 2023-03-25 20:36:52 +02:00
parent 459e93cce0
commit 55ad42af84
No known key found for this signature in database
GPG Key ID: 449E073F9DC10735
4 changed files with 13 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
README.md
View File

@ -179,7 +179,10 @@ Here is an example few-shot interaction, invoked with the command
```bash ```bash
# default arguments using 7B model # default arguments using 7B model
./chat.sh ./examples/chat.sh
# advanced chat with 13B model
./examples/chat-13B.sh
# custom arguments using 13B model # custom arguments using 13B model
./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt ./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
@ -195,7 +198,7 @@ Note the use of `--color` to distinguish between user input and generated text.
2. Run the `main` tool like this: 2. Run the `main` tool like this:
``` ```
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins ./examples/alpaca.sh
``` ```
Sample run: Sample run:

4
alpaca.sh → examples/alpaca.sh
View File

@ -1,6 +1,10 @@
#!/bin/bash #!/bin/bash
# #
# Temporary script - will be removed in the future # Temporary script - will be removed in the future
# #
cd `dirname $0`
cd ..
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 ./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7

0
examples/chatLLaMa → examples/chat-13B.sh
View File

4
chat.sh → examples/chat.sh
View File

@ -1,6 +1,10 @@
#!/bin/bash #!/bin/bash
# #
# Temporary script - will be removed in the future # Temporary script - will be removed in the future
# #
cd `dirname $0`
cd ..
./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt ./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt