llama.cpp/examples/alpaca.sh

#!/bin/bash

#
# Temporary script - will be removed in the future
#

cd `dirname $0`
cd ..

./main -m ./models/alpaca.13b.ggmlv3.q8_0.bin \
       --color \
       -f ./prompts/alpaca.txt \
       --ctx_size 2048 \
       -n -1 \
       -ins -b 256 \
       --top_k 10000 \
       --temp 0.2 \
       --repeat_penalty 1.1 \
       -t 7
Add temporary helper script for Alpaca chat 2023-03-19 19:57:28 +00:00			`#!/bin/bash`
Move chat scripts into "./examples" 2023-03-25 18:36:52 +00:00
Add temporary helper script for Alpaca chat 2023-03-19 19:57:28 +00:00			`#`
			`# Temporary script - will be removed in the future`
			`#`

Move chat scripts into "./examples" 2023-03-25 18:36:52 +00:00			cd `dirname $0`
			`cd ..`

alpaca.sh : update model file name (#2074) The original file name, `ggml-alpaca-7b-q4.bin`, implied the first-generation GGML. After the breaking changes (mentioned in https://github.com/ggerganov/llama.cpp/issues/382), `llama.cpp` requires GGML V3 now. Those model files are named `ggmlv3.bin`. We should change the example to an actually working model file, so that this thing is more likely to run out-of-the-box for more people, and less people would waste time downloading the old Alpaca model. 2023-07-06 16:17:50 +00:00			`./main -m ./models/alpaca.13b.ggmlv3.q8_0.bin \`
examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107) * Moving parameters to separate lines for readability. * Increasing repeate_penalty to 1.1 to make alpaca more usable by default. * Adding trailing newline. 2023-04-22 06:54:33 +00:00			`--color \`
			`-f ./prompts/alpaca.txt \`
			`--ctx_size 2048 \`
			`-n -1 \`
			`-ins -b 256 \`
			`--top_k 10000 \`
			`--temp 0.2 \`
			`--repeat_penalty 1.1 \`
			`-t 7`