llama.cpp/examples/llama2-13b.sh

#!/bin/bash

#
# Temporary script - will be removed in the future
#

cd `dirname $0`
cd ..

./main -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \
       --color \
       --kv_size 2048 \
       -n -1 \
       -ins -b 256 \
       --top_k 10000 \
       --temp 0.2 \
       --repeat_penalty 1.1 \
       -t 8
gitignore : changes for Poetry users + chat examples (#2284) A fix in Makefile for FreeBSD users. In the platfrom x86_64 is amd64. This fix resolve compilation using CFLAGS and CXXFLAGS with -march=native and -mtune=native Add two examples for interactive mode using Llama2 models (thx TheBloke for models) Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2023-07-21 10:53:27 +00:00			`#!/bin/bash`

			`#`
			`# Temporary script - will be removed in the future`
			`#`

			cd `dirname $0`
			`cd ..`

			`./main -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \`
			`--color \`
rename n_ctx to kv_size 2024-02-18 19:59:26 +00:00			`--kv_size 2048 \`
gitignore : changes for Poetry users + chat examples (#2284) A fix in Makefile for FreeBSD users. In the platfrom x86_64 is amd64. This fix resolve compilation using CFLAGS and CXXFLAGS with -march=native and -mtune=native Add two examples for interactive mode using Llama2 models (thx TheBloke for models) Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2023-07-21 10:53:27 +00:00			`-n -1 \`
			`-ins -b 256 \`
			`--top_k 10000 \`
			`--temp 0.2 \`
			`--repeat_penalty 1.1 \`
			`-t 8`