2023-03-21 16:09:37 +00:00
|
|
|
#!/bin/bash
|
2023-03-25 18:36:52 +00:00
|
|
|
|
2023-03-21 16:09:37 +00:00
|
|
|
#
|
|
|
|
|
# Temporary script - will be removed in the future
|
|
|
|
|
#
|
|
|
|
|
|
2023-03-25 18:36:52 +00:00
|
|
|
cd `dirname $0`
|
|
|
|
|
cd ..
|
|
|
|
|
|
2023-03-25 19:36:22 +00:00
|
|
|
# Important:
|
|
|
|
|
#
|
|
|
|
|
# "--keep 48" is based on the contents of prompts/chat-with-bob.txt
|
|
|
|
|
#
|
main : log file (#2748)
* initial, base LOG macro
* add *.log to .gitignore
* added basic log file handler
* reverted log auto endline to better mimic printf
* remove atomics and add dynamic log target
* log_enable/disable, LOG_TEE, basic usage doc
* update .gitignore
* mv include to common, params, help msg
* log tostring helpers, token vectors pretty prints
* main: replaced fprintf/LOG_TEE, some trace logging
* LOG_DISABLE_LOGS compile flag, wrapped f in macros
* fix LOG_TEELN and configchecker
* stub LOG_DUMP_CMDLINE for WIN32 for now
* fix msvc
* cleanup main.cpp:273
* fix stray whitespace after master sync
* log : fix compile warnings
- do not use C++20 stuff
- use PRIu64 to print uint64_t
- avoid string copies by using const ref
- fix ", ##__VA_ARGS__" warnings
- compare strings with == and !=
* log : do not append to existing log + disable file line func by default
* log : try to fix Windows build
* main : wip logs
* main : add trace log
* review: macro f lowercase, str append to sstream
* review: simplify ifs and str comparisons
* fix MSVC, formatting, FMT/VAL placeholders
* review: if/else cleanup
* review: if/else cleanup (2)
* replace _ prefix with _impl suffix
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-08-30 06:29:32 +00:00
|
|
|
./main -m ./models/llama-7b/ggml-model-q4_0.gguf -c 512 -b 1024 -n 256 --keep 48 \
|
2023-03-25 19:36:22 +00:00
|
|
|
--repeat_penalty 1.0 --color -i \
|
|
|
|
|
-r "User:" -f prompts/chat-with-bob.txt
|