root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-24 02:14:35 +00:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
e36ecdccc8
llama.cpp/examples
History
Georgi Gerganov e36ecdccc8
build : on Mac OS enable Metal by default (#2901) 
* build : on Mac OS enable Metal by default

* make : try to fix build on Linux

* make : move targets back to the top

* make : fix target clean

* llama : enable GPU inference by default with Metal

* llama : fix vocab_only logic when GPU is enabled

* common : better `n_gpu_layers` assignment

* readme : update Metal instructions

* make : fix merge conflict remnants

* gitignore : metal
2023-09-04 22:26:24 +03:00
..
baby-llama build : fix most gcc and clang warnings (#2861) 2023-09-01 16:34:50 +03:00
beam-search build : fix most gcc and clang warnings (#2861) 2023-09-01 16:34:50 +03:00
benchmark cmake : install targets (#2256) 2023-07-19 10:01:11 +03:00
convert-llama2c-to-ggml llama2c : rename function 2023-09-01 17:01:11 +03:00
embd-input llama : more tokenizer fixes (#2810) 2023-08-27 14:19:19 +03:00
embedding llama : more tokenizer fixes (#2810) 2023-08-27 14:19:19 +03:00
gguf train : mem usage and other improvements (#2439) 2023-08-28 22:51:47 +03:00
gptneox-wip examples : fix gpt-neox (#2943) 2023-09-03 08:36:28 +03:00
jeopardy chmod : make scripts executable (#2675) 2023-08-23 17:29:09 +03:00
llama-bench llama-bench : make cpp file non-executable (#2999) 2023-09-04 13:40:18 +03:00
main build : on Mac OS enable Metal by default (#2901) 2023-09-04 22:26:24 +03:00
metal gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
perplexity build : on Mac OS enable Metal by default (#2901) 2023-09-04 22:26:24 +03:00
quantize Allow quantize to only copy tensors, some other improvements (#2931) 2023-09-01 08:02:48 -06:00
quantize-stats gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
save-load-state llama : more tokenizer fixes (#2810) 2023-08-27 14:19:19 +03:00
server server : add a subtle loading animation to the edit box (#2466) 2023-09-04 16:28:55 +08:00
simple llama : more tokenizer fixes (#2810) 2023-08-27 14:19:19 +03:00
speculative speculative : PoC for speeding-up inference via speculative sampling (#2926) 2023-09-03 15:12:08 +03:00
train-text-from-scratch scripts: Use local gguf package when running from repo (#2927) 2023-08-31 16:49:24 -06:00
alpaca.sh alpaca.sh : update model file name (#2074) 2023-07-06 19:17:50 +03:00
chat-13B.bat Create chat-13B.bat (#592) 2023-03-29 20:21:09 +03:00
chat-13B.sh examples : read chat prompts from a template file (#1196) 2023-05-03 20:58:11 +03:00
chat-persistent.sh chat-persistent.sh : use bracket expressions in grep (#1564) 2023-05-24 09:16:22 +03:00
chat-vicuna.sh examples : add chat-vicuna.sh (#1854) 2023-06-15 21:05:53 +03:00
chat.sh main : log file (#2748) 2023-08-30 09:29:32 +03:00
CMakeLists.txt speculative : PoC for speeding-up inference via speculative sampling (#2926) 2023-09-03 15:12:08 +03:00
gpt4all.sh examples : add -n to alpaca and gpt4all scripts (#706) 2023-04-13 16:03:39 +03:00
json-schema-to-grammar.py chmod : make scripts executable (#2675) 2023-08-23 17:29:09 +03:00
llama2-13b.sh gitignore : changes for Poetry users + chat examples (#2284) 2023-07-21 13:53:27 +03:00
llama2.sh gitignore : changes for Poetry users + chat examples (#2284) 2023-07-21 13:53:27 +03:00
llama.vim vim : streaming and more (#2495) 2023-08-08 14:44:48 +03:00
llm.vim llm.vim : stop generation at multiple linebreaks, bind to <F2> (#2879) 2023-08-30 09:50:55 +03:00
make-ggml.py chmod : make scripts executable (#2675) 2023-08-23 17:29:09 +03:00
Miku.sh MIKU MAYHEM: Upgrading the Default Model for Maximum Fun 🎉 (#2287) 2023-07-21 11:13:18 +03:00
reason-act.sh chmod : make scripts executable (#2675) 2023-08-23 17:29:09 +03:00
server-llama2-13B.sh chmod : make scripts executable (#2675) 2023-08-23 17:29:09 +03:00