root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-27 03:44:35 +00:00
Code Issues Actions 4 Packages Projects Releases Wiki Activity

Updated GGML Tips & Tricks (markdown)

Georgi Gerganov 2024-01-08 10:03:31 +02:00
parent 329b54761d
commit 9df3b17acf
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
GGML-Tips-&-Tricks.md

@ -101,6 +101,8 @@ index 3413288..7578bfa 100644
{ {
``` ```
Note: [`n_past` is now replaced with `batch.pos[]`](https://github.com/ggerganov/llama.cpp/issues/4819#issuecomment-1880471864)
- LLaMAv2 7B, `n_past == 45`, `n_batch == 1` - LLaMAv2 7B, `n_past == 45`, `n_batch == 1`
![image](https://github.com/ggerganov/llama.cpp/assets/1991296/93ac4a44-e7e6-4a9e-a332-b38c642847cc) ![image](https://github.com/ggerganov/llama.cpp/assets/1991296/93ac4a44-e7e6-4a9e-a332-b38c642847cc)