mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-09-23 05:26:19 +00:00
8800226d65
* Fix --split-max-size Byte size calculation was done on int and overflowed. * add tests.sh * add examples test scripts to ci run Will autodiscover examples/*/tests.sh scripts and run them. * move WORK_PATH to a subdirectory * clean up before and after test * explicitly define which scripts to run * add --split-max-size to readme
11 lines
343 B
Markdown
11 lines
343 B
Markdown
## GGUF split Example
|
|
|
|
CLI to split / merge GGUF files.
|
|
|
|
**Command line options:**
|
|
|
|
- `--split`: split GGUF to multiple GGUF, default operation.
|
|
- `--split-max-size`: max size per split in `M` or `G`, f.ex. `500M` or `2G`.
|
|
- `--split-max-tensors`: maximum tensors in each split: default(128)
|
|
- `--merge`: merge multiple GGUF to a single GGUF.
|