llama.cpp/examples/batched.swift/README.md

5 lines
98 B
Markdown
Raw Permalink Normal View History

This is a swift clone of `examples/batched`.
$ `make`
$ `./swift MODEL_PATH [PROMPT] [PARALLEL]`