llama.cpp/examples/batched.swift
2024-02-18 22:40:35 +02:00
..
Sources rename n_ctx to kv_size 2024-02-18 22:40:35 +02:00
.gitignore examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Makefile examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Package.swift examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
README.md batched.swift : update README.md (#4214) 2023-11-30 23:45:17 +02:00

This is a swift clone of examples/batched.

$ make $ ./batched_swift MODEL_PATH [PROMPT] [PARALLEL]