llama.cpp/examples/batched.swift
2024-06-11 23:27:04 -04:00
..
Sources examples : replace llama_kv_cache_seq_* with llama_past_seq_* 2024-06-11 23:27:04 -04:00
.gitignore examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Makefile examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Package.swift examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
README.md batched.swift : update README.md (#4214) 2023-11-30 23:45:17 +02:00

This is a swift clone of examples/batched.

$ make $ ./batched_swift MODEL_PATH [PROMPT] [PARALLEL]