5 Commits

Author	SHA1	Message	Date
Georgi Gerganov	bd9451ca2a	Merge branch 'master' into speculative-tree	2023-10-17 19:31:40 +03:00
staviq	1a159553f9	tokenizer : special token handling (#3538) ... * Rewrite special token handling from #1931 * shorten param name, add st verification by type * use offsets instead of copy by substr * formatting, remove copying iterator on delete * llama : normalize code-style * swift fix * print pfx/sfx if verb, main: split pfx input sfx * dont add space when using special tokens * minor : comment + spacing --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-10-17 18:11:01 +03:00
Georgi Gerganov	5b34bfa2e6	swift : try to fix build ... ggml-ci	2023-10-16 00:39:57 +03:00
Georgi Gerganov	b8acb6c9b8	swift : fix build ... ggml-ci	2023-10-16 00:26:16 +03:00
Zane Shannon	24ba3d829e	examples : add batched.swift + improve CI for swift (#3562)	2023-10-11 06:14:05 -05:00