root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-13 04:00:16 +00:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
3,304 Commits 364 Branches 2,920 Tags 354 MiB
22a648f8cc
Commit Graph

2 Commits

Author SHA1 Message Date
Georgi Gerganov
20fc3804bf
convert : fix gemma v1 tokenizer convert (#8248) 
ggml-ci
 2024-07-04 10:41:03 +03:00
Ren Xuancheng
229ffff872
llama : add BPE pre-tokenization for Qwen2 (#7114) 
* Add BPE pre-tokenization for Qwen2.

* minor : fixes

---------

Co-authored-by: Ren Xuancheng <17811943+jklj077@users.noreply.github.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2024-05-08 15:06:43 +03:00