root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-09-22 21:16:20 +00:00
Code Issues Actions 16 Packages Projects Releases Wiki Activity
d94c6e0ccb
llama.cpp/include
History
Jason Stillerman d94c6e0ccb
llama : add support for SmolLm pre-tokenizer (#8609) 
* Adding SmolLM Pre Tokenizer

* Update convert_hf_to_gguf_update.py

Co-authored-by: compilade <git@compilade.net>

* Update src/llama.cpp

Co-authored-by: compilade <git@compilade.net>

* handle regex

* removed .inp and out .out ggufs

---------

Co-authored-by: compilade <git@compilade.net>
2024-07-22 17:43:01 +03:00
..
llama.h llama : add support for SmolLm pre-tokenizer (#8609) 2024-07-22 17:43:01 +03:00