root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-30 21:34:36 +00:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
cc98896db8
llama.cpp/examples/server/tests/unit
History
haopeng 64ed2091b2
Some checks failed
flake8 Lint / Lint (push) Has been cancelled
Details
Python Type-Check / pyright type-check (push) Has been cancelled
Details
server: Add "tokens per second" information in the backend (#10548) 
* add cmake rvv support

* add timings

* remove space

* update readme

* fix

* fix code

* remove empty line

* add test

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
2024-12-02 14:45:54 +01:00
..
test_basic.py server : add more test cases (#10569) 2024-11-29 21:48:56 +01:00
test_chat_completion.py server: Add "tokens per second" information in the backend (#10548) 2024-12-02 14:45:54 +01:00
test_completion.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00
test_ctx_shift.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00
test_embedding.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00
test_infill.py server : add more test cases (#10569) 2024-11-29 21:48:56 +01:00
test_lora.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00
test_rerank.py server : add more test cases (#10569) 2024-11-29 21:48:56 +01:00
test_security.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00
test_slot_save.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00
test_speculative.py server : add more test cases (#10569) 2024-11-29 21:48:56 +01:00
test_tokenize.py server : replace behave with pytest (#10416) 2024-11-26 16:20:18 +01:00