154 Commits

Author	SHA1	Message	Date
Georgi Gerganov	483bab2e3d	Avoid the transposed X branch in the Z = X * Y matrix multiplication (#439) ... Should make results reproducible for different number of threads and batch sizes	2023-03-23 23:22:01 +02:00
Yusuf Kağan Hanoğlu	d5850c53ca	Add missing header for memcpy (#386) ... fixed: memcpy is not defined	2023-03-22 10:55:45 +02:00
Georgi Gerganov	928480ef5b	Init llama_context_params properly from CLI (#370)	2023-03-22 07:45:14 +02:00
Georgi Gerganov	f5a77a629b	Introduce C-style API (#370) ... * Major refactoring - introduce C-style API * Clean up * Add <cassert> * Add <iterator> * Add <algorithm> .... * Fix timing reporting and accumulation * Measure eval time only for single-token calls * Change llama_tokenize return meaning	2023-03-22 07:32:36 +02:00