M. Yusuf Sarıgöz
d09fd10713
gguf : write metadata in gguf_file_saver
2023-08-11 20:07:43 +03:00
M. Yusuf Sarıgöz
781b9ec3f5
gguf : write metadata in gguf_file_saver (WIP)
2023-08-11 18:01:26 +03:00
M. Yusuf Sarıgöz
28abfc90fa
gguf : write metadata in gguf_file_saver (WIP)
2023-08-11 13:27:58 +03:00
M. Yusuf Sarıgöz
e3a4960953
gguf : add gguf_get_kv_type
2023-08-11 13:03:23 +03:00
M. Yusuf Sarıgöz
eb8ca6996f
gguf : add gguf_get_kv_type
2023-08-11 12:24:08 +03:00
M. Yusuf Sarıgöz
b2440f1943
gguf : start implementing gguf_file_saver (WIP)
2023-08-11 11:29:50 +03:00
M. Yusuf Sarıgöz
a356b0e228
gguf : start implementing gguf_file_saver (WIP)
2023-08-11 10:50:02 +03:00
M. Yusuf Sarıgöz
e7d346c37c
gguf : start implementing gguf_file_saver (WIP)
2023-08-11 09:52:01 +03:00
M. Yusuf Sarıgöz
f316b94c7c
gguf : rm deprecated function
2023-08-10 20:20:22 +03:00
M. Yusuf Sarıgöz
cfb8e35b73
gguf : inference with 7B model working (WIP)
2023-08-10 19:56:56 +03:00
M. Yusuf Sarıgöz
42cc04d11d
gguf : calculate n_mult
2023-08-10 18:49:08 +03:00
M. Yusuf Sarıgöz
22de6c5c4c
upd .gitignore
2023-08-10 18:09:49 +03:00
M. Yusuf Sarıgöz
4c0f64e302
rm binary commited by mistake
2023-08-10 18:07:41 +03:00
M. Yusuf Sarıgöz
4f865181aa
gguf : start implementing libllama in GGUF (WIP)
2023-08-10 17:49:31 +03:00
M. Yusuf Sarıgöz
1c4d8bf981
gguf : start implementing libllama in GGUF (WIP)
2023-08-10 16:52:08 +03:00
klosax
0246d0dd6f
gptneox-main.cpp : map tensor names
2023-08-09 00:54:21 +02:00
klosax
7d5f4522dd
convert-llama-h5-to-gguf.py : map tensor names
2023-08-09 00:52:16 +02:00
klosax
f4d137d98c
convert-gptneox-h5-to-gguf.py : map tensor names
2023-08-09 00:50:11 +02:00
klosax
ece4fc185e
map tensor names
2023-08-09 00:48:33 +02:00
klosax
65559a23c8
Update gptneox-main.cpp
2023-08-07 22:28:43 +02:00
Georgi Gerganov
8083ae347a
gguf : minor stuff
2023-08-07 19:02:18 +03:00
Georgi Gerganov
1da82c551f
Merge branch 'master' into gguf
2023-08-07 18:53:03 +03:00
klosax
4357e692ac
gguf.py : use custom alignment if present
2023-08-07 13:51:26 +02:00
Georgi Gerganov
93356bdb7a
ggml : mul mat tweaks ( #2372 )
...
* ggml : mul mat wip
ggml-ci
* ggml : alternative thread distribution for mul_mat
ggml-ci
* ggml : mul_mat block tiling attempt
* ggml : mul_mat threads yield
ggml-ci
2023-08-07 14:25:58 +03:00
Georgi Gerganov
60baff7c85
ggml : pad result of ggml_nbytes()
2023-08-07 14:24:42 +03:00
Georgi Gerganov
9082b5dfbf
ggml : change params pointer (style change) ( #2539 )
...
ggml-ci
2023-08-07 13:55:18 +03:00
Georgi Gerganov
99d29c0094
ggml : sync (custom ops) ( #2537 )
...
ggml-ci
2023-08-07 13:20:09 +03:00
Johannes Gäßler
3d9a551816
Fixed mmap prefetch for GPU offloading ( #2529 )
2023-08-07 10:09:40 +02:00
Georgi Gerganov
f6f9896ac3
metal : fix out-of-bounds access + inc concurrency nodes ( #2416 )
...
* metal : fix out-of-bounds access + style changes
* metal : increase concurrency nodes to 2*GGML_MAX_NODES
2023-08-07 10:52:57 +03:00
GiviMAD
34a14b28ff
[Makefile] Move ARM CFLAGS before compilation ( #2536 )
2023-08-07 09:21:46 +03:00
Henri Vasserman
7297128db8
[Zig] Rewrite build for Zig 0.11 ( #2514 )
...
* zig build fixes
* Disable LTO on Windows.
2023-08-07 08:35:53 +03:00
DannyDaemonic
86c3219895
console : fix issue related to Windows 11 PowerShell console mode persistence ( #2521 )
2023-08-06 09:49:34 +03:00
Keiichi Tabata
2e8265ae17
convert.py : add missing abstract methods for quantized data ( #2491 )
2023-08-06 09:34:05 +03:00
Johannes Gäßler
f514d1b306
CUDA: faster k-quant mul_mat_q kernels ( #2525 )
2023-08-05 18:20:44 +02:00
Jonas Wunderlich
332311234a
fix firefox autoscroll ( #2519 )
2023-08-04 22:16:11 +02:00
Cebtenzzre
182af739c4
server: regenerate completion.js.hpp ( #2515 )
2023-08-04 21:00:57 +02:00
Cebtenzzre
4329d1acb0
CUDA: use min compute capability of GPUs actually used ( #2506 )
2023-08-04 17:35:22 +02:00
Cebtenzzre
02f9d96a86
CUDA: check if event is NULL before cudaStreamWaitEvent ( #2505 )
...
Fixes #2503
2023-08-04 17:34:32 +02:00
DannyDaemonic
3498588e0f
Add --simple-io option for subprocesses and break out console.h and cpp ( #1558 )
2023-08-04 08:20:12 -07:00
Stephen Nichols
5f631c2679
Fixing race condition in server and partial stream handling in frontend. ( #2391 )
...
* Fixing race condition in server.cpp and partial stream handling in completion.js
* Reverting assert edits.
* Adding newline to eof
2023-08-04 13:37:24 +02:00
l3utterfly
415e99fec2
Stream save llama context data to file instead of allocating entire buffer upfront ( #2488 )
...
* added stream saving context data to file to avoid allocating unnecessary amounts of memory
* generalised copying state data to file or buffer
* added comments explaining how copy_state_data works
* fixed trailing whitespaces
* fixed save load state example
* updated save load state to use public function in llama.cpp
* - restored breakage of the llama_copy_state_data API
- moved new logic for copying llama state data to internal function
* fixed function declaration order
* restored save load state example
* fixed whitepace
* removed unused llama-util.h include
* Apply suggestions from code review
Co-authored-by: slaren <slarengh@gmail.com>
* Apply code review suggestions
Co-authored-by: slaren <slarengh@gmail.com>
---------
Co-authored-by: slaren <slarengh@gmail.com>
2023-08-04 13:29:52 +02:00
Borislav Stanimirov
ff966e7ca6
build : fix several cast and printf warnings ( #2499 )
2023-08-04 13:07:21 +03:00
klosax
db5618ad99
cmpnct_gpt2bpe.hpp : comments
2023-08-04 04:57:51 +02:00
klosax
278ada9572
gguf.py : bytesarray for gpt2bpe tokenizer
2023-08-04 04:07:57 +02:00
klosax
fb0b243705
Makefile : remove gptneox-common
2023-08-04 04:02:10 +02:00
klosax
5d98989cf6
gpt2 bpe tokenizer (handles merges and unicode)
2023-08-04 03:58:44 +02:00
klosax
e6f19ba240
gptneox-main.cpp : gpt2 bpe tokenizer
2023-08-04 03:56:37 +02:00
klosax
2922280a1a
convert-gptneox-h5-to-gguf.py : gpt2bpe tokenizer
2023-08-04 03:55:23 +02:00
klosax
6691aa8797
Delete gptneox-common.h
2023-08-04 03:52:01 +02:00
klosax
23abbe8e00
Delete gptneox-common.cpp
2023-08-04 03:51:43 +02:00
