llama.cpp/.gitignore

*.o
*.a
.cache/
.vs/
.vscode/
.DS_Store

build/
build-em/
build-debug/
build-release/
build-static/
build-no-accel/
build-sanitize-addr/
build-sanitize-thread/

models/*

/main
/quantize
/magic.dat

arm_neon.h
compile_commands.json
CMakeFiles/
CMakeCache.txt
Initial release 2023-03-10 18:40:58 +00:00			`*.o`
			`*.a`
			`.cache/`
			`.vs/`
			`.vscode/`
			`.DS_Store`

			`build/`
			`build-em/`
			`build-debug/`
			`build-release/`
			`build-static/`
			`build-no-accel/`
			`build-sanitize-addr/`
			`build-sanitize-thread/`

.gitignore models/ 2023-03-11 10:26:46 +00:00			`models/*`

Initial release 2023-03-10 18:40:58 +00:00			`/main`
			`/quantize`
Implement prototype for instant mmap() loading This change uses a custom malloc() implementation to transactionally capture to a file dynamic memory created during the loading process. That includes (1) the malloc() allocation for mem_buffer and (2) all the C++ STL objects. On my $1000 personal computer, this change lets me run ./main to generate a single token (-n 1) using the float16 7B model (~12gb size) in one second. In order to do that, there's a one time cost where a 13gb file needs to be generated. This change rocks but it shouldn't be necessary to do something this heroic. We should instead change the file format, so that tensors don't need reshaping and realignment in order to be loaded. 2023-03-17 05:03:09 +00:00			`/magic.dat`
Initial release 2023-03-10 18:40:58 +00:00
			`arm_neon.h`
			`compile_commands.json`
Make WIN32 mmap() improvements (#341) Still not fully working yet. Closes #341 2023-03-20 21:46:44 +00:00			`CMakeFiles/`
			`CMakeCache.txt`