root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-25 19:04:35 +00:00
Code Issues Actions 9 Packages Projects Releases Wiki Activity

llama.swiftui : update readme

Browse Source
This commit is contained in:
Georgi Gerganov 2024-01-08 15:57:36 +02:00 committed by GitHub
parent 52531fdff8
commit 42ea63c5a3
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
examples/llama.swiftui/README.md
View File

@ -1,7 +1,12 @@
# llama.swiftui # llama.cpp/examples/llama.swiftui
Local inference of llama.cpp on an iPhone. Local inference of llama.cpp on an iPhone. This is a sample app that can be used as a starting
So far I only tested with starcoder 1B model, but it can most likely handle 7B models as well. point for more advanced projects.
For usage instructions and performance stats, check the following discussion: https://github.com/ggerganov/llama.cpp/discussions/4508
![image](https://github.com/ggerganov/llama.cpp/assets/1991296/2b40284f-8421-47a2-b634-74eece09a299)
Video demonstration:
https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545 https://github.com/bachittle/llama.cpp/assets/39804642/e290827a-4edb-4093-9642-2a5e399ec545