root/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-26 03:14:35 +00:00
Code Issues Actions 7 Packages Projects Releases Wiki Activity

metal : refactor kernel loading code (#4794)

Browse Source 
* metal : detect more GPU families

* metal : refactor kernel loading

* metal : set kernel family requirements

* metal : fix kernel init + fix compile options

* metal : take into account simdgroup reduction support

* metal : print only skipped kernels

* metal : fix check for simdgroup reduction support

* metal : check for Metal 3

* metal : free allocations

* metal : normalize encoder:setComputePipelineStatus calls

ggml-ci

* metal : fix Metal3 family check

ggml-ci

* metal : check for simdgroup matrix mul. feature

ggml-ci
This commit is contained in:
Georgi Gerganov 2024-01-13 18:03:45 +02:00 committed by GitHub
parent 7dc78764e2
commit b38b5e93ae
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 530 additions and 518 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1034
ggml-metal.m
View File

File diff suppressed because it is too large Load Diff