mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-09-22 21:16:20 +00:00
Merge 7323304092
into ecd5d6b65b
This commit is contained in:
commit
2f4fc576ec
@ -178,6 +178,7 @@ Unless otherwise noted these projects are open-source with permissive licensing:
|
||||
|
||||
**Infrastructure:**
|
||||
|
||||
- [llmaz](https://github.com/InftyAI/llmaz) - ☸️ Effortlessly serve state-of-the-art LLMs on Kubernetes, see [llama.cpp example](https://github.com/InftyAI/llmaz/tree/main/docs/examples/llamacpp) here.
|
||||
- [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp
|
||||
- [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user