Browse
L
LLMKube
Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, an…
144ActiveApache-2.0
Self-host
Docker ComposeDifficulty
Docker Compose(estimated)
Deploy methods
dockercomposehelmk8ssource
Required dependencies
Not yet detected
Resource footprint
Not yet measured
Get started
$ git clone https://github.com/defilantech/LLMKube.gitA vetted docker-compose.yml, dependency list, and RAM footprint are extracted from the repo during enrichment.
Request a deploy recipeNo one-click recipe yet — request one and we’ll build it.Self-host docs / repo
About
Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, and OpenAI-compatible API.
Description from awesome-selfhosted-data · CC-BY-SA 3.0.