1 open-source project
Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, an…