LLMKube

llmkube.com

免费额度 · Free Tier

该资源暂无抓取的免费额度明细，以下为结构化的权益标识。

免信用卡长期有效

概述

Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API. (Source Code) Apache-2.0 Go/Docker/K8S