# LLM
97 tools tagged
showing 1 of 97 tools
Official Kubernetes and Helm reference stack built on the vLLM inference engine
Official vLLM reference implementation for scaling the existing inference engine on Kubernetes with Helm, request routing, KV-cache offload, autoscaling and Prometheus/Grafana observability.
Open Source