vLLM Production Stack provides a reference implementation on how to build an inference stack on top of vLLM, allowing for scalable, monitored, and performant LLM deployments using Kubernetes and Helm.
High-performance deployment of the vLLM serving engine, optimized for serving large language models at scale.
