PygmalionAI's large-scale inference engine designed for serving Pygmalion models to a large number of users with blazing fast speeds. Integrates work from projects like vLLM, TensorRT-LLM, xFormers, AutoAWQ, AutoGPTQ, SqueezeLLM, Exllamav2, TabbyAPI, AQLM, KoboldAI, Text Generation WebUI, and Megatron-LM.
Lambda Stack is an all-in-one package that provides a one line installation and managed upgrade path for deep learning and AI software, ensuring that you always have the most up-to-date versions of PyTorch, TensorFlow, CUDA, CuDNN, and NVIDIA Drivers.
