This project provides Dockerised deployment of oobabooga's text-generation-webui with pre-built images for Nvidia GPU, AMD GPU, Intel Arc, and CPU-only inference. It supports various extensions and offers easy deployment and updates.
   
    
 
 
  
   
   An extension that automatically unloads and reloads your model, freeing up VRAM for other programs.