Podman AI Lab is an open source extension for Podman Desktop that allows users to work with LLMs on a local environment, featuring a recipe catalog with common AI use cases, a curated set of open source models, and a playground for learning, prototyping, and experimentation. It uses Podman machines to run inference servers for LLM models and supports various formats like GGUF, Pytorch, and Tensorflow.
Bookmarks on this page are managed by an admin user. 