Get the latest tech news

Large Language Models in Containers Locally with Podman AI Lab


Contribute to containers/podman-desktop-extension-ai-lab development by creating an account on GitHub.

Each recipe comes with detailed explanations and sample applications that can be run with various large language models (LLMs). You can use yarn watch --extension-folder from the Podman Desktop directory to automatically rebuild and test the AI Lab extension: Enhanced Playgrounds: Streamlined workflows and UX giving a better space to experiment with LLMs and quickly iterate.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of local LLMs

local LLMs

Photo of GUI

GUI

Photo of Podman Desktop

Podman Desktop

Related news:

News photo

Podman Desktop 1.10: 1M downloads and counting

News photo

Pter: TUI and GUI for Todo.txt

News photo

Fast and secure translation on your local machine with a GUI