sam2-playground

Gradio based playground web UI using facebook/segment-anything-2 models.

Online Demos

Feature

Add filters to segment parts of a video with pixelated or solid color

Pixelize the girl's face

Divide segmentation parts into layers and save them as PSD files.

Divide clothes into layers and save as PSD file

See PROMPT_GUIDE.md to see how to prompt the segmentation parts of the image.

Installation and Running

Prerequisites

To run this Web UI, you need these prerequisites. If you don't have them, please install them in the following links :

git : https://git-scm.com/downloads
python=>3.10 : https://www.python.org/downloads/
FFmpeg : https://ffmpeg.org/download.html

After installing FFmpeg, make sure to add the FFmpeg/bin folder to your system PATH!
And for CUDA, if you're not using an Nvidia GPU and CUDA 12.4, edit the requirements.txt to match your environment.

Option 1 : Running with Shell / Batch Scripts

There's a set of shell / batch scripts for installation and running.

Download sam2-playground-portable.zip with the file corresponding to your OS and extract its contents.
Run install.bat or install.sh to install dependencies. (This will create a venv directory and install dependencies there.)
Start WebUI with start-webui.bat or start-webui.sh
To update, run update.bat or update.sh

Option 2: Docker

Clone the repository

git clone https://github.com/jhj0517/sam2-playground.git

Build the image ( Image is about ~6 GB )

docker compose build

Run the container

docker compose up

Connect to localhost:7860 with your browser.

If needed, update docker-compose.yaml to match your environments.

Todo 🗓

Support change() API for gradio_image_prompter and automatically generate preview for video predictor