ComfyUI-SamAudio
Converted standard BF16 .safetensors checkpoints for SAM-Audio (Segment Anything Model for Audio) by Meta AI, optimized for native use in ComfyUI.
Available Checkpoints
| Checkpoint | Format | Size | Description |
|---|---|---|---|
sam_audio_base.safetensors |
BF16 | 1.73 GB | 12-layer DiT, 1536 dim. Fast daily driver. |
sam_audio_large.safetensors |
BF16 | 6.38 GB | 22-layer DiT, 2816 dim. Maximum separation fidelity. |
Installation & Placement in ComfyUI
Place the .safetensors model(s) into:
ComfyUI/models/sam-audio/
Quick download via CLI:
hf download Aero-Ex/ComfyUI-SamAudio --local-dir ComfyUI/models/sam-audio
Required Text Encoder
For text prompting, place t5-base.safetensors into ComfyUI/models/text_encoders/:
- Download: Comfy-Org/t5-base
Custom Node
Run these models natively using the dependency-free custom node:
ComfyUI-SAM-Audio-Native
Supported Modalities
- Text-Prompted Separation: Isolate vocals, speech, instruments, sound effects using natural language.
- Temporal Span Separation: Isolate sounds using
+(present) or-(absent) time intervals. - Video-Guided Separation: Isolate sounds tied to visual objects using video frames and tracking masks (e.g. from SAM 3).
License
This model is subject to Meta's SAM License. See LICENSE for details.