Text-to-Audio
Diffusers
Safetensors
MossSoundEffectPipeline
sound-effects
foley
flow-matching
diffusion-transformer
dac-vae
english
chinese
moss
mirror
Instructions to use AEmotionStudio/moss-soundeffect-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AEmotionStudio/moss-soundeffect-models with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AEmotionStudio/moss-soundeffect-models", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
MOSS SoundEffect v2.0 — inference mirror for MAESTRO
Inference-ready repack of OpenMOSS-Team/MOSS-SoundEffect-v2.0 (OpenMOSS, Fudan University), kept by AEmotionStudio so the MAESTRO DAW can fetch the checkpoint on demand. The model is not fine-tuned or otherwise altered — this repo only repacks the upstream weights for loading:
transformer/diffusion_pytorch_model.safetensors— the 1.3B DiT, stored in the inference dtype MAESTRO pins after GPU validation (upstream ships fp32 and runs under bf16 autocast).vae/diffusion_pytorch_model.safetensors— the 48 kHz continuous DAC VAE, converted from the pickledvae_128d_48k.pth(audiotools package) to safetensors; the constructor kwargs live invae/config.json.text_encoder/+tokenizer/— the Qwen3 text encoder shards and tokenizer, verbatim from upstream.model_index.json,scheduler/,transformer/config.json— verbatim.
| Component | Purpose |
|---|---|
transformer/ |
1.3B flow-matching Diffusion Transformer |
vae/ |
Continuous DAC VAE decoder (latents → 48 kHz mono waveform) |
text_encoder/ + tokenizer/ |
Qwen3 text encoder (EN + ZH prompts) |
scheduler/ |
Flow-match scheduler config (shift 5.0) |
MOSS SoundEffect generates 48 kHz sound effects up to 30 s from English or Chinese text prompts — nature, urban, creature, human-action, and musical-element sounds.
License
- Code: Apache-2.0 (OpenMOSS/MOSS-TTS,
moss_soundeffect_v2). - Weights (this repo): Apache-2.0 — inherited unchanged from upstream.
Credit for the model belongs entirely to the OpenMOSS team at Fudan University; this mirror exists only for reliable on-demand delivery into MAESTRO.
- Downloads last month
- -