Orpheus 3B (orpheus), released 2025-03
Task: Text to speech
Parameters: 3B
Mixture-of-experts: no
Precision: Q4_K_M GGUF (llama.cpp) / fp16 (vLLM)
Recommended memory:
gb: 4
quant: Q4_K_M GGUF
Runs on CPU: yes
Device classes: mac, nvidia, amd, laptop
Tools: llama.cpp, LM Studio, vLLM
Model license: Apache-2.0 (commercial use: yes)
Notes: A Llama-3.2-3B fine-tune that emits speech tokens, so it runs through the usual LLM stacks. The llama.cpp GGUF path (Q4_K_M ~2.5GB on disk) runs on CPU or Apple Silicon Metal at roughly ~4GB with overhead; the vLLM/CUDA path needs more VRAM headroom. Apache-2.0, commercial OK. Anchor is the Q4_K_M file plus typical llama.cpp overhead (synthesis, not a single measurement). Sources: Canopy model card and repo, Mungert GGUF repo.