VibeVoice 7B GGUF for audio.cpp

GGUF conversion of vibevoice/VibeVoice-7B for audio.cpp.

Upstream model: vibevoice/VibeVoice-7B

Files

  • vibevoice-7b-q8_0.gguf: Q8_0 GGUF package for VibeVoice 7B.
  • LICENSE: MIT license from the upstream VibeVoice project.

Usage

Use the GGUF directly with audio.cpp CLI/server, or download/select it from the native WebUI once the package is published.

VibeVoice is a long-form, multi-speaker speech generation model. It is intended for English and Chinese speech synthesis.

Local audio.cpp check

Observed quick-check performance on RTX 5090 for the Q8_0 GGUF in audio.cpp server mode:

  • RTF: about 0.18
  • Output length: about 52s
  • Peak VRAM: about 13.3 GB

These numbers are implementation and hardware dependent. They are only a quick audio.cpp sanity check, not a benchmark.

Downloads last month
-
GGUF
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for audio-cpp/VibeVoice-7B-GGUF

Quantized
(5)
this model