No Vibevoice 7B ggufs?

#4
by detemasinton - opened

Hi, this seems like a great project, but I haven't tested it because I couldn't find the gguf files for Vibevoice 7B. Could you please upload them? Its 1.5B version is pretty good (the official one), so having the option to use the 7B ggufs would be fantastic since I don't have enough VRAM for its full size. Thanks.

@detemasinton Is that okay I only upload the Q8 version?

@audio-cpp Yes, that would be okay. I would really appreciate it!

audio-cpp changed discussion status to closed

Here https://huggingface.co/audio-cpp/VibeVoice-7B-GGUF. Code also updated to reduce VRAM usage of 7B model.

Sign up or log in to comment