Instructions to use pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0 # Run inference directly in the terminal: llama cli -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0 # Run inference directly in the terminal: llama cli -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0 # Run inference directly in the terminal: ./llama-cli -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
Use Docker
docker model run hf.co/pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
- LM Studio
- Jan
- Ollama
How to use pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf with Ollama:
ollama run hf.co/pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
- Unsloth Studio
How to use pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf to start chatting
- Docker Model Runner
How to use pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf with Docker Model Runner:
docker model run hf.co/pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
- Lemonade
How to use pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf:Q4_0
Run and chat with the model
lemonade run user.VieNeu-TTS-0.3B-q4-gguf-Q4_0
List all available models
lemonade list
- Atomic Chat
π¦ VieNeu-TTS-0.3B-Q4-0-GGUF (CPU Optimized)
VieNeu-TTS-0.3B-Q4-0-GGUF is a Q4_0 quantized version of VieNeu-TTS-0.3B. This model is specifically optimized to run directly on the CPU, providing extremely fast speech synthesis without the need for a dedicated GPU.
Author: PhαΊ‘m Nguyα» n Ngα»c BαΊ£o
β Support This Project
Training high-quality TTS models requires significant GPU resources. If you find this model useful, please consider supporting the development:
π οΈ Requirements (eSpeak NG)
eSpeak NG is mandatory for phonemization.
- Windows: Download
.msifrom eSpeak NG Releases. - macOS:
brew install espeak - Linux:
sudo apt install espeak-ng
π How to Use
Use the source code from GitHub for the best experience with full text preprocessing support:
# 1. Clone repository
git clone https://github.com/pnnbao97/VieNeu-TTS.git
cd VieNeu-TTS
# 2. Sync environment (requires uv)
uv sync
# 3. Launch Web UI
uv run gradio_app.py
In the UI, select Backbone: VieNeu-TTS-0.3B-q4-gguf and Device: CPU.
π¦ Using Python SDK (vieneu)
Install the SDK to integrate VieNeu-TTS-0.3B into your research or applications:
# Windows (Avoid llama-cpp build errors)
pip install vieneu --extra-index-url https://pnnbao97.github.io/llama-cpp-python-v0.3.16/cpu/
# Linux / MacOS
pip install vieneu
Full Features Guide
from vieneu import Vieneu
import os
# Initialization
tts = Vieneu() # Default: 0.3B-Q4 GGUF for CPU
os.makedirs("outputs", exist_ok=True)
# 1. List preset voices
available_voices = tts.list_preset_voices()
for desc, name in available_voices:
print(f" - {desc} (ID: {name})")
# 2. Use specific voice (dynamically select second voice)
if available_voices:
_, my_voice_id = available_voices[1] if len(available_voices) > 1 else available_voices[0]
voice_data = tts.get_preset_voice(my_voice_id)
audio_spec = tts.infer(text="ChΓ o bαΊ‘n, tΓ΄i Δang nΓ³i bαΊ±ng giα»ng cα»§a bΓ‘c sΔ© TuyΓͺn.", voice=voice_data)
tts.save(audio_spec, f"outputs/standard_{my_voice_id}.wav")
print(f"πΎ Saved synthesis to: outputs/standard_{my_voice_id}.wav")
# 3. Standard synthesis (uses default voice)
text = "Xin chΓ o, tΓ΄i lΓ VieNeu. TΓ΄i cΓ³ thα» giΓΊp bαΊ‘n Δα»c sΓ‘ch, lΓ m chatbot thα»i gian thα»±c, hoαΊ·c thαΊm chΓ clone giα»ng nΓ³i cα»§a bαΊ‘n."
audio = tts.infer(text=text)
tts.save(audio, "outputs/standard_output.wav")
print("πΎ Saved synthesis to: outputs/standard_output.wav")
# 4. Zero-shot voice cloning
if os.path.exists("examples/audio_ref/example_ngoc_huyen.wav"):
cloned_audio = tts.infer(
text="ΔΓ’y lΓ giα»ng nΓ³i ΔΓ£ Δược clone thΓ nh cΓ΄ng tα»« file mαΊ«u.",
ref_audio="examples/audio_ref/example_ngoc_huyen.wav",
ref_text="TΓ‘c phαΊ©m dα»± thi bαΊ£o ΔαΊ£m tΓnh khoa hα»c, tΓnh ΔαΊ£ng, tΓnh chiαΊΏn ΔαΊ₯u, tΓnh Δα»nh hΖ°α»ng."
)
tts.save(cloned_audio, "outputs/standard_cloned_output.wav")
print("πΎ Saved cloned voice to: outputs/standard_cloned_output.wav")
# 5. Cleanup
tts.close()
π Technical Specifications
- Format: GGUF (Q4_0)
- Size: ~200 MB
- Standard Devices: Office laptops, Mini PCs, and computers without GPUs.
- Performance: Achieves real-time speed even on standard consumer CPUs.
β οΈ Licensing & Copyright
This model is released under the CC BY-NC 4.0 license.
- β Free: For students, researchers, and non-profit purposes.
- β οΈ Commercial/Enterprise: Use for businesses or commercial products is strictly prohibited without prior authorization.
- Commercial Licensing: Please contact the author (PhαΊ‘m Nguyα» n Ngα»c BαΊ£o) for licensing terms (Estimated: 5,000 USD/year - negotiable).
π Citation
@misc{vieneutts03bgguf2026,
title = {VieNeu-TTS-0.3B-GGUF: CPU-Optimized Vietnamese Text-to-Speech},
author = {Pham Nguyen Ngoc Bao},
year = {2026},
publisher = {Hugging Face},
howpublished = {\url{https://huggingface.co/pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf}}
}
Made with β€οΈ for the Vietnamese TTS community
- Downloads last month
- 40,383
4-bit
Model tree for pnnbao-ump/VieNeu-TTS-0.3B-q4-gguf
Base model
pnnbao-ump/VieNeu-TTS-0.3B