ONNX
GGUF
speech-to-speech
on-device
qualcomm-qnn
hexagon-v73
snapdragon-8-gen-2
llama-cpp
sherpa-onnx
piper-tts
imatrix
conversational
Instructions to use Vantuk/model_set_v73 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Vantuk/model_set_v73 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Vantuk/model_set_v73 # Run inference directly in the terminal: llama cli -hf Vantuk/model_set_v73
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Vantuk/model_set_v73 # Run inference directly in the terminal: llama cli -hf Vantuk/model_set_v73
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Vantuk/model_set_v73 # Run inference directly in the terminal: ./build/bin/llama cli -hf Vantuk/model_set_v73
Use Docker
docker model run hf.co/Vantuk/model_set_v73
- Llama new
- LM Studio
- Jan
- Ollama
How to use Vantuk/model_set_v73 with Ollama:
ollama run hf.co/Vantuk/model_set_v73
- Unsloth Desktop
- Docker Model Runner
How to use Vantuk/model_set_v73 with Docker Model Runner:
docker model run hf.co/Vantuk/model_set_v73
- Lemonade
How to use Vantuk/model_set_v73 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Vantuk/model_set_v73
Run and chat with the model
lemonade run user.model_set_v73-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Speakilo / OneVoice On-Device Model Set (Snapdragon 8 Gen 2 / SM8550 Hexagon v73 + Tier 2A)
- Target NPU: Qualcomm Hexagon HTP v73 (
soc_model = 43,htp_arch = 73, QNN SDK2.51.0) - Total files: 388 (1.877 GB)
| Step | Stage | Path | Hardware |
|---|---|---|---|
| 1 | Spoken LID | ecapa-lid/* |
NPU (QNN HTP v73) |
| 2a | VI ASR (gipformer INT8) |
asr/vi/* |
CPU (Sherpa-ONNX) |
| 2b | EN/KO ASR (SenseVoice INT8) |
asr/en/* |
CPU (Sherpa-ONNX) |
| 2c | KO Streaming ASR | asr/ko/* |
CPU (Sherpa-ONNX) |
| 3 | Source Readiness | source-readiness/* |
NPU (QNN HTP v73) |
| 4 | Translation (Tier 2A Hy-MT2-1.8B-Q4_0-enviko32k) |
mt/model.gguf |
CPU (llama.cpp + KleidiAI +dotprod+i8mm) |
| 5a | Korean TTS (piper-ko-kss KSS) |
tts/piper_ko_kss/* |
Hybrid CPU (enc_dp_flow) -> NPU QNN HTP v73 (dec_128_2d) |
| 5b | Vietnamese TTS (piper-vi-vais1000) |
tts/piper_vi_vais1000/* |
Hybrid CPU -> NPU QNN HTP v73 (+ CPU fallback) |
| 5c | English TTS (piper-en-lessac) |
tts/piper_en_lessac/* |
Hybrid CPU -> NPU QNN HTP v73 (+ CPU fallback) |
| 5d | eSpeak-NG data | tts/espeak-ng-data/* |
CPU G2P for EN/VI Piper |
- Downloads last month
- 44
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support