Instructions to use funnyQZQ/undertext-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use funnyQZQ/undertext-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf funnyQZQ/undertext-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf funnyQZQ/undertext-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf funnyQZQ/undertext-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf funnyQZQ/undertext-models:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf funnyQZQ/undertext-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf funnyQZQ/undertext-models:Q4_K_M
Use Docker
docker model run hf.co/funnyQZQ/undertext-models:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use funnyQZQ/undertext-models with Ollama:
ollama run hf.co/funnyQZQ/undertext-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use funnyQZQ/undertext-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf funnyQZQ/undertext-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "funnyQZQ/undertext-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use funnyQZQ/undertext-models with Docker Model Runner:
docker model run hf.co/funnyQZQ/undertext-models:Q4_K_M
- Lemonade
How to use funnyQZQ/undertext-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull funnyQZQ/undertext-models:Q4_K_M
Run and chat with the model
lemonade run user.undertext-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use funnyQZQ/undertext-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf funnyQZQ/undertext-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default funnyQZQ/undertext-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use funnyQZQ/undertext-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf funnyQZQ/undertext-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "funnyQZQ/undertext-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
UnderText models
UnderText 是一个在 Mac 本地运行的实时英文字幕和中文翻译工具。这个仓库存放它用到的五个模型的副本,这样下载不依赖原作者的仓库一直可用。同样的文件在 ModelScope(中国大陆下载快)和 Hugging Face 上各有一份。文件和原版完全一样,没有做任何修改。
Copies of the five models used by UnderText, a local real-time English subtitle and Chinese translation app for macOS. Keeping them here means downloads don't depend on the original repositories staying available. The same files are on ModelScope (fast in mainland China) and Hugging Face. They are unchanged from the original releases.
文件 / Files
| 文件 / File | 用途 / Role | 来源 / Source | 原作者 / Original authors | 许可证 / License |
|---|---|---|---|---|
Qwen3.5-2B-Q4_K_M.gguf |
翻译 / Translation | unsloth/Qwen3.5-2B-GGUF | Qwen Team, Alibaba (Qwen/Qwen3.5-2B); GGUF quantization by Unsloth | Apache-2.0 |
sherpa-onnx-nemo-parakeet-tdt-0.6b-v2-int8/ |
语音识别 / Speech recognition | csukuangfj/sherpa-onnx-nemo-parakeet-tdt-0.6b-v2-int8 | NVIDIA (nvidia/parakeet-tdt-0.6b-v2); ONNX export by the sherpa-onnx project | CC-BY-4.0 |
nemo_en_titanet_small.onnx |
说话人识别 / Speaker labels | csukuangfj/speaker-embedding-models | NVIDIA (TitaNet-small); ONNX export by the sherpa-onnx project | NeMo Toolkit license (Apache-2.0) |
silero_vad.onnx |
人声检测 / Voice activity detection | csukuangfj/vad | Silero Team | MIT |
opus-mt-en-zh-ct2/ |
草稿翻译 / Draft translation | gaudi/opus-mt-en-zh-ctranslate2 | Helsinki-NLP (Jörg Tiedemann et al.); CTranslate2 conversion by gaudi | Apache-2.0 |
每个模型都按它自己的许可证使用和分发,这个仓库没有为它们设定统一的许可证。Parakeet-TDT(CC-BY-4.0)在使用时需要注明 NVIDIA 为原作者。
Each model is used and redistributed under its own license; this repository does not apply a single license to them. Parakeet-TDT (CC-BY-4.0) requires attribution to NVIDIA.
目录结构 / Layout
和 UnderText 的模型文件夹一致,下载后可以直接使用:
Same layout as UnderText's models folder:
Qwen3.5-2B-Q4_K_M.gguf
sherpa-onnx-nemo-parakeet-tdt-0.6b-v2-int8/
encoder.int8.onnx
decoder.int8.onnx
joiner.int8.onnx
tokens.txt
nemo_en_titanet_small.onnx
silero_vad.onnx
opus-mt-en-zh-ct2/
config.json
model.bin
shared_vocabulary.json
source.spm
target.spm
引用 / Citations
- Parakeet-TDT: Xu et al., "Efficient Sequence Transduction by Jointly Predicting Tokens and Durations", ICML 2023.
- TitaNet: Koluguri et al., "TitaNet: Neural Model for Speaker Representation with 1D Depth-wise Separable Convolutions and Global Context", ICASSP 2022.
- Opus-MT: Tiedemann and Thottingal, "OPUS-MT — Building open translation services for the World", EAMT 2020.
- Downloads last month
- 46
4-bit