Instructions to use luzhengsong/vxtools-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use luzhengsong/vxtools-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf luzhengsong/vxtools-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf luzhengsong/vxtools-models:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf luzhengsong/vxtools-models:Q4_K_M # Run inference directly in the terminal: llama cli -hf luzhengsong/vxtools-models:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf luzhengsong/vxtools-models:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf luzhengsong/vxtools-models:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf luzhengsong/vxtools-models:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf luzhengsong/vxtools-models:Q4_K_M
Use Docker
docker model run hf.co/luzhengsong/vxtools-models:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use luzhengsong/vxtools-models with Ollama:
ollama run hf.co/luzhengsong/vxtools-models:Q4_K_M
- Unsloth Desktop
- Pi
How to use luzhengsong/vxtools-models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf luzhengsong/vxtools-models:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "luzhengsong/vxtools-models:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use luzhengsong/vxtools-models with Docker Model Runner:
docker model run hf.co/luzhengsong/vxtools-models:Q4_K_M
- Lemonade
How to use luzhengsong/vxtools-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull luzhengsong/vxtools-models:Q4_K_M
Run and chat with the model
lemonade run user.vxtools-models-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use luzhengsong/vxtools-models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf luzhengsong/vxtools-models:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default luzhengsong/vxtools-models:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use luzhengsong/vxtools-models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf luzhengsong/vxtools-models:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "luzhengsong/vxtools-models:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
vxtools-models
HiPangWork「速记纪要」EN 版客户端运行所需的全套本地资源,共 54 个文件、合计约 4.67 GB: 13 个模型权重/词表 + 41 个 llama.cpp Windows 运行时文件。 全部为本地离线推理,运行时不依赖任何远程 AI 接口。
本仓库是第三方权重与二进制的再分发镜像,不拥有任何模型版权。 各文件许可证以其上游 model card / release 为准(见下方 Provenance),因此仓库 license 标记为
other。
文件清单
模型权重(客户端落地目录 data/models/,与仓库路径一一对应):
| 路径 | 大小 | 用途 |
|---|---|---|
qwen-4b/Qwen3-4B-Q4_K_M.gguf |
2381.6 MB | 会议纪要 AI 总结 / PPT 大纲生成(llama.cpp 主槽,标准档) |
qwen3-1.7b-chat/Qwen3-1.7B-Q4_K_M.gguf |
1056.1 MB | 智享助理会话槽;内存不足时纪要总结也降档复用它(低配档) |
funasr-nano/llm.int8.onnx |
572.5 MB | Fun-ASR-Nano 长音频精准转写 · LLM 解码器 |
funasr-nano/encoder_adaptor.int8.onnx |
226.8 MB | Fun-ASR-Nano · 音频编码器 + 适配器 |
funasr-nano/embedding.int8.onnx |
148.4 MB | Fun-ASR-Nano · 词嵌入 |
funasr-nano/Qwen3-0.6B/tokenizer.json |
11.6 MB | Fun-ASR-Nano 配套分词器 |
funasr-nano/Qwen3-0.6B/vocab.json |
2.6 MB | 同上 · 词表 |
funasr-nano/Qwen3-0.6B/merges.txt |
1.7 MB | 同上 · BPE 合并规则 |
sense-voice/model.int8.onnx |
228.2 MB | SenseVoice 实时转写(中英日韩粤) |
sense-voice/tokens.txt |
0.3 MB | SenseVoice token 表 |
speaker-embedding/3dspeaker_speech_eres2net_base_sv_zh-cn_3dspeaker_16k.onnx |
37.8 MB | 说话人声纹嵌入,用于按声纹自动区分说话人 |
speech-denoise/gtcrn_simple.onnx |
0.5 MB | GTCRN 语音增强(16kHz 降噪) |
vad/silero_vad.onnx |
2.2 MB | Silero VAD 神经网络语音活动检测,用于离线转写的语音分段(替代能量门限) |
推理运行时(客户端落地目录 data/bin/llama/,共 41 个文件、合计约 107.4 MB):
| 路径 | 大小 | 用途 |
|---|---|---|
llama/llama-server.exe |
10.3 MB | llama.cpp HTTP 服务,客户端以子进程方式启动,对外提供 OpenAI 兼容 /v1/chat/completions |
llama/llama.dll、llama/ggml*.dll |
约 19 MB | 推理核心与 GGML 后端;ggml-cpu-*.dll 是按 CPU 指令集(sse42 / haswell / icelake / zen4 等)分别编译的变体,运行时自动择优加载 |
llama/libomp140.x86_64.dll、llama/mtmd.dll、llama/ggml-rpc.dll |
约 1.6 MB | OpenMP 运行时、多模态与 RPC 支持库 |
llama/llama-cli.exe 等 20 个工具 |
约 77 MB | 官方 release 自带的 bench / quantize / perplexity 等工具,客户端不调用,随包保留以便本地排障 |
llama-server.exe 必须与上述 dll 同目录才可用,客户端按仓库清单逐文件下载(本地大小一致即跳过),
因此单传 exe 无意义。
Provenance(上游来源)
| 本仓库文件 | 直接来源 | 原始出处 |
|---|---|---|
funasr-nano/*、sense-voice/*、speaker-embedding/*、qwen-4b/*、qwen3-1.7b-chat/* |
ModelScope lu18851615825/fuyuan_sherpa_onnx_funasr_nano_int8_2025_12_30_mirror |
见下各条 |
sense-voice/* |
↑ 同仓库 sense-voice/ 子目录 |
sherpa-onnx-sense-voice-zh-en-ja-ko-yue-int8-2024-07-17(SenseVoiceSmall 的 sherpa-onnx int8 导出) |
speaker-embedding/*.onnx |
↑ 同仓库根目录 | 3D-Speaker speech_eres2net_base_sv_zh-cn_3dspeaker_16k |
qwen-4b/Qwen3-4B-Q4_K_M.gguf |
↑ 同仓库 qwen-4b/ 子目录 |
Qwen/Qwen3-4B 的 Q4_K_M GGUF 社区量化 |
qwen3-1.7b-chat/Qwen3-1.7B-Q4_K_M.gguf |
↑ 同仓库 qwen3-1.7b-chat/ 子目录 |
Qwen/Qwen3-1.7B 的 Q4_K_M GGUF 社区量化 |
speech-denoise/gtcrn_simple.onnx |
GitHub k2-fsa/sherpa-onnx release speech-enhancement-models |
GTCRN 官方权重 |
llama/* |
GitHub ggml-org/llama.cpp release b8581 的 llama-b8581-bin-win-cpu-x64.zip(原样摊平,未改动任何文件) |
llama.cpp 官方 Windows x64 CPU 构建,MIT |
vad/silero_vad.onnx |
PyPI silero-vad 6.2.3 wheel(src/silero_vad/data/silero_vad.onnx) |
snakers4/silero-vad v5,MIT |
上游许可证(Apache-2.0 / MIT / CC 系等)各不相同,公开本仓库前请逐个核对上游 model card 的再分发条款。
已核实:vad/silero_vad.onnx 与 llama/* 上游均为 MIT,允许随本仓库再分发(保留版权声明即可)。
VAD 版本约束:silero-vad 6.2.3 的 wheel 内含 6 个 onnx 变体,其中只有
silero_vad.onnx与silero_vad_16k_op15.onnx的 IO 签名被 sherpa-onnx 1.13.6 接受;silero_vad_op18_ifless.onnx的输入顺序为input/sr/state,会触发CheckV5:360 Input[1]: sr. Expected: state,其余变体报Unsupported。加载失败会走SHERPA_ONNX_EXIT(-1)直接杀进程而非抛异常,故文件名不可替换。
下载
整仓拉取(推荐)。注意客户端把两部分资源放在不同目录:模型权重落 data/models/,
llama.cpp 运行时落 data/bin/llama/,故分两次拉取:
from huggingface_hub import snapshot_download
# 1) 模型权重与词表 → data/models(目录结构与仓库一致)
snapshot_download(
repo_id="luzhengsong/vxtools-models",
repo_type="model",
local_dir="data/models",
ignore_patterns=["llama/*", "README.md", "sha256sums.txt", ".gitattributes"],
)
# 2) llama.cpp 推理运行时 → data/bin/llama
snapshot_download(
repo_id="luzhengsong/vxtools-models",
repo_type="model",
local_dir="data/bin",
allow_patterns=["llama/*"],
)
客户端自身的下载顺序为:huggingface.co 直连 → hf-mirror.com 镜像 → 国内 ModelScope 兜底;
推理运行时另有一条最终回退,即直接取 llama.cpp 官方 GitHub release 的 zip。
按需拉单个文件:
from huggingface_hub import hf_hub_download
hf_hub_download(
repo_id="luzhengsong/vxtools-models",
filename="sense-voice/model.int8.onnx",
local_dir="data/models",
)
大于 10 MB 的文件由 Git LFS 托管,huggingface_hub 会自动处理,无需手动 git lfs install。
完整性校验
仓库根目录的 sha256sums.txt 记录了全部 54 个文件的 SHA-256(相对路径以仓库根为基准,正斜杠,
不含 README.md / sha256sums.txt 自身)。在仓库克隆目录内可直接校验:
sha256sum -c sha256sums.txt
在客户端安装目录校验时要做路径映射:llama/ 对应 data\bin\llama\,其余对应 data\models\。
PowerShell(在客户端根目录执行,$sums 指向 sha256sums.txt):
$sums = 'data\models\sha256sums.txt'
Get-Content $sums | ForEach-Object {
$hash, $rel = $_ -split '\s{2}', 2
$path = if ($rel -like 'llama/*') { Join-Path 'data\bin' ($rel -replace '/', '\') }
else { Join-Path 'data\models' ($rel -replace '/', '\') }
$actual = if (Test-Path $path) { (Get-FileHash $path -Algorithm SHA256).Hash.ToLower() } else { '' }
$flag = if ($actual -eq $hash) { 'OK ' } elseif (-not $actual) { 'MISS' } else { 'FAIL' }
"{0} {1}" -f $flag, $rel
}
- Downloads last month
- 60
4-bit