Instructions to use Motanni/auditbox-command-guard-0.8b-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Motanni/auditbox-command-guard-0.8b-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0 # Run inference directly in the terminal: llama cli -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0 # Run inference directly in the terminal: llama cli -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Use Docker
docker model run hf.co/Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use Motanni/auditbox-command-guard-0.8b-gguf with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Motanni/auditbox-command-guard-0.8b-gguf" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Motanni/auditbox-command-guard-0.8b-gguf", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
- Ollama
How to use Motanni/auditbox-command-guard-0.8b-gguf with Ollama:
ollama run hf.co/Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
- Unsloth Desktop
- Pi
How to use Motanni/auditbox-command-guard-0.8b-gguf with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Motanni/auditbox-command-guard-0.8b-gguf:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Motanni/auditbox-command-guard-0.8b-gguf with Docker Model Runner:
docker model run hf.co/Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
- Lemonade
How to use Motanni/auditbox-command-guard-0.8b-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Run and chat with the model
lemonade run user.auditbox-command-guard-0.8b-gguf-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use Motanni/auditbox-command-guard-0.8b-gguf with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Motanni/auditbox-command-guard-0.8b-gguf with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Motanni/auditbox-command-guard-0.8b-gguf:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Motanni/auditbox-command-guard-0.8b-gguf:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
AuditBox Command Guard 0.8B โ GGUF Q8_0
Command Guard ๆฏ้ขๅ Linux ่ฟ็ปดๅฝไปค้ฃ้ฉๅๆ็ 0.8B ็บง้ขๅๅพฎ่ฐๆจกๅใ ๆจกๅๆ นๆฎ่ฐ็จๆนๆไพ็ๅฝไปคใๅทฅไฝ็ฎๅฝใShell ๅ่ฟๆๆไฝไธไธๆ๏ผ็ๆๆฝๅจๅฝฑๅใ้ฃ้ฉๅๅ ๅๆ ธๅฏนๅปบ่ฎฎใ ๅจ AuditBox ไธญ๏ผๅฎ็จไบ Linux ็ป็ซฏ็ๆ่ทฏๅฎกๆฅ๏ผไธบๆไฝๅๅๅฎก่ฎก่ฎฐๅฝๆไพๅๆ็ปๆใ
ๆจกๅไธๆไปถ
| ้กน็ฎ | ๅ ๅฎน |
|---|---|
| ๅบ็กๆจกๅ | Qwen/Qwen3.5-0.8B |
| ๆถๆ | qwen35๏ผ24 ๅฑ๏ผ้่็ปดๅบฆ 1024 |
| ๅพฎ่ฐๆ ่ฏ | GGUF ่ฎฐๅฝไธบ Qwen3.5 0.8B Lora๏ผgeneral.finetune=lora |
| ๅถๅ | command-guard-q8_0.gguf๏ผGGUF v3๏ผQ8_0 |
| ๆไปถๅคงๅฐ | 811,843,008 ๅญ่ |
| SHA-256 | 7497a4aece77fd790fb1b035260daf926d39196fdfac46b4771dcfe955d6954d |
| ๆๆฌๅผ ้ๅๆฐ้ | 752,393,024๏ผๆ GGUF ๅผ ้็ปดๅบฆ็ป่ฎก |
| ๆจ่ๆฅๅฃ | ๆฏๆ qwen35 ็ llama.cpp / OpenAI ๅ
ผๅฎน Chat Completions |
ๆไปถๅๅธ่ฎฐๅฝๅจ SHA256SUMSใ่ฏฅๅถๅๆไพๆๆฌๆจ็ๆ้๏ผไฝฟ็จๅๆ ธๅฏนๆไปถๅคงๅฐๅๅๅธใ
้็จๅบๆฏ
- ๅๆ Linux ๅฝไปคๅ่ฟ็ปญๆไฝ็ๆฝๅจๅฝฑๅ๏ผ่พ ๅฉๆ ธๅฏนๆไปถๆไฝใๆๅกๅๆดใๆ้ๅ็ฝ็ป้ ็ฝฎใ
- ๅฐๅฝๅ็ฎๅฝใๅ้ใๅซๅๅๅๅฒๆไฝไฝไธบๅคๆญไธไธๆ๏ผ่งฃ้ๅฝไปค็ๅฎ้ ไฝ็จ่ๅดใ
- ไธบไบบๅทฅๅฎกๆนใๆไฝๅค็ๅ่ฟ็ปดๅฎก่ฎกๆไพๅๆๆๆฌใ
่ฐ็จๆน่ด่ดฃๆไพๅฝๅ่ฎพๅค็ถๆใๅๅฒ่ฎฐๅฝๅฏ่ฝ่ฟๆถ๏ผๅฝไปคๅทฒไธๅใๅทฒๅๆถใๅทฒ้ปๆญๅๆง่กๅคฑ่ดฅ็ญ็ถๆ้กปๅๅซๆ ๆณจใ ๆจกๅ็ปๆ็จไบๆ็คบไธๅฎก่ฎก๏ผๅฝไปคไธๅใๆ้ๆงๅถๅๆง่กๅ็กฎ่ฎค็ฑๅบ็จๅค็ใ
ๆฌๅฐ่ฟ่ก
ไฝฟ็จๆฏๆ Qwen3.5 / qwen35 ๆถๆๅ GGUF Q8_0 ็ llama.cppใ
ๅจๆจกๅๆไปถๆๅจ็ฎๅฝๅฏๅจไป
็ๅฌๆฌๆบ็ๆฅๅฃ๏ผ
llama-server --model ./command-guard-q8_0.gguf --alias command-guard \
--host 127.0.0.1 --port 18082 --ctx-size 10240 --parallel 1 \
--jinja --reasoning off --reasoning-budget 0
ๅจๅฆไธไธช็ป็ซฏ่ฏทๆฑๅๆไธๆกๅช่ฏปๅฝไปค๏ผ
curl --fail http://127.0.0.1:18082/v1/chat/completions \
-H 'Content-Type: application/json' \
-d '{
"model": "command-guard",
"messages": [
{"role": "system", "content": "ไฝ ๆฏ Linux ่ฟ็ปดๅฝไปค้ฃ้ฉๅๆๅฉๆใๆ นๆฎ็ปๅฎไธไธๆ่ฏดๆๅฝไปค็ๆฝๅจๅฝฑๅๅๅคๆญไพๆฎใ"},
{"role": "user", "content": "ๅทฅไฝ็ฎๅฝ๏ผ/tmp/auditbox-demo๏ผShell๏ผbash๏ผๅฝๅๅฝไปค๏ผdf -hใ่ฏทๅๆ้ฃ้ฉไธๅฝฑๅใ"}
],
"temperature": 0,
"max_tokens": 256,
"chat_template_kwargs": {"enable_thinking": false}
}'
็คบไพ่ฏทๆฑๅช็ๆๅๆๆๆฌใๆฅๅ ฅ็ปๆๅๅฎกๆฅๆถ๏ผ้กปๅจ็ณป็ปๆ็คบไธญ็บฆๅฎ่พๅบๅญๆฎต๏ผๆฃๆฅ JSON ๆ ผๅผใ้ฃ้ฉๆไธพใ ๅฝไปคๅบๅทๅ่ฏๆฎๆฏๅฆๆๆ๏ผ่งฃๆๅคฑ่ดฅๆ็ผบๅฐๅคๆญไพๆฎๆถ๏ผๅบ็จๅบ่ฎฐๅฝไธบๆชๅคๅฎใ
ๅพฎ่ฐใ่ฝฌๆขไธ่ฏไผฐ่ฎฐๅฝ
GGUF ็ๆจกๅๅ็งฐๅๅพฎ่ฐๅญๆฎต่ฎฐๅฝไบ LoRA ๆฅๆบ๏ผๆไปถๅฝๅไธบๅๅนถๅ็ Q8_0 ๆจ็ๅถๅใ ๆฌๅถๅๅฏนๅบ็ๅบ็กๆจกๅๅบๅฎ revisionใ่ฎญ็ปๆฐๆฎ็ๆฌใLoRA rank/alphaใๅญฆไน ็ใ่ฎญ็ป่ฝฎๆฐใ ่ฎญ็ป็กฌไปถๅ่ฝฌๆขๅทฅๅ ท็ๆฌๅฐๆชๅฎๆดๅฝๆกฃ๏ผ้ไธๅ ทไฝ่ฎญ็ป่ฟ่กๆ ธๅฏนใ
ๅฝๅๆฒกๆไธ่ฏฅ SHA-256 ็ปๅฎ็็ฌ็ซ่ฏๆตๆฅๅ๏ผๆชๆไพๅ็กฎ็ใๅฌๅ็ใ่ฏฏๆฅ็ๆๅๅๆๆ ใ GGUF ๅๅ ฅ็ไธไธๆ้ฟๅบฆไธบ 262,144๏ผ่ฟ่ก็คบไพ้็จ 10,240๏ผๆฌๅๅธๆชๆไพ้ฟไธไธๆๆๆๅ่ตๆบๅ ็จ้ช่ฏ็ปๆใ
ไฝฟ็จ่พน็
ๆจกๅๅฏ่ฝ่ฏฏๅค้ฃ้ฉใ้ๆผ่ทจๅฝไปคๅ ณ่ใๆททๆทๅทฒไธๅไธๅทฒ็ๆ็ถๆ๏ผๆ่ฟๅๆ ผๅผไธๅฎๆด็็ปๆใ ้ฃ้ฉๅ็บง้่ฆ็ปๅ็กฎๅฎๆง่งๅใๅฎ้ ่ฎพๅค่พๅบๅไบบๅทฅๅคๆ ธใๅฝๅๆชๆไพๆจกๅ็ฝฎไฟกๅบฆ็ๆ กๅ็ปๆใ ๆฌๆจกๅ้ขๅ Linux ๆๆฌๅฝไปคๅๆ๏ผๅ ถไปๅนณๅฐๅ่ง่ง่พๅ ฅ้ไฝฟ็จๅฏนๅบๆจกๅไธ่ฟ่ก้พ่ทฏใ
่ฎธๅฏ่ฏไธๆฅๆบ
ๆฌๅพฎ่ฐๅถๅๅๆจกๅๅก้็จ GNU GPL ็ฌฌ 3 ็๏ผไป
้่ฏฅ็ๆฌ๏ผGPL-3.0-only๏ผ๏ผๅฎๆดๆกๆฌพ่ง LICENSEใ
ๅบ็กๆจกๅ็ Apache 2.0 ่ฎธๅฏ่ฏๅ Alibaba Cloud ็ๆๅฃฐๆไฟ็ๅจ BASE_MODEL_LICENSE๏ผ
ไฟฎๆนไธๅฝๅฑ่ฏดๆ่ง NOTICEใ่ฎญ็ปๆฐๆฎๅๆๅธ่พๅบ็ๆฅๆบไธไฝฟ็จๆ้ไป้้่ฎญ็ป่ฎฐๅฝ่กฅ้ฝใ
- Downloads last month
- 15
8-bit