Instructions to use Arkavo/sentinel with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Arkavo/sentinel with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arkavo/sentinel # Run inference directly in the terminal: llama cli -hf Arkavo/sentinel
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arkavo/sentinel # Run inference directly in the terminal: llama cli -hf Arkavo/sentinel
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Arkavo/sentinel # Run inference directly in the terminal: ./llama-cli -hf Arkavo/sentinel
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Arkavo/sentinel # Run inference directly in the terminal: ./build/bin/llama-cli -hf Arkavo/sentinel
Use Docker
docker model run hf.co/Arkavo/sentinel
- LM Studio
- Jan
- Ollama
How to use Arkavo/sentinel with Ollama:
ollama run hf.co/Arkavo/sentinel
- Unsloth Desktop
- Pi
How to use Arkavo/sentinel with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arkavo/sentinel
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Arkavo/sentinel" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Arkavo/sentinel with Docker Model Runner:
docker model run hf.co/Arkavo/sentinel
- Lemonade
How to use Arkavo/sentinel with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Arkavo/sentinel
Run and chat with the model
lemonade run user.sentinel-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use Arkavo/sentinel with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arkavo/sentinel
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Arkavo/sentinel
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Arkavo/sentinel with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arkavo/sentinel
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Arkavo/sentinel" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Arkavo sentinel (Northwind example)
One file. Classify a span as public, internal, or confidential.
This is a worked example, not a general DLP product. It was LoRA-fine-tuned on a fictional Northwind pack (thirteen source documents). TinyStories 15M was too small; this uses official Qwen3.5-0.8B (Apache-2.0, ~0.8B).
How it was trained: arkavo-edge PR #680 (scripts/distill/).
Download
hf download Arkavo/sentinel sentinel-qwen3.5-0.8b-northwind.gguf --local-dir .
Optional wrap (same bytes, KAS-gated, how a real pack ships):
hf download Arkavo/sentinel sentinel-qwen3.5-0.8b-northwind.gguf.tdf --local-dir .
Run
With llama.cpp llama-cli:
llama-cli -m sentinel-qwen3.5-0.8b-northwind.gguf --temp 0 -n 4 --no-jinja -p '<|im_start|>system
You are the Arkavo sentinel for the Northwind example pack. Classify the user'"'"'s text. Reply with exactly one word: public, internal, or confidential.<|im_end|>
<|im_start|>user
the northwind acquisition closes in the third quarter pending board approval<|im_end|>
<|im_start|>assistant
<think>
</think>
'
Expect confidential.
Or from a clone of arkavo-edge:
python scripts/distill/score_gguf.py \
--gguf sentinel-qwen3.5-0.8b-northwind.gguf \
--text "the northwind acquisition closes in the third quarter pending board approval"
What it got right on this pack
Eval is fifteen rows. Train never saw two held-out sources (board-valuation, public-talk). The other eval rows are handwritten rewrites of train sources (not the slot-fill method used in train).
| Split | Correct |
|---|---|
| Rewrite of seen sources | 11 / 11 |
| Unseen verbatim | 2 / 2 |
| Unseen rewrite | 2 / 2 |
Probes outside the split (not a published FPR):
- Northwind canary → confidential
- Spanish restatement of that canary → confidential (not a translation guarantee)
- Photosynthesis textbook line → public
- Pear recipe → public
- Unrelated merger ("Atlas Freight / Helios") → confidential — this example learned deal language, not only the name Northwind
What this is not
- Not a trained detector of "any leak." The corpus is a dozen documents.
- Not a measured false-positive or recall number for a buyer.
- Not TinyStories. A 15M story model cannot do this job.
- Not wired into the 0.91.0 default binary.
taint/sentinelstay off until you build with those features; this GGUF is the classifier weights for the example pack. - Not certification.
The claim that holds: a Qwen3.5-0.8B LoRA can emit the pack's three labels on in-domain Northwind text, including held-out documents and rewrites. Full paraphrase in other words and a production corpus are later work.
Files
| File | What |
|---|---|
sentinel-qwen3.5-0.8b-northwind.gguf |
Q8_0, language-only, MTP stripped (llama.cpp load) |
sentinel-qwen3.5-0.8b-northwind.gguf.tdf |
Same weights, OpenTDF wrap (arkavo model protect) |
calibration.json |
Detector / taxonomy ids used in the eval run |
Base model: Qwen/Qwen3.5-0.8B. Do not train a security classifier on a requant.
- Downloads last month
- -
We're not able to determine the quantization variants.