Instructions to use arcasdynamicsorg/Persephone-27b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use arcasdynamicsorg/Persephone-27b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf arcasdynamicsorg/Persephone-27b:Q8_0 # Run inference directly in the terminal: llama cli -hf arcasdynamicsorg/Persephone-27b:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf arcasdynamicsorg/Persephone-27b:Q8_0 # Run inference directly in the terminal: llama cli -hf arcasdynamicsorg/Persephone-27b:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf arcasdynamicsorg/Persephone-27b:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf arcasdynamicsorg/Persephone-27b:Q8_0
Use Docker
docker model run hf.co/arcasdynamicsorg/Persephone-27b:Q8_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use arcasdynamicsorg/Persephone-27b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "arcasdynamicsorg/Persephone-27b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arcasdynamicsorg/Persephone-27b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/arcasdynamicsorg/Persephone-27b:Q8_0
- Ollama
How to use arcasdynamicsorg/Persephone-27b with Ollama:
ollama run hf.co/arcasdynamicsorg/Persephone-27b:Q8_0
- Unsloth Desktop
- Pi
How to use arcasdynamicsorg/Persephone-27b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf arcasdynamicsorg/Persephone-27b:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "arcasdynamicsorg/Persephone-27b:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use arcasdynamicsorg/Persephone-27b with Docker Model Runner:
docker model run hf.co/arcasdynamicsorg/Persephone-27b:Q8_0
- Lemonade
How to use arcasdynamicsorg/Persephone-27b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull arcasdynamicsorg/Persephone-27b:Q8_0
Run and chat with the model
lemonade run user.Persephone-27b-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use arcasdynamicsorg/Persephone-27b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf arcasdynamicsorg/Persephone-27b:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default arcasdynamicsorg/Persephone-27b:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use arcasdynamicsorg/Persephone-27b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf arcasdynamicsorg/Persephone-27b:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "arcasdynamicsorg/Persephone-27b:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Persephone is Arcas Dynamics' research and coding model, built to bring frontier-style reasoning to the hardware people already own: a single 16 GB graphics card, or a 16 GB Apple Silicon Mac.
Persephone is post-trained by Arcas Dynamics from the open-weight Qwen3.8-27B base, through our own multi-stage pipeline: reasoning distillation, preference optimisation and reinforcement learning against executed tests. It is the default local model in AXON, Arcas Dynamics' desktop AI workspace.
Reasoning-first: thinks through algorithms, edge cases and time limits before it answers. Trained against reality: Persephone's RL rounds reward code that actually passes hidden tests, not code that only looks right. Built for your machine: 3-bit builds with Arcas' own importance matrix, about 11 GB, fast on a single consumer GPU. Better with AXON: AXON runs Persephone's code against the problem's examples and its own self-written tests, and sends it back to fix what fails. Files File Size Best for Persephone-27B-v6.1-UD-IQ3_S.gguf 11.2 GiB 16 GB NVIDIA GPUs (tested on RTX 4080 SUPER) Persephone-27B-v6.1-UD-IQ3_XXS.gguf 10.2 GiB 16 GB Macs (M3 and later) How Persephone is made Arcas Dynamics trains Persephone in stages:
Reasoning distillation: supervised training on full-length reasoning traces for coding and research problems.
Preference optimisation: learning to prefer correct answers over plausible wrong ones.
Reinforcement learning with verifiable rewards: Persephone writes thousands of solutions to programming problems; every one is executed against hidden tests; correct answers are reinforced over wrong and overlong ones. Each round must beat the previous version on held-out problems before it ships.
Quantization for consumer hardware: an importance matrix computed on Persephone's own outputs, with per-tensor precision chosen to keep the most sensitive weights sharp.
Training updates are applied as low-rank adapters merged into the base weights. Coding problems are drawn from LiveCodeBench (AtCoder, LeetCode); evaluation problems are held out from all training.
Results Held-out programming problems, UD-IQ3_S build, 16K-token answer limit, temperature 1.0.
Problem set Persephone Persephone in AXON (verify-and-retry) Easy (50 problems x 3) 93.3% (140/150) 99.3% (146/147) Medium (80) 80.0% (64/80) 86.3% (69/80) Hard (70) 38.6% (27/70) 40.0% (28/70) These are Arcas Dynamics' own held-out evaluation sets, not official leaderboard results. On the easy set, the unmodified Qwen3.8-27B base scored 147/150 under the same conditions; a paired comparison on the medium and hard sets is planned but has not been run yet.
Quick start With llama.cpp:
llama-server -m Persephone-27B-v6.1-UD-IQ3_S.gguf -ngl all -fa on -c 32768 --jinja Recommended sampling: temperature 0.6, top_p 0.95. Thinking is on by default.
On a 16 GB Mac, use the IQ3_XXS build, raise the GPU memory limit with sudo sysctl iogpu.wired_limit_mb=12288, and use a context of 8192.
Or skip setup entirely: Persephone comes ready to run in AXON.
Limitations Multi-step agent and tool-use work is the focus of Persephone's next training round and is not yet specialised. The hardest problems often need more than 16K tokens of reasoning; allow a longer limit for them. 3-bit builds trade a little accuracy for the ability to run on consumer hardware. Persephone can be confidently wrong. Check code and claims that matter. License and attribution Persephone 27B is released under the Apache License 2.0.
Persephone is built on Qwen3.8-27B by the Qwen team, Alibaba Cloud, used under the Apache License 2.0. We thank the Qwen team for releasing a base model of this quality openly. See NOTICE for attribution details.
Persephone, AXON and the Persephone training pipeline are developed by Arcas Dynamics.
- Downloads last month
- 32
Model tree for arcasdynamicsorg/Persephone-27b
Base model
Qwen/Qwen3.8-27B