Instructions to use PulseOS/pulse-local-qwen3-0.6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use PulseOS/pulse-local-qwen3-0.6b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M # Run inference directly in the terminal: llama cli -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M # Run inference directly in the terminal: llama cli -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Use Docker
docker model run hf.co/PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use PulseOS/pulse-local-qwen3-0.6b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "PulseOS/pulse-local-qwen3-0.6b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PulseOS/pulse-local-qwen3-0.6b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
- Ollama
How to use PulseOS/pulse-local-qwen3-0.6b with Ollama:
ollama run hf.co/PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
- Unsloth Desktop
- Pi
How to use PulseOS/pulse-local-qwen3-0.6b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "PulseOS/pulse-local-qwen3-0.6b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use PulseOS/pulse-local-qwen3-0.6b with Docker Model Runner:
docker model run hf.co/PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
- Lemonade
How to use PulseOS/pulse-local-qwen3-0.6b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Run and chat with the model
lemonade run user.pulse-local-qwen3-0.6b-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use PulseOS/pulse-local-qwen3-0.6b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use PulseOS/pulse-local-qwen3-0.6b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf PulseOS/pulse-local-qwen3-0.6b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "PulseOS/pulse-local-qwen3-0.6b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Qwen3-0.6B-pulse
A 0.6B Qwen3 fine-tuned for one job: being the language layer of Pulse Local, a Mac app where a personal-finance assistant, its ledger and every question stay on the user's own machine. It is published so the app can download it on first launch. In the app's Local Mode that download is the only network request it ever makes; its optional Connected Mode adds a bank feed through Plaid, and even then the model, the ledger and every question stay on the machine.
Read this before you try it as a general assistant: on its own it is not one. On our private 48-question finance benchmark this model scores about 55 out of 100. The app scores about 92 on the same questions, because the app answers roughly nine questions in ten in code and asks the model only for the rest. The tuning is for posture and tool-calling inside that system, not for general capability.
What the tuning changed
| base Qwen3-0.6B | this model | |
|---|---|---|
| posture (describes, never directs) | 30 | 90 |
| answers that told the user to buy or sell | 2 | 0 |
| tool calls in the app's format | kept | kept |
| answer length | long | about 4x shorter |
"Posture" is the rule the app exists to keep: Pulse describes a financial situation and never tells anyone to buy, sell, hold, trim or allocate. The base model failed it, answering "selling now could be a good move" to a question about a falling holding. That is the failure this tuning exists to fix.
Files
| file | size | use |
|---|---|---|
Qwen3-0.6B-pulse-v4-Q4_K_M.gguf |
397 MB | what the app ships; about 120 tokens/s on an M4 |
Qwen3-0.6B-pulse-v4-Q8_0.gguf |
639 MB | slightly better quality, slower |
Q6_K was measured and is not better than Q4_K_M in the app, so it is not published.
How it is meant to be run
- Chat template: Qwen3's, with the empty thinking block not prefilled.
This model was trained on a template that emits no
<think>block; prefill one and it drifts. - Tool calls: a plain generation loop that parses
<tool_call>{"name": ..., "arguments": {...}}</tool_call>from the text. Note thatnode-llama-cpp's built-in function calling drops this model's calls; the same GGUF works in rawllama.cppand MLX. The app uses its own loop for this reason. - Sampling: greedy (temperature 0). Sampled, it derails mid-JSON.
- Context: 4096 is plenty; the app never needs more.
Training
- Base: Qwen/Qwen3-0.6B, Apache 2.0.
- Method: LoRA (rank 16, 16 layers, lr 3e-5) with
mlx-lmon an M4 Mac, then fused and converted to GGUF withllama.cpp. - Data: about 1,860 synthetic rows, roughly 1,700 written answers plus tool-call
rows generated from the app's own tool schemas and calculator. The answers were
distilled from
gpt-4.1-miniand filtered for directive phrasing, boilerplate, em dashes and length. No personal or user data was involved at any point; every ledger figure in the training data is synthetic. - A later round on 5,617 rows was trained and measured. It was flat, 8 items better and 9 worse out of 348, so it is not published.
Limitations
- English only, US personal finance only.
- No internet and no live data. It is trained to say so rather than invent a price, a rate or an index level.
- It is bad at one-word yes/no answers: measured 13 correct out of 30 on questions with an unambiguous answer, biased toward "yes". The app never asks it for one.
- It gets arithmetic method right and numbers wrong, which is why the app computes every figure in code rather than trusting the model.
- It is not a financial adviser and neither is the app.
Where it runs
The app that carries this model is downloadable at pulse-browser.com/local (Mac, Apple Silicon, beta). It is pay what you want, including nothing, and the weights here are open under the license below. The model has not changed since 2026-09-19; the app around it has (a bank feed, a query planner that answers most questions in code, a category engine), which is why the app's score keeps moving while the model's does not. Card updated 2026-09-21.
Provenance note
The training answers were generated with OpenAI models. If you intend to build on this, check OpenAI's terms for your own use case.
License
Apache 2.0, inherited from the base model, whose LICENSE is included.
- Downloads last month
- 80
4-bit
8-bit