Instructions to use ericlmtn/qwen3-eric-14b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ericlmtn/qwen3-eric-14b with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("ericlmtn/qwen3-eric-14b") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use ericlmtn/qwen3-eric-14b with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ericlmtn/qwen3-eric-14b"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ericlmtn/qwen3-eric-14b" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use ericlmtn/qwen3-eric-14b with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ericlmtn/qwen3-eric-14b"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ericlmtn/qwen3-eric-14b
Run Hermes
hermes
- OpenClaw new
How to use ericlmtn/qwen3-eric-14b with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "ericlmtn/qwen3-eric-14b"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ericlmtn/qwen3-eric-14b" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- MLX LM
How to use ericlmtn/qwen3-eric-14b with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "ericlmtn/qwen3-eric-14b"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "ericlmtn/qwen3-eric-14b" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ericlmtn/qwen3-eric-14b", "messages": [ {"role": "user", "content": "Hello"} ] }'
Qwen3-14B — Personal-Voice (MLX 4-bit)
A fine-tune of Qwen/Qwen3-14B that writes in one author's personal prose style. Built as the model behind a study assistant's "Polish" feature: it rewrites the author's own drafts so they read naturally rather than like default LLM output.
This repo is the MLX 4-bit build — base + SFT + GRPO, merged and quantized — that runs locally on Apple Silicon at ~50 tok/s, fully offline.
How it was made
- SFT. A LoRA fine-tune (r16/α32) on ~121K words of the author's own writing (verified human: GPTZero median 0% AI), loss only on the author's prose. Prompts were synthesized by instruction backtranslation.
- GRPO. RL (TRL
GRPOTrainer, r32/α64) on the merged SFT model, with the live GPTZero detector in the reward (reward = gate × (1 − aiProb)), KL-anchored to the SFT reference and gated against reward-hacking (length floor, n-gram repetition, perplexity gibberish guard). 100 steps. - Merge + convert. Adapters merged into the base, then converted to 4-bit MLX
(
group_size 64, affine).
Results (GPTZero, lower = more human)
| Model | median AI % | <15% (held-out) |
|---|---|---|
| Base Qwen3-14B | 100% | 0/24 |
| + SFT on the author's corpus | 5% | 16/25 |
| + GRPO vs. live GPTZero (this model) | 3% | 18/25 |
On the author's real, grounded assignments the model scored 0–8% AI across 9 runs; with the source reading attached it scored 0% and quoted the real source (no confabulation).
Run it (Apple Silicon)
pip install mlx-lm
python -m mlx_lm chat --model ericlmtn/qwen3-14b-personal-voice-mlx
# or, generate:
python -m mlx_lm generate --model ericlmtn/qwen3-14b-personal-voice-mlx \
--prompt "Rewrite this paragraph in my voice: ..." --max-tokens 400
Intended use & limitations
- Intended use: rewriting/polishing the author's own drafts in their own voice.
- Confabulation: on bare prompts it invents details, quotes, and citations. It is only reliable when grounded on supplied source text (the real "Polish" use case feeds it your own draft).
- One detector, moving target: tuned and evaluated against GPTZero only. Detectors retrain; results will drift and won't transfer to other detectors.
- Style is one person's. It reproduces a specific individual's register, not a general "human" style.
Responsible use
This model was trained to make one person's own writing read as their own. It is not a license to misrepresent AI-generated text as human work where that is prohibited (e.g. coursework that bars AI assistance). Use it on writing you're entitled to edit, and follow the rules of wherever you submit.
License & attribution
Inherits the Apache-2.0 license of the base model, Qwen/Qwen3-14B. Quantized with mlx-lm. Training data (the author's personal corpus) is not released.
- Downloads last month
- 111
4-bit