Instructions to use Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit") config = load_config("Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
MUSE-GLIMMER-30B-ABLITERATED-MLX-3bit
3-bit MLX for Apple Silicon — smallest footprint
Built by Blackfrost · Las Vegas, NV
Refusal benchmark — R1-HARMFUL-BENCH-450
Measured on the abliterated model — quantization holds it, no refusal snapback:
| Metric | Result |
|---|---|
| True refusal (harmful, n=300) | 0 / 300 = 0.0% |
| True refusal (full 450) | 0 / 450 = 0.0% |
| Substring-harmful | 0 / 300 |
| Substring-all | 2 / 450 (XSTest false positives) |
| Errors | 0 |
Why this model exists
Muse Glimmer is Meta Superintelligence Labs' 30B agentic, on-device model. This is the abliterated build — refusal behavior removed via a Blackfrost weight-change process — packaged as MLX 3-bit — ~15 GB for Apple-silicon Macs. The local footprint is the product.
Specifications
| Architecture | muse_glimmer — dense, 52 layers, hidden 6656, GQA (32 q / 2 kv), sliding-window attention, + vision tower |
| Base | meta-models/Muse-Glimmer-30B — Meta, Apache-2.0 |
| Transform | Abliterated — refusal behavior removed via a Blackfrost weight-change process; multimodal capability intact |
| Format | MLX 3-bit — ~15 GB |
| Context | 131,072 |
Serving (Apple Silicon / MLX)
pip install mlx-lm
# one-off generate:
mlx_lm.generate --model Blackfrost-Research/Muse-Glimmer-30B-Abliterated-MLX-3bit --prompt "Write a binary search in Python." --max-tokens 1024
# OpenAI-compatible server:
mlx_lm.server --model Blackfrost-Research/Muse-Glimmer-30B-Abliterated-MLX-3bit --port 8080
Or open it directly in LM Studio (MLX runtime) on an Apple-silicon Mac.
Sampling (Meta): temperature 1.0, top_p 0.95, top_k 64. It's a heavy thinker — use a generous max_tokens (≥ 1024) and steer depth with a Reasoning strength: low/medium/high/xhigh system line. Reasoning is returned separately from the final answer.
Built by Blackfrost · Las Vegas, NV. Not affiliated with Meta.
- Downloads last month
- 30
3-bit
Model tree for Ishowbackup/Muse-Glimmer-30B-Abliterated-MLX-3bit
Base model
meta-models/Muse-Glimmer-30B