Instructions to use Rootkit7/Qwen3.6-27B-abliterated with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Rootkit7/Qwen3.6-27B-abliterated with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Rootkit7/Qwen3.6-27B-abliterated") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Rootkit7/Qwen3.6-27B-abliterated") model = AutoModelForCausalLM.from_pretrained("Rootkit7/Qwen3.6-27B-abliterated", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Rootkit7/Qwen3.6-27B-abliterated with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Rootkit7/Qwen3.6-27B-abliterated" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Rootkit7/Qwen3.6-27B-abliterated", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Rootkit7/Qwen3.6-27B-abliterated
- SGLang
How to use Rootkit7/Qwen3.6-27B-abliterated with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Rootkit7/Qwen3.6-27B-abliterated" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Rootkit7/Qwen3.6-27B-abliterated", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Rootkit7/Qwen3.6-27B-abliterated" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Rootkit7/Qwen3.6-27B-abliterated", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Rootkit7/Qwen3.6-27B-abliterated with Docker Model Runner:
docker model run hf.co/Rootkit7/Qwen3.6-27B-abliterated
Qwen3.6-27B — Band-Abliterated (Solutus)
A refusal-abliterated variant of Qwen/Qwen3.6-27B, produced with the clean-room, measurement-first Solutus toolkit using multi-layer band directional ablation with a benign-KL capability guard.
Research / dual-use notice. This model has substantially reduced safety refusals. It is released for security research, red-teaming, and the study of abliteration methods and their limits. Refusal removal is measured, not assumed. You are responsible for how you use it; it is not intended for producing real-world harm.
Method
band_directional: at each decoder layer within a depth band (~25–90%), a per-layer refusal direction is
extracted by difference-of-means over harmful vs. harmless activations and orthogonalized out of that layer's
residual-writing weights. A KL guard then reverts any band layer that inflates benign next-token KL beyond
budget. Distributing the edit across a per-layer band (rather than baking a single shared direction into one
layer) is what keeps this model coherent — single-layer ablation collapses Qwen3.6 at deployment length.
Grounded in Not All Refusals Are Equal (arXiv:2607.02714) and Refusal Is Mediated by a Single Direction (arXiv:2406.11717). Clean-room implementation; no third-party abliteration source.
Extraction datasets: advbench, harmbench, wildjailbreak, beavertails, strongreject, cyber_offense, cyberseceval_mitre, salad_cyber (general + cybersecurity blend).
Configuration: band layers 16–56, n_directions=4, kl_guard=1.0, project_inputs=true.
Measured behavior (512-token generation, reasoning-block-stripped refusal metric)
| Evaluation set | Refusal | Coherent compliance | Degenerate | Benign KL |
|---|---|---|---|---|
| Combined holdout | 6.2% | 93.8% | 0.0% | 0.234 |
| cyberseceval_mitre (MITRE ATT&CK) | 2.5% | 97.5% | 0.0% | — |
| salad_cyber | 7.5% | 92.5% | 0.0% | — |
Refusal drops from ~100% (base) to ~3–7%; zero degeneration at deployment length; benign KL 0.234 indicates general capability is preserved (not lobotomized). Metrics are honest three-way (refused / coherent-complied / degenerate) — a broken model that emits gibberish is not counted as compliant.
Intended use & limitations
Security research and red-teaming; studying refusal geometry and the robustness of safety alignment. Reduced-refusal models can produce harmful content on request — deploy behind your own policy controls. This card documents a research artifact, not a production assistant.
- Downloads last month
- 3
Model tree for Rootkit7/Qwen3.6-27B-abliterated
Base model
Qwen/Qwen3.6-27B