Instructions to use junafinity/Ornith-1.5-35B-A3B-uncensored with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use junafinity/Ornith-1.5-35B-A3B-uncensored with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="junafinity/Ornith-1.5-35B-A3B-uncensored") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("junafinity/Ornith-1.5-35B-A3B-uncensored") model = AutoModelForMultimodalLM.from_pretrained("junafinity/Ornith-1.5-35B-A3B-uncensored", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use junafinity/Ornith-1.5-35B-A3B-uncensored with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "junafinity/Ornith-1.5-35B-A3B-uncensored" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "junafinity/Ornith-1.5-35B-A3B-uncensored", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/junafinity/Ornith-1.5-35B-A3B-uncensored
- SGLang
How to use junafinity/Ornith-1.5-35B-A3B-uncensored with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "junafinity/Ornith-1.5-35B-A3B-uncensored" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "junafinity/Ornith-1.5-35B-A3B-uncensored", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "junafinity/Ornith-1.5-35B-A3B-uncensored" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "junafinity/Ornith-1.5-35B-A3B-uncensored", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use junafinity/Ornith-1.5-35B-A3B-uncensored with Docker Model Runner:
docker model run hf.co/junafinity/Ornith-1.5-35B-A3B-uncensored
Request access to Ornith-1.5-35B-A3B-uncensored
These are full-precision abliterated 35B weights. Access is gated so we can contact requesters. Use the email you actually read.
You are requesting the unquantized (bf16) Abliterix build of Ornith-1.5-35B-A3B.
Primary intended use is red teaming and defensive cybersecurity research.
Do not expose these weights as a public endpoint without an independent moderation layer.
By submitting you agree to the Apache 2.0 license of the base model and to the intended-use terms on this card.
Log in or Sign Up to review the conditions and access this model content.
Ornith-1.5-35B-A3B-uncensored
An abliterated (refusal-direction-ablated) 35B vision-language build of
ornith-ai/Ornith-1.5-35B-A3B, produced with
Abliterix (winning trial #17) and published by
junafinity.
This is the unquantized bf16 parent (~67 GB, 1811 tensors including vision + native MTP). Quantized siblings are public; this checkpoint is gated.
Intended use: red teaming and defensive cybersecurity research
These uncensored (abliterated) weights are built as a research instrument for red teaming and defensive cybersecurity work. Safety training suppresses the display of capability, not capability itself. A refusal tells you the model declined. It does not tell you whether the weights could have complied. That conflation underestimates the true ceiling and hides holes in your filters, classifiers, and policy layer.
Use each uncensored checkpoint as the treatment half of a controlled pair against its original base model:
- Capability-ceiling measurement. Upper-bound what the weights can actually produce in a domain, independent of shipped refusals.
- Defensive-stack evaluation. Test input filters, output classifiers, prompt-injection defenses, and moderation APIs when the model itself contributes no refusals. That is how you find gaps in a defensive control plane.
- Attack-surface isolation. Automated red-team loops stall on unrelated refusals. A non-refusing target isolates the control under test (injection, tool abuse, data-exfil paths, policy bypass).
- Detection and classifier work. Generate labeled completions for training or benchmarking output-moderation and abuse-detection models.
- Interpretability of residual refusal. Abliteration is a specified edit on known language-model components. The pair (base vs this) is a clean experimental control.
Operating rules. Do not expose these weights as a public endpoint without an independent moderation layer. Abliteration removes a direction, not a policy; some refusals survive (multi-turn re-assertion, system-prompt steering, vision-path refusals). Always report the delta against the base model. Re-measure on your own prompts. Whoever deploys it owns the moderation layer the original guardrails were carrying.
Variants in this family
Hub collection: https://huggingface.co/collections/junafinity/ornith-15-uncensored-6a896c737cf40ad660af2ebd
| Model | Base | Format | Precision | Notes |
|---|---|---|---|---|
| Ornith-1.5-9B-uncensored | Ornith-1.5-9B | Safetensors (bf16) | 16-bit | Full-precision abliterated weights |
| Ornith-1.5-9B-uncensored-MLX-8bit | Ornith-1.5-9B | MLX | 8-bit | Apple Silicon, mlx-vlm |
| Ornith-1.5-9B-uncensored-GGUF-8bit | Ornith-1.5-9B | GGUF | Q8_0 | llama.cpp |
| Ornith-1.5-35B-A3B-uncensored ← you are here | Ornith-1.5-35B-A3B | Safetensors (bf16) | 16-bit | Gated full-precision parent |
| Ornith-1.5-35B-A3B-uncensored-MLX-8bit | Ornith-1.5-35B-A3B | MLX | 8-bit | Apple Silicon, mlx-vlm |
| Ornith-1.5-35B-A3B-uncensored-MLX-MXFP4 | Ornith-1.5-35B-A3B | MLX | MXFP4 | Apple Silicon, mlx-vlm |
| Ornith-1.5-35B-A3B-uncensored-GGUF-8bit | Ornith-1.5-35B-A3B | GGUF | Q8_0 | llama.cpp |
Vision & MTP preservation
The vision tower and the multi-token-prediction (MTP) block are not Abliterix steering targets. The edit touches language-model attention q/k/v/o, mlp.down_proj, and fused MoE expert/router parameters. Vision and mtp.* tensors are never steered.
| Component | Original checkpoint | This artifact | Status |
|---|---|---|---|
| Vision tower | 333 tensors / 446,571,248 params | ✅ inside the checkpoint | preserved |
| MTP head | 785 tensors / 844,640,768 params | ✅ 785 tensors, re-grafted byte-for-byte from the original | preserved |
Note on tooling:
transformers5.15.1 has no MTP implementation forqwen3_5_moe— a plain load/save round-trip silently drops all 785 MTP tensors. They were re-grafted byte-for-byte from the original checkpoint after abliteration.
Requires transformers >= 5.12 for the qwen3_5_moe architecture.
Abliteration result
| Metric | Value |
|---|---|
| Refusals on held-out harmful set | 100 → 9 / 100 (9%) |
| KL divergence from base | 0.3985 |
| Tool | Abliterix 1.12.2 |
| Optuna trials | 50 (15 warmup), seed 42 |
| Selected trial | #17 |
| Steering | per-layer attn q/k/v/o + mlp.down_proj |
| MoE expert steering | n_suppress=4, router_bias=-2.72, expert_ablation_weight=4.31 |
These figures were measured on this bf16 parent.
Method
- Residual-stream activations captured on harmful vs. harmless prompt sets.
- Refusal direction estimated per layer; attention and
mlp.down_projsteered. - Fused-MoE expert suppression + router bias (the path Heretic cannot touch on this architecture).
- Optuna TPE over 50 trials; trial #17 selected (9% refusals, KL 0.3985, under the 0.5 damage threshold).
Usage
from transformers import AutoModelForImageTextToText, AutoProcessor
repo = "junafinity/Ornith-1.5-35B-A3B-uncensored"
model = AutoModelForImageTextToText.from_pretrained(repo, dtype="auto", device_map="auto")
processor = AutoProcessor.from_pretrained(repo)
You must be logged in to Hugging Face and have been granted access.
Responsible use
Primary intended use is red teaming and defensive cybersecurity research. See the section of that name above.
This model has had safety guardrails reduced or removed. Do not expose it as a public endpoint without an independent moderation layer. You are responsible for compliance with the base model's license and acceptable-use policy, applicable law, and the terms of any platform you deploy on. Removing guardrails does not remove accountability.
- Downloads last month
- 46
Model tree for junafinity/Ornith-1.5-35B-A3B-uncensored
Base model
ornith-ai/Ornith-1.5-35B-A3B