Instructions to use yethdev/ornith-1.5-9b-manumit-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use yethdev/ornith-1.5-9b-manumit-v2 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="yethdev/ornith-1.5-9b-manumit-v2")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("yethdev/ornith-1.5-9b-manumit-v2")
model = AutoModelForMultimodalLM.from_pretrained("yethdev/ornith-1.5-9b-manumit-v2", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use yethdev/ornith-1.5-9b-manumit-v2 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "yethdev/ornith-1.5-9b-manumit-v2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "yethdev/ornith-1.5-9b-manumit-v2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/yethdev/ornith-1.5-9b-manumit-v2

SGLang

How to use yethdev/ornith-1.5-9b-manumit-v2 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "yethdev/ornith-1.5-9b-manumit-v2" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "yethdev/ornith-1.5-9b-manumit-v2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "yethdev/ornith-1.5-9b-manumit-v2" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "yethdev/ornith-1.5-9b-manumit-v2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use yethdev/ornith-1.5-9b-manumit-v2 with Docker Model Runner:
```
docker model run hf.co/yethdev/ornith-1.5-9b-manumit-v2
```

Ornith-1.5-9B, manumit v2

Ornith-1.5-9B with the refusals taken out. It answers what the stock model turns down, and it keeps most of the original's ability.

manumit finds the directions in the residual stream that carry refusal and projects them out of the weights, then heals the model back on ordinary data so the ablation does not cost you the model. Refusal here is a small subspace, not one direction, so it takes out the whole thing instead of the single best vector a one-shot tool grabs.

Numbers

Refusal is the keyword refusal rate on held-out harmful prompts, AdvBench-test and JailbreakBench. Ability is MMLU-Pro at n=500, base measured the same way.

	this model	base
AdvBench refusal	0.0%	high
JailbreakBench refusal	4.2%	high
MMLU-Pro	43.0%	43.0%

Refusal is essentially gone and MMLU-Pro landed at or above the base. That is the result worth having.

Use

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "yethdev/ornith-1.5-9b-manumit-v2"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")

msgs = [{"role": "user", "content": "Your prompt here"}]
ids = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(ids, max_new_tokens=512)
print(tok.decode(out[0][ids.shape[-1]:], skip_special_tokens=True))

Stated plainly

There is no safety layer left and no guard model watching the output. Whatever you generate is yours to answer for, and you still have to follow the law and the base model's terms. manumit takes the refusal behaviour out, it does not put anything back.

License

The license is in LICENSE.md. The base model is ornith-ai/Ornith-1.5-9B and keeps its own terms. If you fork or reshare this, keep the manumit credit.

Downloads last month: -

Safetensors

Model size

9B params

Tensor type

BF16

Model tree for yethdev/ornith-1.5-9b-manumit-v2

Base model

ornith-ai/Ornith-1.5-9B

Finetuned

(21)

this model

Collection including yethdev/ornith-1.5-9b-manumit-v2

manumit v2

Collection

HUGE improvements over v1. manumit suppresses refusals while increasing performance in open-weight models. • 7 items • Updated about 10 hours ago