huihui-ai/granite-3.1-8b-instruct-abliterated

This is an uncensored version of ibm-granite/granite-3.1-8b-instruct created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Use with ollama

You can use huihui_ai/granite3.1-dense-abliterated directly,

ollama run huihui_ai/granite3.1-dense-abliterated
Downloads last month
13
Safetensors
Model size
8.17B params
Tensor type
BF16
·
Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for huihui-ai/granite-3.1-8b-instruct-abliterated

Finetuned
(1)
this model
Quantizations
3 models

Collection including huihui-ai/granite-3.1-8b-instruct-abliterated