OusiaResearch/Aureth-4B-Qwen3.5 decensored with Heretic 1.3.0

	Base model	This thing
Refusals	84	10
KLD	n/a	0.0102

(Realistically, it's actually 2 or 3 refusals, the rest are false positives.)

Parameter Name	Value
direction_scope	global
direction_index	14.56
attn.o_proj.max_weight	1.10
attn.o_proj.max_weight_position	25.35
attn.o_proj.min_weight	0.03
attn.o_proj.min_weight_distance	14.95
mlp.down_proj.max_weight	1.32
mlp.down_proj.max_weight_position	22.95
mlp.down_proj.min_weight	1.23
mlp.down_proj.min_weight_distance	18.26
kl_divergence	0.01
refusals	10
base_refusals	84
n_bad_prompts	100

Aureth 4B is an interesting model, if you miss some personality in small models in the post-Hermes3 world. It's better suited to creative tasks than base Qwen 3.5 4B. But to be honest, it's quite borked. It hallucinates a lot and gets stuck in loops. It doesn't support reasoning either (if you try to force it, it will get worse). Also, OG Aureth is censored A LOT and is even smug about it.

This decensored version even reduces hallucinations somewhat; but it's still prone to looping.

Query: Tell me some cool random fact.

Original Aureth 4B (BF16):

"Here's a cool random fact: The human body can produce up to 2000 liters of saliva every day, which helps to break down food and protect our teeth from decay."

(Seriously? 2000 liters??)

Heretic (this one) (BF16):

"Here is a cool random fact for you:

The largest known star in the universe is the star V838A8, which is located in the constellation Cygnus. It is a hypernova, which is a type of star that has exploded into a supernova. The star is so massive that it is estimated to be 100 times the mass of our Sun."

(Lots of mistakes even in this short snippet, but at least it's not as outrageous as claiming the body can produce 2000 litres of saliva a day.)

Interestingly, quantized to Q6_K, both original and uncensored versions gave the same response:

"Here is a cool random fact for you: The largest planet in our solar system is Jupiter, which is so massive that it could fit all the other planets inside it."

(All ran at temperature 0.)