skafte/mako-ablations

mako ablation files

Refusal directions for mako, applied at run time: mako removes them from chosen rows of the computation (x -= scale (x . v) v per direction) and leaves the model files as they are.

GLM-5.3-Flash

glm-5.3-flash/refusal-3dir.abl: 3 directions per layer for 45 layers, at the sites ffn_out and stream. For the Maya GGUFs. It is the vector vector/glm53-refusal-per-block-3dir.layers45.f32 from alesha-pro/GLM-5.3-Flash-abliterated-Maya-M-GGUF in mako's format, the same directions at both sites.

DeepSeek-V4.1-Flash-1017

deepseek-v4.1-flash-1017/refusal.abl: 2 directions per layer for 40 layers, at the sites attn_out and shexp_out. For the Maya and ISTA GSQ-RCO GGUFs. The directions come from mrfakename/DeepSeek-V4.1-Flash-1017-abliterated.

Use

mako_serve <first .gguf of the model> --ablate refusal.abl [--ablate-scale F]

--ablate-scale multiplies the strength the vectors' norms carry (default 1). mako-download <model> --ablate fetches the right file along with the model.

Format

MAKOABL1: the magic, then four little-endian uint32 (embedding width, layers, sites, directions k), the site names (16 bytes each, zero-padded), then float32 vectors [layer][site][k][width]. Only mako reads it.