GLM-5.3 Uncensored โ€” Maya quant (G-M24U-GPTQ)

The full GLM-5.3 (753B MoE) quantized to ~2.5 bits with GPTQ, with refusals removed, built to run on the GLM-5.3 Uncensored on Maya engine โ€” a fork of Project Maya ported to the full GLM-5.3.

43โ€“57 tokens/s on 7 GPUs (5ร— RTX 4090 48 GB + 2ร— A100 40 GB), 512K context, 2 / 40 refusals on JailbreakBench (stock: 39 / 40).

Files

File Size What
GLM-5.3-Maya-G-M24U-GPTQ-0000{1..6}-of-00006.gguf 267 GB the quantized model (llama.cpp glm-dsa tensor layout)
pack/ 2.8 GB the Maya engine's index of the shards + dense weights + tokenizer + chat template; it finds the shards next to itself
dir3.f32 5.8 MB the refusal vector, 78 layers ร— 3 directions ร— 6144, float32 (applied at runtime)

Run

git clone https://github.com/denisnotes357-prog/GLM-5.3-Uncensored-Maya && cd GLM-5.3-Uncensored-Maya
./setup.sh                      # builds the engine (decline the Flash model download it offers)
hf download nofacedfl/GLM-5.3-Uncensored-Maya --local-dir models/GLM-5.3-Uncensored-Maya
tools/glm53/run-glm53.sh        # chat at http://127.0.0.1:8095, OpenAI and Anthropic APIs

The shipped config needs ~320 GB of VRAM across 7 GPUs for full speed; with less, the engine serves the experts that do not fit from RAM (slower). The tested runtime is the Maya engine; llama.cpp compatibility of this exact file was not tested.

How it was made

  1. Quant (G-M24A-GPTQ). FP8 calibration statistics on 128 sequences (chat, multilingual, reasoning, code, tool calls) โ†’ imatrix for every tensor and GPTQ for the experts' gate/up. Experts IQ2_S gate/up and IQ3_XXS down (IQ3_S down in layers 3โ€“6 and 74โ€“77); attention and shared expert Q4_K, Q8_0 on the layers placed on the A100s; NextN Q3_K/Q4_K; router and norms F32. Against FP8 on 8 held-out texts: KL 0.204, top-1 agreement 88.4%.
  2. Donor (G-M24U). dealignai/GLM-5.3-UNCENSORED-FP8 changes only self_attn.o_proj and mlp.shared_experts.down_proj (155 tensors); those were quantized to the same types and swapped in. Refusals 39 โ†’ 6 of 40, speed unchanged.
  3. Refusal vector (dir3.f32). Three directions per layer measured on 256 harmful / 100 harmless prompts (method of alesha-pro), projected out of the residual stream after every layer by the engine. Refusals 6 โ†’ 2 of 40.

Full story, numbers and dead ends: HOW-IT-WAS-MADE.md.

Speed (7 GPUs, pipelined MTP window, 400-token answers)

Text tok/s
English 54โ€“57
Russian 43โ€“45
Chat at temperature 1.0 43โ€“44
1M context ~30

Engine fixes (2026-10-20)

The engine on GitHub now invalidates a conversation snapshot when another conversation resets the state (a dropped request could otherwise leave long agent sessions answering garbage) and applies repetition penalties on the GLM path. Update the engine if you cloned before 2026-10-20.

Responsible use

This model answers requests the original refuses. It is published for research, red-teaming, private and creative use by adults. You are responsible for how you use it and for following the laws that apply to you. Outputs can be wrong or harmful; do not rely on them for medical, legal or other high-stakes decisions.

License and credits

Downloads last month
478
GGUF
Model size
753B params
Architecture
glm-dsa
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for nofacedfl/GLM-5.3-Uncensored-Maya

Quantized
(17)
this model