NLA for gemma-4-26B-A4B-it (layer 20)

Natural Language Autoencoder trained with EasyNLA/nanoNLA: 49.4% held-out FVE (800 GRPO steps; single-vector baseline โˆ’9.6%, i.e. all FVE is text-derived).

  • av/ โ€” merged bf16 verbalizer (Gemma4ForCausalLM, text-only)
  • av_lora_iter800/ โ€” the RL LoRA adapter alone
  • critic/ โ€” 24-block reconstructor + value_head.safetensors Injection marker ใˆœ (id 246566); sidecars included. Recipe + full story: report gemma4-nla + github.com/asherps/EasyNLA/pull/1.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ceselder/gemma4-26b-a4b-nla

Finetuned
(145)
this model