YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
sae_qwen3_8b_L24_d65k_k80
BatchTopK rank-1 SAE, Qwen3-8B layer 24. d=65536, k=80, lr 1e-4, ~100M FineFineWeb tokens (Karvonen-matched recipe). Autointerp: detection 0.724 / fuzzing 0.786. FVE ~0.804 — our best rank-1 SAE reconstruction.
Standard dictionary_learning BatchTopK SAE (EleutherAI). Load with
dictionary_learning.trainers.batch_top_k.BatchTopKSAE.from_pretrained(ae.pt).
Config in config.json. Trained 2026-07 on the NLA project's L24 activation stream.
- Downloads last month
- 21
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support