idimitrov
/

olmoe-sae-layer7

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

SAE for allenai/OLMoE-1B-7B-0125 - Layer 7

This is a Sparse Autoencoder (SAE) trained on layer 7 of the allenai/OLMoE-1B-7B-0125 model.

Model Details

Base Model: allenai/OLMoE-1B-7B-0125
Target Layer: 7
Expansion Factor: 4x
K-Sparsity: 32

Files

layers.7/sae.safetensors
layers.7/cfg.json
config.json
state.pt
optimizer_0.pt
rank_0_state.pt

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support