YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

SAE: openai-community/gpt2 layer 8

Sparse Autoencoder trained with Interp-Pal.

Training config

  • Model: openai-community/gpt2
  • Layer: 8
  • d_sae: 24576 (32x)
  • k: 32
  • Training tokens: 100,000,000
  • Dataset: Skylion007/openwebtext

Metrics

  • Loss: 0.0001
  • L0: 32.0
  • Features cached: 17071
Downloads last month
6
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support