| license: mit | |
| datasets: | |
| - EleutherAI/fineweb-edu-dedup-10b | |
| base_model: | |
| - deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B | |
| tags: | |
| - SAE | |
| - interpretability | |
| SAEs and transcoders can be loaded using https://github.com/EleutherAI/sae: | |
| ``` | |
| from sae import Sae | |
| sae = Sae.load_from_hub("EleutherAI/sae-DeepSeek-R1-Distill-Qwen-1.5B-65k", hookpoint="layers.10.mlp") | |
| ``` |