chanind/sae-llama-3.2-1b-topk-res

SAEs for use with the SAELens library

This repository contains the following SAEs:

• blocks.0.hook_resid_post/l0-10
• blocks.1.hook_resid_post/l0-10
• blocks.10.hook_resid_post/l0-10
• blocks.11.hook_resid_post/l0-10
• blocks.12.hook_resid_post/l0-10
• blocks.13.hook_resid_post/l0-10
• blocks.14.hook_resid_post/l0-10
• blocks.2.hook_resid_post/l0-10
• blocks.3.hook_resid_post/l0-10
• blocks.4.hook_resid_post/l0-10
• blocks.5.hook_resid_post/l0-10
• blocks.6.hook_resid_post/l0-10
• blocks.7.hook_resid_post/l0-10
• blocks.8.hook_resid_post/l0-10
• blocks.9.hook_resid_post/l0-10

Load these SAEs using SAELens as below:

from sae_lens import SAE

sae, cfg_dict, sparsity = SAE.from_pretrained("chanind/sae-llama-3.2-1b-topk-res", "<sae_id>")