google
/

gemma-scope-9b-pt-res

Model card Files Files and versions Community

gemma-scope-9b-pt-res / layer_20 /width_524k

2 contributors

History: 9 commits

Tom Lieberum

9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5

745af8a about 1 month ago

average_l0_10
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_241
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago
average_l0_48
9B: Add sparsity lambdas for residual stream and clean up the feature splitting suite so that we only have SAEs with learning rate 7e-5 about 1 month ago