tylercosgrove commited on
Commit
e230979
1 Parent(s): ca92d44

update readme metadata

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -1,6 +1,9 @@
1
  ---
2
  license: mit
 
 
 
3
  ---
4
  This contains the weights of a sparse autoencoder I trained on the residual activations of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1). I used [The Pile (uncopyrighted)](https://huggingface.co/datasets/monology/pile-uncopyrighted) for the training data. As of right now, I have only trained a single SAE (on layer 16), though I may do more in the future.
5
 
6
- Here is the associated [GitHub repo](https://github.com/tylercosgrove/sparse-autoencoder-mistral7b) I used to train it, which you can also use to do some crude inference.
 
1
  ---
2
  license: mit
3
+ datasets:
4
+ - monology/pile-uncopyrighted
5
+ library_name: transformers
6
  ---
7
  This contains the weights of a sparse autoencoder I trained on the residual activations of [Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1). I used [The Pile (uncopyrighted)](https://huggingface.co/datasets/monology/pile-uncopyrighted) for the training data. As of right now, I have only trained a single SAE (on layer 16), though I may do more in the future.
8
 
9
+ Here is the associated [GitHub repo](https://github.com/tylercosgrove/sparse-autoencoder-mistral7b) I used to train it, which you can also use to do some crude inference.