Hugging Face's logo

Spaces:
AlignmentResearch
/
tuned-lens
Running

App Files Community
47
levmckinney commited on
Commit
db390c2
•
1 Parent(s): 97727e5

Added new pythia-deduped models (#33)

Browse files

- added pythia lens files (e4680eb4479c53de8fa72df322aebff5f41bbc8c)
- Added tuned lens for pythia-1.4b (8a034dc13f600d05386ef6ad80371ebef39623c3)
- added pythia-2.8b (9e121a2f02a556ecd649c4abf1cdd538d5e12213)
- added pythia 6.9b (55929dfd7dee058ea805568d738309a62d351c88)
- added pythia-12b (7620067a025aab5784fe1200d4f53943bbfb0528)

Files changed (14) hide show
  1. lens/EleutherAI/pythia-1.4b-deduped/config.json +1 -0
  2. lens/EleutherAI/pythia-1.4b-deduped/params.pt +3 -0
  3. lens/EleutherAI/pythia-12b-deduped/config.json +1 -0
  4. lens/EleutherAI/pythia-12b-deduped/params.pt +3 -0
  5. lens/EleutherAI/pythia-160m-deduped/config.json +1 -0
  6. lens/EleutherAI/pythia-160m-deduped/params.pt +3 -0
  7. lens/EleutherAI/pythia-2.8b-deduped/config.json +1 -0
  8. lens/EleutherAI/pythia-2.8b-deduped/params.pt +3 -0
  9. lens/EleutherAI/pythia-410m-deduped/config.json +1 -0
  10. lens/EleutherAI/pythia-410m-deduped/params.pt +3 -0
  11. lens/EleutherAI/pythia-6.9b-deduped/config.json +1 -0
  12. lens/EleutherAI/pythia-6.9b-deduped/params.pt +3 -0
  13. lens/EleutherAI/pythia-70m-deduped/config.json +1 -0
  14. lens/EleutherAI/pythia-70m-deduped/params.pt +3 -0
lens/EleutherAI/pythia-1.4b-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-1.4b-deduped", "d_model": 2048, "num_hidden_layers": 24, "bias": true, "base_model_revision": null, "unemebd_hash": "42dcb52bd3d955648e9fbae0ab40527eed42b22b06945c680255d620d46dffd8", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-1.4b-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b56db530d2c0df1bc5916bae58b241cfd4389dd4b1aa29e7210395df97164824
3
+ size 402861347
lens/EleutherAI/pythia-12b-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-12b-deduped", "d_model": 5120, "num_hidden_layers": 36, "bias": true, "base_model_revision": null, "unemebd_hash": "d676a152f789a57219afa5b93c3718bf56805a8fcb45eeaacdb6665aa880e82e", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-12b-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8452947780e3caf7009a752d62f1a2d71c66f67b3855c7e409869b7e633db40e
3
+ size 3775628355
lens/EleutherAI/pythia-160m-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-160m-deduped", "d_model": 768, "num_hidden_layers": 12, "bias": true, "base_model_revision": null, "unemebd_hash": "7f56aa8e6e19b2e0dc2d465ca802f839d691a9306a6bca06ccae0cbd17e03283", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-160m-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d16b68baa1eb903bbf74eaf859cee5c34361f3e8dff331b17f55b8ce52a2dbe
3
+ size 28354051
lens/EleutherAI/pythia-2.8b-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-2.8b-deduped", "d_model": 2560, "num_hidden_layers": 32, "bias": true, "base_model_revision": null, "unemebd_hash": "0e9d6241f727a812fdd9e612496192e1da3409fc0a9426a1077eca654180c6f1", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-2.8b-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:314d403f2e1b1bf575ab2e851419d3a687c54138bfae5feace3ff00f1a96fd60
3
+ size 839204003
lens/EleutherAI/pythia-410m-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-410m-deduped", "d_model": 1024, "num_hidden_layers": 24, "bias": true, "base_model_revision": null, "unemebd_hash": "e9b52de378cf3ce115b2f23028993fb797268389a10a6241fe981e361dfd2b78", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-410m-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:166ea259b35481e1eb2feba50b5ac4d9a8faed47b0937ede0d7bd6d9830dbc95
3
+ size 100773155
lens/EleutherAI/pythia-6.9b-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-6.9b-deduped", "d_model": 4096, "num_hidden_layers": 32, "bias": true, "base_model_revision": null, "unemebd_hash": "272e395758b795a73dddd10c3b33000a33a9380784b963623a36a50d5df6c34e", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-6.9b-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2d00af6f64631b932b089fac5ca031061e207d51132a0f7433bd7a34fb06da0
3
+ size 2148023459
lens/EleutherAI/pythia-70m-deduped/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "EleutherAI/pythia-70m-deduped", "d_model": 512, "num_hidden_layers": 6, "bias": true, "base_model_revision": null, "unemebd_hash": "35a97f97ca7cc395758d14911297122458e306a960feab2a9b79d07439de4db4", "lens_type": "linear_tuned_lens"}
lens/EleutherAI/pythia-70m-deduped/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c363b641564af68e9f9b73af56015b6b5c5b08caea5880787744eaabfab01343
3
+ size 6306803