Spaces:
Running
Running
Commit
•
0f6d04a
1
Parent(s):
8fb650a
Upload lens/pythia-1b-deduped/config.json with huggingface_hub (#13)
Browse files- Upload lens/pythia-1b-deduped/config.json with huggingface_hub (6cc78b2c68a7bb5c1c70f4866499767f53c928e6)
Co-authored-by: Nora Belrose <norabelrose@users.noreply.huggingface.co>
lens/pythia-1b-deduped/config.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"identity_init": true, "include_input": true, "rank": null, "shared_mlp_hidden_sizes": [], "sublayers": false, "num_layers": 16, "vocab_size": 50304, "bias": true, "d_model": 2048, "dropout": 0.0, "mlp_hidden_sizes": []}
|