Pi3141 commited on
Commit
60af902
1 Parent(s): b1125a2

Upload params.json

Browse files
Files changed (1) hide show
  1. params.json +1 -0
params.json ADDED
@@ -0,0 +1 @@
 
1
+ { "dim": 6656, "multiple_of": 256, "n_heads": 52, "n_layers": 60, "norm_eps": 1e-6, "vocab_size": -1 }