Kilgori commited on
Commit
bb1c44b
1 Parent(s): 6bb60fb

Update variant.json

Browse files
Files changed (1) hide show
  1. variant.json +9 -0
variant.json CHANGED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_configuration": {
3
+ "num_layers": 6,
4
+ "hidden_size": 512,
5
+ "num_heads": 8,
6
+ "ffn_size": 2048
7
+ },
8
+ ...
9
+ }