TheStoneMX commited on
Commit
66fd30b
1 Parent(s): b53329b

Initial Upload of the 7B mode

Browse files

model on base format, no fine-tunning.

Files changed (3) hide show
  1. checklist.chk +2 -0
  2. consolidated.00.pth +3 -0
  3. params.json +1 -0
checklist.chk ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ 6efc8dab194ab59e49cd24be5574d85e consolidated.00.pth
2
+ 7596560e011154b90eb51a1b15739763 params.json
consolidated.00.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9cd2edb8691fb1deb7ba79a5dfbcbc824ba108ebb4a019d55043b57c1834767
3
+ size 13476939516
params.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"dim": 4096, "multiple_of": 256, "n_heads": 32, "n_layers": 32, "norm_eps": 1e-06, "vocab_size": -1}