TheStoneMX
commited on
Commit
•
66fd30b
1
Parent(s):
b53329b
Initial Upload of the 7B mode
Browse filesmodel on base format, no fine-tunning.
- checklist.chk +2 -0
- consolidated.00.pth +3 -0
- params.json +1 -0
checklist.chk
ADDED
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
1 |
+
6efc8dab194ab59e49cd24be5574d85e consolidated.00.pth
|
2 |
+
7596560e011154b90eb51a1b15739763 params.json
|
consolidated.00.pth
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b9cd2edb8691fb1deb7ba79a5dfbcbc824ba108ebb4a019d55043b57c1834767
|
3 |
+
size 13476939516
|
params.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"dim": 4096, "multiple_of": 256, "n_heads": 32, "n_layers": 32, "norm_eps": 1e-06, "vocab_size": -1}
|