ikawrakow commited on
Commit
86ea5c5
1 Parent(s): 4f5a82b

Adding 2-bit and large 5-bit quants

Browse files
mistral-7b-q2k-extra-small.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc5175431a49579ffccf74e53d9743ee28f9cf4dec363f9df7a01521c4d80041
3
+ size 2473875072
mistral-7b-q51.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b439dbecd90443c0476dc7ac41815d989f17d45c4bb8c6a2effd53a846f0f974
3
+ size 5442115200