Hugging Face's logo

Lewdiculous
/
Erosumika-7B-GGUF-IQ-Imatrix

Text Generation
Transformers
GGUF
mistral
quantized
text-generation-inference
roleplay
Model card Files Community
2
Lewdiculous commited on
Commit
9563725
•
1 Parent(s): 3f4af82

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Erosumika-7B-Q5_K_M-imat.gguf +3 -0
  3. Erosumika-7B-Q5_K_S-imat.gguf +3 -0
  4. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -36,3 +36,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Erosumika-7B-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
  Erosumika-7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  Erosumika-7B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
36
  Erosumika-7B-F16.gguf filter=lfs diff=lfs merge=lfs -text
37
  Erosumika-7B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  Erosumika-7B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Erosumika-7B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Erosumika-7B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
Erosumika-7B-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f62b46265a2ccd966470d1db322c7251e48641f626d29dc682fbc01fa39d792
3
+ size 5131409504
Erosumika-7B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fc88c90c1ce6cceddfa2185df51501a9ffb830343a3a5989bb2ab9552569733
3
+ size 4997716064
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:625d54370e4d75aabcc171db3b5d481403ee76bd1929cc37beccc81258affb00
3
+ size 4988126