Hugging Face's logo

Lewdiculous
/
llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

GGUF
English
roleplay
llama3
sillytavern
imatrix
Model card Files Community
1
Lewdiculous commited on
Commit
ef282df
•
1 Parent(s): 88c1537

IQ4, Q4, Q5, Q6, Q8

Browse files
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. llama-3-Stheno-Mahou-8B-IQ4_XS-imat.gguf +3 -0
  3. llama-3-Stheno-Mahou-8B-Q4_K_S-imat.gguf +3 -0
  4. llama-3-Stheno-Mahou-8B-Q5_K_S-imat.gguf +3 -0
  5. llama-3-Stheno-Mahou-8B-Q6_K-imat.gguf +3 -0
  6. llama-3-Stheno-Mahou-8B-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  llama-3-Stheno-Mahou-8B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
37
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
38
  llama-3-Stheno-Mahou-8B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
36
  llama-3-Stheno-Mahou-8B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
37
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
38
  llama-3-Stheno-Mahou-8B-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ llama-3-Stheno-Mahou-8B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ llama-3-Stheno-Mahou-8B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ llama-3-Stheno-Mahou-8B-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ llama-3-Stheno-Mahou-8B-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ llama-3-Stheno-Mahou-8B-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
llama-3-Stheno-Mahou-8B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7839c6e733d1ac9f873bbf0dc4779262ca9b87d10b3fd778f72f9582972e354b
3
+ size 4447662240
llama-3-Stheno-Mahou-8B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:740522862c026db75c171a7bb3c53f40329a18f545aecc6d8e8fb1c9729b3a19
3
+ size 4692668576
llama-3-Stheno-Mahou-8B-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c1b71a7ad0b6a20798c19cbc60a063b9fbb3cc878b89014eb839831d5a7f6ad
3
+ size 5599293600
llama-3-Stheno-Mahou-8B-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cc7e45c216e4970d6e3460b5b6003351aad8933427a097cdb49e3ee9bb6920c
3
+ size 6596006048
llama-3-Stheno-Mahou-8B-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a062a3cc8b223c46f5d00b78467b0f80348be210940dbfa4473d7769112fbd2d
3
+ size 8540770464