Hugging Face's logo

secretmoon
/
WoonaV1.2-9b-GGUF-Imatrix

Text Generation
Transformers
GGUF
Russian
unsloth
sft
pony
MyLittlePony
Russian
Lora
Inference Endpoints
imatrix
conversational
Model card Files Community
secretmoon commited on
Commit
7dfd4fb
•
1 Parent(s): 670b394

Upload 5 files

Browse files
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. WoonaV1.2-9b-imat-IQ3_M.gguf +3 -0
  3. WoonaV1.2-9b-imat-IQ3_XXS.gguf +3 -0
  4. WoonaV1.2-9b-imat-IQ4_XS.gguf +3 -0
  5. WoonaV1.2-9b-imat-Q2_K.gguf +3 -0
  6. WoonaV1.2-9b-imat-Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,8 @@ WoonaV1.2-9b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
38
  WoonaV1.2-9b-imat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  WoonaV1.2-9b-imat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
  WoonaV1.2-9b-imat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
38
  WoonaV1.2-9b-imat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
  WoonaV1.2-9b-imat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
  WoonaV1.2-9b-imat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ WoonaV1.2-9b-imat-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ WoonaV1.2-9b-imat-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ WoonaV1.2-9b-imat-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ WoonaV1.2-9b-imat-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ WoonaV1.2-9b-imat-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
WoonaV1.2-9b-imat-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:827ce81cdb4a9dca3f3f144c712afb95fb1199e89bbb18e4e332429f28e18231
3
+ size 4494615648
WoonaV1.2-9b-imat-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:128cffab3515d5c35be1b966eb696e74ed51032239122740abc6b0c1164b1fa2
3
+ size 3796739168
WoonaV1.2-9b-imat-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dd29c44ab60efe9c1e536de053be2063ccdd2aaf557a98243984cfd7df1f906
3
+ size 5183030368
WoonaV1.2-9b-imat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c220439b79174ee59eb41ad35172f19f13ba3baff3e9bba1a6de703db27f5425
3
+ size 3805398112
WoonaV1.2-9b-imat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ea83ffd0a6a67d0db89193480c6488b1d0f849d8f3c01d9b5046729f2028b3f
3
+ size 5478925408