Hugging Face's logo

JohannesGaessler
/
cosmosage_v2-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
JohannesGaessler commited on
Commit
dd62907
•
1 Parent(s): 0505c6e

add .gguf

Browse files
Files changed (11) hide show
  1. cosmosage_v2-7b-q2_k.gguf +3 -0
  2. cosmosage_v2-7b-q2_k_s.gguf +3 -0
  3. cosmosage_v2-7b-q3_k_l.gguf +3 -0
  4. cosmosage_v2-7b-q3_k_m.gguf +3 -0
  5. cosmosage_v2-7b-q3_k_s.gguf +3 -0
  6. cosmosage_v2-7b-q3_k_xs.gguf +3 -0
  7. cosmosage_v2-7b-q4_k_m.gguf +3 -0
  8. cosmosage_v2-7b-q4_k_s.gguf +3 -0
  9. cosmosage_v2-7b-q5_k_m.gguf +3 -0
  10. cosmosage_v2-7b-q5_k_s.gguf +3 -0
  11. cosmosage_v2-7b-q6_k.gguf +3 -0
cosmosage_v2-7b-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4652c55a5b1c972ec1b6b1211ea77549c26df482ab808c02961949921c4de55f
3
+ size 2719242400
cosmosage_v2-7b-q2_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:006fff9ad74559e7a229d30771b490909ea4a14a58509dddaffab080f6dc7e44
3
+ size 2528925856
cosmosage_v2-7b-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49c31865bde9a96558f2db8dfa220f92fda1c95f7c103a9a6b360f1540d31c4c
3
+ size 3822024864
cosmosage_v2-7b-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbb6acc81f594ce54ae51e042372377e228d55f83177f4fdb7f722f4ddddc28f
3
+ size 3518986400
cosmosage_v2-7b-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a092f0b61e4b5aa2775bf867cbdd2e70b6a6d43434448cfe986b1df4ec94616
3
+ size 3164567712
cosmosage_v2-7b-q3_k_xs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37aa3479c6727cd58675bade8369b067a981b9736005a1a87d6d0505a8d4e9c5
3
+ size 3000989856
cosmosage_v2-7b-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87082d83eba37122092e5a7b35bf0cb9c59bd8f38395b09cecf1b884b40f25ca
3
+ size 4368439456
cosmosage_v2-7b-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1817136b7ef771e630dc50bed87e2b1cfcea16f03e9c0543c1056695edea8485
3
+ size 4140374176
cosmosage_v2-7b-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51756656e3d24c2c8a53fb5ab1037865bfa57b42830ff71b4f3994602a88fea9
3
+ size 5131409568
cosmosage_v2-7b-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4ff67f4f739de4eb0692d58b85fc446a6f5bbcfd3e0b4c3e4eea2d21d4e03b3
3
+ size 4997716128
cosmosage_v2-7b-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32635b8cbab64d55f124e8060a7654411e9958ead5af703885303994ba290497
3
+ size 5942065312