Hugging Face's logo

DanielClough
/
Candle_MistralLite

Text Generation
Transformers
GGUF
English
mistral
Inference Endpoints
text-generation-inference
Model card Files Community
Ubuntu commited on
Commit
e649dc6
•
1 Parent(s): d8814a3

add .gguf

Browse files
Files changed (13) hide show
  1. Candle_MistralLite_f16.gguf +3 -0
  2. Candle_MistralLite_q2k.gguf +3 -0
  3. Candle_MistralLite_q3k.gguf +3 -0
  4. Candle_MistralLite_q4_0.gguf +3 -0
  5. Candle_MistralLite_q4_1.gguf +3 -0
  6. Candle_MistralLite_q4k.gguf +3 -0
  7. Candle_MistralLite_q5_0.gguf +3 -0
  8. Candle_MistralLite_q5_1.gguf +3 -0
  9. Candle_MistralLite_q5k.gguf +3 -0
  10. Candle_MistralLite_q6k.gguf +3 -0
  11. Candle_MistralLite_q8_0.gguf +3 -0
  12. Candle_MistralLite_q8_1.gguf +3 -0
  13. Candle_MistralLite_q8k.gguf +3 -0
Candle_MistralLite_f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fee0892cbfb71d02f6d9816781775f260bec06ca259483183af5e316b06eeec0
3
+ size 14484068064
Candle_MistralLite_q2k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d7d3ffdd67fb56ad420b8951a4e2d400df81e2917efba507b300cb2bfc153d4
3
+ size 2377201248
Candle_MistralLite_q3k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e09cad91fb9ebf3417375eb47752bf7b0ec1716ba73aceb97888986eefd0cd5d
3
+ size 3112665120
Candle_MistralLite_q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70f37113482033879722e79b4cb263f15bcee8a5209feb20512779886efdcd59
3
+ size 4074425568
Candle_MistralLite_q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ac86cde78abbd6cb98c49a054af981809cb74d9613ffaef83fa24b9b437652
3
+ size 4527018720
Candle_MistralLite_q4k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e52d0475bfaed53b2517bd953d4efc1db71c2462aa4b4a593acae3cbc7cd9aa6
3
+ size 4074425568
Candle_MistralLite_q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6765eaa8a60d8952f8423821a79415eaa303d6d0999d4bacf5b9a03f383a35a
3
+ size 4979611872
Candle_MistralLite_q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ec8ca5186c28391392fbe00de47736721d40a9a35e364a83e31d0d47974238b
3
+ size 5432205024
Candle_MistralLite_q5k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb03c377cb16a6dfc11b48bb81c68d3d71d66d5b26b934e6cd1fcd1afdda9bf4
3
+ size 4979611872
Candle_MistralLite_q6k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcdc0e0928183e959da3f7771f4c599276c848595ea83e771c04f7f9600940c3
3
+ size 5941372320
Candle_MistralLite_q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:085dd05bc04efddff0a4a08447550223c16c574ea0a033f179064aef2168ffd8
3
+ size 7695170784
Candle_MistralLite_q8_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39213a6805df219472b1ad7f6636ef75e60fb2afd2f65863e1abb6c222b321fb
3
+ size 8147763936
Candle_MistralLite_q8k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1b033613bf20b9fecf30a097f7448b1276bd97816df045214a9221d96dbf3a0
3
+ size 8260912224