Hugging Face's logo

Zoyd
/
cypienai_cymist-2-v03-SFT-3_0bpw_exl2

Text2Text Generation
Transformers
Safetensors
Turkish
English
mistral
text-generation
turkish
general tasks
RAG
SFT
Eval Results
text-generation-inference
Inference Endpoints
3-bit
exl2
Model card Files Community
Zoyd commited on
Commit
f7fb824
•
1 Parent(s): 29252aa

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -41,6 +41,23 @@ model-index:
41
 
42
 
43
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
  # Model Card for Cymist2-v0.3-SFT
45
  ### Model Description
46
 
 
41
 
42
 
43
  ---
44
+ **Exllamav2** quant (**exl2** / **3.0 bpw**) made with ExLlamaV2 v0.0.21
45
+
46
+ Other EXL2 quants:
47
+ | **Quant** | **Model Size** | **lm_head** |
48
+ | ----- | ---------- | ------- |
49
+ |<center>**[2.2](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-2_2bpw_exl2)**</center> | <center>2208 MB</center> | <center>6</center> |
50
+ |<center>**[2.5](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-2_5bpw_exl2)**</center> | <center>2438 MB</center> | <center>6</center> |
51
+ |<center>**[3.0](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-3_0bpw_exl2)**</center> | <center>2854 MB</center> | <center>6</center> |
52
+ |<center>**[3.5](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-3_5bpw_exl2)**</center> | <center>3269 MB</center> | <center>6</center> |
53
+ |<center>**[3.75](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-3_75bpw_exl2)**</center> | <center>3477 MB</center> | <center>6</center> |
54
+ |<center>**[4.0](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-4_0bpw_exl2)**</center> | <center>3685 MB</center> | <center>6</center> |
55
+ |<center>**[4.25](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-4_25bpw_exl2)**</center> | <center>3892 MB</center> | <center>6</center> |
56
+ |<center>**[5.0](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-5_0bpw_exl2)**</center> | <center>4515 MB</center> | <center>6</center> |
57
+ |<center>**[6.0](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-6_0bpw_exl2)**</center> | <center>5358 MB</center> | <center>8</center> |
58
+ |<center>**[6.5](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-6_5bpw_exl2)**</center> | <center>5789 MB</center> | <center>8</center> |
59
+ |<center>**[8.0](https://huggingface.co/Zoyd/cypienai_cymist-2-v03-SFT-8_0bpw_exl2)**</center> | <center>6655 MB</center> | <center>8</center> |
60
+
61
  # Model Card for Cymist2-v0.3-SFT
62
  ### Model Description
63