Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,42 @@ base_model:
|
|
| 8 |
tags:
|
| 9 |
- uncensored
|
| 10 |
- GGUF
|
| 11 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
tags:
|
| 9 |
- uncensored
|
| 10 |
- GGUF
|
| 11 |
+
---
|
| 12 |
+
<div align="center">
|
| 13 |
+
<img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/>
|
| 14 |
+
</div>
|
| 15 |
+
</br>
|
| 16 |
+
<div align="center">
|
| 17 |
+
|
| 18 |
+
# 🚀 Sailor2-8B-Chat-Uncensored-GGUF
|
| 19 |
+
|
| 20 |
+
### Optimized quantized models for efficient inference
|
| 21 |
+
|
| 22 |
+
</div>
|
| 23 |
+
|
| 24 |
+
## 📋 Overview
|
| 25 |
+
|
| 26 |
+
A collection of optimized GGUF quantized models derived from [BlossomsAI/Sailor2-8B-Chat-Uncensored](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored), providing various performance-quality tradeoffs.
|
| 27 |
+
|
| 28 |
+
## 💎 Model Variants
|
| 29 |
+
|
| 30 |
+
| Variant | Use Case | Download
|
| 31 |
+
|---------|-----------|------------|
|
| 32 |
+
| Q2_K | Basic text completion tasks | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q2_k.gguf?download=true)
|
| 33 |
+
| Q3_K_M | Memory-efficient quality operations | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q3_k_m.gguf?download=true)
|
| 34 |
+
| Q4_K_S | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q4_k_s.gguf?download=true)
|
| 35 |
+
| Q4_K_M | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q4_k_m.gguf?download=true)
|
| 36 |
+
| Q5_K_S | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q5_k_s.gguf?download=true)
|
| 37 |
+
| Q5_K_M | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q5_k_m.gguf?download=true)
|
| 38 |
+
| Q6_K | Superior quality outputs | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q6_k.gguf?download=true)
|
| 39 |
+
| Q8_0 | Maximum quality, production-grade results | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q8_0.gguf?download=true)
|
| 40 |
+
|
| 41 |
+
## 🤝 Contributors
|
| 42 |
+
|
| 43 |
+
Developed with ❤️ by [BlossomAI](https://huggingface.co/BlossomsAI)
|
| 44 |
+
|
| 45 |
+
---
|
| 46 |
+
|
| 47 |
+
<div align="center">
|
| 48 |
+
<sub>Star ⭐️ this repo if you find it valuable!</sub>
|
| 49 |
+
</div>
|