--- license: mit language: - vi - en base_model: - BlossomsAI/Sailor2-8B-Chat-Uncensored tags: - uncensored - GGUF ---
Logo

# 🚀 Sailor2-8B-Chat-Uncensored-GGUF ### Optimized quantized models for efficient inference
## 📋 Overview A collection of optimized GGUF quantized models derived from [BlossomsAI/Sailor2-8B-Chat-Uncensored](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored), providing various performance-quality tradeoffs. ## 💎 Model Variants | Variant | Use Case | Download |---------|-----------|------------| | Q2_K | Basic text completion tasks | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q2_k.gguf?download=true) | Q3_K_M | Memory-efficient quality operations | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q3_k_m.gguf?download=true) | Q4_K_S | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q4_k_s.gguf?download=true) | Q4_K_M | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q4_k_m.gguf?download=true) | Q5_K_S | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q5_k_s.gguf?download=true) | Q5_K_M | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q5_k_m.gguf?download=true) | Q6_K | Superior quality outputs | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q6_k.gguf?download=true) | Q8_0 | Maximum quality, production-grade results | [📥](https://huggingface.co/BlossomsAI/Sailor2-8B-Chat-Uncensored-GGUF/resolve/main/q8_0.gguf?download=true) ## 🤝 Contributors Developed with ❤️ by [BlossomAI](https://huggingface.co/BlossomsAI) ---
Star ⭐️ this repo if you find it valuable!