'Make knowledge free for everyone'

Quantized version of: sail/Sailor2-8B-Chat

Downloads last month: 24

GGUF

Model size

8.55B params

Architecture

qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for DevQuasar/sail.Sailor2-8B-Chat-GGUF

Base model

Qwen/Qwen2.5-7B

Finetuned

sail/Sailor2-8B

Finetuned

sail/Sailor2-8B-Chat

Quantized

(5)

this model

Collection including DevQuasar/sail.Sailor2-8B-Chat-GGUF

GGUFs

Collection

quantized models • 191 items • Updated 1 day ago • 2