DevQuasar
/

Qwen2-7B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Quantized version of Qwen/Qwen2-7B-Instruct

Downloads last month: 49

GGUF

Model size

7.62B params

Architecture

qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Collection including DevQuasar/Qwen2-7B-Instruct-GGUF

GGUFs

quantized models • 137 items • Updated 5 days ago • 1