You have to use the backend from HimariO's branch. Big thanks to add Qwen2.5VL support! Additional discussions

'Make knowledge free for everyone'

Quantized version of: Qwen/Qwen2.5-VL-7B-Instruct Buy Me a Coffee at ko-fi.com

Downloads last month
614
GGUF
Model size
677M params
Architecture
clip

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DevQuasar/Qwen.Qwen2.5-VL-7B-Instruct-GGUF

Quantized
(26)
this model

Collections including DevQuasar/Qwen.Qwen2.5-VL-7B-Instruct-GGUF