r3b31/Qwen2-VL-7B-Captioner-Relaxed-GGUF

This was tested with llamacpp and Koboldcpp

Used mmproj from:

https://huggingface.co/bartowski/Qwen2-VL-7B-Instruct-GGUF/

This model was converted to GGUF format from Ertugrul/Qwen2-VL-7B-Captioner-Relaxed using llama.cpp via the ggml.ai's GGUF-my-repo space. Refer to the original model card for more details on the model

Downloads last month
263
GGUF
Model size
7.62B params
Architecture
qwen2vl

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for r3b31/Qwen2-VL-7B-Captioner-Relaxed-GGUF

Base model

Qwen/Qwen2-VL-7B
Quantized
(2)
this model