Mistral-RealworldQA-7b SFT GGUF

Original fp16 weights can be found here.

An experiment with the goal of reducing halucinations in VQA. First in of a series of projects centering around fine-tuning for image captioning.

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
13
GGUF
Model size
7.24B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for InferenceIllusionist/Mistral-RealworldQA-7b-SFT-GGUF

Quantized
(27)
this model

Dataset used to train InferenceIllusionist/Mistral-RealworldQA-7b-SFT-GGUF