Omkar2118/datasets huggingface dataset:
MMInstruct-GPT4V
Full name: MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity

Vision-language supervised fine-tuning effectively enhances VLLM performance, but existing visual instruction tuning datasets have limitations:

1. **Instruction Annotation Quality**: Despite strong performance, advanced VLLMs may generate instructions with inaccuracies, such as hallucinations.
2. **Instruction and Image Diversity**: Limited instruction types and lack of diverse image data impact the model's ability to generate varied and realistic outputs.


MMInstruct Dataset

To address these challenges, we created the MMInstruct dataset, featuring:
- **973K instructions** from **24 domains**
- Four instruction types: Judgement, Multiple-Choice, Long Visual Question Answering, and Short Visual Question Answering.

Introducing paper: MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity