Docmatix - a huge dataset for Document Visual Question Answering
•
66
Hugo Laurençon
HugoLaurencon
AI & ML interests
None yet
Articles
Organizations
Posts
5
Post
2811
We release Idefics2-chatty, the chatbot-optimized version of Idefics2:
HuggingFaceM4/idefics2-8b-chatty
Idefics2-chatty is better at following instructions and following Chain-of-Thoughts reasoning.
Moreover, we also release a paper, containing a lot of findings on how to build an efficient and performant Vision-Language Model: What matters when building vision-language models? (2405.02246)
How are you going to use the model, or what data are you going to fine-tune it on?
Idefics2-chatty is better at following instructions and following Chain-of-Thoughts reasoning.
Moreover, we also release a paper, containing a lot of findings on how to build an efficient and performant Vision-Language Model: What matters when building vision-language models? (2405.02246)
How are you going to use the model, or what data are you going to fine-tune it on?
Post
2434
Idefics2 is trained mostly on OBELICS, our open interleaved image-text document dataset.
Training on interleaved data is crucial to reaching high performance on VQA tasks, taking an arbitrary number of images as input, and doing in-context learning.
Dataset: HuggingFaceM4/OBELICS
Nomic visualization: https://atlas.nomic.ai/map/f2fba2aa-3647-4f49-a0f3-9347daeee499/ee4a84bd-f125-4bcc-a683-1b4e231cb10f
Link to OBELICS thread: https://twitter.com/HugoLaurencon/status/1694005892839006301
Training on interleaved data is crucial to reaching high performance on VQA tasks, taking an arbitrary number of images as input, and doing in-context learning.
Dataset: HuggingFaceM4/OBELICS
Nomic visualization: https://atlas.nomic.ai/map/f2fba2aa-3647-4f49-a0f3-9347daeee499/ee4a84bd-f125-4bcc-a683-1b4e231cb10f
Link to OBELICS thread: https://twitter.com/HugoLaurencon/status/1694005892839006301
spaces
3
models
None public yet