Best dataset for highest DocVQA

#6
by supercharge19 - opened

Hi, just came from thread: Best option for DocQVA->JSON in HuggingFaceTB/SmolVLM-Instruct. So, what would be the best dataset for this purpose. I am looking forward to train this model to be able to work on pdf files with very complex and intricate tables, data will be highly unstructured and unpredictable. Is there a dataset can be used to train a model to perform well for the purpose?

My idea is to first turn pdf to image so OCRing can be possible then run these images through the model to extract data in json or markdown format.

supercharge19 changed discussion title from Best database for highest DocVQA to Best dataset for highest DocVQA

Sign up or log in to comment