WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset
Authors: name: Andrea Burns; name: Krishna Srinivasan; name: Joshua Ainslie; name: Geoff Brown; name: Bryan A. Plummer; name: Kate Saenko; name: Jianmo Ni; name: Mandy Guo
Published: 2023-05-09 13:20:59

Abstract: Webpages have been a rich resource for language and vision-language tasks.
Yet only pieces of webpages are kept: image-caption pairs, long text articles,
or raw HTML, never all in one place. Webpage tasks have resultingly received
little attention and structured image-text data underused. To study multimodal
webpage understanding, we introduce the Wikipedia Webpage 2M (WikiWeb2M) suite;
the first to retain the full set of images, text, and structure data available
in a page. WikiWeb2M can be used for tasks like page description generation,
section summarization, and contextual image captioning.