Omkar2118/datasets huggingface dataset:
MUSIC-AVQA

The large-scale MUSIC-AVQA dataset of musical performance contains 45,867 question-answer pairs, distributed in 9,288 videos for over 150 hours. All QA pairs types are divided into 3 modal scenarios, which contain 9 question types and 33 question templates. Finally, as an open-ended problem of our AVQA tasks, all 42 kinds of answers constitute a set for selection.

Introducing paper: Learning to Answer Questions in Dynamic Audio-Visual Scenarios