Before revision: We introduce a new multimodal retrieval task - TV show Retrieval (TVR), in which a short video moment has to be localized from a large video (with subtitle) corpus, given a natural language query. Different from previous moment retrieval tasks dealing with videos only, TVR requires the system to understand both the video and the associated subtitle text , making it a more realistictask.
After revision: We introduce a new multimodal retrieval task - TV show Retrieval (TVR), a new multimodal retrieval dataset. TVR requires systems to understand both the video and the associated subtitle text , making it a more realistictask.