text: 44,5,1169690389579800581,1071548796,Cătălina Cangea,"Really excited to finally share our new paper! w/ @ebelilov, Pietro Liò, @AaronCourville VideoNavQA: Bridging the Gap between Visual and Embodied Question Answering (<LINK>) + A benchmark in an alternate EQA-like setting + Generalized VQA-style models We tackle the Embodied QA task from a different perspective, where navigation paths are provided and the focus shifts towards answering much more complex and varied questions about the environment. <LINK> Our motivation: initial EQA studies use IL+RL, but results show that the task might be too challenging for these methods. We propose a novel way of evaluating EQA feasibility, building the VideoNavQA dataset containing pairs of questions and videos generated in House3D. <LINK> We generalize widely adopted VQA-style models including FiLM & MAC to a temporal and rich visual setting. Dataset and code available, full results in the paper! :-) <LINK> <LINK> Work partially carried out during my research internship at @MILAMontreal!",http://arxiv.org/abs/1908.04950,"Embodied Question Answering (EQA) is a recently proposed task, where an agent is placed in a rich 3D environment and must act based solely on its egocentric input to answer a given question. The desired outcome is that the agent learns to combine capabilities such as scene understanding, navigation and language understanding in order to perform complex reasoning in the visual world. However, initial advancements combining standard vision and language methods with imitation and reinforcement learning algorithms have shown EQA might be too complex and challenging for these techniques. In order to investigate the feasibility of EQA-type tasks, we build the VideoNavQA dataset that contains pairs of questions and videos generated in the House3D environment. The goal of this dataset is to assess question-answering performance from nearly-ideal navigation paths, while considering a much more complete variety of questions than current instantiations of the EQA task. We investigate several models, adapted from popular VQA methods, on this new benchmark. This establishes an initial understanding of how well VQA-style methods can perform within this novel EQA paradigm. ","VideoNavQA: Bridging the Gap between Visual and Embodied Question