TL
TL;DR
It is shown through experiments on the EQAv1 dataset that a simple question-only baseline achieves state-of-the-art results on the EmbodiedQA task in all cases except when the agent is spawned extremely close to the object.
Abstract
We explore blindfold (question-only) baselines for Embodied Question Answering. The EmbodiedQA task requires an agent to answer a question by intelligently navigating in a simulated environment, gathering necessary visual information only through first-person vision before finally answering. Consequently, a blindfold baseline which ignores the environment and visual information is a degenerate solution, yet we show through our experiments on the EQAv1 dataset that a simple question-only baseline achieves state-of-the-art results on the EmbodiedQA task in all cases except when the agent is spawned extremely close to the object.
References26 items
1
Visual Question Answering: From Theory to Application
2
Neural Modular Control for Embodied Question Answering
3
How Much Reading Does Reading Comprehension Require? A Critical Investigation of Popular Benchmarks
4
Hypothesis Only Baselines in Natural Language Inference
5