Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering (2017-04-11T00:00:00.000000Z)

TL;DR

This model, while being architecturally simple and relatively small in terms of trainable parameters, sets a new state of the art on both unbalanced and balanced VQA benchmark.

Abstract

This paper presents a new baseline for visual question answering task. Given an image and a question in natural language, our model produces accurate answers according to the content of the image. Our model, while being architecturally simple and relatively small in terms of trainable parameters, sets a new state of the art on both unbalanced and balanced VQA benchmark. On VQA 1.0 open ended challenge, our model achieves 64.6% accuracy on the test-standard set without using additional data, an improvement of 0.4% over state of the art, and on newly released VQA 2.0, our model scores 59.7% on validation set outperforming best previously reported results by 0.5%. The results presented in this paper are especially interesting because very similar models have been tried before but significantly lower performance were reported. In light of the new results we hope to see more meaningful research on visual question answering in the future.

Authors

V. Kazemi

1 papers

Ali Elqursh

1 papers

TL;DR

Abstract

Authors

References32 items

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

Dual Attention Networks for Multimodal Reasoning and Matching

Training Recurrent Answering Units with Joint Loss Minimization for VQA

Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding

Multimodal Residual Learning for Visual QA

Hierarchical Question-Image Co-Attention for Visual Question Answering

Dynamic Memory Networks for Visual and Textual Question Answering

Deep Residual Learning for Image Recognition

Rethinking the Inception Architecture for Computer Vision

DenseCap: Fully Convolutional Localization Networks for Dense Captioning

Ask Me Anything: Free-Form Visual Question Answering Based on Knowledge from External Sources

Neural Module Networks

Stacked Attention Networks for Image Question Answering

Generation and Comprehension of Unambiguous Object Descriptions

VQA: Visual Question Answering

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention

Adam: A Method for Stochastic Optimization

Show and tell: A neural image caption generator

Going deeper with convolutions

Very Deep Convolutional Networks for Large-Scale Image Recognition

Neural Machine Translation by Jointly Learning to Align and Translate

Recurrent Models of Visual Attention

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Microsoft COCO: Common Objects in Context

ImageNet classification with deep convolutional neural networks

Improving neural networks by preventing co-adaptation of feature detectors

Convolutional networks and applications in vision

Rectified Linear Units Improve Restricted Boltzmann Machines

Understanding the difficulty of training deep feedforward neural networks

ImageNet: A large-scale hierarchical image database

Long Short-Term Memory

Long short-term memory recurrent neural network architectures for large scale acoustic modeling

Field of Study

Journal Information

Name

Volume

Venue Information

Name

Type

URL

Alternate Names