Microsoft COCO Captions: Data Collection and Evaluation Server
Published in
arXiv.org(2015)External Links:
TL
TL;DR
The Microsoft COCO Caption dataset and evaluation server are described and several popular metrics, including BLEU, METEOR, ROUGE and CIDEr are used to score candidate captions.
Abstract
In this paper we describe the Microsoft COCO Caption dataset and evaluation server. When completed, the dataset will contain over one and a half million captions describing over 330,000 images. For the training and validation images, five independent human generated captions will be provided. To ensure consistency in evaluation of automatic caption generation algorithms, an evaluation server is used. The evaluation server receives candidate captions and scores them using several popular metrics, including BLEU, METEOR, ROUGE and CIDEr. Instructions for using the evaluation server are provided.
References46 items
1
Phrase-based Image Captioning
2
Combining Language and Vision with a Multimodal Skip-gram Model
3
Deep visual-semantic alignments for generating image descriptions
4
Simple Image Description Generator via a Linear Phrase-Based Approach
5