Flickr30k

From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions

This work proposes to use the visual denotations of linguistic expressions to define novel denotational similarity metrics, which are shown to be at least as beneficial as distributional similarities for two tasks that require semantic inference.