VTC

VTC: Improving Video-Text Retrieval with User Comments

This paper introduces a new dataset of videos, titles and comments and presents an attention-based mechanism that allows the model to learn from sometimes irrelevant data such as comments, and shows that by using comments, the method is able to learn better, more contextualised, representations for image, video and audio representations.