YouMakeup VQA Challenge: Towards Fine-grained Action Understanding in Domain-Specific Videos
Published in
arXiv.org(2020)External Links:
TL
TL;DR
The goal of the YouMakeup VQA Challenge 2020 is to provide a common benchmark for fine-grained action understanding in domain-specific videos e.g. makeup instructional videos, and two novel question-answering tasks are proposed to evaluate models' fine-grade action understanding abilities.
Abstract
The goal of the YouMakeup VQA Challenge 2020 is to provide a common benchmark for fine-grained action understanding in domain-specific videos e.g. makeup instructional videos. We propose two novel question-answering tasks to evaluate models' fine-grained action understanding abilities. The first task is \textbf{Facial Image Ordering}, which aims to understand visual effects of different actions expressed in natural language to the facial object. The second task is \textbf{Step Ordering}, which aims to measure cross-modal semantic alignments between untrimmed videos and multi-sentence texts. In this paper, we present the challenge guidelines, the dataset used, and performances of baseline models on the two proposed tasks. The baseline codes and models are released at \url{this https URL}.
References32 items
1
YouMakeup: A Large-Scale Domain-Specific Multimodal Dataset for Fine-Grained Semantic Comprehension
2
Semantic Conditioned Dynamic Modulation for Temporal Sentence Grounding in Videos
3
Cross-Modal Image-Text Retrieval with Semantic Consistency
4
Visual Semantic Reasoning for Image-Text Matching
5