Introduced in Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering2017
The VQA-CP dataset was constructed by reorganizing VQA v2 such that the correlation between the question type and correct answer differs in the training and test splits. For example, the most common answer to questions starting with What sport… is tennis in the training set, but skiing in the test set. A model that guesses an answer primarily from the question will perform poorly.
Source: Unshuffling Data for Improved Generalization Image Source: https://arxiv.org/pdf/1712.00377.pdf
