FreebaseQA: A New Factoid QA Data Set Matching Trivia-Style Question-Answer Pairs with Freebase
Published in
North American Chapter of the Association for C...(2019)External Links:
TL
TL;DR
This data set, named FreebaseQA, is generated by matching trivia-type question-answer pairs with subject-predicate-object triples in Freebase to generate over 54K matches from about 28K unique questions with minimal cost.
Abstract
In this paper, we present a new data set, named FreebaseQA, for open-domain factoid question answering (QA) tasks over structured knowledge bases, like Freebase. The data set is generated by matching trivia-type question-answer pairs with subject-predicate-object triples in Freebase. For each collected question-answer pair, we first tag all entities in each question and search for relevant predicates that bridge a tagged entity with the answer in Freebase. Finally, human annotation is used to remove any false positive in these matched triples. Using this method, we are able to efficiently generate over 54K matches from about 28K unique questions with minimal cost. Our analysis shows that this data set is suitable for model training in factoid QA tasks beyond simpler questions since FreebaseQA provides more linguistically sophisticated questions than other existing data sets.
References19 items
1
A General FOFE-net Framework for Simple and Effective Question Answering over Knowledge Bases
2
SimpleQuestions Nearly Solved: A New Upperbound and Baseline Approach
3
A Local Detection Approach for Named Entity Recognition and Mention Detection
4
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension
5