A Survey of Word Embeddings Evaluation Methods
Published in
arXiv.org(2018)External Links:
TL
TL;DR
An extensive overview of the field of word embeddings evaluation is presented, highlighting main problems and proposing a typology of approaches to evaluation, summarizing 16 intrinsic methods and 12 extrinsic methods.
Abstract
Word embeddings are real-valued word representations able to capture lexical semantics and trained on natural language corpora. Models proposing these representations have gained popularity in the recent years, but the issue of the most adequate evaluation method still remains open. This paper presents an extensive overview of the field of word embeddings evaluation, highlighting main problems and proposing a typology of approaches to evaluation, summarizing 16 intrinsic methods and 12 extrinsic methods. I describe both widely-used and experimental methods, systematize information about evaluation datasets and discuss some key challenges.
References139 items
1
The Provo Corpus: A large eye-tracking corpus with predictability norms
2
Distributional Models of Word Meaning
3
Experiential, Distributional and Dependency-based Word Embeddings have Complementary Roles in Decoding Brain Activity
4
An Exploration of Word Embedding Initialization in Deep-Learning Tasks
5