SentEval: An Evaluation Toolkit for Universal Sentence Representations
Published in
International Conference on Language Resources ...(2018)External Links:
TL
TL;DR
SentEval is introduced, a toolkit for evaluating the quality of universal sentence representations that encompasses a variety of tasks, including binary and multi-class classification, natural language inference and sentence similarity.
Abstract
We introduce SentEval, a toolkit for evaluating the quality of universal sentence representations. SentEval encompasses a variety of tasks, including binary and multi-class classification, natural language inference and sentence similarity. The set of tasks was selected based on what appears to be the community consensus regarding the appropriate evaluations for universal sentence representations. The toolkit comes with scripts to download and preprocess datasets, and an easy interface to evaluate sentence encoders. The aim is to provide a fairer, less cumbersome and more centralized way for evaluating sentence representations.
References41 items
1
Advances in Pre-Training Distributed Word Representations
2
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation
3
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data
4
Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling
5