Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network
Published in
arXiv.org(2015)External Links:
TL
TL;DR
This study proposes to use BLSTM-RNN with word embedding for part-of-speech (POS) tagging task and can also achieve a good performance comparable with the Stanford POS tagger.
Abstract
Bidirectional Long Short-Term Memory Recurrent Neural Network (BLSTM-RNN) has been shown to be very effective for tagging sequential data, e.g. speech utterances or handwritten documents. While word embedding has been demoed as a powerful representation for characterizing the statistical properties of natural language. In this study, we propose to use BLSTM-RNN with word embedding for part-of-speech (POS) tagging task. When tested on Penn Treebank WSJ test set, a state-of-the-art performance of 97.40 tagging accuracy is achieved. Without using morphological features, this approach can also achieve a good performance comparable with the Stanford POS tagger.
References30 items
1
From Feedforward to Recurrent LSTM Neural Networks for Language Modeling
2
GloVe: Global Vectors for Word Representation
3
Translation Modeling with Bidirectional Recurrent Neural Networks
4
Fast High-Accuracy Part-of-Speech Tagging by Independent Classifiers
5