Deep Unknown Intent Detection with Margin Loss
TL
TL;DR
This paper uses bidirectional long short-term memory network with the margin loss as the feature extractor, and feeds the feature vectors to the density-based novelty detection algorithm, local outlier factor (LOF), to detect unknown intents.
Abstract
Identifying the unknown (novel) user intents that have never appeared in the training set is a challenging task in the dialogue system. In this paper, we present a two-stage method for detecting unknown intents. We use bidirectional long short-term memory (BiLSTM) network with the margin loss as the feature extractor. With margin loss, we can learn discriminative deep features by forcing the network to maximize inter-class variance and to minimize intra-class variance. Then, we feed the feature vectors to the density-based novelty detection algorithm, local outlier factor (LOF), to detect unknown intents. Experiments on two benchmark datasets show that our method can yield consistent improvements compared with the baseline methods.
References21 items
1
Do Deep Generative Models Know What They Don't Know?
2
Joint Learning of Domain Classification and Out-of-Domain Detection with Dynamic Class Weighting for Satisficing False Acceptance Rates
3
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction
4
A Bi-Model Based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling
5