Incorporating External POS Tagger for Punctuation Restoration (2021-06-12T00:00:00.000000Z)

TL;DR

This work incorporates an external POS tagger and fuse its predicted labels into the existing language model to provide syntactic information, and proposes sequence boundary sampling (SBS) to learn punctuation positions more efficiently as a sequence tagging task.

Abstract

Punctuation restoration is an important post-processing step in automatic speech recognition. Among other kinds of external information, part-of-speech (POS) taggers provide informative tags, suggesting each input token's syntactic role, which has been shown to be beneficial for the punctuation restoration task. In this work, we incorporate an external POS tagger and fuse its predicted labels into the existing language model to provide syntactic information. Besides, we propose sequence boundary sampling (SBS) to learn punctuation positions more efficiently as a sequence tagging task. Experimental results show that our methods can consistently obtain performance gains and achieve a new state-of-the-art on the common IWSLT benchmark. Further ablation studies illustrate that both large pre-trained language models and the external POS tagger take essential parts to improve the model's performance.

Authors

Zhouhan Lin

9 papers

Ning Shi

2 papers

Boxin Wang

3 papers

TL;DR

Abstract

Authors

References32 items

Focal Loss for Punctuation Prediction

Multimodal Semi-supervised Learning Framework for Punctuation Prediction in Conversational Speech

Efficient Automatic Punctuation Restoration Using Bidirectional Transformers with Robust Inference

Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing

Adversarial Transfer Learning for Punctuation Restoration

Controllable Time-Delay Transformer for Real-Time Punctuation Prediction and Disfluency Detection

Unsupervised Cross-lingual Representation Learning at Scale

Transfer Learning for Punctuation Prediction

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Leveraging a Character, Word and Prosody Triplet for an ASR Error Robust and Agglutination Friendly Punctuation Approach

RoBERTa: A Robustly Optimized BERT Pretraining Approach

FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP

Deep Recurrent Neural Networks with Layer-wise Multi-head Attentions for Punctuation Restoration

Self-attention Based Model for Punctuation Prediction Using Word and Speech Embeddings

Self-Attention Based Network for Punctuation Restoration

Distilling Knowledge from an Ensemble of Models for Punctuation Prediction

Attention is All you Need

Joint Learning of Correlated Sequence Labeling Tasks Using Bidirectional Recurrent Neural Networks

Bidirectional Recurrent Neural Network with Attention Mechanism for Punctuation Restoration

Punctuation Prediction for Unsegmented Transcript Based on Word Vector

Adam: A Method for Stochastic Optimization

Punctuation Prediction with Transition-based Parsing

The effect of pitch, intensity and pause duration in punctuation detection

On the difficulty of training recurrent neural networks

Punctuation Restoration using Transformer Models for High-and Low-Resource Languages

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

LSTM for punctuation restoration in speech transcripts

Combination of NN and CRF models for joint detection of punctuation and disfluencies

Overview of the IWSLT 2012 evaluation campaign

Dynamic Conditional Random Fields for Joint Sentence Boundary and Punctuation Prediction

Neural Networks: Tricks of the Trade

Early Stopping-But When?

Field of Study

Venue Information

Name

Type

URL

Alternate Names