natural-language-processing-10
Lexical Normalization
3260 papers • 126 benchmarks • 313 datasets
Lexical normalization is the task of translating/transforming a non standard text to a standard register. Example: new pix comming tomoroe new pictures coming tomorrow Datasets usually consists of tweets, since these naturally contain a fair amount of these phenomena. For lexical normalization, only replacements on the word-level are annotated. Some corpora include annotation for 1-N and N-1 replacements. However, word insertion/deletion and reordering is not part of the task.
(Image credit: Papersgraph)
Benchmarks
These leaderboards are used to track progress in lexical-normalization-10
Trend
Dataset
Best Model
Actions
LexNorm
LexNorm
Libraries
iUse these libraries to find lexical-normalization-10 models and implementations
Datasets
Subtasks
Most implemented papers
MoNoise: Modeling Noise Using a Modular Normalization System
Rob van der Goot, Gertjan van Noord•Mon Oct 09 2017
MoNoise is a normalization model focused on generalizability and efficiency, it aims at being easily reusable and adaptable, based on a modular candidate generation in which each module is responsible for a different type of normalization action.
37