SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval) (2019-03-19T00:00:00.000000Z)

TL;DR

The results and the main findings of SemEval-2019 Task 6 on Identifying and Categorizing Offensive Language in Social Media (OffensEval), based on a new dataset, contain over 14,000 English tweets, are presented.

Abstract

We present the results and the main findings of SemEval-2019 Task 6 on Identifying and Categorizing Offensive Language in Social Media (OffensEval). The task was based on a new dataset, the Offensive Language Identification Dataset (OLID), which contains over 14,000 English tweets, and it featured three sub-tasks. In sub-task A, systems were asked to discriminate between offensive and non-offensive posts. In sub-task B, systems had to identify the type of offensive content in the post. Finally, in sub-task C, systems had to detect the target of the offensive posts. OffensEval attracted a large number of participants and it was one of the most popular tasks in SemEval-2019. In total, nearly 800 teams signed up to participate in the task and 115 of them submitted results, which are presented and analyzed in this report.

Authors

Sara Rosenthal

5 papers

Marcos Zampieri

12 papers

Preslav Nakov

14 papers

TL;DR

Abstract

Authors

References83 items

CAMsterdam at SemEval-2019 Task 6: Neural and graph-based feature extraction for the identification of offensive tweets

YNUWB at SemEval-2019 Task 6: K-max pooling CNN with average meta-embedding for identifying offensive language

Embeddia at SemEval-2019 Task 6: Detecting Hate with Neural Network and Transfer Learning Approaches

BNU-HKBU UIC NLP Team 2 at SemEval-2019 Task 6: Detecting Offensive Language Using BERT model

HHU at SemEval-2019 Task 6: Context Does Matter - Tackling Offensive Language Identification and Categorization with ELMo

INGEOTEC at SemEval-2019 Task 5 and Task 6: A Genetic Programming Approach for Text Classification

UTFPR at SemEval-2019 Task 6: Relying on Compositionality to Find Offense

Amrita School of Engineering - CSE at SemEval-2019 Task 6: Manipulating Attention with Temporal Convolutional Neural Network for Offense Identification and Classification

Duluth at SemEval-2019 Task 6: Lexical Approaches to Identify and Categorize Offensive Tweets

TUVD team at SemEval-2019 Task 6: Offense Target Identification

bhanodaig at SemEval-2019 Task 6: Categorizing Offensive Language in social media

Stop PropagHate at SemEval-2019 Tasks 5 and 6: Are abusive language classification results reproducible?

Ghmerti at SemEval-2019 Task 6: A Deep Word- and Character-based Approach to Offensive Language Identification

LaSTUS/TALN at SemEval-2019 Task 6: Identification and Categorization of Offensive Language in Social Media with Attention-based Bi-LSTM model

TECHSSN at SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Tweets using Deep Neural Networks

UVA Wahoos at SemEval-2019 Task 6: Hate Speech Identification using Ensemble Machine Learning

DeepAnalyzer at SemEval-2019 Task 6: A deep learning-based ensemble method for identifying offensive tweets

LTL-UDE at SemEval-2019 Task 6: BERT and Two-Vote Classification for Categorizing Offensiveness

Zeyad at SemEval-2019 Task 6: That’s Offensive! An All-Out Search For An Ensemble To Identify And Categorize Offense in Tweets.

YNU-HPCC at SemEval-2019 Task 6: Identifying and Categorising Offensive Language on Twitter

JTML at SemEval-2019 Task 6: Offensive Tweets Identification using Convolutional Neural Networks

Emad at SemEval-2019 Task 6: Offensive Language Identification using Traditional Machine Learning and Deep Learning approaches

TüKaSt at SemEval-2019 Task 6: Something Old, Something Neu(ral): Traditional and Neural Approaches to Offensive Text Classification

NULI at SemEval-2019 Task 6: Transfer Learning for Offensive Language Detection using Bidirectional Transformers

nlpUP at SemEval-2019 Task 6: A Deep Neural Language Model for Offensive Language Detection

ConvAI at SemEval-2019 Task 6: Offensive Language Identification and Categorization with Perspective and BERT

UBC-NLP at SemEval-2019 Task 6: Ensemble Learning of Offensive Content With Enhanced Training Data

NLP at SemEval-2019 Task 6: Detecting Offensive language using Neural Networks

MIDAS at SemEval-2019 Task 6: Identifying Offensive Posts and Targeted Offense from Twitter

NLP@UIOWA at SemEval-2019 Task 6: Classifying the Crass using Multi-windowed CNNs

JU_ETCE_17_21 at SemEval-2019 Task 6: Efficient Machine Learning and Neural Network Approaches for Identifying and Categorizing Offensive Language in Tweets

NIT_Agartala_NLP_Team at SemEval-2019 Task 6: An Ensemble Approach to Identifying and Categorizing Offensive Language in Twitter Social Media Corpora

UHH-LT at SemEval-2019 Task 6: Supervised vs. Unsupervised Transfer Learning for Offensive Language Detection

CN-HIT-MI.T at SemEval-2019 Task 6: Offensive Language Identification Based on BiLSTM with Double Attention

SINAI at SemEval-2019 Task 6: Incorporating lexicon knowledge into SVM learning to identify and categorize offensive language in social media

USF at SemEval-2019 Task 6: Offensive Language Detection Using LSTM With Word Embeddings

DA-LD-Hildesheim at SemEval-2019 Task 6: Tracking Offensive Content with Deep Learning using Shallow Representation

KMI-Coling at SemEval-2019 Task 6: Exploring N-grams for Offensive Language detection

Hope at SemEval-2019 Task 6: Mining social media language to discover offensive language

Amobee at SemEval-2019 Tasks 5 and 6: Multiple Choice CNN Over Contextual Embedding

NLPR@SRPOL at SemEval-2019 Task 6 and Task 5: Linguistically enhanced deep learning offensive sentence classifier

UM-IU@LING at SemEval-2019 Task 6: Identifying Offensive Tweets Using BERT and SVMs

Bidirectional Recurrent Models for Offensive Tweet Classification

Combination of multiple Deep Learning architectures for Offensive Language Detection in Tweets

An Exploration of State-of-the-art Methods for Offensive Language Detection

Absit invidia verbo: Comparing Deep Learning methods for offensive language

Offensive Language Analysis using Deep Learning Architecture

Towards NLP with Deep Learning: Convolutional Neural Networks and Recurrent Neural Networks for Offensive Language Identification in Social Media

Predicting the Type and Target of Offensive Posts in Social Media

Word Representations

Benchmarking Aggression Identification in Social Media

Filtering Aggression from the Multilingual Social Media Feed

Aggression Detection in Social Media: Using Deep Neural Networks, Data Augmentation, and Pseudo Labeling

Merging Datasets for Aggressive Text Identification

Convolutional Neural Networks for Toxic Comment Classification

Deep Contextualized Word Representations

Challenges in discriminating profanity from hate speech

Detecting Hate Speech in Social Media

Understanding Abuse: A Typology of Abusive Language Detection Subtasks

Automated Hate Speech Detection and the Problem of Offensive Language

Wikipedia Talk Labels: Toxicity

Enriching Word Vectors with Subword Information

Multimedia Lab @ ACL WNUT NER Shared Task: Named Entity Recognition for Twitter Microposts using Distributed Word Representations

Cyber Hate Speech on Twitter: An Application of Machine Classification and Statistical Modeling for Policy and Decision Making

Hate Speech Detection with Comment Embeddings

GloVe: Global Vectors for Word Representation

The Stanford CoreNLP Natural Language Processing Toolkit

Distributed Representations of Words and Phrases and their Compositionality

Locate the Hate: Detecting Tweets against Blacks

Improving Cyberbullying Detection with User Context

Learning from Bullying Traces in Social Media

Modeling the Detection of Textual Cyberbullying

Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Pardeep at SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media using Deep Learning

HAD-Tübingen at SemEval-2019 Task 6: Deep Learning Analysis of Offensive Language on Twitter: Identification and Categorization