SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic (2022-01-01T00:00:00.000000Z)

TL;DR

An overview of the shared task, data, and participating teams is provided, which contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase.

Abstract

iSarcasmEval is the first shared task to target intended sarcasm detection: the data for this task was provided and labelled by the authors of the texts themselves. Such an approach minimises the downfalls of other methods to collect sarcasm data, which rely on distant supervision or third-party annotations. The shared task contains two languages, English and Arabic, and three subtasks: sarcasm detection, sarcasm category classification, and pairwise sarcasm identification given a sarcastic sentence and its non-sarcastic rephrase. The task received submissions from 60 different teams, with the sarcasm detection task being the most popular. Most of the participating teams utilised pre-trained language models. In this paper, we provide an overview of the task, data, and participating teams.

Authors

Silviu Vlad Oprea

2 papers

Walid Magdy

2 papers

Ibrahim Abu Farha

1 papers

TL;DR

Abstract

Authors

References62 items

X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection

CS-UM6P at SemEval-2022 Task 6: Transformer-based Models for Intended Sarcasm Detection in English and Arabic

A comparative study of effective approaches for Arabic sentiment analysis

ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora

ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic

Rethinking embedding coupling in pre-trained language models

I Was Just Being Sarcastic! Reactive Supervision: A New Method for Collecting Sarcasm Data

GAN-BERT: Generative Adversarial Learning for Robust Text Classification with a Bunch of Labeled Examples

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP

DAICT: A Dialectal Arabic Irony Corpus Extracted from Twitter

From Arabic Sentiment Analysis to Sarcasm Detection: The ArSarcasm Dataset

The Effect of Sociocultural Variables on Sarcasm Communication Online

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization

AraBERT: Transformer-based Model for Arabic Language Understanding

IDAT at FIRE2019: Overview of the Track on Irony Detection in Arabic Tweets

iSarcasm: A Dataset of Intended Sarcasm

Unsupervised Cross-lingual Representation Learning at Scale

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Exploring Author Context for Detecting Intended vs Perceived Sarcasm

RoBERTa: A Robustly Optimized BERT Pretraining Approach

SemEval-2018 Task 3: Irony Detection in English Tweets

CASCADE: Contextual Sarcasm Detection in Online Discussion Forums

A Large Self-Annotated Corpus for Sarcasm

Are Word Embedding-based Features Useful for Sarcasm Detection?

Putting Sarcasm Detection into Context: The Effects of Class Imbalance and Manual Labelling on Supervised Machine Classification of Twitter Conversations

Modelling Context with User Embeddings for Sarcasm Detection in Social Media

Contextualized Sarcasm Detection on Twitter

Sarcasm Detection on Twitter: A Behavioral Modeling Approach

Sentiment analysis algorithms and applications: A survey

Sarcasm Detection on Czech and English Twitter

SemEval-2014 Task 9: Sentiment Analysis in Twitter

Who cares about Sarcastic Tweets? Investigating the Impact of Sarcasm on Sentiment Analysis.

Sarcasm as Contrast between a Positive Sentiment and Negative Situation

Are There Necessary Conditions for Inducing a Sense of Sarcastic Irony?

Irony and Sarcasm: Corpus Generation and Analysis Using Crowdsourcing

Sentiment Analysis and Opinion Mining

The pragmatics of verbal irony: Echo or pretence?

Verbal irony as implicit display of ironic environment: Distinguishing ironic utterances from nonirony☆

Emotional Reactions to Verbal Irony

PALI-NLP at SemEval-2022 Task 6: iSarcasmEval- Fine-tuning the Pre-trained Model for Detecting Intended Sarcasm

High Tech team at SemEval-2022 Task 6: Intended Sarcasm Detection for Arabic texts

YNU-HPCC at SemEval-2022 Task 6: Transformer-based Model for Intended Sarcasm Detection in English and Arabic

MarSan at SemEval-2022 Task 6: iSarcasm Detection via T5 and Sequence Learners

TUG-CIC at SemEval-2021 Task 6: Two-stage Fine-tuning for Intended Sarcasm Detection

reamtchka at SemEval-2022 Task 6: Investigating the effect of different loss functions for Sarcasm detection for unbalanced datasets

AlexU-AL at SemEval-2022 Task 6: Detecting Sarcasm in Arabic Text Using Deep Learning Techniques

stce at SemEval-2022 Task 6: Sarcasm Detection in English Tweets

, Teven Le Scao , Sylvain Gugger , Mariama Drame , Quentin Lhoest , and Alexander Rush . 2020 . Transformers : State - ofthe - art natural language processing

2022. stce at semeval-2022

Overview of the WANLP 2021 Shared Task on Sarcasm and Sentiment Detection in Arabic

Figlang2020 - sarcasm detection

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Controversy over the concept of irony (=al-mophareqeh) from sarcasm to contradiction; a linguistic and semantic approach. Researches in Arabic language

SOUKHRIA: Towards an Irony Detection System for Arabic in Social Media

Sparse, Contextually Informed Models for Irony Detection: Exploiting User Communities, Entities and Sentiment

Synthesis Lectures on Human Language Technologies

Logic and Conversation

Irony and the Use-Mention Distinction

of the Association for Computational Linguistics

2022b. Cs-um6p

Naive at semeval - 2022 task 6

Field of Study

Venue Information

Name

Type

URL

Alternate Names