Multimodal Sentiment Analysis using Hierarchical Fusion with Context Modeling

Published in

Knowledge-Based Systems(2018)

External Links:

Generate Graph

TL;DR

A novel feature fusion strategy that proceeds in a hierarchical fashion, first fusing the modalities two in two and only then fusing all three modalities, which outperforms conventional concatenation of features by 1%, which amounts to 5% reduction in error rate.

Authors

E. Cambria

25 papers

Devamanyu Hazarika

11 papers

Soujanya Poria

37 papers

Navonil Majumder

18 papers

Alexander Gelbukh

6 papers

References57 items

Distinguishing between facts and opinions for sentiment analysis: Survey and challenges

OntoSenticNet: A Commonsense Ontology for Sentiment Analysis

A Generative Model for category text generation

Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos

Learning multi-grained aspect target sequence for Chinese sentiment analysis

Multimodal Sentiment Analysis using Hierarchical Fusion with Context Modeling

Published in

Knowledge-Based Systems(2018)

External Links:

Generate Graph

TL;DR

Authors

E. Cambria

25 papers

Devamanyu Hazarika

11 papers

Soujanya Poria

37 papers

Navonil Majumder

18 papers

Alexander Gelbukh

6 papers

References57 items

Distinguishing between facts and opinions for sentiment analysis: Survey and challenges

OntoSenticNet: A Commonsense Ontology for Sentiment Analysis

A Generative Model for category text generation

Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos

Learning multi-grained aspect target sequence for Chinese sentiment analysis

Targeted Aspect-Based Sentiment Analysis via Embedding Commonsense Knowledge into an Attentive LSTM

Augmenting End-to-End Dialogue Systems With Commonsense Knowledge

SenticNet 5: Discovering Conceptual Primitives for Sentiment Analysis by Means of Context Embeddings

Multimodal sentiment analysis in social media using deep learning with convolutional neural networks

Multi-attention Recurrent Network for Human Communication Comprehension

Semi-supervised learning for big social data analysis

Learning Community Embedding with Community Detection and Node Embedding on Graphs

Sentiment Analysis Is a Big Suitcase

Phonetic-Based Microtext Normalization for Twitter Sentiment Analysis

Ensemble application of convolutional neural networks and multiple kernel learning for multimodal sentiment analysis

Natural language based financial forecasting: a survey

Adaptive two-stage feature selection for sentiment classification

Challenges of Sentiment Analysis for Dynamic Events

A review of affective computing: From unimodal analysis to multimodal fusion

Sentiment Analysis in TripAdvisor

Learning Word Representations for Sentiment Analysis

Recent Trends in Deep Learning Based Natural Language Processing

Bayesian network based extreme learning machine for subjectivity detection

Tensor Fusion Network for Multimodal Sentiment Analysis

Time Expression Analysis and Recognition Using Syntactic Token Types and General Heuristic Rules

Context-Dependent Sentiment Analysis in User-Generated Videos

Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis

Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages

Multilingual sentiment analysis: from formal to informal and scarce resource languages

Statistical Learning Theory and ELM for Big Social Data Analysis

What Men Say, What Women Hear: Finding Gender-Specific Meaning Shades

Multilingual Sentiment Analysis: State of the Art and Independent Comparison of Techniques

Affective Computing and Sentiment Analysis

Emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information and semantic labels (Extended abstract)

Word Polarity Disambiguation Using Bayesian Model and Opinion-Level Features

Adam: A Method for Stochastic Optimization

Large-Scale Video Classification with Convolutional Neural Networks

A graph-based approach to commonsense concept extraction and semantic similarity detection

YouTube Movie Reviews: Sentiment Analysis in an Audio-Visual Context

Efficient Estimation of Word Representations in Vector Space

Ensemble of SVM trees for multimodal emotion recognition

Recognizing Affect from Linguistic Information in 3D Continuous Space

Sentic Computing for patient centered applications

Opensmile: the munich versatile and fast open-source audio feature extractor

Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis

On-line emotion recognition in a 3-D activation-valence-time continuum using acoustic and linguistic cues

Audio-Visual Emotion Recognition Using Gaussian Mixture Models for Face and Voice

IEMOCAP: interactive emotional dyadic motion capture database

Multimodal human emotion/expression recognition

Facial emotion recognition using multi-modal information

Lexicon Generation for Emotion Detection from Text

AFFECTIVE COMPUTI G AND SENTIMENT ANALYSIS Deep Learning-Based Document Modeling for Personality Detection from Text

Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis

Utterance-Level Multimodal Sentiment Analysis

3D convolutional neural networks for human action recognition

Emotion Recognition of Affective Speech Based on Multiple Classifiers Using Acoustic-Prosodic Information and Semantic Labels

Rate-coded Restricted Boltzmann Machines for Face Recognition

Field of Study

Computer Science

Journal Information

Name

Knowl. Based Syst.

Page

114535

Volume

330

Venue Information

Name

Knowledge-Based Systems

Type

journal

URL

http://www.elsevier.com/wps/find/journaldescription.cws_home/525448/description#description

Alternate Names

Knowl Based Syst
Knowledge Based Systems
Knowledge-based Syst