Hierarchical Multi-label Classification of Text with Capsule Networks (2019-07-01T00:00:00.000000Z)

TL;DR

This paper applies and compares simple shallow capsule networks for hierarchical multi-label text classification and shows that they can perform superior to other neural networks, and non-neural network architectures such as SVMs.

Abstract

Capsule networks have been shown to demonstrate good performance on structured data in the area of visual inference. In this paper we apply and compare simple shallow capsule networks for hierarchical multi-label text classification and show that they can perform superior to other neural networks, such as CNNs and LSTMs, and non-neural network architectures such as SVMs. For our experiments, we use the established Web of Science (WOS) dataset and introduce a new real-world scenario dataset, the BlurbGenreCollection (BGC). Our results confirm the hypothesis that capsule networks are especially advantageous for rare events and structurally diverse categories, which we attribute to their ability to combine latent encoded information.

Authors

Chris Biemann

6 papers

Rami Aly

1 papers

Steffen Remus

1 papers

Hierarchical Multi-label Classification of Text with Capsule Networks

TL;DR

Abstract

Authors

References25 items

Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction

Sentylic at IEST 2018: Gated Recurrent Neural Network and Capsule Network Based Approach for Implicit Emotion Detection

Zero-shot User Intent Detection via Capsule Neural Networks

A Capsule Network-based Embedding Model for Knowledge Graph Completion and Search Personalization

Identifying Aggression and Toxicity in Comments using Capsule Network

Sentiment Analysis by Capsules

Investigating Capsule Networks with Dynamic Routing for Text Classification

Dynamic Routing Between Capsules

HDLTex: Hierarchical Deep Learning for Text Classification

Initializing neural networks for hierarchical multi-label text classification

Enriching Word Vectors with Subword Information

Improved Neural Network-based Multi-label Classification with Better Initialization Leveraging Label Co-occurrence

A Theoretically Grounded Application of Dropout in Recurrent Neural Networks

Convolutional Neural Networks for Sentence Classification

Hierarchical multi-label classification using local neural networks

Transforming Auto-Encoders

RCV1: A New Benchmark Collection for Text Categorization Research

Hierarchical text classification and evaluation

Long Short-Term Memory

Support-Vector Networks

MCapsNet: Capsule Network for Text with Multi-Task Learning

Deep Learning

A Literature Survey on Algorithms for Multi-label Learning

Functional Annotation of Genes Using Hierarchical Text Categorization

Noname manuscript No. (will be inserted by the editor) A Survey of Hierarchical Classification Across Different Application Domains

Field of Study

Venue Information

Name

Type

URL

Alternate Names