Deep reinforcement learning for imbalanced classification (2019-01-05T00:00:00.000000Z)

TL;DR

A general imbalanced classification model based on deep reinforcement learning, in which the problem is formulated as a sequential decision-making process and solved by a deep Q-learning network, and the agent finally finds an optimal classification policy in imbalanced data.

Abstract

Data in real-world application often exhibit skewed class distribution which poses an intense challenge for machine learning. Conventional classification algorithms are not effective in case of imbalanced data distribution, and may fail when the data distribution is highly imbalanced. To address this issue, we propose a general imbalanced classification model based on deep reinforcement learning, in which we formulate the classification problem as a sequential decision-making process and solve it by a deep Q-learning network. In our model, the agent performs a classification action on one sample in each time step, and the environment evaluates the classification action and returns a reward to the agent. The reward from the minority class sample is larger, so the agent is more sensitive to the minority class. The agent finally finds an optimal classification policy in imbalanced data under the guidance of the specific reward function and beneficial simulated environment. Experiments have shown that our proposed model outperforms other imbalanced classification algorithms, and identifies more minority samples with better classification performance.

Authors

Enlu Lin

1 papers

Qiong Chen

1 papers

Xiaoming Qi

1 papers

TL;DR

Abstract

Authors

References47 items

Improving lazy decision tree for imbalanced classification by using skew-insensitive criteria

A Deep Reinforcement Learning Approach for Early Classification of Time Series

Deep Reinforcement Learning for Surgical Gesture Segmentation and Classification

Entropy based fuzzy least squares twin support vector machine for class imbalance learning

Imbalanced Deep Learning by Minority Class Incremental Rectification

Reinforcement Learning for Relation Classification From Noisy Data

Learning Structured Representation for Text Classification via Reinforcement Learning

Deep Reinforcement Learning for List-wise Recommendations

Deep Reinforcement Learning With Visual Attention for Vehicle Classification

Classification with Costly Features using Deep Reinforcement Learning

Focal Loss for Dense Object Detection

Learning from class-imbalanced data: Review of methods and applications

Balanced undersampling: a novel sentence-based undersampling method to improve recognition of named entities in chemical and biomedical text

Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates

Training deep neural networks on imbalanced data sets

Learning Deep Representation for Imbalanced Classification

ODOC-ELM: Optimal decision outputs compensation-based extreme learning machine for classifying imbalanced data

Deep Learning for Imbalanced Multimedia Data Classification

Cost-Sensitive Neural Network with ROC-Based Moving Threshold for Imbalanced Classification

Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data

Should We Really Use Post-Hoc Tests Based on Mean-Ranks?

Playing Atari with Deep Reinforcement Learning

Practical Recommendations for Gradient-Based Training of Deep Architectures

Reinforcement learning algorithms for solving classification problems

Evaluation Measures of the Classification Performance of Imbalanced Data Sets

Learning from Imbalanced Data

SVMs Modeling for Highly Imbalanced Classification

Statistical Comparisons of Classifiers over Multiple Data Sets

Decision threshold adjustment in class prediction

Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning

KBA: kernel boundary alignment considering imbalanced data distribution

Mining with rarity: a unifying framework

A study of the behavior of several methods for balancing machine learning training data

Cost-sensitive learning by cost-proportionate example weighting

The class imbalance problem: A systematic study

Learning and making decisions when costs and probabilities are both unknown

A Comparative Study of Cost-Sensitive Boosting Algorithms

An Empirical Study of MetaCost Using Boosting Algorithms

Individual Comparisons by Ranking Methods

An Ensemble Pruning Approach Based on Reinforcement Learning in Presence of Multi-class Imbalanced Data

C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling

C 4 . 5 , Class Imbalance , and Cost Sensitivity : Why Under-Sampling beats OverSampling

I Zhang, knn approach to unbalanced data distributions: a case study involving information extraction

Controlling the Sensitivity of Support Vector Machines

A Simple Sequentially Rejective Multiple Test Procedure

Optimization in Economic Theory

Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem

Field of Study

Journal Information

Name

Page

Volume