DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data (2021-05-05T00:00:00.000000Z)

TL;DR

Deep synthetic minority oversampling technique (SMOTE) is proposed, a novel oversamplings algorithm for deep learning models that leverages the properties of the successful SMOTE algorithm and is capable of generating high-quality, artificial images that can enhance minority classes and balance the training set.

Abstract

Despite over two decades of progress, imbalanced data is still considered a significant challenge for contemporary machine learning models. Modern advances in deep learning have further magnified the importance of the imbalanced data problem, especially when learning from images. Therefore, there is a need for an oversampling method that is specifically tailored to deep learning models, can work on raw images while preserving their properties, and is capable of generating high-quality, artificial images that can enhance minority classes and balance the training set. We propose Deep synthetic minority oversampling technique (SMOTE), a novel oversampling algorithm for deep learning models that leverages the properties of the successful SMOTE algorithm. It is simple, yet effective in its design. It consists of three major components: 1) an encoder/decoder framework; 2) SMOTE-based oversampling; and 3) a dedicated loss function that is enhanced with a penalty term. An important advantage of DeepSMOTE over generative adversarial network (GAN)-based oversampling is that DeepSMOTE does not require a discriminator, and it generates high-quality artificial images that are both information-rich and suitable for visual inspection. DeepSMOTE code is publicly available at https://github.com/dd1github/DeepSMOTE.

Authors

Damien Dablain

1 papers

B. Krawczyk

2 papers

N. Chawla

5 papers

TL;DR

Abstract

Authors

References119 items

On oversampling imbalanced data with deep conditional generative models

Class-Incremental Experience Replay for Continual Learning under Concept Drift

Concept Drift Detection from Multi-Class Imbalanced Data Streams

How to design the fair experimental classifier evaluation

Preprocessed dynamic classifier ensemble selection for highly imbalanced drifted data streams

Multiset Feature Learning for Highly Imbalanced Data Classification

ReMix: Calibrated Resampling for Class Imbalance in Deep learning

Radial-Based Oversampling for Multiclass Imbalanced Data Classification

Learning Deep Landmarks for Imbalanced Classification

Deep Neural Architectures for Highly Imbalanced Data in Bioinformatics

LR-SMOTE - An improved unbalanced data set oversampling based on K-means and SVM

Combined Cleaning and Resampling Algorithm for Multi-Class Imbalanced Data with Label Noise

Long-Tailed Recognition Using Class-Balanced Experts

Long-tail Visual Relationship Recognition with a Visiolinguistic Hubless Loss

Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition From a Domain Adaptation Perspective

Equalization Loss for Long-Tailed Object Recognition

Neighbourhood-based undersampling approach for handling imbalanced and overlapped data

Improvement of Bagging performance for classification of imbalanced datasets using evolutionary multi-objective optimization

BBN: Bilateral-Branch Network With Cumulative Learning for Long-Tailed Visual Recognition

Analyzing and Improving the Image Quality of StyleGAN

A new adaptive weighted imbalanced data classifier via improved support vector machines with high-dimension nature

Geometric SMOTE a geometrically enhanced drop-in replacement for SMOTE

Deep class-skewed learning for face recognition

Conditional Transferring Features: Scaling GANs to Thousands of Classes with 30% Less High-Quality Data for Training

LOGAN: Latent Optimisation for Generative Adversarial Networks

Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

On evaluating the online local pool generation method for imbalance learning

Radial-Based Undersampling for Imbalanced Data Classification

Self-adaptive cost weights-based support vector machine cost-sensitive ensemble for imbalanced data classification

Multiobjective Support Vector Machines: Handling Class Imbalance With Pareto Optimality

Radial-Based oversampling for noisy imbalanced data classification

Generative Adversarial Minority Oversampling

Survey on deep learning with class imbalance

Class-Balanced Loss Based on Effective Number of Samples

Learning in presence of class imbalance and class overlapping by using one-class SVM and undersampling technique

Deep Discriminative Features Learning and Sampling for Imbalanced Data Problem

Learning from Imbalanced Data Sets

Generative Adversarial Network in Medical Imaging: A Review

AMDO: An Over-Sampling Technique for Multi-Class Imbalanced Problems

Deep Imbalanced Learning for Face Recognition and Attribute Prediction

IMCStacking: Cost-sensitive stacking learning with feature inverse mapping for imbalanced problems

Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels

Imbalanced Deep Learning by Minority Class Incremental Rectification

A Cost-Sensitive Deep Belief Network for Imbalanced Classification

RSDNE: Exploring Relaxed Similarity and Dissimilarity from Completely-Imbalanced Labels for Network Embedding

A study on combining dynamic selection and data preprocessing for imbalance learning

BAGAN: Data Augmentation with Balancing GAN

Spectral Normalization for Generative Adversarial Networks

Synthesizing realistic neural population activity patterns using Generative Adversarial Networks

CCR: A combined cleaning and resampling algorithm for imbalanced data classification

Are GANs Created Equal? A Large-Scale Study

Wasserstein Auto-Encoders

Manifold-based synthetic oversampling with manifold conformance estimation

Controlling Imbalanced Error in Deep Learning with the Log Bilinear Loss

Clustering-based undersampling in class-imbalanced data

Boosting with Lexicographic Programming: Addressing Class Imbalance without Cost Tuning

Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms

Focal Loss for Dense Object Detection

Wasserstein Generative Adversarial Networks

GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium

On Unifying Deep Generative Models

Deep Over-sampling Framework for Classifying Imbalanced Data

Improved Training of Wasserstein GANs

Range Loss for Deep Face Recognition with Long-Tailed Training Data

Connecting Generative Adversarial Networks and Actor-Critic Methods

Training deep neural networks on imbalanced data sets

Tutorial on Variational Autoencoders

Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysis

InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets

Improved Techniques for Training GANs

Learning from imbalanced data: open challenges and future directions

Cost-sensitive feature selection using random forest: Selecting low-cost subsets of informative features

Decision tree induction based on minority entropy for the class imbalance problem

Diversity techniques improve the performance of the best imbalance learning ensembles

Deep Residual Learning for Image Recognition

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks