Autoencoders and their applications in machine learning: a survey (2024-02-01T00:00:00.000000Z)

TL;DR

A comprehensive survey of autoencoders is presented, starting with an explanation of the principle of conventional autoencoder and their primary development process, and a taxonomy of autoencoders based on their structures and principles is provided.

Abstract

Autoencoders have become a hot researched topic in unsupervised learning due to their ability to learn data features and act as a dimensionality reduction method. With rapid evolution of autoencoder methods, there has yet to be a complete study that provides a full autoencoders roadmap for both stimulating technical improvements and orienting research newbies to autoencoders. In this paper, we present a comprehensive survey of autoencoders, starting with an explanation of the principle of conventional autoencoder and their primary development process. We then provide a taxonomy of autoencoders based on their structures and principles and thoroughly analyze and discuss the related models. Furthermore, we review the applications of autoencoders in various fields, including machine vision, natural language processing, complex network, recommender system, speech process, anomaly detection, and others. Lastly, we summarize the limitations of current autoencoder algorithms and discuss the future directions of the field.

Authors

Kamal Berahmand

1 papers

Fatemeh Daneshfar

1 papers

Elaheh Sadat Salehi

1 papers

TL;DR

Abstract

Authors

References100 items

Integration of hyperspectral imaging and autoencoders: Benefits, applications, hyperparameter tunning and challenges

DAC-HPP: deep attributed clustering with high-order proximity preserve

Fuzzy CNN Autoencoder for Unsupervised Anomaly Detection in Log Data

Elastic deep autoencoder for text embedding clustering by an improved graph regularization

Ensemble deep learning in speech signal tasks: A review

A Survey on Masked Autoencoder for Visual Self-supervised Learning

Pyramid-VAE-GAN: Transferring hierarchical latent variables for image inpainting

Iterative cleaning and learning of big highly-imbalanced fraud data using unsupervised learning

Credit Card Fraud Detection Based on Unsupervised Attentional Anomaly Detection Network

Variational gated autoencoder-based feature extraction model for inferring disease-miRNA associations based on multiview features

Detecting insurance fraud using supervised and unsupervised machine learning

A novel combined approach based on deep Autoencoder and deep classifiers for credit card fraud detection

Auto-Encoders in Deep Learning—A Review with New Perspectives

A comprehensive survey on design and application of autoencoder in deep learning

A Generalized Deep Learning Clustering Algorithm Based on Non-Negative Matrix Factorization

Variational autoencoder for prosody‐based speaker recognition

A probabilistic framework for product health monitoring in multistage manufacturing using Unsupervised Artificial Neural Networks and Gaussian Processes

Multichannel Variational Autoencoder-Based Speech Separation in Designated Speaker Order

A review on autoencoder based representation learning for fault detection and diagnosis in industrial processes

Factor Analysis and Dimension Reduction in R

An autoencoder-based feature level fusion for speech emotion recognition

Effective network intrusion detection via representation learning: A Denoising AutoEncoder approach

CNN Architectures and Feature Extraction Methods for EEG Imaginary Speech Recognition

Graph autoencoder-based unsupervised outlier detection

GraphMAE: Self-Supervised Masked Graph Autoencoders

A Deep Learning Approach to Network Intrusion Detection Using a Proposed Supervised Sparse Auto-encoder and SVM

FDCNet: Presentation of the Fuzzy CNN and Fractal Feature Extraction for Detection and Classification of Tumors

Deep Neuro-Fuzzy System application trends, challenges, and future perspectives: a systematic survey

Semi-Supervised Learning for Defect Segmentation with Autoencoder Auxiliary Module

Manifold-Based Multi-Deep Belief Network for Feature Extraction of Hyperspectral Image

An overview and empirical comparison of natural language processing (NLP) models and an introduction to and empirical application of autoencoder models in marketing

Survey of Deep Learning Paradigms for Speech Processing

Ensemble unsupervised autoencoders and Gaussian mixture model for cyberattack detection

Bayesian autoencoders with uncertainty quantification: Towards trustworthy anomaly detection

Deep text clustering using stacked AutoEncoder

Multi-Scale Variational Graph AutoEncoder for Link Prediction

Graph regularized locally linear embedding for unsupervised feature selection

An Overview of Variational Autoencoders for Source Separation, Finance, and Bio-Signal Applications

Bimodal variational autoencoder for audiovisual speech recognition

Multi actor hierarchical attention critic with RNN-based feature extraction

Masked Face Recognition Using Deep Learning: A Review

Face feature point detection based on nonlinear high-dimensional space

Self-supervised pretraining via contrast learning for intelligent incipient fault detection of bearings

A Survey of Autoencoder Algorithms to Pave the Diagnosis of Rare Diseases

A survey on feature selection methods for mixed data

A Transformer-Based Hierarchical Variational AutoEncoder Combined Hidden Markov Model for Long Text Generation

Fat-saturated image generation from multi-contrast MRIs using generative adversarial networks with Bloch equation-based autoencoder regularization

Facial image denoising using AutoEncoder and UNET

Analysis of Autoencoders for Network Intrusion Detection †

A comprehensive review of computer-aided whole-slide image analysis: from datasets to feature extraction, segmentation, classification and detection approaches

Factor Analysis as a Tool for Survey Analysis

Semi-Supervised Classification on Credit Card Fraud Detection using AutoEncoders

Various dimension reduction techniques for high dimensional data analysis: a review

Forecasting and Anomaly Detection approaches using LSTM and LSTM Autoencoder techniques with the applications in supply chain management

Reviewing Autoencoders for Missing Data Imputation: Technical Trends, Applications and Outcomes

Enhanced balancing GAN: minority-class image generation

Dynamical Variational Autoencoders: A Comprehensive Review

Text feature extraction based on stacked variational autoencoder

One2Multi Graph Autoencoder for Multi-view Graph Clustering

Multiresolution Convolutional Autoencoders

Applications of machine learning to machine fault diagnosis: A review and roadmap

A novel statistical analysis and autoencoder driven intelligent intrusion detection approach

A survey of autoencoder-based recommender systems

A Review of Multi-Objective Deep Learning Speech Denoising Methods

End-to-end recurrent denoising autoencoder embeddings for speaker identification

Cost-sensitive dual-bidirectional linear discriminant analysis

Gravity-Inspired Graph Autoencoders for Directed Link Prediction

Text Classification Algorithms: A Survey

A semi-supervised auto-encoder using label and sparse regularizations for classification

A survey on Deep Learning based bearing fault diagnosis

Semi-supervised dimensional sentiment analysis with variational autoencoder

Deep Learning for Anomaly Detection

Facial Expression Analysis under Partial Occlusion

Variational Autoencoders for Collaborative Filtering

A practical tutorial on autoencoders for nonlinear feature fusion: Taxonomy, models, software and guidelines

IDAE: Imputation-boosted Denoising Autoencoder for Collaborative Filtering