Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions (2021-08-02T00:00:00.000000Z)

TL;DR

A structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised, which can be used as a reference guide for both academia and industry professionals.

Abstract

Deep learning (DL), a branch of machine learning (ML) and artificial intelligence (AI) is nowadays considered as a core technology of today’s Fourth Industrial Revolution (4IR or Industry 4.0). Due to its learning capabilities from data, DL technology originated from artificial neural network (ANN), has become a hot topic in the context of computing, and is widely applied in various application areas like healthcare, visual recognition, text analytics, cybersecurity, and many more. However, building an appropriate DL model is a challenging task, due to the dynamic nature and variations in real-world problems and data. Moreover, the lack of core understanding turns DL methods into black-box machines that hamper development at the standard level. This article presents a structured and comprehensive view on DL techniques including a taxonomy considering various types of real-world tasks like supervised or unsupervised. In our taxonomy, we take into account deep networks for supervised or discriminative learning, unsupervised or generative learning as well as hybrid learning and relevant others. We also summarize real-world application areas where deep learning techniques can be used. Finally, we point out ten potential aspects for future generation DL modeling with research directions. Overall, this article aims to draw a big picture on DL modeling that can be used as a reference guide for both academia and industry professionals.

Authors

Iqbal H. Sarker

6 papers

TL;DR

Abstract

Authors

References141 items

Google Trends

Automatic and Robust Object Detection in X-Ray Baggage Inspection Using Deep Convolutional Neural Networks

Energy-Net: A Deep Learning Approach for Smart Energy Management in IoT-Based Smart Cities

On the platform but will they buy? Predicting customers' purchase behavior using deep learning

Predictive Analytics for Smart Parking: A Deep Learning Approach in Forecasting of IoT Data

Soil monitoring and evaluation system using EDL‐ASQE: Enhanced deep learning model for IoT smart agriculture network

A review of deep learning methods for semantic segmentation of remote sensing imagery

Data Science and Analytics: An Overview from Data-Driven Smart Computing, Decision-Making and Applications Perspective

Domain Knowledge-Based Deep-Broad Learning Framework for Fault Diagnosis

A review on the attention mechanism of deep learning

CyberLearning: Effectiveness Analysis of Machine Learning Security Modeling to Detect Cyber-Anomalies and Multi-Attacks

Machine Learning: Algorithms, Real-World Applications and Research Directions

Big data based stock trend prediction using deep CNN with reinforcement-LSTM model

Deep Cybersecurity: A Comprehensive Overview from Neural Network and Deep Learning Perspective

Domain Adversarial Reinforcement Learning

Generative adversarial network: An overview of theory and applications

AI-Driven Cybersecurity: An Overview, Security Intelligence Modeling and Research Directions

Cyber security in smart cities: A review of deep learning-based applications and case studies

The architectural design of smart blind assistant using IoT with deep learning paradigm

A reinforcement learning and deep learning based intelligent system for the support of impaired patients in home treatment

CNN-based transfer learning–BiLSTM network: A novel approach for COVID-19 infection detection

CNN-based feature cross and classifier for loan default prediction

ABC-RuleMiner: User behavioral rule-based machine learning method for context-aware intelligent services

Mobile Data Science and Intelligent Apps: Concepts, AI-Based Modeling and Research Directions

Multi-Step Short-Term Power Consumption Forecasting Using Multi-Channel LSTM With Time Location Considering Customer Behavior

Are GRU Cells More Specific and LSTM Cells More Sensitive in Motive Classification of Text?

A Real-Time Collision Prediction Mechanism With Deep Learning for Intelligent Transportation System

A combined deep CNN-LSTM network for the detection of novel coronavirus (COVID-19) using X-ray images

Cybersecurity data science: an overview from machine learning perspective

An intelligent Chatbot using deep learning with Bidirectional RNN and attention model

IntruDTree: A Machine Learning Based Cyber Security Intrusion Detection Model

DNNRec: A novel deep learning based hybrid recommender system

ContextPCA: Predicting Context-Aware Smartphone Apps Usage Based On Machine Learning Techniques

A survey of autoencoder-based recommender systems

Application of deep reinforcement learning to intrusion detection for supervised problems

Deep learning-based intelligent face recognition in IoT-cloud environment

Toward multi-label sentiment analysis: a transfer learning based approach

Convolutional neural networks for object detection in aerial imagery for disaster response and recovery

A Survey on Deep Learning Empowered IoT Applications

PyTorch: An Imperative Style, High-Performance Deep Learning Library

The Performance of LSTM and BiLSTM in Forecasting Time Series

Deep Learning Based Plant Disease Detection for Smart Agriculture

BehavDT: A Behavioral Decision Tree Learning to Build User-Centric Context-Aware Predictive Model

Transfer Learning for Molecular Cancer Classification Using Deep Neural Networks

Context-aware rule learning from smartphone data: survey, challenges and future directions

A Survey on the Development of Self-Organizing Maps for Unsupervised Intrusion Detection

A smart agriculture IoT system based on deep reinforcement learning

Deep Autoencoder Based Neural Networks for Coronary Heart Disease Risk Prediction

AppsPred: Predicting Context-Aware Smartphone Apps using Random Forest Learning

Recommendation system based on deep learning methods: a systematic review and new directions

Toward RNN Based Micro Non-verbal Behavior Generation for Virtual Listener Agents

Domain-specific cues improve robustness of deep learning-based segmentation of CT volumes

Supervised Determined Source Separation with Multichannel Variational Autoencoder

Effectiveness analysis of machine learning classification models for predicting personalized context-aware smartphone usage

RecencyMiner: mining recency-based personalized behavior from contextual smartphone data

An Introduction to Variational Autoencoders

Analysis of computer user behavior, security incidents and fraud using Self-Organizing Maps

Sherlock: A Deep Learning Approach to Semantic Data Type Detection

A Survey on Deep Learning based Brain Computer Interface: Recent Advances and New Frontiers

Deep-Sentiment: Sentiment Analysis Using Ensemble of CNN and Bi-LSTM Models

An Attentive Survey of Attention Models

A Deep Learning-Based Intelligent Medicine Recognition System for Chronic Patients

A Knowledge-Based Recommendation System That Includes Sentiment Analysis and Deep Learning

A Machine Learning based Robust Prediction Model for Real-life Mobile Phone Data

Hybrid Deep-Learning-Based Anomaly Detection Scheme for Suspicious Flow Detection in SDN: A Social Multimedia Perspective

New attacks on RNN based healthcare learning system and their detections

Deep Learning Approach Combining Sparse Autoencoder With SVM for Network Intrusion Detection

Zero-day malware detection using transferred generative adversarial networks based on deep autoencoders

A Survey on Deep Transfer Learning

A Deep CNN-LSTM Model for Particulate Matter (PM2.5) Forecasting in Smart Cities

INDUSTRY 4.0 – ARE WE READY?

Deep Learning Method for Denial of Service Attack Detection Based on Restricted Boltzmann Machine

Machine Learning and Deep Learning Methods for Cybersecurity

Effective android malware detection with a hybrid model based on deep autoencoder and convolutional neural network

Aspect-Based Financial Sentiment Analysis using Deep Learning

Multi-modality Sensor Data Classification with Selective Attention