3D Deep Learning on Medical Images: A Review (2020-04-01T00:00:00.000000Z)

TL;DR

The history of how the 3D CNN was developed from its machine learning roots is traced, a brief mathematical description of3D CNN is provided and the preprocessing steps required for medical images before feeding them to 3DCNNs are provided.

Abstract

The rapid advancements in machine learning, graphics processing technologies and the availability of medical imaging data have led to a rapid increase in the use of deep learning models in the medical domain. This was exacerbated by the rapid advancements in convolutional neural network (CNN) based architectures, which were adopted by the medical imaging community to assist clinicians in disease diagnosis. Since the grand success of AlexNet in 2012, CNNs have been increasingly used in medical image analysis to improve the efficiency of human clinicians. In recent years, three-dimensional (3D) CNNs have been employed for the analysis of medical images. In this paper, we trace the history of how the 3D CNN was developed from its machine learning roots, we provide a brief mathematical description of 3D CNN and provide the preprocessing steps required for medical images before feeding them to 3D CNNs. We review the significant research in the field of 3D medical imaging analysis using 3D CNNs (and its variants) in different medical areas such as classification, segmentation, detection and localization. We conclude by discussing the challenges associated with the use of 3D CNNs in the medical imaging domain (and the use of deep learning models in general) and possible future trends in the field.

Authors

S. Singh

1 papers

Lipo Wang

2 papers

Sukrit Gupta

1 papers

TL;DR

Abstract

Authors

References144 items

Advanced Normalization Tools (ANTs)

Fully Automated 3D Cardiac MRI Localisation and Segmentation Using Deep Neural Networks

Deep learning of volumetric 3D CNN for fMRI in Alzheimer's disease classification

Automatic Multi-organ Segmentation in Dual Energy CT (DECT) with Dedicated 3D Fully Convolutional DECT Networks.

Classification and Visualization of Alzheimer’s Disease using Volumetric Convolutional Neural Network and Transfer Learning

Fast and Accurate Electron Microscopy Image Registration with 3D Convolution

Multi‐Scale 3D U‐Nets: An approach to automatic segmentation of brain tumor

3-D Convolutional Neural Networks for Automatic Detection of Pulmonary Nodules in Chest CT

Segmentation

Decoding brain functional connectivity implicated in AD and MCI

Pulmonary nodule detection in CT scans with equivariant CNNs

One-Pass Multi-Task Networks With Cross-Task Guided Attention for Brain Tumor Segmentation

Image Thresholding Improves 3-Dimensional Convolutional Neural Network Diagnosis of Different Acute Brain Hemorrhages on Computed Tomography Scans

OBELISK‐Net: Fewer layers to solve 3D multi‐organ segmentation with sparse deformable convolutions

Deep Learning Framework for Alzheimer’s Disease Diagnosis via 3D-CNN and FSBi-LSTM

Automated pulmonary nodule detection in CT images using 3D deep squeeze-and-excitation networks

Weakly supervised 3D deep learning for breast cancer classification and localization of the lesions in MR images

3D whole brain segmentation using spatially localized atlas network tiles

Unsupervised 3D End-to-End Medical Image Registration With Volume Tweening Network

Prediction of Lymph Node Maximum Standardized Uptake Value in Patients With Cancer Using a 3D Convolutional Neural Network: A Proof-of-Concept Study.

Automated segmentation of knee bone and cartilage combining statistical shape knowledge and convolutional neural networks: Data from the Osteoarthritis Initiative

Single-Pixel Imaging and Its Application in Three-Dimensional Reconstruction: A Brief Review

Automatic lung nodule detection using a 3D deep convolutional neural network combined with a multi-scale prediction strategy in chest CTs

Combining MRF-based deformable registration and deep binary 3D-CNN descriptors for large lung motion estimation in COPD patients

Coronary artery centerline extraction in cardiac CT angiography using a CNN‐based orientation classifier

AIRNet: Self-Supervised Affine Registration for 3D Medical Images using Neural Networks

S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation

Combining many-objective radiomics and 3D convolutional neural network through evidential reasoning to predict lymph node metastasis in head and neck cancer

3D deep learning for detecting pulmonary nodules in CT scans

Fully Automated Convolutional Neural Network Method for Quantification of Breast MRI Fibroglandular Tissue and Background Parenchymal Enhancement

VP‐Nets : Efficient automatic localization of key brain structures in 3D fetal neurosonography

H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes

Automatic Segmentation of 3D Perivascular Spaces in 7T MR Images Using Multi-Channel Fully Convolutional Network.

Machine learning, natural language programming, and electronic health records: The next step in the artificial intelligence journey?

Attaining human-level performance for anatomical landmark detection in 3D CT data

Attaining Human-Level Performance with Atlas Location Autocontext for Anatomical Landmark Detection in 3D CT Data

FMRIPrep: a robust preprocessing pipeline for functional MRI

3D multi‐scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi‐modality MR Images

Classification of Alzheimer’s Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling

Real-Time Deep Pose Estimation With Geodesic Loss for Image-to-Template Rigid Registration

An application of cascaded 3D fully convolutional networks for medical image segmentation

Visual Explanations From Deep 3D Convolutional Neural Networks for Alzheimer's Disease Classification

The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches

Cerebral microbleed detection in traumatic brain injury patients using 3D convolutional neural networks

A primitive study on unsupervised anomaly detection with an autoencoder in emergency head CT volumes

Classification of brain MRI with big data and deep 3D convolutional neural networks

Deep 3D convolution neural network for CT brain hemorrhage classification

3D regression neural network for the quantification of enlarged perivascular spaces in brain MRI

An Unsupervised Learning Model for Deformable Medical Image Registration

Deep Learning for Detecting Processing History of Images

A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation

A 3D Coarse-to-Fine Framework for Automatic Pancreas Segmentation

Deep-learning-based ghost imaging

Regularization for Deep Learning: A Taxonomy

3D deeply supervised network for automated segmentation of volumetric medical images

H-DenseUNet: Hybrid Densely Connected UNet for Liver and Liver Tumor Segmentation from CT Volumes

Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge

Hybrid Loss Guided Convolutional Networks for Whole Heart Parsing

3D U-net with Multi-level Deep Supervision: Fully Automatic Segmentation of Proximal Femur in 3D MR Images

Nonrigid Image Registration Using Multi-scale 3D Convolutional Neural Networks

EnzyNet: enzyme classification using 3D convolutional neural networks on spatial representation

Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection

Deep Learning in Medical Image Analysis.

3D deep convolutional neural networks for amino acid environment similarity analysis

Imitating the brain with neurocomputer a “new” way towards artificial general intelligence

Dynamic 2-D/3-D Rigid Registration Framework Using Point-To-Plane Correspondence Model

Lung nodule detection in CT using 3D convolutional neural networks

ConvNet-Based Localization of Anatomical Structures in 3-D Medical Images

CNN-based Segmentation of Medical Imaging Data

3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study

Feature selection methods for big data bioinformatics: A survey from the search perspective.

DeepMedic for Brain Tumor Segmentation

3D FractalNet: Dense Volumetric Segmentation for Cardiovascular MRI Volumes

Fast Fully Automatic Segmentation of the Human Placenta from Motion Corrupted MRI

3D Deep Learning for Multi-modal Imaging-Guided Survival Time Prediction of Brain Tumor Patients

3D Convolutional Neural Networks for Brain Tumor Segmentation: A Comparison of Multi-resolution Architectures