ECG Heartbeat Classification Using Multimodal Fusion (2021-07-21T00:00:00.000000Z)

TL;DR

The superiority of the proposed fusion models for ECG heart beat classification is demonstrated by performing experiments on PhysioNet’s MIT-BIH dataset for five distinct conditions of arrhythmias which are consistent with the AAMI EC57 protocols and on PTB diagnostics dataset for Myocardial Infarction classification.

Abstract

Electrocardiogram (ECG) is an authoritative source to diagnose and counter critical cardiovascular syndromes such as arrhythmia and myocardial infarction (MI). Current machine learning techniques either depend on manually extracted features or large and complex deep learning networks which merely utilize the 1D ECG signal directly. Since intelligent multimodal fusion can perform at the state-of-the-art level with an efficient deep network, therefore, in this paper, we propose two computationally efficient multimodal fusion frameworks for ECG heart beat classification called Multimodal Image Fusion (MIF) and Multimodal Feature Fusion (MFF). At the input of these frameworks, we convert the raw ECG data into three different images using Gramian Angular Field (GAF), Recurrence Plot (RP) and Markov Transition Field (MTF). In MIF, we first perform image fusion by combining three imaging modalities to create a single image modality which serves as input to the Convolutional Neural Network (CNN). In MFF, we extracted features from penultimate layer of CNNs and fused them to get unique and interdependent information necessary for better performance of classifier. These informational features are finally used to train a Support Vector Machine (SVM) classifier for ECG heart-beat classification. We demonstrate the superiority of the proposed fusion models by performing experiments on PhysioNet’s MIT-BIH dataset for five distinct conditions of arrhythmias which are consistent with the AAMI EC57 protocols and on PTB diagnostics dataset for Myocardial Infarction (MI) classification. We achieved classification accuracy of 99.7% and 99.2% on arrhythmia and MI classification, respectively. Source code at https://github.com/zaamad/ECG-Heartbeat-Classification-Using-Multimodal-Fusion

Authors

Zeeshan Ahmad

1 papers

Anika Tabassum

1 papers

L. Guan

1 papers

TL;DR

Abstract

Authors

References74 items

A Novel 1-D CCANet for ECG Classification

ECG arrhythmia classification by using a recurrence plot and convolutional neural network

Multiclass ECG Signal Analysis Using Global Average-Based 2-D Convolutional Neural Network Modeling

ECG Heartbeat Classification Using Ensemble of Efficient Machine Learning Approaches on Imbalanced Datasets

CNN-Based Multistage Gated Average Fusion (MGAF) for Human Action Recognition Using Depth and Inertial Sensors

Multi-level Stress Assessment Using Multi-domain Fusion of ECG Signal

Fully Convolutional Deep Neural Networks with Optimized Hyperparameters for Detection of Shockable and Non-Shockable Rhythms

Deep Multi-Scale Fusion Neural Network for Multi-Class Arrhythmia Detection

Multi-Channel Lightweight Convolutional Neural Network for Remote Myocardial Infarction Monitoring

A high-precision arrhythmia classification method based on dual fully connected neural network

Automated arrhythmia classification based on a combination network of CNN and LSTM

Generalization of Convolutional Neural Networks for ECG Classification Using Generative Adversarial Networks

Automatic Detection of QRS Complexes Using Dual Channels Based on U-Net and Bidirectional Long Short-Term Memory

A convolutional neural network approach to detect congestive heart failure

Sensor Classification Using Convolutional Neural Network by Encoding Multivariate Time Series as Two-Dimensional Colored Images

Dense Convolutional Networks With Focal Loss and Image Generation for Electrocardiogram Classification

Localization of Myocardial Infarction From Multi-Lead ECG Signals Using Multiscale Analysis and Convolutional Neural Network

Cardiac Arrhythmia Detection from 2D ECG Images by Using Deep Learning Technique

Multi-class Arrhythmia Detection based on Neural Network with Multi-stage Features Fusion

Automated Heartbeat Classification Exploiting Convolutional Neural Network With Channel-Wise Attention

A novel deep convolutional neural network for arrhythmia classification

ECG Arrhythmia Classification Using STFT-Based Spectrogram and Convolutional Neural Network

Spectro-Temporal Feature Based Multi-Channel Convolutional Neural Network for ECG Beat Classification

Morphological Arrhythmia Automated Diagnosis Method Using Gray-Level Co-Occurrence Matrix Enhanced Convolutional Neural Network

A Novel Arrhythmia Classification Method Based On Convolutional Neural Networks Interpretation of Electrocardiogram Images

A Novel Wearable Electrocardiogram Classification System Using Convolutional Neural Networks and Active Learning

Towards Improved Human Action Recognition Using Convolutional Neural Networks and Multimodal Fusion of Depth and Inertial Sensor Data

Deep Convolutional Neural Networks and Learning ECG Features for Screening Paroxysmal Atrial Fibrillation Patients

Multi-Channel Lightweight Convolution Neural Network for Anterior Myocardial Infarction Detection

Real-Time Multilead Convolutional Neural Network for Myocardial Infarction Detection

Multiscaled Fusion of Deep Convolutional Neural Networks for Screening Atrial Fibrillation From Single Lead Short ECG Recordings

Automated ECG Classification Using Dual Heartbeat Coupling Based on Convolutional Neural Network

ECG Heartbeat Classification: A Deep Transferable Representation

Application of deep convolutional neural network for automated detection of myocardial infarction using ECG signals

Influence of beat-to-beat blood pressure variability on vascular elasticity in hypertensive population

Electrocardiograph (ECG) Recognition Based on Graphical Fusion with Geometric Algebra

ECG-based biometrics using recurrent neural networks

Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks

Imaging Time-Series to Improve Classification and Imputation

Prediction of acute myocardial infarction with artificial neural networks in patients with nondiagnostic electrocardiogram

Multiscale Energy and Eigenspace Approach to Detection and Localization of Myocardial Infarction

ECG Biometric with Abnormal Cardiac Conditions in Remote Monitoring System

A review of unsupervised feature learning and deep learning for time-series modeling

Heartbeat classification using disease-specific feature selection

ANSI/AAMI EC57:2012/(R)2020; Testing and reporting performance results of cardiac rhythm and ST segment measurement algorithms

ImageNet classification with deep convolutional neural networks

Myocardial infarction classification with multi-lead ECG using hidden Markov models and Gaussian mixture models

ECG Analysis Using Multiple Instance Learning for Myocardial Infarction Detection

Feature selection via dimensionality reduction for object class recognition

Active Learning Methods for Electrocardiographic Signal Classification

A comparative study of DWT, CWT and DCT transformations in ECG arrhythmias classification

Image Fusion: Theories, Techniques and Applications

Nutzung der EKG-Signaldatenbank CARDIODAT der PTB über das Internet

Arrhythmia Classification Using Serial Fusion of Support Vector Machines and Logistic Regression

Automatic Image Annotation by Ensemble of Visual Descriptors

Study of heart rate variability signals at sitting and lying postures

Automatic classification of heartbeats using ECG morphology and heartbeat interval features

The impact of the MIT-BIH Arrhythmia Database

An automated ECG classification system based on a neuro-fuzzy system

Real-time discrimination of ventricular tachyarrhythmia with Fourier-transform neural network

A patient-adaptable ECG beat classifier using a mixture of experts approach

Recurrence Plots of Dynamical Systems

Interpretation of Electrocardiogram (ECG) Rhythm by Combined CNN and BiLSTM

A Fast and Accurate Recognition of ECG Signals Based on ELM-LRF and BLSTM Algorithm

Paper Title (use style: paper title)

Entropies for automated detection of coronary artery disease using ECG signals: A review

He is currently pursuing Ph.D. degree with the Department of Electrical and Computer Engineering

Performance Analysis of Support Vector Machine and Neural Networks in Detection of Myocardial Infarction

Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks

Threshold-based Detection of P and T-wave in ECG using New Feature Signal

SMOTE: Synthetic Minority Over-sampling Technique

Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol

Recuplots and cnns for time-series classification

Ecg heartbeat categorization dataset

Field of Study

Journal Information