Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networks
Published in
British Machine Vision Conference(2019)External Links:
TL
TL;DR
This work proposes an rPPG measurement method, which is the first work to use deep spatio-temporal networks for reconstructing precise rP PG signals from raw facial videos, and can achieve superior performance on both HR and HRV levels comparing to the state-of-the-art methods.
Abstract
Recent studies demonstrated that the average heart rate (HR) can be measured from facial videos based on non-contact remote photoplethysmography (rPPG). However for many medical applications (e.g., atrial fibrillation (AF) detection) knowing only the average HR is not sufficient, and measuring precise rPPG signals from face for heart rate variability (HRV) analysis is needed. Here we propose an rPPG measurement method, which is the first work to use deep spatio-temporal networks for reconstructing precise rPPG signals from raw facial videos. With the constraint of trend-consistency with ground truth pulse curves, our method is able to recover rPPG signals with accurate pulse peaks. Comprehensive experiments are conducted on two benchmark datasets, and results demonstrate that our method can achieve superior performance on both HR and HRV levels comparing to the state-of-the-art methods. We also achieve promising results of using reconstructed rPPG signals for AF detection and emotion recognition.
References28 items
1
Atrial Fibrillation Detection From Face Videos by Fusing Subtle Variations
2
SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific
3
DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks
4
The OBF Database: A Large Face Video Database for Remote Physiological Signal Measurement and Atrial Fibrillation Detection
5