Real-Time Monitoring of User Stress, Heart Rate and Heart Rate Variability on Mobile Devices
TL
TL;DR
The Beam AI SDK is introduced, which can monitor user stress through the selfie camera in real-time and demonstrate an average Pearson correlation of 0.801 in determining stress and heart rate variability, thus producing commercially useful readings to derive content decisions in apps.
Abstract
Stress is considered to be the epidemic of the 21st-century. Yet, mobile apps cannot directly evaluate the impact of their content and services on user stress. We introduce the Beam AI SDK to address this issue. Using our SDK, apps can monitor user stress through the selfie camera in real-time. Our technology extracts the user's pulse wave by analyzing subtle color variations across the skin regions of the user's face. The user's pulse wave is then used to determine stress (according to the Baevsky Stress Index), heart rate, and heart rate variability. We evaluate our technology on the UBFC dataset, the MMSE-HR dataset, and Beam AI's internal data. Our technology achieves 99.2%, 97.8% and 98.5% accuracy for heart rate estimation on each benchmark respectively, a nearly twice lower error rate than competing methods. We further demonstrate an average Pearson correlation of 0.801 in determining stress and heart rate variability, thus producing commercially useful readings to derive content decisions in apps. Our SDK is available for use at www.beamhealth.ai.
References31 items
1
EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Cardiac Measurement
2
Optimizing Autonomic Function Analysis via Heart Rate Variability Associated With Motor Activity of the Human Colon
3
MetaPhys: few-shot adaptation for non-contact physiological measurement
4
Mostly worse, occasionally better: impact of COVID-19 pandemic on the mental health of Canadian children and adolescents
5