Deep learning-based image enhancement for robust remote photoplethysmography in various illumination scenarios

Authors

Shutao Chen, Sui Kei Ho, Jing Wei Chin, Kin Ho Luo, Tsz Tai Chan, Richard H.Y. So, Kwan Long Wong

Publication date

June, 2023

Abstract

Remote photoplethysmography (rPPG) is a non-invasive and convenient approach for measuring human vital signs using a camera. However, accurate measurement can be challenging due to the different illumination of the surrounding environment. In this study, we present a deep learning-based image enhancement model (IEM) inspired by the Retinex theory to improve the robustness of rPPG signal extraction and heart rate (HR) estimation in different lighting conditions. We fine-tuned the IEM with a timeshifted negative Pearson correlation between the PPG signal ground truth and the predicted rPPG signal from a pretrained 3D CNN (PhysNet). We evaluated our method using a publicly available dataset (BH-rPPG) of various lighting scenarios and our own private dataset. Our results demonstrate that our proposed model is generalizable and significantly improves rPPG extraction and HR estimation accuracies across a range of illumination intensities.

 

For full article, please visit this link:

https://openaccess.thecvf.com/content/CVPR2023W/CVPM/papers/Ho_Deep_Learning-Based_Image_Enhancement_for_Robust_Remote_Photoplethysmography_in_Various_CVPRW_2023_paper.pdf

Another
Research

Optimizing Camera Exposure Control Settings for Remote Vital Sign Measurements in Low...

Read more

Camera-based heart rate variability and stress measurement from facial videos

Read more

Vitals: Camera-based Physiological Monitoring and Health Management Platform

Read more