Optimising rPPG Signal Extraction by Exploiting Facial Surface Orientation

Authors

Kwan Long Wong, Jing Wei Chin, Tsz Tai Chan, Ismoil Odinae, Kristian Suhartono, Kang Tianqu, Richard H.Y. So

Publication date

June, 2022

Abstract

Remote photoplethysmography (rPPG) is a contactless method to measure human vital signs by detecting subtle skin color changes through a camera. Although many studies have used region of interest (ROI) selection tools to improve rPPG signal extraction, no study has investigated the influence of the ROI’s surface orientation. We propose a novel ‘angle map’ representation of the face to study the effects of the surface orientation on the extracted rPPG signal. The angle map is generated by mapping each facial pixel to an angle of reflection (angle between the skin surface and the camera) calculated from the surface normal of the facial landmarks and the camera axis. Our results show that surface orientation significantly affects the correlation between the extracted rPPG signal and ground truth blood volume pulse (BVP). Regions with small angles of reflection contained stronger signals, which explains why areas near the cheeks and forehead are often chosen for rPPG signal extraction. Moreover, we applied a thresholding method to the angle map and demonstrated its potential for dynamic ROI selection, thereby optimising the rPPG signal extraction process

 

For full article, please visit this link:

https://openaccess.thecvf.com/content/CVPR2022W/CVPM/papers/Wong_Optimising_rPPG_Signal_Extraction_by_Exploiting_Facial_Surface_Orientation_CVPRW_2022_paper.pdf

Another
Research

Optimizing Camera Exposure Control Settings for Remote Vital Sign Measurements in Low...

Read more

Deep learning-based image enhancement for robust remote photoplethysmography in vario...

Read more

Camera-based heart rate variability and stress measurement from facial videos

Read more