Non-Contact Physiological Measurement System for Wearing Masks During the Epidemic

Physiological signals indicate a person’s physical and mental state at any given time. Accordingly, many studies extract physiological signals from the human body with non-contact methods, and most of them require facial feature points. However, under COVID-19, wearing a mask has become a must in many places, so how non-contact physiological information measurements can still be performed correctly even when a mask covers the facial information has become a focus of research. In this study, RGB and thermal infrared cameras were used to execute non-contact physiological information measurement systems for heart rate, blood pressure, respiratory rate, and forehead temperature for people wearing masks due to the pandemic. Using the green (G) minus red (R) signal in the RGB image, the region of interest (ROI) is established in the forehead and nose bridge regions. The photoplethysmography (PPG) waveforms of the two regions are obtained after the acquired PPG signal is subjected to the optical flow method, baseline drift calibration, normalization, and bandpass filtering. The relevant parameters in Deep Neural Networks (DNN) for the regression model can correctly predict the heartbeat and blood pressure. In addition, the temperature change in the ROI of the mask after thermal image processing and filtering can be used to correctly determine the number of breaths. Meanwhile, the thermal image can be used to read the temperature average of the ROI of the forehead, and the forehead temperature can be obtained smoothly. The experimental results show that the above-mentioned physiological signals of a subject can be obtained in 6-s images with the error for both heart rate and blood pressure within 2%~3% and the error of forehead temperature within ±0.5°C.