Development of a Novel Web Camera-Based Contact-Free Major Depressive Disorder Screening System Using Autonomic Nervous Responses Induced by a Mental Task and Its Clinical Application

The Use of Photoplethysmography in the Assessment of Mental Health: Scoping Review

BACKGROUND

With the rise in mental health problems globally, mobile health provides opportunities for timely medical care and accessibility. One emerging area of mobile health involves the use of photoplethysmography (PPG) to assess and monitor mental health.

OBJECTIVE

In recent years, there has been an increase in the use of PPG-based technology for mental health. Therefore, we conducted a review to understand how PPG has been evaluated to assess a range of mental health and psychological problems, including stress, depression, and anxiety.

METHODS

A scoping review was performed using PubMed and Google Scholar databases.

RESULTS

A total of 24 papers met the inclusion criteria and were included in this review. We identified studies that assessed mental health via PPG using finger- and face-based methods as well as smartphone-based methods. There was variation in study quality. PPG holds promise as a potential complementary technology for detecting changes in mental health, including depression and anxiety. However, rigorous validation is needed in diverse clinical populations to advance PPG technology in tackling mental health problems.

CONCLUSIONS

PPG holds promise for assessing mental health problems; however, more research is required before it can be widely recommended for clinical use.

Clinical applications of contactless photoplethysmography for monitoring in adults: A systematic review and meta-analysis

Contactless photoplethysmography (cPPG) is a method of physiological monitoring. It differs from conventional monitoring methods (e.g., saturation probe) by ensuring no contact with the subject by use of a camera. The majority of research on cPPG is conducted in a laboratory setting or in healthy populations. This review aims to evaluate the current literature on monitoring using cPPG in adults within a clinical setting. Adhering to the Preferred Items for Systematic Reviews and Meta-analysis (PRISMA, 2020) guidelines, OVID, Webofscience, Cochrane library, and clinicaltrials.org were systematically searched by two researchers. Research articles using cPPG for monitoring purposes in adults within a clinical setting were selected. Twelve studies with a total of 654 individuals were included. Heart rate (HR) was the most investigated vital sign (n = 8) followed by respiratory rate ((n = 2), Sp02 (n = 2), and HR variability (n = 2). Four studies were included in a meta-analysis of HR compared to ECG data which demonstrated a mean bias of -0.13 (95% CI, -1.22-0.96). This study demonstrates cPPG can be a useful tool in the remote monitoring of patients and has demonstrated accuracy for HR. However, further research is needed into the clinical applications of this method.

Screening for Major Depressive Disorder Using a Wearable Ultra-Short-Term HRV Monitor and Signal Quality Indices

To encourage potential major depressive disorder (MDD) patients to attend diagnostic sessions, we developed a novel MDD screening system based on sleep-induced autonomic nervous responses. The proposed method only requires a wristwatch device to be worn for 24 h. We evaluated heart rate variability (HRV) via wrist photoplethysmography (PPG). However, previous studies have indicated that HRV measurements obtained using wearable devices are susceptible to motion artifacts. We propose a novel method to improve screening accuracy by removing unreliable HRV data (identified on the basis of signal quality indices (SQIs) obtained by PPG sensors). The proposed algorithm enables real-time calculation of signal quality indices in the frequency domain (SQI-FD). A clinical study conducted at Maynds Tower Mental Clinic enrolled 40 MDD patients (mean age, 37.5 ± 8.8 years) diagnosed on the basis of the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, and 29 healthy volunteers (mean age, 31.9 ± 13.0 years). Acceleration data were used to identify sleep states, and a linear classification model was trained and tested using HRV and pulse rate data. Ten-fold cross-validation showed a sensitivity of 87.3% (80.3% without SQI-FD data) and specificity of 84.0% (73.3% without SQI-FD data). Thus, SQI-FD drastically improved sensitivity and specificity.

Resting-state EEG-based convolutional neural network for the diagnosis of depression and its severity

Purpose: The study aimed to assess the value of the resting-state electroencephalogram (EEG)-based convolutional neural network (CNN) method for the diagnosis of depression and its severity in order to better serve depressed patients and at-risk populations.

Methods: In this study, we used the resting state EEG-based CNN to identify depression and evaluated its severity. The EEG data were collected from depressed patients and healthy people using the Nihon Kohden EEG-1200 system. Analytical processing of resting-state EEG data was performed using Python and MATLAB software applications. The questionnaire included the Self-Rating Anxiety Scale (SAS), Self-Rating Depression Scale (SDS), Symptom Check-List-90 (SCL-90), and the Eysenck Personality Questionnaire (EPQ).

Results: A total of 82 subjects were included in this study, with 41 in the depression group and 41 in the healthy control group. The area under the curve (AUC) of the resting-state EEG-based CNN in depression diagnosis was 0.74 (95%CI: 0.70–0.77) with an accuracy of 66.40%. In the depression group, the SDS, SAS, SCL-90 subscales, and N scores were significantly higher in the major depression group than those in the non-major depression group (p < 0.05). The AUC of the model in depression severity was 0.70 (95%CI: 0.65–0.75) with an accuracy of 66.93%. Correlation analysis revealed that major depression AI scores were significantly correlated with SAS scores (r = 0.508, p = 0.003) and SDS scores (r = 0.765, p < 0.001).

Conclusion: Our model can accurately identify the depression-specific EEG signal in terms of depression diagnosis and severity identification. It would eventually provide new strategies for early diagnosis of depression and its severity.

Development of a Novel Vital-Signs-Based Infection Screening Composite-Type Camera With Truncus Motion Removal Algorithm to Detect COVID-19 Within 10 Seconds and Its Clinical Validation

Background: To conduct a rapid preliminary COVID-19 screening prior to polymerase chain reaction (PCR) test under clinical settings, including patient’s body moving conditions in a non-contact manner, we developed a mobile and vital-signs-based infection screening composite-type camera (VISC-Camera) with truncus motion removal algorithm (TMRA) to screen for possibly infected patients.

Methods: The VISC-Camera incorporates a stereo depth camera for respiratory rate (RR) determination, a red–green–blue (RGB) camera for heart rate (HR) estimation, and a thermal camera for body temperature (BT) measurement. In addition to the body motion removal algorithm based on the region of interest (ROI) tracking for RR, HR, and BT determination, we adopted TMRA for RR estimation. TMRA is a reduction algorithm of RR count error induced by truncus non-respiratory front-back motion measured using depth-camera-determined neck movement. The VISC-Camera is designed for mobile use and is compact (22 cm × 14 cm × 4 cm), light (800 g), and can be used in continuous operation for over 100 patients with a single battery charge. The VISC-Camera discriminates infected patients from healthy people using a logistic regression algorithm using RR, HR, and BT as explanatory variables. Results are available within 10 s, including imaging and processing time. Clinical testing was conducted on 154 PCR positive COVID-19 inpatients (aged 18–81 years; M/F = 87/67) within the initial 48 h of hospitalization at the First Central Hospital of Mongolia and 147 healthy volunteers (aged 18–85 years, M/F = 70/77). All patients were on treatment with antivirals and had body temperatures <37.5°C. RR measured by visual counting, pulsimeter-determined HR, and BT determined by thermometer were used for references.

Result: 10-fold cross-validation revealed 91% sensitivity and 90% specificity with an area under receiver operating characteristic curve of 0.97. The VISC-Camera-determined HR, RR, and BT correlated significantly with those measured using references (RR: r = 0.93, p < 0.001; HR: r = 0.97, p < 0.001; BT: r = 0.72, p < 0.001).

Conclusion: Under clinical settings with body motion, the VISC-Camera with TMRA appears promising for the preliminary screening of potential COVID-19 infection for afebrile patients with the possibility of misdiagnosis as asymptomatic.

Multi-ROI Spectral Approach for the Continuous Remote Cardio-Respiratory Monitoring from Mobile Device Built-In Cameras

Heart rate (HR) and respiratory rate (f_R) can be estimated by processing videos framing the upper body and face regions without any physical contact with the subject. This paper proposed a technique for continuously monitoring HR and f_R via a multi-ROI approach based on the spectral analysis of RGB video frames recorded with a mobile device (i.e., a smartphone's camera). The respiratory signal was estimated by the motion of the chest, whereas the cardiac signal was retrieved from the pulsatile activity at the level of right and left cheeks and forehead. Videos were recorded from 18 healthy volunteers in four sessions with different user-camera distances (i.e., 0.5 m and 1.0 m) and illumination conditions (i.e., natural and artificial light). For HR estimation, three approaches were investigated based on single or multi-ROI approaches. A commercially available multiparametric device was used to record reference respiratory signals and electrocardiogram (ECG). The results demonstrated that the multi-ROI approach outperforms the single-ROI approach providing temporal trends of both the vital parameters comparable to those provided by the reference, with a mean absolute error (MAE) consistently below 1 breaths·min^-1 for f_R in all the scenarios, and a MAE between 0.7 bpm and 6 bpm for HR estimation, whose values increase at higher distances.

Contactless Vital Sign Monitoring System for Heart and Respiratory Rate Measurements with Motion Compensation Using a Near-Infrared Time-of-Flight Camera

This study describes a contactless vital sign monitoring (CVSM) system capable of measuring heart rate (HR) and respiration rate (RR) using a low-power, indirect time-of-flight (ToF) camera. The system takes advantage of both the active infrared illumination as well as the additional depth information from the ToF camera to compensate for the motion-induced artifacts during the HR measurements. The depth information captures how the user is moving with respect to the camera and, therefore, can be used to differentiate where the intensity change in the raw signal is from the underlying heartbeat or motion. Moreover, from the depth information, the system can acquire respiration rate by directly measuring the motion of the chest wall during breathing. We also conducted a pilot human study using this system with 29 participants of different demographics such as age, gender, and skin color. Our study shows that with depth-based motion compensation, the success rate (system measurement within 10% of reference) of HR measurements increases to 75%, as compared to 35% when motion compensation is not used. The mean HR deviation from the reference also drops from 21 BPM to −6.25 BPM when we apply the depth-based motion compensation. In terms of the RR measurement, our system shows a mean deviation of 1.7 BPM from the reference measurement. The pilot human study shows the system performance is independent of skin color but weakly dependent on gender and age.