1
|
Alves R, van Meulen F, Overeem S, Zinger S, Stuijk S. Thermal Cameras for Continuous and Contactless Respiration Monitoring. SENSORS (BASEL, SWITZERLAND) 2024; 24:8118. [PMID: 39771853 PMCID: PMC11679429 DOI: 10.3390/s24248118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Revised: 12/04/2024] [Accepted: 12/16/2024] [Indexed: 01/11/2025]
Abstract
Continuous respiration monitoring is an important tool in assessing the patient's health and diagnosing pulmonary, cardiovascular, and sleep-related breathing disorders. Various techniques and devices, both contact and contactless, can be used to monitor respiration. Each of these techniques can provide different types of information with varying accuracy. Thermal cameras have become a focal point in research due to their contactless nature, affordability, and the type of data they provide, i.e., information on respiration motion and respiration flow. Several studies have demonstrated the feasibility of this technology and developed robust algorithms to extract important information from thermal camera videos. This paper describes the current state-of-the-art in respiration monitoring using thermal cameras, dividing the system into acquiring data, defining and tracking the region of interest, and extracting the breathing signal and respiration rate. The approaches taken to address the various challenges, the limitations of these methods, and possible applications are discussed.
Collapse
Affiliation(s)
- Raquel Alves
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands
- Centre for Sleep Medicine Kempenhaeghe, 5590 AB Heeze, The Netherlands
| | - Fokke van Meulen
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands
- Centre for Sleep Medicine Kempenhaeghe, 5590 AB Heeze, The Netherlands
| | - Sebastiaan Overeem
- Department of Electrical Engineering, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands
- Centre for Sleep Medicine Kempenhaeghe, 5590 AB Heeze, The Netherlands
| | - Svitlana Zinger
- Centre for Sleep Medicine Kempenhaeghe, 5590 AB Heeze, The Netherlands
| | - Sander Stuijk
- Centre for Sleep Medicine Kempenhaeghe, 5590 AB Heeze, The Netherlands
| |
Collapse
|
2
|
Linschmann O, Uguz DU, Romanski B, Baarlink I, Gunaratne P, Leonhardt S, Walter M, Lueken M. A Portable Multi-Modal Cushion for Continuous Monitoring of a Driver's Vital Signs. SENSORS (BASEL, SWITZERLAND) 2023; 23:4002. [PMID: 37112341 PMCID: PMC10144144 DOI: 10.3390/s23084002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/02/2023] [Accepted: 04/06/2023] [Indexed: 06/19/2023]
Abstract
With higher levels of automation in vehicles, the need for robust driver monitoring systems increases, since it must be ensured that the driver can intervene at any moment. Drowsiness, stress and alcohol are still the main sources of driver distraction. However, physiological problems such as heart attacks and strokes also exhibit a significant risk for driver safety, especially with respect to the ageing population. In this paper, a portable cushion with four sensor units with multiple measurement modalities is presented. Capacitive electrocardiography, reflective photophlethysmography, magnetic induction measurement and seismocardiography are performed with the embedded sensors. The device can monitor the heart and respiratory rates of a vehicle driver. The promising results of the first proof-of-concept study with twenty participants in a driving simulator not only demonstrate the accuracy of the heart (above 70% of medical-grade heart rate estimations according to IEC 60601-2-27) and respiratory rate measurements (around 30% with errors below 2 BPM), but also that the cushion might be useful to monitor morphological changes in the capacitive electrocardiogram in some cases. The measurements can potentially be used to detect drowsiness and stress and thus the fitness of the driver, since heart rate variability and breathing rate variability can be captured. They are also useful for the early prediction of cardiovascular diseases, one of the main reasons for premature death. The data are publicly available in the UnoVis dataset.
Collapse
Affiliation(s)
- Onno Linschmann
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| | - Durmus Umutcan Uguz
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| | - Bianca Romanski
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| | - Immo Baarlink
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| | - Pujitha Gunaratne
- Toyota Collaborative Safety Research Center, Toyota Motors Corporation, Ann Arbor, MI 48105, USA
| | - Steffen Leonhardt
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| | - Marian Walter
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| | - Markus Lueken
- Medical Information Technology, Helmholtz Institute, RWTH Aachen University, 52074 Aachen, Germany
| |
Collapse
|
3
|
Teichmann D, Hallmann A, Wolfart S, Teichmann M. Identification of dental pain sensation based on cardiorespiratory signals. BIOMED ENG-BIOMED TE 2021; 66:159-165. [PMID: 33768763 DOI: 10.1515/bmt-2020-0047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Accepted: 09/28/2020] [Indexed: 11/15/2022]
Abstract
The aim of this study is to investigate the feasibility of the detection of brief periods of pain sensation based on cardiorespiratory signals during dental pain triggers. Twenty patients underwent dental treatment and reported their pain events by pressing a push button while ECG, PPG, and thoracic effort signals were simultaneously recorded. Potential pain-indicating features were calculated from the physiological data (sample length of 6 s) and were used for supervised learning of a Random forest pain detector. The best feature combination was determined by Feature forward selection. The best feature combination comprises nine feature groups consisting of four respiratory and five cardiac related groups. The final algorithm achieved a sensitivity of 87% and a specificity of 63% with an AUC of 0.828. Using supervised learning it is possible to train an algorithm to differentiate between short time intervals of pain and no pain solely based on cardiorespiratory signals. An on-site and real-time detection and rating of pain sensations would allow a precise, individuum- and treatment-tailored administration of local anesthesia. Severe phases of pain could be paused or avoided, this would allow more comfortable treatment and yield better patient compliance.
Collapse
Affiliation(s)
- Daniel Teichmann
- Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA, USA.,Chair for Medical Information Technology, RWTH Aachen University, Aachen, Germany.,SDU Health Informatics and Technology, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Odense, Denmark
| | - Alexander Hallmann
- Chair for Medical Information Technology, RWTH Aachen University, Aachen, Germany
| | - Stefan Wolfart
- Department of Prosthodontics and Biomaterials, Center of Implantology, Medical Faculty, RWTH Aachen University, Aachen, Germany
| | - Maren Teichmann
- Department of Prosthodontics and Biomaterials, Center of Implantology, Medical Faculty, RWTH Aachen University, Aachen, Germany.,Forsyth Institute, Cambridge, MA, USA.,Department of Developmental Biology, Harvard School of Dental Medicine, Boston, MA, USA
| |
Collapse
|
4
|
Yu X, Neu W, Vetter P, Bollheimer LC, Leonhardt S, Teichmann D, Antink CH. A Multi-Modal Sensor for a Bed-Integrated Unobtrusive Vital Signs Sensing Array. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2019; 13:529-539. [PMID: 30990438 DOI: 10.1109/tbcas.2019.2911199] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
In this paper, we present a novel unobtrusive multi-modal sensor for monitoring of physiological parameters featuring capacitive electrocardiogram (cECG), reflective photoplethysmogram (rPPG), and magnetic induction monitoring (MI) in a single sensor. The sensor system comprises sensor nodes designed and optimized for integration into a grid-like array of multiple sensors in a bed and a central controller box for data collection and processing. Hence, it is highly versatile in application and suitable for unobtrusive monitoring of vital signs, both in a professional setting and a home-care environment. The presented hardware design takes both inter-modal interference between cECG and MI into account as well as intra-modal interference due to cross talk between two MI sensors in close vicinity. In a lab study, we evaluated a prototype of our new multi-modal sensor with two sensor nodes on four healthy subjects. The subjects were lying on the sensors and exercising with a hand grip in order to increase heart rate and thus evaluate our sensor both during changing physiological parameters as well as a wider range of those. Heart beat intervals and heart rate variability were derived from both cECG and rPPG. Breathing intervals were derived from the MI sensor. For heart beat intervals, we achieved an RMSE of 2.3 ms and a correlation of 0.99 using cECG. Similarly, using rPPG, an RMSE of 18.9 ms with a correlation of 0.99 was achieved. With regard to breathing intervals derived from MI, we achieved an RMSE of 1.12 s and a correlation of 0.90.
Collapse
|
5
|
Teichmann D, Klopp J, Hallmann A, Schuett K, Wolfart S, Teichmann M. Detection of acute periodontal pain from physiological signals. Physiol Meas 2018; 39:095007. [PMID: 30183680 DOI: 10.1088/1361-6579/aadf0c] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
OBJECTIVE To investigate the feasibility of the detection of brief orofacial pain sensations from easily recordable physiological signals by means of machine learning techniques. APPROACH A total of 47 subjects underwent periodontal probing and indicated each instance of pain perception by means of a push button. Simultaneously, physiological signals were recorded and, subsequently, autonomic indices were computed. By using the autonomic indices as input features of a classifier, a pain indicator based on fusion of the various autonomic mechanisms was achieved. Seven patients were randomly chosen for the test set. The rest of the data were utilized for the validation of several classifiers and feature combinations by applying leave-one-out-cross-validation. MAIN RESULTS During the validation process the random forest classifier, using frequency spectral bins of the ECG, wavelet level energies of the ECG and PPG, PPG amplitude, and SPI as features, turned out to be the best pain detection algorithm. The final test of this algorithm on the independent test dataset yielded a sensitivity and specificity of 71% and 70%, respectively. SIGNIFICANCE Based on these results, fusion of autonomic indices by applying machine learning techniques is a promising option for the detection of very brief instances of pain perception, that are not covered by the established indicators.
Collapse
Affiliation(s)
- Daniel Teichmann
- Philips Chair for Medical Information Technology, RWTH Aachen University, Aachen, Germany. Institute for Medical Engineering & Science, Massachusetts Institute of Technology, Cambridge, MA, United States of America
| | | | | | | | | | | |
Collapse
|
6
|
Barbosa Pereira C, Czaplik M, Blazek V, Leonhardt S, Teichmann D. Monitoring of Cardiorespiratory Signals Using Thermal Imaging: A Pilot Study on Healthy Human Subjects. SENSORS (BASEL, SWITZERLAND) 2018; 18:E1541. [PMID: 29757248 PMCID: PMC5982845 DOI: 10.3390/s18051541] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Revised: 05/05/2018] [Accepted: 05/08/2018] [Indexed: 12/25/2022]
Abstract
Heart rate (HR) and respiratory rate (RR) are important parameters for patient assessment. However, current measurement techniques require attachment of sensors to the patient’s body, often leading to discomfort, stress and even pain. A new algorithm is presented for monitoring both HR and RR using thermal imaging. The cyclical ejection of blood flow from the heart to the head (through carotid arteries and thoracic aorta) leads to periodic movements of the head; these vertical movements are used to assess HR. Respiratory rate is estimated by using temperature fluctuations under the nose during the respiratory cycle. To test the viability and feasibility of this approach, a pilot study was conducted with 20 healthy subjects (aged 18⁻36 and 1 aged 50 years). The study consisted of two phases: phase A (frontal view acquisitions) and phase B (side view acquisitions). To validate the results, photoplethysmography and thoracic effort (piezoplethysmography) were simultaneously recorded. High agreement between infrared thermography and ground truth/gold standard was achieved. For HR, the root-mean-square errors (RMSE) for phases A and B were 3.53 ± 1.53 and 3.43 ± 1.61 beats per minute, respectively. For RR, the RMSE between thermal imaging and piezoplethysmography stayed around 0.71 ± 0.30 breaths per minute (phase A). This study demonstrates that infrared thermography may be a promising, clinically relevant alternative for the assessment of HR and RR.
Collapse
Affiliation(s)
- Carina Barbosa Pereira
- Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, Pauwelsstr. 20, D-52074 Aachen, Germany.
| | - Michael Czaplik
- Department of Anesthesiology, University Hospital RWTH Aachen, Pauwelsstr. 30, D-52074 Aachen, Germany.
| | - Vladimir Blazek
- Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, Pauwelsstr. 20, D-52074 Aachen, Germany.
- Czech Institute of Informatics, Robotics and Cybernetics (CIIRC), CTU Prague, Zikova street 1903/4, 166 36 Prague, Czech Republic.
| | - Steffen Leonhardt
- Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, Pauwelsstr. 20, D-52074 Aachen, Germany.
| | - Daniel Teichmann
- Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, Pauwelsstr. 20, D-52074 Aachen, Germany.
| |
Collapse
|