1
|
Noncontact respiration monitoring techniques in young children: A scoping review. Pediatr Pulmonol 2024. [PMID: 38661255 DOI: 10.1002/ppul.27028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 03/22/2024] [Accepted: 04/14/2024] [Indexed: 04/26/2024]
Abstract
Pediatric sleep-related breathing disorders, or sleep-disordered breathing (SDB), cover a range of conditions, including obstructive sleep apnea, central sleep apnea, sleep-related hypoventilation disorders, and sleep-related hypoxemia disorder. Pediatric SDB is often underdiagnosed, potentially due to difficulties associated with performing the gold standard polysomnography in children. This scoping review aims to: (1) provide an overview of the studies reporting on safe, noncontact monitoring of respiration in young children, (2) describe the accuracy of these techniques, and (3) highlight their respective advantages and limitations. PubMed and EMBASE were searched for studies researching techniques in children <12 years old. Both quantitative data and the quality of the studies were analyzed. The evaluation of study quality was conducted using the QUADAS-2 tool. A total of 19 studies were included. Techniques could be grouped into bed-based methods, microwave radar, video, infrared (IR) cameras, and garment-embedded sensors. Most studies either measured respiratory rate (RR) or detected apneas; n = 2 aimed to do both. At present, bed-based approaches are at the forefront of research in noncontact RR monitoring in children, boasting the most sophisticated algorithms in this field. Yet, despite extensive studies, there remains no consensus on a definitive method that outperforms the rest. The accuracies reported by these studies tend to cluster within a similar range, indicating that no single technique has emerged as markedly superior. Notably, all identified methods demonstrate capability in detecting body movements and RR, with reported safety for use in children across the board. Further research into contactless alternatives should focus on cost-effectiveness, ease-of-use, and widespread availability.
Collapse
|
2
|
A public dataset of dogs vital signs recorded with ultra wideband radar and reference sensors. Sci Data 2024; 11:107. [PMID: 38253685 PMCID: PMC10803748 DOI: 10.1038/s41597-024-02947-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/10/2024] [Indexed: 01/24/2024] Open
Abstract
Recently, radar sensors have been extensively used for vital sign monitoring in dogs, owing to their noncontact and noninvasive nature. However, a public dataset on dog vital signs has yet to be proposed since capturing data from dogs requires special training and approval. This work presents the first ever ultra wideband radar-based dog vital sign (UWB-DVS) dataset, which was captured in two independent scenarios. In the first scenario, clinical reference sensors are attached to the fainted dogs, and data from UWB radar and reference sensors are captured synchronously. In the second scenario, the dogs can move freely, and video recordings are provided as a reference for movement detection and breathing extraction. For technical validation, a high correlation, above 0.9, is found between the radar and clinical reference sensors for both the heart rate and breathing rate measurements in scenario 1. In scenario 2, the vital signs and movement of the dogs are shown in the form of dashboards, demonstrating the long-term monitoring capability of the radar sensor.
Collapse
|
3
|
The Derivation of Epigastric Motion to Assess Neonatal Breathing and Sleep: An Exploratory Study. KLINISCHE PADIATRIE 2023. [PMID: 37673092 DOI: 10.1055/a-2135-2163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/08/2023]
Abstract
INTRODUCTION New non-medical monitors are offered for respiration monitoring of neonates. Epigastric motion during sleep was investigated by means of a wearable tracker in parallel to clinical monitoring. COHORT 23 hospitalised neonates ready for discharge. METHODS A 3-axes-accelerometer and -gyroscope was placed in a standard epigastric position. Between two routine care rounds signals were recorded in parallel to monitoring of impedance pneumography (IP), ECG and pulse oximetry. Motion signals vs. time charts were evaluated using 10-min episodes and semiquantitatively assigned to breathing signal quality, regular breathing, periodic breathing and confounding artefacts. The results were compared with the impedance pneumographic data. RESULTS 26 recordings (mean duration: 210 min/infant) were conducted without bradycardia or apnea alarm. The gestational age at birth ranged 28.9 to 41.1 and at recording from 35.6 to 42.3 postmenstrual weeks. Motion patterns of quiet sleep with regular breathing, periodic breathing and active sleep with confounding body movements were found. The longitudinal and transversal gyroscope axes resulted in best signal quality. Periodic breathing was found in up to 80% of episodes and decreased inversely with gestational age showing significantly more periodic breathing in preterm infants. Respiration signals of the gyroscope vs. IP showed a low bias and highly variating frequencies. CONCLUSIONS Standardized motion trackers may detect typical neonatal breathing and body-motion-patterns, that could help to classify neonatal sleep. Respiratory rates can only be determined during quiet sleep.
Collapse
|
4
|
Ultra-Wideband Radar for Simultaneous and Unobtrusive Monitoring of Respiratory and Heart Rates in Early Childhood: A Deep Transfer Learning Approach. SENSORS (BASEL, SWITZERLAND) 2023; 23:7665. [PMID: 37765721 PMCID: PMC10535330 DOI: 10.3390/s23187665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 08/31/2023] [Accepted: 09/02/2023] [Indexed: 09/29/2023]
Abstract
Unobtrusive monitoring of children's heart rate (HR) and respiratory rate (RR) can be valuable for promoting the early detection of potential health issues, improving communication with healthcare providers and reducing unnecessary hospital visits. A promising solution for wireless vital sign monitoring is radar technology. This paper presents a novel approach for the simultaneous estimation of children's RR and HR utilizing ultra-wideband (UWB) radar using a deep transfer learning algorithm in a cohort of 55 children. The HR and RR are calculated by processing radar signals via spectrogram from time epochs of 10 s (25 sample length of hamming window with 90% overlap) and then transforming the resultant representation into 2-dimensional images. These images were fed into a pre-trained Visual Geometry Group-16 (VGG-16) model (trained on ImageNet dataset), with weights of five added layers fine-tuned using the proposed data. The prediction on the test data achieved a mean absolute error (MAE) of 7.3 beats per minute (BPM < 6.5% of average HR) and 2.63 breaths per minute (BPM < 7% of average RR). We also achieved a significant Pearson's correlation of 77% and 81% between true and extracted for HR and RR, respectively. HR and RR samples are extracted every 10 s.
Collapse
|
5
|
Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115038. [PMID: 37299762 DOI: 10.3390/s23115038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 05/22/2023] [Accepted: 05/23/2023] [Indexed: 06/12/2023]
Abstract
Sleep is essential to physical and mental health. However, the traditional approach to sleep analysis-polysomnography (PSG)-is intrusive and expensive. Therefore, there is great interest in the development of non-contact, non-invasive, and non-intrusive sleep monitoring systems and technologies that can reliably and accurately measure cardiorespiratory parameters with minimal impact on the patient. This has led to the development of other relevant approaches, which are characterised, for example, by the fact that they allow greater freedom of movement and do not require direct contact with the body, i.e., they are non-contact. This systematic review discusses the relevant methods and technologies for non-contact monitoring of cardiorespiratory activity during sleep. Taking into account the current state of the art in non-intrusive technologies, we can identify the methods of non-intrusive monitoring of cardiac and respiratory activity, the technologies and types of sensors used, and the possible physiological parameters available for analysis. To do this, we conducted a literature review and summarised current research on the use of non-contact technologies for non-intrusive monitoring of cardiac and respiratory activity. The inclusion and exclusion criteria for the selection of publications were established prior to the start of the search. Publications were assessed using one main question and several specific questions. We obtained 3774 unique articles from four literature databases (Web of Science, IEEE Xplore, PubMed, and Scopus) and checked them for relevance, resulting in 54 articles that were analysed in a structured way using terminology. The result was 15 different types of sensors and devices (e.g., radar, temperature sensors, motion sensors, cameras) that can be installed in hospital wards and departments or in the environment. The ability to detect heart rate, respiratory rate, and sleep disorders such as apnoea was among the characteristics examined to investigate the overall effectiveness of the systems and technologies considered for cardiorespiratory monitoring. In addition, the advantages and disadvantages of the considered systems and technologies were identified by answering the identified research questions. The results obtained allow us to determine the current trends and the vector of development of medical technologies in sleep medicine for future researchers and research.
Collapse
|
6
|
Evaluation Protocol for Analogue Intelligent Medical Radars: Towards a Systematic Approach Based on Theory and a State of the Art. SENSORS (BASEL, SWITZERLAND) 2023; 23:3036. [PMID: 36991747 PMCID: PMC10054009 DOI: 10.3390/s23063036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 02/08/2023] [Accepted: 03/09/2023] [Indexed: 06/19/2023]
Abstract
We propose the basis for a systematised approach to the performance evaluation of analogue intelligent medical radars. In the first part, we review the literature on the evaluation of medical radars and compare the provided experimental elements with models from radar theory in order to identify the key physical parameters that will be useful to develop a comprehensive protocol. In the second part, we present our experimental equipment, protocol and metrics to carry out such an evaluation.
Collapse
|
7
|
Non-contact respiratory rate monitoring using thermal and visible imaging: a pilot study on neonates. J Clin Monit Comput 2022; 37:815-828. [PMID: 36463541 PMCID: PMC10175339 DOI: 10.1007/s10877-022-00945-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 11/05/2022] [Indexed: 12/07/2022]
Abstract
AbstractRespiratory rate (RR) monitoring is essential in neonatal intensive care units. Despite its importance, RR is still monitored intermittently by manual counting instead of continuous monitoring due to the risk of skin damage with prolonged use of contact electrodes in preterm neonates and false signals due to displacement of electrodes. Thermal imaging has recently gained significance as a non-contact method for RR detection because of its many advantages. However, due to the lack of information in thermal images, the selection and tracking of the region of interest (ROI) in thermal images for neonates are challenging. This paper presents the integration of visible (RGB) and thermal (T) image sequences for the selection and tracking of ROI for breathing rate extraction. The deep-learning based tracking-by-detection approach is employed to detect the ROI in the RGB images, and it is mapped to the thermal images using the RGB-T image registration. The mapped ROI in thermal spectrum sequences gives the respiratory rate. The study was conducted first on healthy adults in different modes, including steady, motion, talking, and variable respiratory order. Subsequently, the method is tested on neonates in a clinical settings. The findings have been validated with a contact-based reference method.The average absolute error between the proposed and belt-based contact method in healthy adults reached 0.1 bpm and for more challenging conditions was approximately 1.5 bpm and 1.8 bpm, respectively. In the case of neonates, the average error is 1.5 bpm, which are promising results. The Bland–Altman analysis showed a good agreement of estimated RR with the reference method RR and this pilot study provided the evidence of using the proposed approach as a contactless method for the respiratory rate detection of neonates in clinical settings.
Collapse
|
8
|
Non-invasive sensor methods used in monitoring newborn babies after birth, a clinical perspective. Matern Health Neonatol Perinatol 2022; 8:9. [DOI: 10.1186/s40748-022-00144-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 10/25/2022] [Indexed: 11/24/2022] Open
Abstract
Abstract
Background
Reducing the global new-born mortality is a paramount challenge for humanity. There are approximately 786,323 live births in the UK each year according to the office for National Statistics; around 10% of these newborn infants require assistance during this transition after birth. Each year around, globally around 2.5 million newborns die within their first month. The main causes are complications due to prematurity and during delivery. To act in a timely manner and prevent further damage, health professionals should rely on accurate monitoring of the main vital signs heart rate and respiratory rate.
Aims
To present a clinical perspective on innovative, non-invasive methods to monitor heart rate and respiratory rate in babies highlighting their advantages and limitations in comparison with well-established methods.
Methods
Using the data collected in our recently published systematic review we highlight the barriers and facilitators for the novel sensor devices in obtaining reliable heart rate measurements. Details about difficulties related to the application of sensors and interfaces, time to display, and user feedback are explored. We also provide a unique overview of using a non-invasive respiratory rate monitoring method by extracting RR from the pulse oximetry trace of newborn babies.
Results
Novel sensors to monitor heart rate offer the advantages of minimally obtrusive technologies but have limitations due to movement artefact, bad sensor coupling, intermittent measurement, and poor-quality recordings compared to gold standard well established methods. Respiratory rate can be derived accurately from pleth recordings in infants.
Conclusion
Some limitations have been identified in current methods to monitor heart rate and respiratory rate in newborn babies. Novel minimally invasive sensors have advantages that may help clinical practice. Further research studies are needed to assess whether they are sufficiently accurate, practical, and reliable to be suitable for clinical use.
Collapse
|
9
|
Preclinical trial of noncontact anthropometric measurement using IR-UWB radar. Sci Rep 2022; 12:8174. [PMID: 35581250 PMCID: PMC9112269 DOI: 10.1038/s41598-022-12209-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Accepted: 05/06/2022] [Indexed: 11/08/2022] Open
Abstract
Anthropometric profiles are important indices for assessing medical conditions, including malnutrition, obesity, and growth disorders. Noncontact methods for estimating those parameters could have considerable value in many practical situations, such as the assessment of young, uncooperative infants or children and the prevention of infectious disease transmission. The purpose of this study was to investigate the feasibility of obtaining noncontact anthropometric measurements using the impulse-radio ultrawideband (IR-UWB) radar sensor technique. A total of 45 healthy adults were enrolled, and a convolutional neural network (CNN) algorithm was implemented to analyze data extracted from IR-UWB radar. The differences (root-mean-square error, RMSE) between values from the radar and bioelectrical impedance analysis (BIA) as a reference in the measurement of height, weight, and body mass index (BMI) were 2.78, 5.31, and 2.25, respectively; predicted data from the radar highly agreed with those from the BIA. The intraclass correlation coefficients (ICCs) were 0.93, 0.94, and 0.83. In conclusion, IR-UWB radar can provide accurate estimates of anthropometric parameters in a noncontact manner; this study is the first to support the radar sensor as an applicable method in clinical situations.
Collapse
|
10
|
Contactless radar-based breathing monitoring of premature infants in the neonatal intensive care unit. Sci Rep 2022; 12:5150. [PMID: 35338172 PMCID: PMC8956695 DOI: 10.1038/s41598-022-08836-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 03/03/2022] [Indexed: 01/18/2023] Open
Abstract
Vital sign monitoring systems are essential in the care of hospitalized neonates. Due to the immaturity of their organs and immune system, premature infants require continuous monitoring of their vital parameters and sensors need to be directly attached to their fragile skin. Besides mobility restrictions and stress, these sensors often cause skin irritation and may lead to pressure necrosis. In this work, we show that a contactless radar-based approach is viable for breathing monitoring in the Neonatal intensive care unit (NICU). For the first time, different scenarios common to the NICU daily routine are investigated, and the challenges of monitoring in a real clinical setup are addressed through different contributions in the signal processing framework. Rather than just discarding measurements under strong interference, we present a novel random body movement mitigation technique based on the time-frequency decomposition of the recovered signal. In addition, we propose a simple and accurate frequency estimator which explores the harmonic structure of the breathing signal. As a result, the proposed radar-based solution is able to provide reliable breathing frequency estimation, which is close to the reference cabled device values most of the time. Our findings shed light on the strengths and limitations of this technology and lay the foundation for future studies toward a completely contactless solution for vital signs monitoring.
Collapse
|
11
|
Movement Compensated Driver’s Respiratory Rate Extraction. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12052695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
In non-contact vital sign monitoring using radar, radar signal distorted by the surrounding unspecified factors is unsuitable for monitoring vital signs. In order to monitor vital signs accurately, it is essential to compensate for distortion of radar signals caused by surrounding environmental factors. In this paper, we propose a driver vital signal compensation method in driving situations, including the driver’s movements using a frequency-modulated continuous-wave (FMCW) radar. Driver’s movement is quantified from the radar signal and used to set a distortion signal compensation index to compensate for the signal distortion induced in the driving situation that the driver’s movement occurs. The experimental results show that the respiration rate estimated from the radar signal compensated through the proposed method is similar to the actual respiration rate than from the signal before calibration. These results confirm the possibility of using the proposed method in a non-statistic situation and effectiveness in estimating respiration rate reflecting human movement in monitoring vital signs using FMCW radar.
Collapse
|
12
|
Early screening tool for developmental delay in infancy: Quantified assessment of movement asymmetry using IR-UWB radar. Front Pediatr 2022; 10:731534. [PMID: 36313883 PMCID: PMC9614076 DOI: 10.3389/fped.2022.731534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2021] [Accepted: 09/26/2022] [Indexed: 12/01/2022] Open
Abstract
In the untact COVID-19 era, the feasibility of a noncontact, impulse-radio ultrawideband (IR-UWB) radar sensor has important medical implications. Premature birth is a major risk factor for brain injury and developmental delay; therefore, early intervention is crucial for potentially achieving better developmental outcomes. Early detection and screening tests in infancy are limited to the quantification of differences between normal and spastic movements. This study investigated the quantified asymmetry in the general movements of an infant with hydrocephalus and proposes IR-UWB radar as a novel, early screening tool for developmental delay. To support this state-of-the-art technology, data from actigraphy and video camcorder recordings were adopted simultaneously to compare relevant time series as the infant grew. The data from the three different methods were highly concordant; specifically, the ρz values comparing radar and actigraphy, which served as the reference for measuring movements, showed excellent agreement, with values of 0.66 on the left and 0.56 on the right. The total amount of movement measured by radar over time increased overall; movements were almost dominant on the left at first (75.2% of total movements), but following shunt surgery, the frequency of movement on both sides was similar (54.8% of total movements). As the hydrocephalus improved, the lateralization of movement on radar began to coincide with the clinical features. These results support the important complementary role of this radar system in predicting motor disorders very early in life.
Collapse
|
13
|
Automatic Separation of Respiratory Flow from Motion in Thermal Videos for Infant Apnea Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:6306. [PMID: 34577513 PMCID: PMC8472592 DOI: 10.3390/s21186306] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 09/16/2021] [Accepted: 09/18/2021] [Indexed: 02/07/2023]
Abstract
Both Respiratory Flow (RF) and Respiratory Motion (RM) are visible in thermal recordings of infants. Monitoring these two signals usually requires landmark detection for the selection of a region of interest. Other approaches combine respiratory signals coming from both RF and RM, obtaining a Mixed Respiratory (MR) signal. The detection and classification of apneas, particularly common in preterm infants with low birth weight, would benefit from monitoring both RF and RM, or MR, signals. Therefore, we propose in this work an automatic RF pixel detector not based on facial/body landmarks. The method is based on the property of RF pixels in thermal videos, which are in areas with a smooth circular gradient. We defined 5 features combined with the use of a bank of Gabor filters that together allow selection of the RF pixels. The algorithm was tested on thermal recordings of 9 infants amounting to a total of 132 min acquired in a neonatal ward. On average the percentage of correctly identified RF pixels was 84%. Obstructive Apneas (OAs) were simulated as a proof of concept to prove the advantage in monitoring the RF signal compared to the MR signal. The sensitivity in the simulated OA detection improved for the RF signal reaching 73% against the 23% of the MR signal. Overall, the method yielded promising results, although the positioning and number of cameras used could be further optimized for optimal RF visibility.
Collapse
|
14
|
Preterm Newborn Presence Detection in Incubator and Open Bed Using Deep Transfer Learning. IEEE J Biomed Health Inform 2021; 25:1419-1428. [PMID: 33646962 DOI: 10.1109/jbhi.2021.3062617] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Video-based motion analysis recently appeared to be a promising approach in neonatal intensive care units for monitoring the state of preterm newborns since it is contact-less and noninvasive. However it is important to remove periods when the newborn is absent or an adult is present from the analysis. In this paper, we propose a method for automatic detection of preterm newborn presence in incubator and open bed. We learn a specific model for each bed type as the camera placement differs a lot and the encountered situations are different between both. We break the problem down into two binary classifications based on deep transfer learning that are fused afterwards: newborn presence detection on the one hand and adult presence detection on the other hand. Moreover, we adopt a strategy of decision intervals fusion in order to take advantage of temporal consistency. We test three deep neural network that were pre-trained on ImageNet: VGG16, MobileNetV2 and InceptionV3. Two classifiers are compared: support vector machine and a small neural network. Our experiments are conducted on a database of 120 newborns. The whole method is evaluated on a subset of 25 newborns including 66 days of video recordings. In incubator, we reach a balanced accuracy of 86%. In open bed, the performance is lower because of a much wider variety of situations whereas less data are available.
Collapse
|
15
|
A Hybrid DCNN-SVM Model for Classifying Neonatal Sleep and Wake States Based on Facial Expressions in Video. IEEE J Biomed Health Inform 2021; 25:1441-1449. [PMID: 33857007 DOI: 10.1109/jbhi.2021.3073632] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Sleep is a natural phenomenon controlled by the central nervous system. The sleep-wake pattern, which functions as an essential indicator of neurophysiological organization in the neonatal period, has profound meaning in the prediction of cognitive diseases and brain maturity. In recent years, unobtrusive sleep monitoring and automatic sleep staging have been intensively studied for adults, but much less for neonates. This work aims to investigate a novel video-based unobtrusive method for neonatal sleep-wake classification by analyzing the behavioral changes in the neonatal facial region. A hybrid model is proposed to monitor the sleep-wake patterns of human neonates. The model combines two algorithms: deep convolutional neural network (DCNN) and support vector machine (SVM), where DCNN works as a trainable feature extractor and SVM as a classifier. Data was collected from nineteen Chinese neonates at the Children's Hospital of Fudan University, Shanghai, China. The classification results are compared with the gold standard of video-electroencephalography scored by pediatric neurologists. Validations indicate that the proposed hybrid DCNN-SVM model achieved reliable performances in classifying neonatal sleep and wake states in RGB video frames (with the face region detected), with an accuracy of 93.8 ± 2.2% and an F1-score 0.93 ± 0.3.
Collapse
|
16
|
Automated Non-Contact Respiratory Rate Monitoring of Neonates Based on Synchronous Evaluation of a 3D Time-of-Flight Camera and a Microwave Interferometric Radar Sensor. SENSORS 2021; 21:s21092959. [PMID: 33922563 PMCID: PMC8122919 DOI: 10.3390/s21092959] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 04/18/2021] [Accepted: 04/19/2021] [Indexed: 11/21/2022]
Abstract
This paper introduces an automatic non-contact monitoring method based on the synchronous evaluation of a 3D time-of-flight (ToF) camera and a microwave interferometric radar sensor for measuring the respiratory rate of neonates. The current monitoring on the Neonatal Intensive Care Unit (NICU) has several issues which can cause pressure marks, skin irritations and eczema. To minimize these risks, a non-contact system made up of a 3D time-of-flight camera and a microwave interferometric radar sensor is presented. The 3D time-of-flight camera delivers 3D point clouds which can be used to calculate the change in distance of the moving chest and from it the respiratory rate. The disadvantage of the ToF camera is that the heartbeat cannot be determined. The microwave interferometric radar sensor determines the change in displacement caused by the respiration and is even capable of measuring the small superimposed movements due to the heartbeat. The radar sensor is very sensitive towards movement artifacts due to, e.g., the baby moving its arms. To allow a robust vital parameter detection the data of both sensors was evaluated synchronously. In this publication, we focus on the first step: determining the respiratory rate. After all processing steps, the respiratory rate determined by the radar sensor was compared to the value received from the 3D time-of-flight camera. The method was validated against our gold standard: a self-developed neonatal simulation system which can simulate different breathing patterns. In this paper, we show that we are the first to determine the respiratory rate by evaluating the data of an interferometric microwave radar sensor and a ToF camera synchronously. Our system delivers very precise breaths per minute (BPM) values within the norm range of 20–60 BPM with a maximum difference of 3 BPM (for the ToF camera itself at 30 BPM in normal mode). Especially in lower respiratory rate regions, i.e., 5 and 10 BPM, the synchronous evaluation is required to compensate the drawbacks of the ToF camera. In the norm range, the ToF camera performs slightly better than the radar sensor.
Collapse
|
17
|
Radar-based sleep stage classification in children undergoing polysomnography: a pilot-study. Sleep Med 2021; 82:1-8. [PMID: 33866298 DOI: 10.1016/j.sleep.2021.03.022] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 03/18/2021] [Accepted: 03/20/2021] [Indexed: 10/21/2022]
Abstract
STUDY OBJECTIVES Unobtrusive monitoring of sleep and sleep disorders in children presents challenges. We investigated the possibility of using Ultra-Wide band (UWB) radar to measure sleep in children. METHODS Thirty-two children scheduled to undergo a clinical polysomnography participated; their ages ranged from 2 months to 14 years. During the polysomnography, the children's body movements and breathing rate were measured by an UWB-radar. A total of 38 features were calculated from the motion signals and breathing rate obtained from the raw radar signals. Adaptive boosting was used as machine learning classifier to estimate sleep stages, with polysomnography as gold standard method for comparison. RESULTS Data of all participants combined, this study achieved a Cohen's Kappa coefficient of 0.67 and an overall accuracy of 89.8% for wake and sleep classification, a Kappa of 0.47 and an accuracy of 72.9% for wake, rapid-eye-movement (REM) sleep, and non-REM sleep classification, and a Kappa of 0.43 and an accuracy of 58.0% for wake, REM sleep, light sleep and deep sleep classification. CONCLUSION Although the current performance is not sufficient for clinical use yet, UWB radar is a promising method for non-contact sleep analysis in children.
Collapse
|
18
|
Towards Continuous Camera-Based Respiration Monitoring in Infants. SENSORS (BASEL, SWITZERLAND) 2021; 21:2268. [PMID: 33804913 PMCID: PMC8036870 DOI: 10.3390/s21072268] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Revised: 03/19/2021] [Accepted: 03/21/2021] [Indexed: 02/06/2023]
Abstract
Aiming at continuous unobtrusive respiration monitoring, motion robustness is paramount. However, some types of motion can completely hide the respiration information and the detection of these events is required to avoid incorrect rate estimations. Therefore, this work proposes a motion detector optimized to specifically detect severe motion of infants combined with a respiration rate detection strategy based on automatic pixels selection, which proved to be robust to motion of the infants involving head and limbs. A dataset including both thermal and RGB (Red Green Blue) videos was used amounting to a total of 43 h acquired on 17 infants. The method was successfully applied to both RGB and thermal videos and compared to the chest impedance signal. The Mean Absolute Error (MAE) in segments where some motion is present was 1.16 and 1.97 breaths/min higher than the MAE in the ideal moments where the infants were still for testing and validation set, respectively. Overall, the average MAE on the testing and validation set are 3.31 breaths/min and 5.36 breaths/min, using 64.00% and 69.65% of the included video segments (segments containing events such as interventions were excluded based on a manual annotation), respectively. Moreover, we highlight challenges that need to be overcome for continuous camera-based respiration monitoring. The method can be applied to different camera modalities, does not require skin visibility, and is robust to some motion of the infants.
Collapse
|
19
|
Non-contact breathing rate monitoring in newborns: A review. Comput Biol Med 2021; 132:104321. [PMID: 33773194 DOI: 10.1016/j.compbiomed.2021.104321] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 03/04/2021] [Accepted: 03/04/2021] [Indexed: 02/07/2023]
Abstract
The neonatal period - the first 4 weeks of life - is the most critical time for a child's survival. Breathing rate is a vital indicator of the health condition and requires continuous monitoring in case of sickness or preterm birth. Breathing movements can be counted by contact and non-contact methods. In the case of newborn infants, the non-contact breathing rate monitoring need is high, as a contact-based approach may interfere while providing care and is subject to interference by non-breathing movements. This review article delivers a factual summary, and describes the methods and processing involved in non-contact based breathing rate monitoring. The article also provides the advantages, limitations, and clinical applications of these methods. Additionally, signal processing, feasibility, and future direction of different non-contact neonatal breathing rate monitoring are discussed.
Collapse
|
20
|
Non-contact Sleep/Wake Monitoring Using Impulse-Radio Ultrawideband Radar in Neonates. Front Pediatr 2021; 9:782623. [PMID: 34993163 PMCID: PMC8724301 DOI: 10.3389/fped.2021.782623] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 11/22/2021] [Indexed: 11/22/2022] Open
Abstract
Background: The gold standard for sleep monitoring, polysomnography (PSG), is too obtrusive and limited for practical use with tiny infants or in neonatal intensive care unit (NICU) settings. The ability of impulse-radio ultrawideband (IR-UWB) radar, a non-contact sensing technology, to assess vital signs and fine movement asymmetry in neonates was recently demonstrated. The purpose of this study was to investigate the possibility of quantitatively distinguishing and measuring sleep/wake states in neonates using IR-UWB radar and to compare its accuracy with behavioral observation-based sleep/wake analyses using video recordings. Methods: One preterm and three term neonates in the NICU were enrolled, and voluntary movements and vital signs were measured by radar at ages ranging from 2 to 27 days. Data from a video camcorder, amplitude-integrated electroencephalography (aEEG), and actigraphy were simultaneously recorded for reference. Radar signals were processed using a sleep/wake decision algorithm integrated with breathing signals and movement features. Results: The average recording time for the analysis was 13.0 (7.0-20.5) h across neonates. Compared with video analyses, the sleep/wake decision algorithm for neonates correctly classified 72.2% of sleep epochs and 80.6% of wake epochs and achieved a final Cohen's kappa coefficient of 0.49 (0.41-0.59) and an overall accuracy of 75.2%. Conclusions: IR-UWB radar can provide considerable accuracy regarding sleep/wake decisions in neonates, and although current performance is not yet sufficient, this study demonstrated the feasibility of its possible use in the NICU for the first time. This unobtrusive, non-contact radar technology is a promising method for monitoring sleep/wake states with vital signs in neonates.
Collapse
|
21
|
Feasibility of non-contact cardiorespiratory monitoring using impulse-radio ultra-wideband radar in the neonatal intensive care unit. PLoS One 2020; 15:e0243939. [PMID: 33370375 PMCID: PMC7769476 DOI: 10.1371/journal.pone.0243939] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 11/26/2020] [Indexed: 11/23/2022] Open
Abstract
Background Current cardiorespiratory monitoring equipment can cause injuries and infections in neonates with fragile skin. Impulse-radio ultra-wideband (IR-UWB) radar was recently demonstrated to be an effective contactless vital sign monitor in adults. The purpose of this study was to assess heart rates (HRs) and respiratory rates (RRs) in the neonatal intensive care unit (NICU) using IR-UWB radar and to evaluate its accuracy and reliability compared to conventional electrocardiography (ECG)/impedance pneumography (IPG). Methods The HR and RR were recorded in 34 neonates between 3 and 72 days of age during minimal movement (51 measurements in total) using IR-UWB radar (HRRd, RRRd) and ECG/IPG (HRECG, RRIPG) simultaneously. The radar signals were processed in real time using algorithms for neonates. Radar and ECG/IPG measurements were compared using concordance correlation coefficients (CCCs) and Bland-Altman plots. Results From the 34 neonates, 12,530 HR samples and 3,504 RR samples were measured. Both the HR and RR measured using the two methods were highly concordant when the neonates had minimal movements (CCC = 0.95 between the RRRd and RRIPG, CCC = 0.97 between the HRRd and HRECG). In the Bland-Altman plot, the mean biases were 0.17 breaths/min (95% limit of agreement [LOA] -7.0–7.3) between the RRRd and RRIPG and -0.23 bpm (95% LOA -5.3–4.8) between the HRRd and HRECG. Moreover, the agreement for the HR and RR measurements between the two modalities was consistently high regardless of neonate weight. Conclusions A cardiorespiratory monitor using IR-UWB radar may provide accurate non-contact HR and RR estimates without wires and electrodes for neonates in the NICU.
Collapse
|
22
|
Experimental Comparison of IR-UWB Radar and FMCW Radar for Vital Signs. SENSORS 2020; 20:s20226695. [PMID: 33238557 PMCID: PMC7768379 DOI: 10.3390/s20226695] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 11/11/2020] [Accepted: 11/14/2020] [Indexed: 11/17/2022]
Abstract
In this paper, we compare the performances of impulse radio ultra-wideband (IR-UWB) and frequency modulation continuous wave (FMCW) radars in measuring noncontact vital signs such as respiration rate and heart rate. These two type radars have been widely used in various fields and have shown their applicability to extract vital signs in noncontact ways. IR-UWB radar can extract vital signs using distance information. On the other hand, FMCW radar requires phase information to estimate vital signs, and the result can be enhanced with Multi-input Multi-output (MIMO) antenna topologies. By using commercial radar chipsets, the operation of radars under different conditions and frequency bands will also affect the performance of vital sign detection capabilities. We compared the accuracy and signal-to-noise (SNR) ratios of IR-UWB and FMCW radars in various scenarios, such as distance, orientation, carotid pulse, harmonics, and obstacle penetration. In general, the IR-UWB radars offer a slightly better accuracy and higher SNR in comparison to FMCW radar. However, each radar system has its own unique advantages, with IR-UWB exhibiting fewer harmonics and a higher SNR, while FMCW can combine the results from each channel.
Collapse
|
23
|
A Joint Localization Assisted Respiratory Rate Estimation using IR-UWB Radars. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:489-493. [PMID: 33018034 DOI: 10.1109/embc44109.2020.9175754] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Respiratory rate (RR) is one of the vital signs which is commonly measured by contact-based methods, such as using a breathing belt. Recently, significant research has been conducted related to contactless RR monitoring - however, the majority of experiments are performed in situations when the subject is oriented towards the radar. In this research, we are interested in monitoring the breathing of subjects who can be anywhere in the room. A system of three impulse radio ultrawideband (IR-UWB) radars is used to cover the whole room. A Kinect camera that can track subjects' joints 3D coordinates was employed to localize the subjects. The results of RR monitoring using IR-UWB radars and Kinect camera show good performance in single/multiple subject(s) tracking and RR estimation.
Collapse
|
24
|
Sensing Systems for Respiration Monitoring: A Technical Systematic Review. SENSORS 2020; 20:s20185446. [PMID: 32972028 PMCID: PMC7570710 DOI: 10.3390/s20185446] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2020] [Revised: 09/16/2020] [Accepted: 09/16/2020] [Indexed: 02/06/2023]
Abstract
Respiratory monitoring is essential in sleep studies, sport training, patient monitoring, or health at work, among other applications. This paper presents a comprehensive systematic review of respiration sensing systems. After several systematic searches in scientific repositories, the 198 most relevant papers in this field were analyzed in detail. Different items were examined: sensing technique and sensor, respiration parameter, sensor location and size, general system setup, communication protocol, processing station, energy autonomy and power consumption, sensor validation, processing algorithm, performance evaluation, and analysis software. As a result, several trends and the remaining research challenges of respiration sensors were identified. Long-term evaluations and usability tests should be performed. Researchers designed custom experiments to validate the sensing systems, making it difficult to compare results. Therefore, another challenge is to have a common validation framework to fairly compare sensor performance. The implementation of energy-saving strategies, the incorporation of energy harvesting techniques, the calculation of volume parameters of breathing, or the effective integration of respiration sensors into clothing are other remaining research efforts. Addressing these and other challenges outlined in the paper is a required step to obtain a feasible, robust, affordable, and unobtrusive respiration sensing system.
Collapse
|
25
|
Multi-camera infrared thermography for infant respiration monitoring. BIOMEDICAL OPTICS EXPRESS 2020; 11:4848-4861. [PMID: 33014585 PMCID: PMC7510882 DOI: 10.1364/boe.397188] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/07/2020] [Revised: 07/21/2020] [Accepted: 07/28/2020] [Indexed: 05/08/2023]
Abstract
Respiration is monitored in neonatal wards using chest impedance (CI), which is obtrusive and can cause skin damage to the infants. Therefore, unobtrusive solutions based on infrared thermography are being investigated. This work proposes an algorithm to merge multiple thermal camera views and automatically detect the pixels containing respiration motion or flow using three features. The method was tested on 152 minutes of recordings acquired on seven infants. We performed a comparison with the CI respiration rate yielding a mean absolute error equal to 2.07 breaths/min. Merging the three features resulted in reducing the dependency on the window size typical of spectrum-based features.
Collapse
|
26
|
An FMCW Radar for Localization and Vital Signs Measurement for Different Chest Orientations. SENSORS (BASEL, SWITZERLAND) 2020; 20:E3489. [PMID: 32575677 PMCID: PMC7348911 DOI: 10.3390/s20123489] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Revised: 06/16/2020] [Accepted: 06/17/2020] [Indexed: 11/16/2022]
Abstract
This work tests the ability of fmcw radar to measure the respiratory rate and the heartbeat of a subject in challenging indoor scenarios. To simulate a realistic configuration for ambient assisted living (AAL) applications, in which the thorax orientation towards the antenna is typically unknown, four different scenarios were considered. Measurements were performed on five volunteers positioned with the chest, left, back, and right side facing the antenna, respectively. The 5 . 8 radar and the antennas used for the measurements were suitably designed for the considered application. To obtain a low cost and compact system, series-fed arrays were preferred over other antenna topologies. The geometry of the patches was opportunely shaped to reduce the side lobe level (SLL) and increase the bandwidth, thus ensuring good system performances. In all scenarios, the vital signs extracted from the radar signal were compared with the ones collected by a photoplethysmograph and a respiratory belt, used as references. A statistical analysis of the measured data on the different subjects and orientations was performed, showing that the radar was able to measure with high accuracy both the respiratory rate and the heartbeat in all considered configurations.
Collapse
|
27
|
An Overview of Signal Processing Techniques for Remote Health Monitoring Using Impulse Radio UWB Transceiver. SENSORS 2020; 20:s20092479. [PMID: 32349382 PMCID: PMC7248922 DOI: 10.3390/s20092479] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Revised: 04/24/2020] [Accepted: 04/25/2020] [Indexed: 11/16/2022]
Abstract
Non-invasive remote health monitoring plays a vital role in epidemiological situations such as SARS outbreak (2003), MERS (2015) and the recently ongoing outbreak of COVID-19 because it is extremely risky to get close to the patient due to the spread of contagious infections. Non-invasive monitoring is also extremely necessary in situations where it is difficult to use complicated wired connections, such as ECG monitoring for infants, burn victims or during rescue missions when people are buried during building collapses/earthquakes. Due to the unique characteristics such as higher penetration capabilities, extremely precise ranging, low power requirement, low cost, simple hardware and robustness to multipath interferences, Impulse Radio Ultra Wideband (IR-UWB) technology is appropriate for non-invasive medical applications. IR-UWB sensors detect the macro as well as micro movement inside the human body due to its fine range resolution. The two vital signs, i.e., respiration rate and heart rate, can be measured by IR-UWB radar by measuring the change in the magnitude of signal due to displacement caused by human lungs, heart during respiration and heart beating. This paper reviews recent advances in IR- UWB radar sensor design for healthcare, such as vital signs measurements of a stationary human, vitals of a non-stationary human, vital signs of people in a vehicle, through the wall vitals measurement, neonate’s health monitoring, fall detection, sleep monitoring and medical imaging. Although we have covered many topics related to health monitoring using IR-UWB, this paper is mainly focused on signal processing techniques for measurement of vital signs, i.e., respiration and heart rate monitoring.
Collapse
|
28
|
Non-contact physiological monitoring of preterm infants in the Neonatal Intensive Care Unit. NPJ Digit Med 2019; 2:128. [PMID: 31872068 PMCID: PMC6908711 DOI: 10.1038/s41746-019-0199-5] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2019] [Accepted: 11/14/2019] [Indexed: 11/09/2022] Open
Abstract
The implementation of video-based non-contact technologies to monitor the vital signs of preterm infants in the hospital presents several challenges, such as the detection of the presence or the absence of a patient in the video frame, robustness to changes in lighting conditions, automated identification of suitable time periods and regions of interest from which vital signs can be estimated. We carried out a clinical study to evaluate the accuracy and the proportion of time that heart rate and respiratory rate can be estimated from preterm infants using only a video camera in a clinical environment, without interfering with regular patient care. A total of 426.6 h of video and reference vital signs were recorded for 90 sessions from 30 preterm infants in the Neonatal Intensive Care Unit (NICU) of the John Radcliffe Hospital in Oxford. Each preterm infant was recorded under regular ambient light during daytime for up to four consecutive days. We developed multi-task deep learning algorithms to automatically segment skin areas and to estimate vital signs only when the infant was present in the field of view of the video camera and no clinical interventions were undertaken. We propose signal quality assessment algorithms for both heart rate and respiratory rate to discriminate between clinically acceptable and noisy signals. The mean absolute error between the reference and camera-derived heart rates was 2.3 beats/min for over 76% of the time for which the reference and camera data were valid. The mean absolute error between the reference and camera-derived respiratory rate was 3.5 breaths/min for over 82% of the time. Accurate estimates of heart rate and respiratory rate could be derived for at least 90% of the time, if gaps of up to 30 seconds with no estimates were allowed.
Collapse
|