1
|
Boiko A, Martínez Madrid N, Seepold R. Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115038. [PMID: 37299762 DOI: 10.3390/s23115038] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 05/22/2023] [Accepted: 05/23/2023] [Indexed: 06/12/2023]
Abstract
Sleep is essential to physical and mental health. However, the traditional approach to sleep analysis-polysomnography (PSG)-is intrusive and expensive. Therefore, there is great interest in the development of non-contact, non-invasive, and non-intrusive sleep monitoring systems and technologies that can reliably and accurately measure cardiorespiratory parameters with minimal impact on the patient. This has led to the development of other relevant approaches, which are characterised, for example, by the fact that they allow greater freedom of movement and do not require direct contact with the body, i.e., they are non-contact. This systematic review discusses the relevant methods and technologies for non-contact monitoring of cardiorespiratory activity during sleep. Taking into account the current state of the art in non-intrusive technologies, we can identify the methods of non-intrusive monitoring of cardiac and respiratory activity, the technologies and types of sensors used, and the possible physiological parameters available for analysis. To do this, we conducted a literature review and summarised current research on the use of non-contact technologies for non-intrusive monitoring of cardiac and respiratory activity. The inclusion and exclusion criteria for the selection of publications were established prior to the start of the search. Publications were assessed using one main question and several specific questions. We obtained 3774 unique articles from four literature databases (Web of Science, IEEE Xplore, PubMed, and Scopus) and checked them for relevance, resulting in 54 articles that were analysed in a structured way using terminology. The result was 15 different types of sensors and devices (e.g., radar, temperature sensors, motion sensors, cameras) that can be installed in hospital wards and departments or in the environment. The ability to detect heart rate, respiratory rate, and sleep disorders such as apnoea was among the characteristics examined to investigate the overall effectiveness of the systems and technologies considered for cardiorespiratory monitoring. In addition, the advantages and disadvantages of the considered systems and technologies were identified by answering the identified research questions. The results obtained allow us to determine the current trends and the vector of development of medical technologies in sleep medicine for future researchers and research.
Collapse
Affiliation(s)
- Andrei Boiko
- Ubiquitous Computing Laboratory, Department of Computer Science, HTWG Konstanz-University of Applied Sciences, Alfred-Wachtel-Str. 8, 78462 Konstanz, Germany
| | - Natividad Martínez Madrid
- Internet of Things Laboratory, School of Informatics, Reutlingen University, Alteburgstr. 150, 72762 Reutlingen, Germany
| | - Ralf Seepold
- Ubiquitous Computing Laboratory, Department of Computer Science, HTWG Konstanz-University of Applied Sciences, Alfred-Wachtel-Str. 8, 78462 Konstanz, Germany
| |
Collapse
|
2
|
Manullang MCT, Lin YH, Lai SJ, Chou NK. Implementation of Thermal Camera for Non-Contact Physiological Measurement: A Systematic Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:7777. [PMID: 34883780 PMCID: PMC8659982 DOI: 10.3390/s21237777] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2021] [Revised: 11/06/2021] [Accepted: 11/19/2021] [Indexed: 01/03/2023]
Abstract
Non-contact physiological measurements based on image sensors have developed rapidly in recent years. Among them, thermal cameras have the advantage of measuring temperature in the environment without light and have potential to develop physiological measurement applications. Various studies have used thermal camera to measure the physiological signals such as respiratory rate, heart rate, and body temperature. In this paper, we provided a general overview of the existing studies by examining the physiological signals of measurement, the used platforms, the thermal camera models and specifications, the use of camera fusion, the image and signal processing step (including the algorithms and tools used), and the performance evaluation. The advantages and challenges of thermal camera-based physiological measurement were also discussed. Several suggestions and prospects such as healthcare applications, machine learning, multi-parameter, and image fusion, have been proposed to improve the physiological measurement of thermal camera in the future.
Collapse
Affiliation(s)
- Martin Clinton Tosima Manullang
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 10607, Taiwan; (M.C.T.M.); (S.-J.L.)
- Department of Informatics, Institut Teknologi Sumatera, South Lampung Regency 35365, Indonesia
| | - Yuan-Hsiang Lin
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 10607, Taiwan; (M.C.T.M.); (S.-J.L.)
| | - Sheng-Jie Lai
- Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 10607, Taiwan; (M.C.T.M.); (S.-J.L.)
| | - Nai-Kuan Chou
- Department of Cardiovascular Surgery, National Taiwan University Hospital, Taipei 10002, Taiwan
| |
Collapse
|
3
|
Leite GS, Albuquerque AB, Pinheiro PR. Applications of Technological Solutions in Primary Ways of Preventing Transmission of Respiratory Infectious Diseases-A Systematic Literature Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:10765. [PMID: 34682511 PMCID: PMC8535524 DOI: 10.3390/ijerph182010765] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 10/09/2021] [Accepted: 10/11/2021] [Indexed: 12/23/2022]
Abstract
With the growing concern about the spread of new respiratory infectious diseases, several studies involving the application of technology in the prevention of these diseases have been carried out. Among these studies, it is worth highlighting the importance of those focused on the primary forms of prevention, such as social distancing, mask usage, quarantine, among others. This importance arises because, from the emergence of a new disease to the production of immunizers, preventive actions must be taken to reduce contamination and fatalities rates. Despite the considerable number of studies, no records of works aimed at the identification, registration, selection, and rigorous analysis and synthesis of the literature were found. For this purpose, this paper presents a systematic review of the literature on the application of technological solutions in the primary ways of respiratory infectious diseases transmission prevention. From the 1139 initially retrieved, 219 papers were selected for data extraction, analysis, and synthesis according to predefined inclusion and exclusion criteria. Results enabled the identification of a general categorization of application domains, as well as mapping of the adopted support mechanisms. Findings showed a greater trend in studies related to pandemic planning and, among the support mechanisms adopted, data and mathematical application-related solutions received greater attention. Topics for further research and improvement were also identified such as the need for a better description of data analysis and evidence.
Collapse
Affiliation(s)
- Gleidson Sobreira Leite
- UNIFOR, Department of Computer Science, University of Fortaleza, Fortaleza 60811-905, Ceará, Brazil; (A.B.A.); (P.R.P.)
| | | | | |
Collapse
|
4
|
Khaksari K, Nguyen T, Hill B, Quang T, Perreault J, Gorti V, Malpani R, Blick E, González Cano T, Shadgan B, Gandjbakhche AH. Review of the efficacy of infrared thermography for screening infectious diseases with applications to COVID-19. J Med Imaging (Bellingham) 2021; 8:010901. [PMID: 33786335 PMCID: PMC7995646 DOI: 10.1117/1.jmi.8.s1.010901] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Accepted: 03/04/2021] [Indexed: 01/12/2023] Open
Abstract
Purpose: The recent coronavirus disease 2019 (COVID-19) pandemic, which spread across the globe in a very short period of time, revealed that the transmission control of disease is a crucial step to prevent an outbreak and effective screening for viral infectious diseases is necessary. Since the severe acute respiratory syndrome (SARS) outbreak in 2003, infrared thermography (IRT) has been considered a gold standard method for screening febrile individuals at the time of pandemics. The objective of this review is to evaluate the efficacy of IRT for screening infectious diseases with specific applications to COVID-19. Approach: A literature review was performed in Google Scholar, PubMed, and ScienceDirect to search for studies evaluating IRT screening from 2002 to present using relevant keywords. Additional literature searches were done to evaluate IRT in comparison to traditional core body temperature measurements and assess the benefits of measuring additional vital signs for infectious disease screening. Results: Studies have reported on the unreliability of IRT due to poor sensitivity and specificity in detecting true core body temperature and its inability to identify asymptomatic carriers. Airport mass screening using IRT was conducted during occurrences of SARS, Dengue, Swine Flu, and Ebola with reported sensitivities as low as zero. Other studies reported that screening other vital signs such as heart and respiratory rates can lead to more robust methods for early infection detection. Conclusions: Studies evaluating IRT showed varied results in its efficacy for screening infectious diseases. This suggests the need to assess additional physiological parameters to increase the sensitivity and specificity of non-invasive biosensors.
Collapse
Affiliation(s)
- Kosar Khaksari
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Thien Nguyen
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Brian Hill
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Timothy Quang
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - John Perreault
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Viswanath Gorti
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Ravi Malpani
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Emily Blick
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Tomás González Cano
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| | - Babak Shadgan
- University of British Columbia, Vancouver, British Columbia, Canada
| | - Amir H. Gandjbakhche
- National Institutes of Health, Eunice Kennedy Shrive National Institute of Child Health and Human Development, Bethesda, Maryland, United States
| |
Collapse
|
5
|
Lutz NW, Bernard M. Contactless Thermometry by MRI and MRS: Advanced Methods for Thermotherapy and Biomaterials. iScience 2020; 23:101561. [PMID: 32954229 PMCID: PMC7489251 DOI: 10.1016/j.isci.2020.101561] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
Control of temperature variation is of primordial importance in particular areas of biomedicine. In this context, medical treatments such as hyperthermia and cryotherapy, and also the development and use of hydrogel-based biomaterials, are of particular concern. To enable accurate temperature measurement without perturbing or even destroying the biological tissue or material to be monitored, contactless thermometry methods are preferred. Among these, the most suitable are based on magnetic resonance imaging and spectroscopy (MRI, MRS). Here, we address the latest developments in this field as well as their current and anticipated practical applications. We highlight recent progress aimed at rendering MR thermometry faster and more reproducible, versatile, and sophisticated and provide our perspective on how these new techniques broaden the range of applications in medical treatments and biomaterial development by enabling insight into finer details of thermal behavior. Thus, these methods facilitate optimization of clinical and industrial heating and cooling protocols.
Collapse
Affiliation(s)
- Norbert W. Lutz
- Aix-Marseille University, CNRS, CRMBM, 27 Bd Jean Moulin, 13005 Marseille, France
| | - Monique Bernard
- Aix-Marseille University, CNRS, CRMBM, 27 Bd Jean Moulin, 13005 Marseille, France
| |
Collapse
|
6
|
Ulhaq A, Born J, Khan A, Gomes DPS, Chakraborty S, Paul M. COVID-19 Control by Computer Vision Approaches: A Survey. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:179437-179456. [PMID: 34812357 PMCID: PMC8545281 DOI: 10.1109/access.2020.3027685] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 09/26/2020] [Indexed: 05/03/2023]
Abstract
The COVID-19 pandemic has triggered an urgent call to contribute to the fight against an immense threat to the human population. Computer Vision, as a subfield of artificial intelligence, has enjoyed recent success in solving various complex problems in health care and has the potential to contribute to the fight of controlling COVID-19. In response to this call, computer vision researchers are putting their knowledge base at test to devise effective ways to counter COVID-19 challenge and serve the global community. New contributions are being shared with every passing day. It motivated us to review the recent work, collect information about available research resources, and an indication of future research directions. We want to make it possible for computer vision researchers to find existing and future research directions. This survey article presents a preliminary review of the literature on research community efforts against COVID-19 pandemic.
Collapse
Affiliation(s)
- Anwaar Ulhaq
- School of Computing and MathematicsCharles Sturt UniversityPort MacquarieNSW2795Australia
| | - Jannis Born
- Department for Biosystems Science and EngineeringETH Zurich4058BaselSwitzerland
| | - Asim Khan
- College of Engineering and ScienceVictoria UniversityMelbourneVIC3011Australia
| | | | - Subrata Chakraborty
- Faculty of Engineering and Information TechnologyUniversity of Technology SydneySydneyNSW2007Australia
| | - Manoranjan Paul
- School of Computing and MathematicsCharles Sturt UniversityPort MacquarieNSW2795Australia
| |
Collapse
|
7
|
Contactless Vital Signs Measurement System Using RGB-Thermal Image Sensors and Its Clinical Screening Test on Patients with Seasonal Influenza. SENSORS 2020; 20:s20082171. [PMID: 32294973 PMCID: PMC7218727 DOI: 10.3390/s20082171] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Revised: 04/08/2020] [Accepted: 04/10/2020] [Indexed: 11/17/2022]
Abstract
Background: In the last two decades, infrared thermography (IRT) has been applied in quarantine stations for the screening of patients with suspected infectious disease. However, the fever-based screening procedure employing IRT suffers from low sensitivity, because monitoring body temperature alone is insufficient for detecting infected patients. To overcome the drawbacks of fever-based screening, this study aims to develop and evaluate a multiple vital sign (i.e., body temperature, heart rate and respiration rate) measurement system using RGB-thermal image sensors. Methods: The RGB camera measures blood volume pulse (BVP) through variations in the light absorption from human facial areas. IRT is used to estimate the respiration rate by measuring the change in temperature near the nostrils or mouth accompanying respiration. To enable a stable and reliable system, the following image and signal processing methods were proposed and implemented: (1) an RGB-thermal image fusion approach to achieve highly reliable facial region-of-interest tracking, (2) a heart rate estimation method including a tapered window for reducing noise caused by the face tracker, reconstruction of a BVP signal with three RGB channels to optimize a linear function, thereby improving the signal-to-noise ratio and multiple signal classification (MUSIC) algorithm for estimating the pseudo-spectrum from limited time-domain BVP signals within 15 s and (3) a respiration rate estimation method implementing nasal or oral breathing signal selection based on signal quality index for stable measurement and MUSIC algorithm for rapid measurement. We tested the system on 22 healthy subjects and 28 patients with seasonal influenza, using the support vector machine (SVM) classification method. Results: The body temperature, heart rate and respiration rate measured in a non-contact manner were highly similarity to those measured via contact-type reference devices (i.e., thermometer, ECG and respiration belt), with Pearson correlation coefficients of 0.71, 0.87 and 0.87, respectively. Moreover, the optimized SVM model with three vital signs yielded sensitivity and specificity values of 85.7% and 90.1%, respectively. Conclusion: For contactless vital sign measurement, the system achieved a performance similar to that of the reference devices. The multiple vital sign-based screening achieved higher sensitivity than fever-based screening. Thus, this system represents a promising alternative for further quarantine procedures to prevent the spread of infectious diseases.
Collapse
|
8
|
Nguyen CV, Le Quang T, Vu TN, Le Thi H, Van KN, Trong TH, Trong TD, Sun G, Ishibashi K. A non-contact infection screening system using medical radar and Linux-embedded FPGA: Implementation and preliminary validation. INFORMATICS IN MEDICINE UNLOCKED 2019; 16:100225. [PMID: 32289073 PMCID: PMC7103934 DOI: 10.1016/j.imu.2019.100225] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
Objectives In this study, an infection screening system was developed to detect patients suffering from infectious diseases. In addition, the system was also designed to deal with the variability in age and gender, which would affect the accuracy of the detection. Furthermore, to enable a low-cost, non-contact and embedded system, multiple vital signs from a medical radar were measured and all algorithms were implemented on a Field Programmable Gate Array, named PYNQ-Z1. Methods The system consisted of two main stages: digital signal processing and data classification. In the former stage, Butterworth filters, with flexible cut-off frequencies depending on age and gender, and a time-domain peak detection algorithm were deployed to compute three vital signs, namely heart rate, respiratory rate, and standard deviation of heart beat-to-beat interval. For the classification problem, two machine learning models, Support Vector Machine and Quadratic Discriminant Analysis, were implemented. Results The Student's t-test showed that our proposed digital signal processing algorithms coped well with the variability of human cases in age and gender. Meanwhile, the f1-score of roughly 98.0% represented the high sensitivity and specificity of our proposed machine learning methods. Conclusion This study outlines the implementation of an infection screening system, which achieved competent performance. The system might be beneficial for fast screening of infected patients at public health centers in underdeveloped areas, where people have little access to healthcare.
Collapse
Affiliation(s)
- Cuong V Nguyen
- School of Electronics and Telecommunications, Hanoi University of Science and Technology, Hanoi, 100000, Viet Nam
| | - Truong Le Quang
- School of Electronics and Telecommunications, Hanoi University of Science and Technology, Hanoi, 100000, Viet Nam
| | - Trung Nguyen Vu
- National Hospital of Tropical Diseases, Hanoi, Viet Nam.,Hanoi Medical University, Hanoi, Vietnam, Hanoi, Viet Nam
| | - Hoi Le Thi
- National Hospital of Tropical Diseases, Hanoi, Viet Nam
| | | | - Thanh Han Trong
- School of Electronics and Telecommunications, Hanoi University of Science and Technology, Hanoi, 100000, Viet Nam
| | - Tuan Do Trong
- School of Electronics and Telecommunications, Hanoi University of Science and Technology, Hanoi, 100000, Viet Nam
| | - Guanghao Sun
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, 182-8585, Japan.,Center for Neuroscience and Biomedical Engineering, The University of Electro-Communications, Tokyo, 182-8585, Japan
| | - Koichiro Ishibashi
- Graduate School of Informatics and Engineering, The University of Electro-Communications, Tokyo, 182-8585, Japan
| |
Collapse
|