Privacy-Preserved Fall Detection Method with Three-Dimensional Convolutional Neural Network Using Low-Resolution Infrared Array Sensor

Artificially intelligent nursing homes: a scoping review of palliative care interventions

Introduction

The world's population is aging at a rapid rate. Nursing homes are needed to care for an increasing number of older adults. Palliative care can improve the quality of life of nursing home residents. Artificial Intelligence can be used to improve palliative care services. The aim of this scoping review is to synthesize research surrounding AI-based palliative care interventions in nursing homes.

Methods

A PRISMA-ScR scoping review was carried out using modified guidelines specifically designed for computer science research. A wide range of keywords are considered in searching six databases, including IEEE, ACM, and SpringerLink.

Results

We screened 3255 articles for inclusion after duplicate removal. 3175 articles were excluded during title and abstract screening. A further 61 articles were excluded during the full-text screening stage. We included 19 articles in our analysis. Studies either focus on intelligent physical systems or decision support systems. There is a clear divide between the two types of technologies. There are key issues to address in future research surrounding palliative definitions, data accessibility, and stakeholder involvement.

Discussion

This paper presents the first review to consolidate research on palliative care interventions in nursing homes. The findings of this review indicate that integrated intelligent physical systems and decision support systems have yet to be explored. A broad range of machine learning solutions remain unused within the context of nursing home palliative care. These findings are of relevance to both nurses and computer scientists, who may use this review to reflect on their own practices when developing such technology.

Multi-Person Localization Based on a Thermopile Array Sensor with Machine Learning and a Generative Data Model

Thermopile sensor arrays provide a sufficient counterbalance between person detection and localization while preserving privacy through low resolution. The latter is especially important in the context of smart building automation applications. Current research has shown that there are two machine learning-based algorithms that are particularly prominent for general object detection: You Only Look Once (YOLOv5) and Detection Transformer (DETR). Over the course of this paper, both algorithms are adapted to localize people in 32 × 32-pixel thermal array images. The drawbacks in precision due to the sparse amount of labeled data were counteracted with a novel generative image generator (IIG). This generator creates synthetic thermal frames from the sparse amount of available labeled data. Multiple robustness tests were performed during the evaluation process to determine the overall usability of the aforementioned algorithms as well as the advantage of the image generator. Both algorithms provide a high mean average precision (mAP) exceeding 98%. They also prove to be robust against disturbances of warm air streams, sun radiation, the replacement of the sensor with an equal type sensor, new persons, cold objects, movements along the image frame border and people standing still. However, the precision decreases for persons wearing thick layers of clothes, such as winter clothing, or in scenarios where the number of present persons exceeds the number of persons the algorithm was trained on. In summary, both algorithms are suitable for detection and localization purposes, although YOLOv5m has the advantage in real-time image processing capabilities, accompanied by a smaller model size and slightly higher precision.

A Non-Contact Fall Detection Method for Bathroom Application Based on MEMS Infrared Sensors

The ratio of the elderly to the total population around the world is larger than 10%, and about 30% of the elderly are injured by falls each year. Accidental falls, especially bathroom falls, account for a large proportion. Therefore, fall events detection of the elderly is of great importance. In this article, a non-contact fall detector based on a Micro-electromechanical Systems Pyroelectric Infrared (MEMS PIR) sensor and a thermopile IR array sensor is designed to detect bathroom falls. Besides, image processing algorithms with a low pass filter and double boundary scans are put forward in detail. Then, the statistical features of the area, center, duration and temperature are extracted. Finally, a 3-layer BP neural network is adopted to identify the fall events. Taking into account the key factors of ambient temperature, objective, illumination, fall speed, fall state, fall area and fall scene, 640 tests were performed in total, and 5-fold cross validation is adopted. Experimental results demonstrate that the averages of the precision, recall, detection accuracy and F₁-Score are measured to be 94.45%, 90.94%, 92.81% and 92.66%, respectively, which indicates that the novel detection method is feasible. Thereby, this IOT detector can be extensively used for household bathroom fall detection and is low-cost and privacy-security guaranteed.

An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques

In this paper, we propose an activity detection system using a 24 × 32 resolution infrared array sensor placed on the ceiling. We first collect the data at different resolutions (i.e., 24 × 32, 12 × 16, and 6 × 8) and apply the advanced deep learning (DL) techniques of Super-Resolution (SR) and denoising to enhance the quality of the images. We then classify the images/sequences of images depending on the activities the subject is performing using a hybrid deep learning model combining a Convolutional Neural Network (CNN) and a Long Short-Term Memory (LSTM). We use data augmentation to improve the training of the neural networks by incorporating a wider variety of samples. The process of data augmentation is performed by a Conditional Generative Adversarial Network (CGAN). By enhancing the images using SR, removing the noise, and adding more training samples via data augmentation, our target is to improve the classification accuracy of the neural network. Through experiments, we show that employing these deep learning techniques to low-resolution noisy infrared images leads to a noticeable improvement in performance. The classification accuracy improved from 78.32% to 84.43% (for images with 6 × 8 resolution), and from 90.11% to 94.54% (for images with 12 × 16 resolution) when we used the CNN and CNN + LSTM networks, respectively.

Artificial Intelligence -based technologies in nursing: A scoping literature review of the evidence

BACKGROUND

Research on technologies based on artificial intelligence in healthcare has increased during the last decade, with applications showing great potential in assisting and improving care. However, introducing these technologies into nursing can raise concerns related to data bias in the context of training algorithms and potential implications for certain populations. Little evidence exists in the extant literature regarding the efficacious application of many artificial intelligence -based health technologies used in healthcare.

OBJECTIVES

To synthesize currently available state-of the-art research in artificial intelligence -based technologies applied in nursing practice.

DESIGN

Scoping review METHODS: PubMed, CINAHL, Web of Science and IEEE Xplore were searched for relevant articles with queries that combine names and terms related to nursing, artificial intelligence and machine learning methods. Included studies focused on developing or validating artificial intelligence -based technologies with a clear description of their impacts on nursing. We excluded non-experimental studies and research targeted at robotics, nursing management and technologies used in nursing research and education.

RESULTS

A total of 7610 articles published between January 2010 and March 2021 were revealed, with 93 articles included in this review. Most studies explored the technology development (n = 55, 59.1%) and formation (testing) (n = 28, 30.1%) phases, followed by implementation (n = 9, 9.7%) and operational (n = 1, 1.1%) phases. The vast majority (73.1%) of studies provided evidence with a descriptive design (level VI) while only a small portion (4.3%) were randomised controlled trials (level II). The study aims, settings and methods were poorly described in the articles, and discussion of ethical considerations were lacking in 36.6% of studies. Additionally, one-third of papers (33.3%) were reported without the involvement of nurses.

CONCLUSIONS

Contemporary research on applications of artificial intelligence -based technologies in nursing mainly cover the earlier stages of technology development, leaving scarce evidence of the impact of these technologies and implementation aspects into practice. The content of research reported is varied. Therefore, guidelines on research reporting and implementing artificial intelligence -based technologies in nursing are needed. Furthermore, integrating basic knowledge of artificial intelligence -related technologies and their applications in nursing education is imperative, and interventions to increase the inclusion of nurses throughout the technology research and development process is needed.

A Novel Concentric Circular Coded Target, and Its Positioning and Identifying Method for Vision Measurement under Challenging Conditions

Coded targets have been demarcated as control points in various vision measurement tasks such as camera calibration, 3D reconstruction, pose estimation, etc. By employing coded targets, matching corresponding image points in multi images can be automatically realized which greatly improves the efficiency and accuracy of the measurement. Although the coded targets are well applied, particularly in the industrial vision system, the design of coded targets and its detection algorithms have encountered difficulties, especially under the conditions of poor illumination and flat viewing angle. This paper presents a novel concentric circular coded target (CCCT), and its positioning and identifying algorithms. The eccentricity error has been corrected based on a practical error-compensation model. Adaptive brightness adjustment has been employed to address the problems of poor illumination such as overexposure and underexposure. The robust recognition is realized by perspective correction based on four vertices of the background area in the CCCT local image. The simulation results indicate that the eccentricity errors of the larger and smaller circles at a large viewing angle of 70° are reduced by 95% and 77% after correction by the proposed method. The result of the wing deformation experiment demonstrates that the error of the vision method based on the corrected center is reduced by up to 18.54% compared with the vision method based on only the ellipse center when the wing is loaded with a weight of 6 kg. The proposed design is highly applicable, and its detection algorithms can achieve accurate positioning and robust identification even in challenging environments.