1
|
Zolfaghari S, Kristoffersson A, Folke M, Lindén M, Riboni D. Unobtrusive Cognitive Assessment in Smart-Homes: Leveraging Visual Encoding and Synthetic Movement Traces Data Mining. SENSORS (BASEL, SWITZERLAND) 2024; 24:1381. [PMID: 38474917 DOI: 10.3390/s24051381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 02/13/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024]
Abstract
The ubiquity of sensors in smart-homes facilitates the support of independent living for older adults and enables cognitive assessment. Notably, there has been a growing interest in utilizing movement traces for identifying signs of cognitive impairment in recent years. In this study, we introduce an innovative approach to identify abnormal indoor movement patterns that may signal cognitive decline. This is achieved through the non-intrusive integration of smart-home sensors, including passive infrared sensors and sensors embedded in everyday objects. The methodology involves visualizing user locomotion traces and discerning interactions with objects on a floor plan representation of the smart-home, and employing different image descriptor features designed for image analysis tasks and synthetic minority oversampling techniques to enhance the methodology. This approach distinguishes itself by its flexibility in effortlessly incorporating additional features through sensor data. A comprehensive analysis, conducted with a substantial dataset obtained from a real smart-home, involving 99 seniors, including those with cognitive diseases, reveals the effectiveness of the proposed functional prototype of the system architecture. The results validate the system's efficacy in accurately discerning the cognitive status of seniors, achieving a macro-averaged F1-score of 72.22% for the two targeted categories: cognitively healthy and people with dementia. Furthermore, through experimental comparison, our system demonstrates superior performance compared with state-of-the-art methods.
Collapse
Affiliation(s)
- Samaneh Zolfaghari
- School of Innovation, Design and Engineering, Division of Intelligent Future Technologies, Mälardalen University, 721 23 Västerås, Sweden
| | - Annica Kristoffersson
- School of Innovation, Design and Engineering, Division of Intelligent Future Technologies, Mälardalen University, 721 23 Västerås, Sweden
| | - Mia Folke
- School of Innovation, Design and Engineering, Division of Intelligent Future Technologies, Mälardalen University, 721 23 Västerås, Sweden
| | - Maria Lindén
- School of Innovation, Design and Engineering, Division of Intelligent Future Technologies, Mälardalen University, 721 23 Västerås, Sweden
| | - Daniele Riboni
- Department of Mathematics and Computer Science, University of Cagliari, 09124 Cagliari, Italy
| |
Collapse
|
2
|
Hoover B, Zaengle D, Mark-Moser M, Wingo P, Suhag A, Rose K. Enhancing knowledge discovery from unstructured data using a deep learning approach to support subsurface modeling predictions. Front Big Data 2023; 6:1227189. [PMID: 38169611 PMCID: PMC10758407 DOI: 10.3389/fdata.2023.1227189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 11/20/2023] [Indexed: 01/05/2024] Open
Abstract
Subsurface interpretations and models rely on knowledge from subject matter experts who utilize unstructured information from images, maps, cross sections, and other products to provide context to measured data (e. g., cores, well logs, seismic surveys). To enhance such knowledge discovery, we advanced the National Energy Technology Laboratory's (NETL) Subsurface Trend Analysis (STA) workflow with an artificial intelligence (AI) deep learning approach for image embedding. NETL's STA method offers a validated science-based approach of combining geologic systems knowledge, statistical modeling, and datasets to improve predictions of subsurface properties. The STA image embedding tool quickly extracts images from unstructured knowledge products like publications, maps, websites, and presentations; categorically labels the images; and creates a repository for geologic domain postulation. Via a case study on geographic and subsurface literature of the Gulf of Mexico (GOM), results show the STA image embedding tool extracts images and correctly labels them with ~90 to ~95% accuracy.
Collapse
Affiliation(s)
- Brendan Hoover
- National Energy Technology Laboratory, Albany, OR, United States
- NETL Support Contractor, Albany, OR, United States
- US Army Corps of Engineers, Geospatial Research Laboratory, Alexandria, VA, United States
| | - Dakota Zaengle
- National Energy Technology Laboratory, Albany, OR, United States
- NETL Support Contractor, Albany, OR, United States
| | - MacKenzie Mark-Moser
- National Energy Technology Laboratory, Albany, OR, United States
- NETL Support Contractor, Albany, OR, United States
| | - Patrick Wingo
- National Energy Technology Laboratory, Albany, OR, United States
- NETL Support Contractor, Albany, OR, United States
| | - Anuj Suhag
- National Energy Technology Laboratory, Albany, OR, United States
| | - Kelly Rose
- National Energy Technology Laboratory, Albany, OR, United States
| |
Collapse
|
3
|
Li C, Weng Y, Zhang Y, Wang B. A Systematic Review of Application Progress on Machine Learning-Based Natural Language Processing in Breast Cancer over the Past 5 Years. Diagnostics (Basel) 2023; 13:diagnostics13030537. [PMID: 36766641 PMCID: PMC9913934 DOI: 10.3390/diagnostics13030537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 01/24/2023] [Indexed: 02/04/2023] Open
Abstract
Artificial intelligence (AI) has been steadily developing in the medical field in the past few years, and AI-based applications have advanced cancer diagnosis. Breast cancer has a massive amount of data in oncology. There has been a high level of research enthusiasm to apply AI techniques to assist in breast cancer diagnosis and improve doctors' efficiency. However, the wise utilization of tedious breast cancer-related medical care is still challenging. Over the past few years, AI-based NLP applications have been increasingly proposed in breast cancer. In this systematic review, we conduct the review using preferred reporting items for systematic reviews and meta-analyses (PRISMA) and investigate the recent five years of literature in natural language processing (NLP)-based AI applications. This systematic review aims to uncover the recent trends in this area, close the research gap, and help doctors better understand the NLP application pipeline. We first conduct an initial literature search of 202 publications from Scopus, Web of Science, PubMed, Google Scholar, and the Association for Computational Linguistics (ACL) Anthology. Then, we screen the literature based on inclusion and exclusion criteria. Next, we categorize and analyze the advantages and disadvantages of the different machine learning models. We also discuss the current challenges, such as the lack of a public dataset. Furthermore, we suggest some promising future directions, including semi-supervised learning, active learning, and transfer learning.
Collapse
Affiliation(s)
- Chengtai Li
- School of Computer Science, Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo 315100, China
| | - Ying Weng
- School of Computer Science, Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo 315100, China
- Correspondence:
| | - Yiming Zhang
- School of Computer Science, Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo 315100, China
| | - Boding Wang
- Hwa Mei Hospital, University of Chinese Academy of Sciences, Ningbo 315010, China
| |
Collapse
|
4
|
Tagde P, Tagde S, Bhattacharya T, Tagde P, Chopra H, Akter R, Kaushik D, Rahman MH. Blockchain and artificial intelligence technology in e-Health. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2021; 28:52810-52831. [PMID: 34476701 PMCID: PMC8412875 DOI: 10.1007/s11356-021-16223-0] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Accepted: 08/24/2021] [Indexed: 05/21/2023]
Abstract
Blockchain and artificial intelligence technologies are novel innovations in healthcare sector. Data on healthcare indices are collected from data published on Web of Sciences and other Google survey from various governing bodies. In this review, we focused on various aspects of blockchain and artificial intelligence and also discussed about integrating both technologies for making a significant difference in healthcare by promoting the implementation of a generalizable analytical technology that can be integrated into a more comprehensive risk management approach. This article has shown the various possibilities of creating reliable artificial intelligence models in e-Health using blockchain, which is an open network for the sharing and authorization of information. Healthcare professionals will have access to the blockchain to display the medical records of the patient, and AI uses a variety of proposed algorithms and decision-making capability, as well as large quantities of data. Thus, by integrating the latest advances of these technologies, the medical system will have improved service efficiency, reduced costs, and democratized healthcare. Blockchain enables the storage of cryptographic records, which AI needs.
Collapse
Affiliation(s)
- Priti Tagde
- Bhabha Pharmacy Research Institute, Bhabha University Bhopal, Bhopal M.P, India.
- PRISAL Foundation (Pharmaceutical Royal International Society), New delhi, India.
| | - Sandeep Tagde
- PRISAL Foundation (Pharmaceutical Royal International Society), New delhi, India
| | - Tanima Bhattacharya
- School of Chemistry & Chemical Engineering, Hubei University, Wuhan, China
- Department of Science & Engineering, Novel Global Community Education Foundation, Hebersham, Australia
| | - Pooja Tagde
- Practice of Medicine Department, Govt. Homeopathy College, Bhopal, M.P, India
| | - Hitesh Chopra
- Chitkara College of Pharmacy, Rajpura, Punjab, 140401, India
| | - Rokeya Akter
- Department of Pharmacy, Jagannath University, Sadarghat, Dhaka, 1100, Bangladesh
| | - Deepak Kaushik
- Department of Pharmaceutical Sciences, Maharshi Dayanand University, Rohtak, Haryana, 124001, India
| | - Md Habibur Rahman
- Department of Pharmacy, Southeast University, Banani, Dhaka, 1213, Bangladesh.
| |
Collapse
|
5
|
Thomas MJ, Lal V, Baby AK, Rabeeh Vp M, James A, Raj AK. Can technological advancements help to alleviate COVID-19 pandemic? a review. J Biomed Inform 2021; 117:103787. [PMID: 33862231 PMCID: PMC8056973 DOI: 10.1016/j.jbi.2021.103787] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 03/22/2021] [Accepted: 04/10/2021] [Indexed: 12/18/2022]
Abstract
The COVID-19 pandemic is continuing, and the innovative and efficient contributions of the emerging modern technologies to the pandemic responses are too early and cannot be completely quantified at this moment. Digital technologies are not a final solution but are the tools that facilitate a quick and effective pandemic response. In accordance, mobile applications, robots and drones, social media platforms (such as search engines, Twitter, and Facebook), television, and associated technologies deployed in tackling the COVID-19 (SARS-CoV-2) outbreak are discussed adequately, emphasizing the current-state-of-art. A collective discussion on reported literature, press releases, and organizational claims are reviewed. This review addresses and highlights how these effective modern technological solutions can aid in healthcare (involving contact tracing, real-time isolation monitoring/screening, disinfection, quarantine enforcement, syndromic surveillance, and mental health), communication (involving remote assistance, information sharing, and communication support), logistics, tourism, and hospitality. The study discusses the benefits of these digital technologies in curtailing the pandemic and 'how' the different sectors adapted to these in a shorter period. Social media and television's role in ensuring global connectivity and serving as a common platform to share authentic information among the general public were summarized. The World Health Organization and Governments' role globally in-line with the prevention of propagation of false news, spreading awareness, and diminishing the severity of the COVID-19 was discussed. Furthermore, this collective review is helpful to investigators, health departments, Government organizations, and policymakers alike to facilitate a quick and effective pandemic response.
Collapse
Affiliation(s)
- Mervin Joe Thomas
- Dept. of Mechanical Engg., National Institute of Technology Calicut, Kerala 673601, India
| | - Vishnu Lal
- Dept. of Mechanical Engg., National Institute of Technology Calicut, Kerala 673601, India
| | - Ajith Kurian Baby
- Dept. of Mechanical Engg., National Institute of Technology Calicut, Kerala 673601, India
| | - Muhammad Rabeeh Vp
- School of Materials Science and Engg., National Institute of Technology Calicut, Kerala 673601, India
| | - Alosh James
- Solar Energy Center, Dept. of Mechanical Engg., National Institute of Technology Calicut, Kerala 673601, India
| | - Arun K Raj
- Dept. of Mechanical Engg., Indian Institute of Technology Bombay, Maharashtra 400076, India.
| |
Collapse
|
6
|
Han C, Rundo L, Murao K, Noguchi T, Shimahara Y, Milacski ZÁ, Koshino S, Sala E, Nakayama H, Satoh S. MADGAN: unsupervised medical anomaly detection GAN using multiple adjacent brain MRI slice reconstruction. BMC Bioinformatics 2021; 22:31. [PMID: 33902457 PMCID: PMC8073969 DOI: 10.1186/s12859-020-03936-1] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Accepted: 12/15/2020] [Indexed: 12/28/2022] Open
Abstract
BACKGROUND Unsupervised learning can discover various unseen abnormalities, relying on large-scale unannotated medical images of healthy subjects. Towards this, unsupervised methods reconstruct a 2D/3D single medical image to detect outliers either in the learned feature space or from high reconstruction loss. However, without considering continuity between multiple adjacent slices, they cannot directly discriminate diseases composed of the accumulation of subtle anatomical anomalies, such as Alzheimer's disease (AD). Moreover, no study has shown how unsupervised anomaly detection is associated with either disease stages, various (i.e., more than two types of) diseases, or multi-sequence magnetic resonance imaging (MRI) scans. RESULTS We propose unsupervised medical anomaly detection generative adversarial network (MADGAN), a novel two-step method using GAN-based multiple adjacent brain MRI slice reconstruction to detect brain anomalies at different stages on multi-sequence structural MRI: (Reconstruction) Wasserstein loss with Gradient Penalty + 100 [Formula: see text] loss-trained on 3 healthy brain axial MRI slices to reconstruct the next 3 ones-reconstructs unseen healthy/abnormal scans; (Diagnosis) Average [Formula: see text] loss per scan discriminates them, comparing the ground truth/reconstructed slices. For training, we use two different datasets composed of 1133 healthy T1-weighted (T1) and 135 healthy contrast-enhanced T1 (T1c) brain MRI scans for detecting AD and brain metastases/various diseases, respectively. Our self-attention MADGAN can detect AD on T1 scans at a very early stage, mild cognitive impairment (MCI), with area under the curve (AUC) 0.727, and AD at a late stage with AUC 0.894, while detecting brain metastases on T1c scans with AUC 0.921. CONCLUSIONS Similar to physicians' way of performing a diagnosis, using massive healthy training data, our first multiple MRI slice reconstruction approach, MADGAN, can reliably predict the next 3 slices from the previous 3 ones only for unseen healthy images. As the first unsupervised various disease diagnosis, MADGAN can reliably detect the accumulation of subtle anatomical anomalies and hyper-intense enhancing lesions, such as (especially late-stage) AD and brain metastases on multi-sequence MRI scans.
Collapse
Affiliation(s)
| | - Leonardo Rundo
- Department of Radiology, University of Cambridge, Cambridge, UK
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK
| | - Kohei Murao
- Research Center for Medical Big Data, National Institute of Informatics, Tokyo, Japan
| | | | | | - Zoltán Ádám Milacski
- Department of Artificial Intelligence, ELTE Eötvös Loránd University, Budapest, Hungary
| | - Saori Koshino
- Department of Radiology, Juntendo University, Tokyo, Japan
| | - Evis Sala
- Department of Radiology, University of Cambridge, Cambridge, UK
- Cancer Research UK Cambridge Centre, University of Cambridge, Cambridge, UK
| | - Hideki Nakayama
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, The University of Tokyo, Tokyo, Japan
| | - Shin’ichi Satoh
- Research Center for Medical Big Data, National Institute of Informatics, Tokyo, Japan
| |
Collapse
|