Use of Machine Learning and Artificial Intelligence Methods in Geriatric Mental Health Research Involving Electronic Health Record or Administrative Claims Data: A Systematic Review

The Role of Artificial Intelligence in Identifying Depression and Anxiety: A Comprehensive Literature Review

This narrative literature review undertakes a comprehensive examination of the burgeoning field, tracing the development of artificial intelligence (AI)-powered tools for depression and anxiety detection from the level of intricate algorithms to practical applications. Delivering essential mental health care services is now a significant public health priority. In recent years, AI has become a game-changer in the early identification and intervention of these pervasive mental health disorders. AI tools can potentially empower behavioral healthcare services by helping psychiatrists collect objective data on patients' progress and tasks. This study emphasizes the current understanding of AI, the different types of AI, its current use in multiple mental health disorders, advantages, disadvantages, and future potentials. As technology develops and the digitalization of the modern era increases, there will be a rise in the application of artificial intelligence in psychiatry; therefore, a comprehensive understanding will be needed. We searched PubMed, Google Scholar, and Science Direct using keywords for this. In a recent review of studies using electronic health records (EHR) with AI and machine learning techniques for diagnosing all clinical conditions, roughly 99 publications have been found. Out of these, 35 studies were identified for mental health disorders in all age groups, and among them, six studies utilized EHR data sources. By critically analyzing prominent scholarly works, we aim to illuminate the current state of this technology, exploring its successes, limitations, and future directions. In doing so, we hope to contribute to a nuanced understanding of AI's potential to revolutionize mental health diagnostics and pave the way for further research and development in this critically important domain.

The validity of electronic health data for measuring smoking status: a systematic review and meta-analysis

BACKGROUND

Smoking is a risk factor for many chronic diseases. Multiple smoking status ascertainment algorithms have been developed for population-based electronic health databases such as administrative databases and electronic medical records (EMRs). Evidence syntheses of algorithm validation studies have often focused on chronic diseases rather than risk factors. We conducted a systematic review and meta-analysis of smoking status ascertainment algorithms to describe the characteristics and validity of these algorithms.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed. We searched articles published from 1990 to 2022 in EMBASE, MEDLINE, Scopus, and Web of Science with key terms such as validity, administrative data, electronic health records, smoking, and tobacco use. The extracted information, including article characteristics, algorithm characteristics, and validity measures, was descriptively analyzed. Sources of heterogeneity in validity measures were estimated using a meta-regression model. Risk of bias (ROB) in the reviewed articles was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool.

RESULTS

The initial search yielded 2086 articles; 57 were selected for review and 116 algorithms were identified. Almost three-quarters (71.6%) of algorithms were based on EMR data. The algorithms were primarily constructed using diagnosis codes for smoking-related conditions, although prescription medication codes for smoking treatments were also adopted. About half of the algorithms were developed using machine-learning models. The pooled estimates of positive predictive value, sensitivity, and specificity were 0.843, 0.672, and 0.918 respectively. Algorithm sensitivity and specificity were highly variable and ranged from 3 to 100% and 36 to 100%, respectively. Model-based algorithms had significantly greater sensitivity (p = 0.006) than rule-based algorithms. Algorithms for EMR data had higher sensitivity than algorithms for administrative data (p = 0.001). The ROB was low in most of the articles (76.3%) that underwent the assessment.

CONCLUSIONS

Multiple algorithms using different data sources and methods have been proposed to ascertain smoking status in electronic health data. Many algorithms had low sensitivity and positive predictive value, but the data source influenced their validity. Algorithms based on machine-learning models for multiple linked data sources have improved validity.

Use of Electronic Medical Records (EMR) in Gerontology: Benefits, Considerations and a Promising Future

Electronic medical records (EMRs) have many benefits in clinical research in gerontology, enabling data analysis, development of prognostic tools and disease risk prediction. EMRs also offer a range of advantages in clinical practice, such as comprehensive medical records, streamlined communication with healthcare providers, remote data access, and rapid retrieval of test results, ultimately leading to increased efficiency, enhanced patient safety, and improved quality of care in gerontology, which includes benefits like reduced medication use and better patient history taking and physical examination assessments. The use of artificial intelligence (AI) and machine learning (ML) approaches on EMRs can further improve disease diagnosis, symptom classification, and support clinical decision-making. However, there are also challenges related to data quality, data entry errors, as well as the ethics and safety of using AI in healthcare. This article discusses the future of EMRs in gerontology and the application of AI and ML in clinical research. Ethical and legal issues surrounding data sharing and the need for healthcare professionals to critically evaluate and integrate these technologies are also emphasized. The article concludes by discussing the challenges related to the use of EMRs in research as well as in their primary intended use, the daily clinical practice.

Application of machine learning in measurement of ageing and geriatric diseases: a systematic review

BACKGROUND

As the ageing population continues to grow in many countries, the prevalence of geriatric diseases is on the rise. In response, healthcare providers are exploring novel methods to enhance the quality of life for the elderly. Over the last decade, there has been a remarkable surge in the use of machine learning in geriatric diseases and care. Machine learning has emerged as a promising tool for the diagnosis, treatment, and management of these conditions. Hence, our study aims to find out the present state of research in geriatrics and the application of machine learning methods in this area.

METHODS

This systematic review followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and focused on healthy ageing in individuals aged 45 and above, with a specific emphasis on the diseases that commonly occur during this process. The study mainly focused on three areas, that are machine learning, the geriatric population, and diseases. Peer-reviewed articles were searched in the PubMed and Scopus databases with inclusion criteria of population above 45 years, must have used machine learning methods, and availability of full text. To assess the quality of the studies, Joanna Briggs Institute's (JBI) critical appraisal tool was used.

RESULTS

A total of 70 papers were selected from the 120 identified papers after going through title screening, abstract screening, and reference search. Limited research is available on predicting biological or brain age using deep learning and different supervised machine learning methods. Neurodegenerative disorders were found to be the most researched disease, in which Alzheimer's disease was focused the most. Among non-communicable diseases, diabetes mellitus, hypertension, cancer, kidney diseases, and cardiovascular diseases were included, and other rare diseases like oral health-related diseases and bone diseases were also explored in some papers. In terms of the application of machine learning, risk prediction was the most common approach. Half of the studies have used supervised machine learning algorithms, among which logistic regression, random forest, XG Boost were frequently used methods. These machine learning methods were applied to a variety of datasets including population-based surveys, hospital records, and digitally traced data.

CONCLUSION

The review identified a wide range of studies that employed machine learning algorithms to analyse various diseases and datasets. While the application of machine learning in geriatrics and care has been well-explored, there is still room for future development, particularly in validating models across diverse populations and utilizing personalized digital datasets for customized patient-centric care in older populations. Further, we suggest a scope of Machine Learning in generating comparable ageing indices such as successful ageing index.

Mining electronic health records using artificial intelligence: Bibliometric and content analyses for current research status and product conversion

BACKGROUND

The use of Electronic Health Records is the most important milestone in the digitization and intelligence of the entire medical industry. AI can effectively mine the immense medical information contained in EHRs, potentially assist doctors in reducing many medical errors.

OBJECTIVE

This article aims to summarize the research status and trends in using AI to mine medical information from EHRs for the past thirteen years and investigate its information application.

METHODS

A systematic search was carried out in 5 databases, including Web of Science Core Collection and PubMed, to identify research using AI to mine medical information from EHRs for the past thirteen years. Furthermore, bibliometric and content analysis were used to explore the research hotspots and trends, and systematically analyze the conversion rate of research resources in this field.

RESULTS

A total of 631 articles were included and analyzed. The number of published articles has increased rapidly after 2017, with an average annual growth rate of 55.73%. The US (41.68%) and China (19.65%) publish the most articles, but there is a lack of international cooperation. The extraction of disease lesions is a hot topic at present, and the research topic is gradually shifting from disease risk grading to disease risk prediction. Classification (66%), and regress (15%) are the main implemented AI tasks. For AI algorithms, deep learning (31.70%), decision tree algorithms family (26.47%), and regression algorithms family (17.43%) are used most frequently. The funding rate for publications is 69.26%, and the input-output conversion rate is 21.05%.

CONCLUSIONS

Over the past decade, the use of AI to mine medical information from EHRs has been developing rapidly. However, it is necessary to strengthen international cooperation, improve EHRs data availability, focus on interpretable AI algorithms, and improve the resource conversion rate in future research.

World Psychiatric Association-Asian Journal of Psychiatry Commission on Psychiatric Education in the 21st century

Psychiatric practice faces many challenges in the first quarter of 21st century. Society has transformed, as have training requirements and patient expectations, underlining an urgent need to look at educational programmes. Meanwhile, awareness has grown around psychiatric disorders and there are evolving workforce trends, with more women going to medical school and specialising in psychiatry. Trainee psychiatrists carry different expectations for work-life balance and are increasingly becoming conscious of their own mental health. A tendency to see health as a commodity and the litigious nature of society has elicited additional pressures for healthcare professionals. Cartesian mind-body dualism has created further complexity and this can often be frustrating for patients and care-partners alike. In many cultures across Asia and beyond, patients can present with physical symptoms to express underlying psychological distress with increasing physical investigations. Simultaneously, in various countries, a shift from asylums to community-based interventions and then home treatments have changed psychiatric care in remarkable ways. These changes have added to pressures faced by mental healthcare professionals. However, trainees and other mental healthcare professionals continue to receive similar training as they did a generation ago. The tensions and differences in ideology/orientation between different branches of psychiatry have made responses to patient needs challenging. Recognising that it is difficult to predict the future, this World Psychiatric Association-Asian Journal of Psychiatry Commission makes recommendations that could help institutions and individuals enhance psychiatric education. This Commission draws from existing resources and recent developments to propose a training framework for future psychiatrists.

Identifying Medicare beneficiaries with Alzheimer's disease and related dementia using home health OASIS assessments

BACKGROUND

Home health services are an important site of care following hospitalization among Medicare beneficiaries, providing health assessments that can be leveraged to detect diagnoses that are not available in other data sources. In this work, we aimed to develop a parsimonious and accurate algorithm using home health outcome and assessment information set (OASIS) measures to identify Medicare beneficiaries with a diagnosis of Alzheimer's disease and related dementia (ADRD).

METHODS

We conducted a retrospective cohort study of Medicare beneficiaries with a complete OASIS start of care assessment in 2014, 2016, 2018, or 2019 to determine how well the items from various versions could identify those with an ADRD diagnosis by the assessment date. The prediction model was developed iteratively, comparing the performance of different models in terms of sensitivity, specificity, and accuracy of prediction, from a multivariable logistic regression model using clinically relevant variables, to regression models with all available variables and predictive modeling techniques, to estimate the best performing parsimonious model.

RESULTS

The most important predictors of having a diagnosis of ADRD by the start of care OASIS assessment were a prior discharge diagnosis of ADRD among those admitted from an inpatient setting, and frequently exhibiting symptoms of confusion. Results from the parsimonious model were consistent across the four annual cohorts and OASIS versions with high specificity (above 96%), but poor sensitivity (below 58%). The positive predictive value was high, over 87% across study years.

CONCLUSIONS

The proposed algorithm has high accuracy, requires a single OASIS assessment, is easy to implement without sophisticated statistical models, and can be used across four OASIS versions and in situations where claims are not available to identify individuals with a diagnosis of ADRD, including the growing population of Medicare Advantage beneficiaries.

Machine learning functional impairment classification with electronic health record data

BACKGROUND

Poor functional status is a key marker of morbidity, yet is not routinely captured in clinical encounters. We developed and evaluated the accuracy of a machine learning algorithm that leveraged electronic health record (EHR) data to provide a scalable process for identification of functional impairment.

METHODS

We identified a cohort of patients with an electronically captured screening measure of functional status (Older Americans Resources and Services ADL/IADL) between 2018 and 2020 (N = 6484). Patients were classified using unsupervised learning K means and t-distributed Stochastic Neighbor Embedding into normal function (NF), mild to moderate functional impairment (MFI), and severe functional impairment (SFI) states. Using 11 EHR clinical variable domains (832 variable input features), we trained an Extreme Gradient Boosting supervised machine learning algorithm to distinguish functional status states, and measured prediction accuracies. Data were randomly split into training (80%) and test (20%) sets. The SHapley Additive Explanations (SHAP) feature importance analysis was used to list the EHR features in rank order of their contribution to the outcome.

RESULTS

Median age was 75.3 years, 62% female, 60% White. Patients were classified as 53% NF (n = 3453), 30% MFI (n = 1947), and 17% SFI (n = 1084). Summary of model performance for identifying functional status state (NF, MFI, SFI) was AUROC (area under the receiving operating characteristic curve) 0.92, 0.89, and 0.87, respectively. Age, falls, hospitalization, home health use, labs (e.g., albumin), comorbidities (e.g., dementia, heart failure, chronic kidney disease, chronic pain), and social determinants of health (e.g., alcohol use) were highly ranked features in predicting functional status states.

CONCLUSION

A machine learning algorithm run on EHR clinical data has potential utility for differentiating functional status in the clinical setting. Through further validation and refinement, such algorithms can complement traditional screening methods and result in a population-based strategy for identifying patients with poor functional status who need additional health resources.

The reporting of neuropsychiatric symptoms in electronic health records of individuals with Alzheimer's disease: a natural language processing study

BACKGROUND

Neuropsychiatric symptoms (NPS) are prevalent in the early clinical stages of Alzheimer's disease (AD) according to proxy-based instruments. Little is known about which NPS clinicians report and whether their judgment aligns with proxy-based instruments. We used natural language processing (NLP) to classify NPS in electronic health records (EHRs) to estimate the reporting of NPS in symptomatic AD at the memory clinic according to clinicians. Next, we compared NPS as reported in EHRs and NPS reported by caregivers on the Neuropsychiatric Inventory (NPI).

METHODS

Two academic memory clinic cohorts were used: the Amsterdam UMC (n = 3001) and the Erasmus MC (n = 646). Patients included in these cohorts had MCI, AD dementia, or mixed AD/VaD dementia. Ten trained clinicians annotated 13 types of NPS in a randomly selected training set of n = 500 EHRs from the Amsterdam UMC cohort and in a test set of n = 250 EHRs from the Erasmus MC cohort. For each NPS, a generalized linear classifier was trained and internally and externally validated. Prevalence estimates of NPS were adjusted for the imperfect sensitivity and specificity of each classifier. Intra-individual comparison of the NPS classified in EHRs and NPS reported on the NPI were conducted in a subsample (59%).

RESULTS

Internal validation performance of the classifiers was excellent (AUC range: 0.81-0.91), but external validation performance decreased (AUC range: 0.51-0.93). NPS were prevalent in EHRs from the Amsterdam UMC, especially apathy (adjusted prevalence = 69.4%), anxiety (adjusted prevalence = 53.7%), aberrant motor behavior (adjusted prevalence = 47.5%), irritability (adjusted prevalence = 42.6%), and depression (adjusted prevalence = 38.5%). The ranking of NPS was similar for EHRs from the Erasmus MC, although not all classifiers obtained valid prevalence estimates due to low specificity. In both cohorts, there was minimal agreement between NPS classified in the EHRs and NPS reported on the NPI (all kappa coefficients < 0.28), with substantially more reports of NPS in EHRs than on NPI assessments.

CONCLUSIONS

NLP classifiers performed well in detecting a wide range of NPS in EHRs of patients with symptomatic AD visiting the memory clinic and showed that clinicians frequently reported NPS in these EHRs. Clinicians generally reported more NPS in EHRs than caregivers reported on the NPI.

Artificial intelligence and discrete-event simulation for capacity management of intensive care units during the Covid-19 pandemic: A case study

The Covid-19 pandemic has pushed the Intensive Care Units (ICUs) into significant operational disruptions. The rapid evolution of this disease, the bed capacity constraints, the wide variety of patient profiles, and the imbalances within health supply chains still represent a challenge for policymakers. This paper aims to use Artificial Intelligence (AI) and Discrete-Event Simulation (DES) to support ICU bed capacity management during Covid-19. The proposed approach was validated in a Spanish hospital chain where we initially identified the predictors of ICU admission in Covid-19 patients. Second, we applied Random Forest (RF) to predict ICU admission likelihood using patient data collected in the Emergency Department (ED). Finally, we included the RF outcomes in a DES model to assist decision-makers in evaluating new ICU bed configurations responding to the patient transfer expected from downstream services. The results evidenced that the median bed waiting time declined between 32.42 and 48.03 min after intervention.

Natural Language Processing in Electronic Health Records in relation to healthcare decision-making: A systematic review

BACKGROUND

Natural Language Processing (NLP) is widely used to extract clinical insights from Electronic Health Records (EHRs). However, the lack of annotated data, automated tools, and other challenges hinder the full utilisation of NLP for EHRs. Various Machine Learning (ML), Deep Learning (DL) and NLP techniques are studied and compared to understand the limitations and opportunities in this space comprehensively.

METHODOLOGY

After screening 261 articles from 11 databases, we included 127 papers for full-text review covering seven categories of articles: (1) medical note classification, (2) clinical entity recognition, (3) text summarisation, (4) deep learning (DL) and transfer learning architecture, (5) information extraction, (6) Medical language translation and (7) other NLP applications. This study follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.

RESULT AND DISCUSSION

EHR was the most commonly used data type among the selected articles, and the datasets were primarily unstructured. Various ML and DL methods were used, with prediction or classification being the most common application of ML or DL. The most common use cases were: the International Classification of Diseases, Ninth Revision (ICD-9) classification, clinical note analysis, and named entity recognition (NER) for clinical descriptions and research on psychiatric disorders.

CONCLUSION

We find that the adopted ML models were not adequately assessed. In addition, the data imbalance problem is quite important, yet we must find techniques to address this underlining problem. Future studies should address key limitations in studies, primarily identifying Lupus Nephritis, Suicide Attempts, perinatal self-harmed and ICD-9 classification.