Using Machine Learning to Predict Cognitive Impairment Among Middle-Aged and Older Chinese: A Longitudinal Study

Predicting cognitive function among Chinese community-dwelling older adults: A supervised machine learning approach

OBJECTIVE

Identifying cognitive impairment early enough could support timely intervention of cognitive impairment and facilitate successful cognitive aging. We aimed to build more precise prediction models for cognitive function using less variable input among Chinese community-dwelling older adults.

METHODS

We used data from a prospective cohort of 13,906 older adults aged 60 years and above from the nationally representative China Health and Retirement Longitudinal Study (CHARLS) 2011-2020. The Gradient Boosting Classifier (GBC) and gradient boosting regressor (GBR) models were used to predict an individual's current cognitive function. For future cognition prediction, we trained GBR models to analyze the prediction error over the years.

RESULTS

Among 68 features, ten features were finally selected to develop the model: education attainment, childhood friendship, age, instrumental activities of daily living (IADLs), hukou type, mobility, sleep duration, gender, residence, and social participation. Our model exhibited robust performance in predicting current and future cognitive function. When an individual's current cognitive function was assessed as a dichotomous classification of cognitive impairment presence, the GBC model achieved an area under the receiver operating characteristic (ROC) of 0.832. When the outcome was forecasted as a continuous variable, the model achieved a root mean square error (RMSE) loss of 3.356 in the test set. For predicting future cognition, models taking into account the current cognitive state demonstrated superior performance.

CONCLUSIONS

Our study offers a practical tool to aid in the early identification of cognitive impairment, thus supporting timely interventions in the community environment and potentially contributing to successful cognitive aging.

Early Identification of Cognitive Impairment in Community Environments Through Modeling Subtle Inconsistencies in Questionnaire Responses: Machine Learning Model Development and Validation

BACKGROUND

The underdiagnosis of cognitive impairment hinders timely intervention of dementia. Health professionals working in the community play a critical role in the early detection of cognitive impairment, yet still face several challenges such as a lack of suitable tools, necessary training, and potential stigmatization.

OBJECTIVE

This study explored a novel application integrating psychometric methods with data science techniques to model subtle inconsistencies in questionnaire response data for early identification of cognitive impairment in community environments.

METHODS

This study analyzed questionnaire response data from participants aged 50 years and older in the Health and Retirement Study (waves 8-9, n=12,942). Predictors included low-quality response indices generated using the graded response model from four brief questionnaires (optimism, hopelessness, purpose in life, and life satisfaction) assessing aspects of overall well-being, a focus of health professionals in communities. The primary and supplemental predicted outcomes were current cognitive impairment derived from a validated criterion and dementia or mortality in the next ten years. Seven predictive models were trained, and the performance of these models was evaluated and compared.

RESULTS

The multilayer perceptron exhibited the best performance in predicting current cognitive impairment. In the selected four questionnaires, the area under curve values for identifying current cognitive impairment ranged from 0.63 to 0.66 and was improved to 0.71 to 0.74 when combining the low-quality response indices with age and gender for prediction. We set the threshold for assessing cognitive impairment risk in the tool based on the ratio of underdiagnosis costs to overdiagnosis costs, and a ratio of 4 was used as the default choice. Furthermore, the tool outperformed the efficiency of age or health-based screening strategies for identifying individuals at high risk for cognitive impairment, particularly in the 50- to 59-year and 60- to 69-year age groups. The tool is available on a portal website for the public to access freely.

CONCLUSIONS

We developed a novel prediction tool that integrates psychometric methods with data science to facilitate "passive or backend" cognitive impairment assessments in community settings, aiming to promote early cognitive impairment detection. This tool simplifies the cognitive impairment assessment process, making it more adaptable and reducing burdens. Our approach also presents a new perspective for using questionnaire data: leveraging, rather than dismissing, low-quality data.

Early prediction of cognitive impairment in adults aged 20 years and older using machine learning and biomarkers of heavy metal exposure

Background

Cognitive impairment poses a growing health challenge as populations age. Heavy metals are implicated as environmental risk factors, but their role is not fully understood. Machine learning can integrate multi-factorial data to predict cognitive outcomes.

Objective

To develop and validate machine learning models for early prediction of cognitive impairment risk using demographics, clinical factors, and biomarkers of heavy metal exposure.

Method

A retrospective analysis was conducted using 2011-2014 NHANES data. Participants aged ≥ 20 underwent cognitive testing. Variables included demographics, medical history, lifestyle factors, and blood and urine levels of lead, cadmium, manganese, and other metals. Machine learning algorithms were trained on 90 % of data and evaluated on 10 %. Performance was assessed using metrics like accuracy, AUC, and sensitivity.

Result

A final sample of 2,933 participants was analyzed. The stacking ensemble model achieved the best performance with an AUC of 0.778 for test data, sensitivity of 0.879. Important predictors included age, gender, hypertension, education, urinary cadmium and blood manganese levels.

Conclusion

Machine learning can effectively predict cognitive impairment risk using comprehensive clinical and exposure data. Incorporating heavy metal biomarkers enhanced prediction and provided insights into environmental contributions to cognitive decline. Prospective studies are needed to validate models over time.

Prediction Model for Cognitive Impairment among Disabled Older Adults: A Development and Validation Study

Disabled older adults exhibited a higher risk for cognitive impairment. Early identification is crucial in alleviating the disease burden. This study aims to develop and validate a prediction model for identifying cognitive impairment among disabled older adults. A total of 2138, 501, and 746 participants were included in the development set and two external validation sets. Logistic regression, support vector machine, random forest, and XGBoost were introduced to develop the prediction model. A nomogram was further established to demonstrate the prediction model directly and vividly. Logistic regression exhibited better predictive performance on the test set with an area under the curve of 0.875. It maintained a high level of precision (0.808), specification (0.788), sensitivity (0.770), and F1-score (0.788) compared with the machine learning models. We further simplified and established a nomogram based on the logistic regression, comprising five variables: age, daily living activities, instrumental activity of daily living, hearing impairment, and visual impairment. The areas under the curve of the nomogram were 0.871, 0.825, and 0.863 in the internal and two external validation sets, respectively. This nomogram effectively identifies the risk of cognitive impairment in disabled older adults.

Community screening for dementia among older adults in China: a machine learning-based strategy

BACKGROUND

Dementia is a leading cause of disability in people older than 65 years worldwide. However, diagnosing dementia in its earliest symptomatic stages remains challenging. This study combined specific questions from the AD8 scale with comprehensive health-related characteristics, and used machine learning (ML) to construct diagnostic models of cognitive impairment (CI).

METHODS

The study was based on the Shenzhen Healthy Ageing Research (SHARE) project, and we recruited 823 participants aged 65 years and older, who completed a comprehensive health assessment and cognitive function assessments. Permutation importance was used to select features. Five ML models using BalanceCascade were applied to predict CI: a support vector machine (SVM), multilayer perceptron (MLP), AdaBoost, gradient boosting decision tree (GBDT), and logistic regression (LR). An AD8 score ≥ 2 was used to define CI as a baseline. SHapley Additive exPlanations (SHAP) values were used to interpret the results of ML models.

RESULTS

The first and sixth items of AD8, platelets, waist circumference, body mass index, carcinoembryonic antigens, age, serum uric acid, white blood cells, abnormal electrocardiogram, heart rate, and sex were selected as predictive features. Compared to the baseline (AUC = 0.65), the MLP showed the highest performance (AUC: 0.83 ± 0.04), followed by AdaBoost (AUC: 0.80 ± 0.04), SVM (AUC: 0.78 ± 0.04), GBDT (0.76 ± 0.04). Furthermore, the accuracy, sensitivity and specificity of four ML models were higher than the baseline. SHAP summary plots based on MLP showed the most influential feature on model decision for positive CI prediction was female sex, followed by older age and lower waist circumference.

CONCLUSIONS

The diagnostic models of CI applying ML, especially the MLP, were substantially more effective than the traditional AD8 scale with a score of ≥ 2 points. Our findings may provide new ideas for community dementia screening and to promote such screening while minimizing medical and health resources.

Development and validation of a cognitive dysfunction risk prediction model for the abdominal obesity population

Objectives

This study was aimed to develop a nomogram that can accurately predict the likelihood of cognitive dysfunction in individuals with abdominal obesity by utilizing various predictor factors.

Methods

A total of 1490 cases of abdominal obesity were randomly selected from the National Health and Nutrition Examination Survey (NHANES) database for the years 2011-2014. The diagnostic criteria for abdominal obesity were as follows: waist size ≥ 102 cm for men and waist size ≥ 88 cm for women, and cognitive function was assessed by Consortium to Establish a Registry for Alzheimer's Disease (CERAD), Word Learning subtest, Delayed Word Recall Test, Animal Fluency Test (AFT), and Digit Symbol Substitution Test (DSST). The cases were divided into two sets: a training set consisting of 1043 cases (70%) and a validation set consisting of 447 cases (30%). To create the model nomogram, multifactor logistic regression models were constructed based on the selected predictors identified through LASSO regression analysis. The model's performance was assessed using several metrics, including the consistency index (C-index), the area under the receiver operating characteristic (ROC) curve (AUC), calibration curves, and decision curve analysis (DCA) to assess the clinical benefit of the model.

Results

The multivariate logistic regression analysis revealed that age, sex, education level, 24-hour total fat intake, red blood cell folate concentration, depression, and moderate work activity were significant predictors of cognitive dysfunction in individuals with abdominal obesity (p < 0.05). These predictors were incorporated into the nomogram. The C-indices for the training and validation sets were 0.814 (95% CI: 0.875-0.842) and 0.805 (95% CI: 0.758-0.851), respectively. The corresponding AUC values were 0.814 (95% CI: 0.875-0.842) and 0.795 (95% CI: 0.753-0.847). The calibration curves demonstrated a satisfactory level of agreement between the nomogram model and the observed data. The DCA indicated that early intervention for at-risk populations would provide a net benefit, as indicated by the line graph.

Conclusion

Age, sex, education level, 24-hour total fat intake, red blood cell folate concentration, depression, and moderate work activity were identified as predictive factors for cognitive dysfunction in individuals with abdominal obesity. In conclusion, the nomogram model developed in this study can effectively predict the clinical risk of cognitive dysfunction in individuals with abdominal obesity.

Application of machine learning in measurement of ageing and geriatric diseases: a systematic review

BACKGROUND

As the ageing population continues to grow in many countries, the prevalence of geriatric diseases is on the rise. In response, healthcare providers are exploring novel methods to enhance the quality of life for the elderly. Over the last decade, there has been a remarkable surge in the use of machine learning in geriatric diseases and care. Machine learning has emerged as a promising tool for the diagnosis, treatment, and management of these conditions. Hence, our study aims to find out the present state of research in geriatrics and the application of machine learning methods in this area.

METHODS

This systematic review followed Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and focused on healthy ageing in individuals aged 45 and above, with a specific emphasis on the diseases that commonly occur during this process. The study mainly focused on three areas, that are machine learning, the geriatric population, and diseases. Peer-reviewed articles were searched in the PubMed and Scopus databases with inclusion criteria of population above 45 years, must have used machine learning methods, and availability of full text. To assess the quality of the studies, Joanna Briggs Institute's (JBI) critical appraisal tool was used.

RESULTS

A total of 70 papers were selected from the 120 identified papers after going through title screening, abstract screening, and reference search. Limited research is available on predicting biological or brain age using deep learning and different supervised machine learning methods. Neurodegenerative disorders were found to be the most researched disease, in which Alzheimer's disease was focused the most. Among non-communicable diseases, diabetes mellitus, hypertension, cancer, kidney diseases, and cardiovascular diseases were included, and other rare diseases like oral health-related diseases and bone diseases were also explored in some papers. In terms of the application of machine learning, risk prediction was the most common approach. Half of the studies have used supervised machine learning algorithms, among which logistic regression, random forest, XG Boost were frequently used methods. These machine learning methods were applied to a variety of datasets including population-based surveys, hospital records, and digitally traced data.

CONCLUSION

The review identified a wide range of studies that employed machine learning algorithms to analyse various diseases and datasets. While the application of machine learning in geriatrics and care has been well-explored, there is still room for future development, particularly in validating models across diverse populations and utilizing personalized digital datasets for customized patient-centric care in older populations. Further, we suggest a scope of Machine Learning in generating comparable ageing indices such as successful ageing index.

Predicting mild cognitive impairment among Chinese older adults: a longitudinal study based on long short-term memory networks and machine learning

Background

Mild cognitive impairment (MCI) is a transitory yet reversible stage of dementia. Systematic, scientific and population-wide early screening system for MCI is lacking. This study aimed to construct prediction models using longitudinal data to identify potential MCI patients and explore its critical features among Chinese older adults.

Methods

A total of 2,128 participants were selected from wave 5-8 of Chinese Longitudinal Healthy Longevity Study. Cognitive function was measured using the Chinese version of Mini-Mental State Examination. Long- short-term memory (LSTM) and three machine learning techniques, including 8 sociodemographic features and 12 health behavior and health status features, were used to predict individual risk of MCI in the next year. Performances of prediction models were evaluated through receiver operating curve and decision curve analysis. The importance of predictors in prediction models were explored using Shapley Additive explanation (SHAP) model.

Results

The area under the curve values of three models were around 0.90 and decision curve analysis indicated that the net benefit of XGboost and Random Forest were approximate when threshold is lower than 0.8. SHAP models showed that age, education, respiratory disease, gastrointestinal ulcer and self-rated health are the five most important predictors of MCI.

Conclusion

This screening method of MCI, combining LSTM and machine learning, successfully predicted the risk of MCI using longitudinal datasets, and enables health care providers to implement early intervention to delay the process from MCI to dementia, reducing the incidence and treatment cost of dementia ultimately.

Exploring Depression and Nutritional Covariates Amongst US Adults using Shapely Additive Explanations

Background

Depression affects personal and public well-being and identification of natural therapeutics such as nutrition is necessary to help alleviate this public health concern.

Objective

The study aimed to identify feature importance in a machine learning model using solely nutrition covariates.

Methods

A retrospective analysis was conducted using a modern, nationally representative cohort, the National Health and Nutrition Examination Surveys (NHANES 2017-2020). Depressive symptoms were evaluated using the validated 9-item Patient Health Questionnaire (PHQ-9), and all adult patients (total of 7929 individuals) who completed the PHQ-9 and total nutritional intake questionnaire were included in the study. Univariable regression was used to identify significant nutritional covariates to be included in a machine learning model and feature importance was reported. The acquisition and analysis of the data were authorized by the National Center for Health Statistics Ethics Review Board.

Results

7929 patients met the inclusion criteria in this study. The machine learning model had 24 out of a total of 60 features that were found to be significant on univariate analysis (p < 0.01 used). In the XGBoost model the model had an Area Under the Receiver Operator Characteristic Curve (AUROC) = 0.603, Sensitivity = 0.943, Specificity = 0.163. The top four highest ranked features by gain, a measure of the percentage contribution of the covariate to the overall model prediction, were Potassium Intake (Gain = 6.8%), Vitamin E Intake (Gain = 5.7%), Number of Foods and Beverages Reported (Gain = 5.7%), and Vitamin K Intake (Gain 5.6%).

Conclusion

Machine learning models with feature importance can be utilized to identify nutritional covariates for further study in patients with clinical symptoms of depression.