1
|
Zhang J, Bandyopadhyay S, Kimmet F, Wittmayer J, Khezeli K, Libon DJ, Price CC, Rashidi P. Developing a fair and interpretable representation of the clock drawing test for mitigating low education and racial bias. Sci Rep 2024; 14:17444. [PMID: 39075127 PMCID: PMC11286895 DOI: 10.1038/s41598-024-68481-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Accepted: 07/24/2024] [Indexed: 07/31/2024] Open
Abstract
The clock drawing test (CDT) is a neuropsychological assessment tool to screen an individual's cognitive ability. In this study, we developed a Fair and Interpretable Representation of Clock drawing test (FaIRClocks) to evaluate and mitigate classification bias against people with less than 8 years of education, while screening their cognitive function using an array of neuropsychological measures. In this study, we represented clock drawings by a priorly published 10-dimensional deep learning feature set trained on publicly available data from the National Health and Aging Trends Study (NHATS). These embeddings were further fine-tuned with clocks from a preoperative cognitive screening program at the University of Florida to predict three cognitive scores: the Mini-Mental State Examination (MMSE) total score, an attention composite z-score (ATT-C), and a memory composite z-score (MEM-C). ATT-C and MEM-C scores were developed by averaging z-scores based on normative references. The cognitive screening classifiers were initially tested to see their relative performance in patients with low years of education (< = 8 years) versus patients with higher education (> 8 years) and race. Results indicated that the initial unweighted classifiers confounded lower education with cognitive compromise resulting in a 100% type I error rate for this group. Thereby, the samples were re-weighted using multiple fairness metrics to achieve sensitivity/specificity and positive/negative predictive value (PPV/NPV) balance across groups. In summary, we report the FaIRClocks model, with promise to help identify and mitigate bias against people with less than 8 years of education during preoperative cognitive screening.
Collapse
Affiliation(s)
- Jiaqing Zhang
- Department of Electrical and Computer Engineering, University of Florida, Gainesville, USA
- Intelligent Critical Care Center (IC3), University of Florida, Gainesville, USA
- Perioperative Cognitive Anesthesia Network(SM), University of Florida, Gainesville, USA
| | | | - Faith Kimmet
- Perioperative Cognitive Anesthesia Network(SM), University of Florida, Gainesville, USA
- Department of Anesthesiology, College of Medicine, University of Florida, Gainesville, USA
| | - Jack Wittmayer
- Intelligent Critical Care Center (IC3), University of Florida, Gainesville, USA
| | - Kia Khezeli
- Intelligent Critical Care Center (IC3), University of Florida, Gainesville, USA
| | - David J Libon
- Department of Geriatrics and Gerontology, Department of Psychology, School of Osteopathic Medicine, New Jersey Institute for Successful Aging, Rowan University, Glassboro, USA
| | - Catherine C Price
- Perioperative Cognitive Anesthesia Network(SM), University of Florida, Gainesville, USA.
- Department of Anesthesiology, College of Medicine, University of Florida, Gainesville, USA.
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, USA.
| | - Parisa Rashidi
- Intelligent Critical Care Center (IC3), University of Florida, Gainesville, USA.
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, USA.
| |
Collapse
|
2
|
Zhang J, Bandyopadhyay S, Kimmet F, Wittmayer J, Khezeli K, Libon DJ, Price CC, Rashidi P. FaIRClocks: Fair and Interpretable Representation of the Clock Drawing Test for mitigating classifier bias against lower educational groups. RESEARCH SQUARE 2023:rs.3.rs-3398970. [PMID: 37886534 PMCID: PMC10602062 DOI: 10.21203/rs.3.rs-3398970/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2023]
Abstract
The clock drawing test (CDT) is a neuropsychological assessment tool to evaluate a patient's cognitive ability. In this study, we developed a Fair and Interpretable Representation of Clock drawing tests (FaIRClocks) to evaluate and mitigate bias against people with lower education while predicting their cognitive status. We represented clock drawings with a 10-dimensional latent embedding using Relevance Factor Variational Autoencoder (RF-VAE) network pretrained on publicly available clock drawings from the National Health and Aging Trends Study (NHATS) dataset. These embeddings were later fine-tuned for predicting three cognitive scores: the Mini-Mental State Examination (MMSE) total score, attention composite z-score (ATT-C), and memory composite z-score (MEM-C). The classifiers were initially tested to see their relative performance in patients with low education (<= 8 years) versus patients with higher education (> 8 years). Results indicated that the initial unweighted classifiers confounded lower education with cognitive impairment, resulting in a 100% type I error rate for this group. Thereby, the samples were re-weighted using multiple fairness metrics to achieve balanced performance. In summary, we report the FaIRClocks model, which a) can identify attention and memory deficits using clock drawings and b) exhibits identical performance between people with higher and lower education levels.
Collapse
Affiliation(s)
- Jiaqing Zhang
- Department of Electrical and Computer Engineering, University of Florida
- Perioperative Cognitive Anesthesia Network, University of Florida
| | - Sabyasachi Bandyopadhyay
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
- Perioperative Cognitive Anesthesia Network, University of Florida
| | - Faith Kimmet
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida
- Department of Anesthesiology, College of Medicine, University of Florida
| | - Jack Wittmayer
- Intelligent Critical Care Center (IC3), University of Florida
| | - Kia Khezeli
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
- Intelligent Critical Care Center (IC3), University of Florida
| | - David J. Libon
- Department of Anesthesiology, College of Medicine, University of Florida
| | - Catherine C. Price
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida
- Department of Anesthesiology, College of Medicine, University of Florida
- Perioperative Cognitive Anesthesia Network, University of Florida
| | - Parisa Rashidi
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida
| |
Collapse
|
3
|
Price CC. The New Frontier of Perioperative Cognitive Medicine for Alzheimer's Disease and Related Dementias. Neurotherapeutics 2022; 19:132-142. [PMID: 35084722 PMCID: PMC9130373 DOI: 10.1007/s13311-021-01180-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/29/2021] [Indexed: 01/03/2023] Open
Abstract
This is a review of preoperative cognitive assessment and other healthcare gaps in the care of older adults at risk for Alzheimer's disease and related dementias (ADRD) who have elected surgery with anesthesia. It summarizes concerns regarding ADRD perioperative healthcare, perioperative cognitive, and neuronal domains of vulnerability. It also offers a plan for phased preoperative cognitive screening and perioperative cognitive intervention opportunities. An argument is made for why medical professionals in the perioperative setting need fundamental training in cognitive-behavioral principles, an understanding of neurodegenerative diseases of aging, and an appreciation of the immediate and long-term medical risks for such patients undergoing anesthesia. The author's goal is to encourage readers to consider perioperative cognitive medicine as a new frontier for generating evidence-based care approaches for at-risk older adults with neurodegenerative disorders who require procedures with anesthesia.
Collapse
Affiliation(s)
- Catherine C Price
- Clinical and Health Psychology, Anesthesiology, University of Florida, Gainesville, FL, USA.
| |
Collapse
|