FDA-approved machine learning algorithms in neuroradiology: A systematic review of the current evidence for approval

Automated neuroradiological support systems for multiple cerebrovascular disease markers - A systematic review and meta-analysis

Cerebrovascular diseases (CVD) can lead to stroke and dementia. Stroke is the second leading cause of death world wide and dementia incidence is increasing by the year. There are several markers of CVD that are visible on brain imaging, including: white matter hyperintensities (WMH), acute and chronic ischaemic stroke lesions (ISL), lacunes, enlarged perivascular spaces (PVS), acute and chronic haemorrhagic lesions, and cerebral microbleeds (CMB). Brain atrophy also occurs in CVD. These markers are important for patient management and intervention, since they indicate elevated risk of future stroke and dementia. We systematically reviewed automated systems designed to support radiologists reporting on these CVD imaging findings. We considered commercially available software and research publications which identify at least two CVD markers. In total, we included 29 commercial products and 13 research publications. Two distinct types of commercial support system were available: those which identify acute stroke lesions (haemorrhagic and ischaemic) from computed tomography (CT) scans, mainly for the purpose of patient triage; and those which measure WMH and atrophy regionally and longitudinally. In research, WMH and ISL were the markers most frequently analysed together, from magnetic resonance imaging (MRI) scans; lacunes and PVS were each targeted only twice and CMB only once. For stroke, commercially available systems largely support the emergency setting, whilst research systems consider also follow-up and routine scans. The systems to quantify WMH and atrophy are focused on neurodegenerative disease support, where these CVD markers are also of significance. There are currently no openly validated systems, commercially, or in research, performing a comprehensive joint analysis of all CVD markers (WMH, ISL, lacunes, PVS, haemorrhagic lesions, CMB, and atrophy).

AI-enabled clinical decision support tools for mental healthcare: A product review

The review seeks to promote transparency in the availability of regulated AI-enabled Clinical Decision Support Systems (AI-CDSS) for mental healthcare. From 84 potential products, seven fulfilled the inclusion criteria. The products can be categorized into three major areas: diagnosis of autism spectrum disorder (ASD) based on clinical history, behavioral, and eye-tracking data; diagnosis of multiple disorders based on conversational data; and medication selection based on clinical history and genetic data. We found five scientific articles evaluating the devices' performance and external validity. The average completeness of reporting, indicated by 52 % adherence to the Consolidated Standards of Reporting Trials Artificial Intelligence (CONSORT-AI) checklist, was modest, signaling room for improvement in reporting quality. Our findings stress the importance of obtaining regulatory approval, adhering to scientific standards, and staying up-to-date with the latest changes in the regulatory landscape. Refining regulatory guidelines and implementing effective tracking systems for AI-CDSS could enhance transparency and oversight in the field.

Towards objective and systematic evaluation of bias in artificial intelligence for medical imaging

OBJECTIVE

Artificial intelligence (AI) models trained using medical images for clinical tasks often exhibit bias in the form of subgroup performance disparities. However, since not all sources of bias in real-world medical imaging data are easily identifiable, it is challenging to comprehensively assess their impacts. In this article, we introduce an analysis framework for systematically and objectively investigating the impact of biases in medical images on AI models.

MATERIALS AND METHODS

Our framework utilizes synthetic neuroimages with known disease effects and sources of bias. We evaluated the impact of bias effects and the efficacy of 3 bias mitigation strategies in counterfactual data scenarios on a convolutional neural network (CNN) classifier.

RESULTS

The analysis revealed that training a CNN model on the datasets containing bias effects resulted in expected subgroup performance disparities. Moreover, reweighing was the most successful bias mitigation strategy for this setup. Finally, we demonstrated that explainable AI methods can aid in investigating the manifestation of bias in the model using this framework.

DISCUSSION

The value of this framework is showcased in our findings on the impact of bias scenarios and efficacy of bias mitigation in a deep learning model pipeline. This systematic analysis can be easily expanded to conduct further controlled in silico trials in other investigations of bias in medical imaging AI.

CONCLUSION

Our novel methodology for objectively studying bias in medical imaging AI can help support the development of clinical decision-support tools that are robust and responsible.

Artificial intelligence in ovarian cancer drug resistance advanced 3PM approach: subtype classification and prognostic modeling

Background

Ovarian cancer patients' resistance to first-line treatment posed a significant challenge, with approximately 70% experiencing recurrence and developing strong resistance to first-line chemotherapies like paclitaxel.

Objectives

Within the framework of predictive, preventive, and personalized medicine (3PM), this study aimed to use artificial intelligence to find drug resistance characteristics at the single cell, and further construct the classification strategy and deep learning prognostic models based on these resistance traits, which can better facilitate and perform 3PM.

Methods

This study employed "Beyondcell," an algorithm capable of predicting cellular drug responses, to calculate the similarity between the expression patterns of 21,937 cells from ovarian cancer samples and the signatures of 5201 drugs to identify drug-resistance cells. Drug resistance features were used to perform 10 multi-omics clustering on the TCGA training set to identify patient subgroups with differential drug responses. Concurrently, a deep learning prognostic model with KAN architecture which had a flexible activation function to better fit the model was constructed for this training set. The constructed patient subtype classifier and prognostic model were evaluated using three external validation sets from GEO: GSE17260, GSE26712, and GSE51088.

Results

This study identified that endothelial cells are resistant to paclitaxel, doxorubicin, and docetaxel, suggesting their potential as targets for cellular therapy in ovarian cancer patients. Based on drug resistance features, 10 multi-omics clustering identified four patient subtypes with differential responses to four chemotherapy drugs, in which subtype CS2 showed the highest drug sensitivity to all four drugs. The other subtypes also showed enrichment in different biological pathways and immune infiltration, allowing for targeted treatment based on their characteristics. Besides, this study applied the latest KAN architecture in artificial intelligence to replace the MLP structure in the DeepSurv prognostic model, finally demonstrating robust performance on patients' prognosis prediction.

Conclusions

This study, by classifying patients and constructing prognostic models based on resistance characteristics to first-line drugs, has effectively applied multi-omics data into the realm of 3PM.

Supplementary Information

The online version contains supplementary material available at 10.1007/s13167-024-00374-4.

The role of artificial intelligence in electrodiagnostic and neuromuscular medicine: Current state and future directions

The rapid advancements in artificial intelligence (AI), including machine learning (ML), and deep learning (DL) have ushered in a new era of technological breakthroughs in healthcare. These technologies are revolutionizing the way we utilize medical data, enabling improved disease classification, more precise diagnoses, better treatment selection, therapeutic monitoring, and highly accurate prognostication. Different ML and DL models have been used to distinguish between electromyography signals in normal individuals and those with amyotrophic lateral sclerosis and myopathy, with accuracy ranging from 67% to 99.5%. DL models have also been successfully applied in neuromuscular ultrasound, with the use of segmentation techniques achieving diagnostic accuracy of at least 90% for nerve entrapment disorders, and 87% for inflammatory myopathies. Other successful AI applications include prediction of treatment response, and prognostication including prediction of intensive care unit admissions for patients with myasthenia gravis. Despite these remarkable strides, significant knowledge, attitude, and practice gaps persist, including within the field of electrodiagnostic and neuromuscular medicine. In this narrative review, we highlight the fundamental principles of AI and draw parallels with the intricacies of human brain networks. Specifically, we explore the immense potential that AI holds for applications in electrodiagnostic studies, neuromuscular ultrasound, and other aspects of neuromuscular medicine. While there are exciting possibilities for the future, it is essential to acknowledge and understand the limitations of AI and take proactive steps to mitigate these challenges. This collective endeavor holds immense potential for the advancement of healthcare through the strategic and responsible integration of AI technologies.

Predictive Value of Machine Learning for Platinum Chemotherapy Responses in Ovarian Cancer: Systematic Review and Meta-Analysis

BACKGROUND

Machine learning is a potentially effective method for predicting the response to platinum-based treatment for ovarian cancer. However, the predictive performance of various machine learning methods and variables is still a matter of controversy and debate.

OBJECTIVE

This study aims to systematically review relevant literature on the predictive value of machine learning for platinum-based chemotherapy responses in patients with ovarian cancer.

METHODS

Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, we systematically searched the PubMed, Embase, Web of Science, and Cochrane databases for relevant studies on predictive models for platinum-based therapies for the treatment of ovarian cancer published before April 26, 2023. The Prediction Model Risk of Bias Assessment tool was used to evaluate the risk of bias in the included articles. Concordance index (C-index), sensitivity, and specificity were used to evaluate the performance of the prediction models to investigate the predictive value of machine learning for platinum chemotherapy responses in patients with ovarian cancer.

RESULTS

A total of 1749 articles were examined, and 19 of them involving 39 models were eligible for this study. The most commonly used modeling methods were logistic regression (16/39, 41%), Extreme Gradient Boosting (4/39, 10%), and support vector machine (4/39, 10%). The training cohort reported C-index in 39 predictive models, with a pooled value of 0.806; the validation cohort reported C-index in 12 predictive models, with a pooled value of 0.831. Support vector machine performed well in both the training and validation cohorts, with a C-index of 0.942 and 0.879, respectively. The pooled sensitivity was 0.890, and the pooled specificity was 0.790 in the training cohort.

CONCLUSIONS

Machine learning can effectively predict how patients with ovarian cancer respond to platinum-based chemotherapy and may provide a reference for the development or updating of subsequent scoring systems.