Medical deep learning-A systematic meta-review

Is the Apple Vision Pro the Ultimate Display? A First Perspective and Survey on Entering the Wonderland of Precision Medicine

At the Worldwide Developers Conference in June 2023, Apple introduced the Vision Pro. The Apple Vision Pro (AVP) is a mixed reality headset; more specifically, it is a virtual reality device with an additional video see-through capability. The video see-through capability turns the AVP into an augmented reality (AR) device. The AR feature is enabled by streaming the real world via cameras on the (virtual reality) screens in front of the user's eyes. This is, of course, not unique and is similar to other devices, such as the Varjo XR-3 (Varjo Technologies Oy). Nevertheless, the AVP has some interesting features, such as an inside-out screen that can show the headset wearer's eyes to "outsiders," and a button on the top, called the "digital crown," that allows a seamless blend of digital content with the user's physical space by turning it. In addition, it is untethered, except for the cable to the battery, which makes the headset more agile, compared to the Varjo XR-3. This could actually come closer to "The Ultimate Display," which Ivan Sutherland had already sketched in 1965. After a great response from the media and social networks to the release, we were able to test and review the new AVP ourselves in March 2024. Including an expert survey with 13 of our colleagues after testing the AVP in our institute, this Viewpoint explores whether the AVP can overcome clinical challenges that AR especially still faces in the medical domain; we also go beyond this and discuss whether the AVP could support clinicians in essential tasks to allow them to spend more time with their patients.

Exploring the benefits and challenges of AI-driven large language models in gastroenterology: Think out of the box

Artificial Intelligence (AI) has evolved significantly over the past decades, from its early concepts in the 1950s to the present era of deep learning and natural language processing. Advanced large language models (LLMs), such as Chatbot Generative Pre-Trained Transformer (ChatGPT) is trained to generate human-like text responses. This technology has the potential to revolutionize various aspects of gastroenterology, including diagnosis, treatment, education, and decision-making support. The benefits of using LLMs in gastroenterology could include accelerating diagnosis and treatment, providing personalized care, enhancing education and training, assisting in decision-making, and improving communication with patients. However, drawbacks and challenges such as limited AI capability, training on possibly biased data, data errors, security and privacy concerns, and implementation costs must be addressed to ensure the responsible and effective use of this technology. The future of LLMs in gastroenterology relies on the ability to process and analyse large amounts of data, identify patterns, and summarize information and thus assist physicians in creating personalized treatment plans. As AI advances, LLMs will become more accurate and efficient, allowing for faster diagnosis and treatment of gastroenterological conditions. Ensuring effective collaboration between AI developers, healthcare professionals, and regulatory bodies is essential for the responsible and effective use of this technology. By finding the right balance between AI and human expertise and addressing the limitations and risks associated with its use, LLMs can play an increasingly significant role in gastroenterology, contributing to better patient care and supporting doctors in their work.

The current and upcoming era of radiomics in phaeochromocytoma and paraganglioma

The topic of the diagnosis of phaeochromocytomas remains highly relevant because of advances in laboratory diagnostics, genetics, and therapeutic options and also the development of imaging methods. Computed tomography still represents an essential tool in clinical practice, especially in incidentally discovered adrenal masses; it allows morphological evaluation, including size, shape, necrosis, and unenhanced attenuation. More advanced post-processing tools to analyse digital images, such as texture analysis and radiomics, are currently being studied. Radiomic features utilise digital image pixels to calculate parameters and relations undetectable by the human eye. On the other hand, the amount of radiomic data requires massive computer capacity. Radiomics, together with machine learning and artificial intelligence in general, has the potential to improve not only the differential diagnosis but also the prediction of complications and therapy outcomes of phaeochromocytomas in the future. Currently, the potential of radiomics and machine learning does not match expectations and awaits its fulfilment.

PIAA: Pre-imaging all-round assistant for digital radiography

BACKGROUND

In radiography procedures, radiographers' suboptimal positioning and exposure parameter settings may necessitate image retakes, subjecting patients to unnecessary ionizing radiation exposure. Reducing retakes is crucial to minimize patient X-ray exposure and conserve medical resources.

OBJECTIVE

We propose a Digital Radiography (DR) Pre-imaging All-round Assistant (PIAA) that leverages Artificial Intelligence (AI) technology to enhance traditional DR.

METHODS

PIAA consists of an RGB-Depth (RGB-D) multi-camera array, an embedded computing platform, and multiple software components. It features an Adaptive RGB-D Image Acquisition (ARDIA) module that automatically selects the appropriate RGB camera based on the distance between the cameras and patients. It includes a 2.5D Selective Skeletal Keypoints Estimation (2.5D-SSKE) module that fuses depth information with 2D keypoints to estimate the pose of target body parts. Thirdly, it also uses a Domain expertise (DE) embedded Full-body Exposure Parameter Estimation (DFEPE) module that combines 2.5D-SSKE and DE to accurately estimate parameters for full-body DR views.

RESULTS

Optimizes DR workflow, significantly enhancing operational efficiency. The average time required for positioning patients and preparing exposure parameters was reduced from 73 seconds to 8 seconds.

CONCLUSIONS

PIAA shows significant promise for extension to full-body examinations.

Artificial Intelligence and Ophthalmic Clinical Registries

PURPOSE

The recent advances in artificial intelligence (AI) represent a promising solution to increasing clinical demand and ever limited health resources. Whilst powerful, AI models require vast amounts of representative training data to output meaningful predictions in the clinical environment. Clinical registries represent a promising source of large volume real-world data which could be used to train more accurate and widely applicable AI models. This review aims to provide an overview of the current applications of AI to ophthalmic clinical registry data.

DESIGN AND METHODS

A systematic search of EMBASE, Medline, PubMed, Scopus and Web of Science for primary research articles that applied AI to ophthalmic clinical registry data was conducted in July 2024.

RESULTS

Twenty-three primary research articles applying AI to ophthalmic clinic registries (n = 14) were found. Registries were primarily defined by the condition captured and the most common conditions where AI was applied were glaucoma (n = 3) and neovascular age-related macular degeneration (n = 3). Tabular clinical data was the most common form of input into AI algorithms and outputs were primarily classifiers (n = 8, 40%) and risk quantifier models (n = 7, 35%). The AI algorithms applied were almost exclusively supervised conventional machine learning models (n = 39, 85%) such as decision tree classifiers and logistic regression, with only 7 applications of deep learning or natural language processing algorithms. Significant heterogeneity was found with regards to model validation methodology and measures of performance.

CONCLUSIONS

Limited applications of deep learning algorithms to clinical registry data have been reported. The lack of standardized validation methodology and heterogeneity of performance outcome reporting suggests that the application of AI to clinical registries is still in its infancy constrained by the poor accessibility of registry data and reflecting the need for a standardization of methodology and greater involvement of domain experts in the future development of clinically deployable AI.

Efficient HLA imputation from sequential SNPs data by transformer

Human leukocyte antigen (HLA) genes are associated with a variety of diseases, yet the direct typing of HLA alleles is both time-consuming and costly. Consequently, various imputation methods leveraging sequential single nucleotide polymorphisms (SNPs) data have been proposed, employing either statistical or deep learning models, such as the convolutional neural network (CNN)-based model, DEEP*HLA. However, these methods exhibit limited imputation efficiency for infrequent alleles and necessitate a large size of reference dataset. In this context, we have developed a Transformer-based model to HLA allele imputation, named "HLA Reliable IMpuatioN by Transformer (HLARIMNT)" designed to exploit the sequential nature of SNPs data. We evaluated HLARIMNT's performance using two distinct reference panels; Pan-Asian reference panel (n = 530) and Type 1 Diabetes genetics Consortium (T1DGC) reference panel (n = 5225), alongside a combined panel (n = 1060). HLARIMNT demonstrated superior accuracy to DEEP*HLA across several indices, particularly for infrequent alleles. Furthermore, we explored the impact of varying training data sizes on imputation accuracy, finding that HLARIMNT consistently outperformed across all data size. These findings suggest that Transformer-based models can efficiently impute not only HLA types but potentially other gene types from sequential SNPs data.

Machine learning application in otology

This review presents a comprehensive history of Artificial Intelligence (AI) in the context of the revolutionary application of machine learning (ML) to medical research and clinical utilization, particularly for the benefit of researchers interested in the application of ML in otology. To this end, we discuss the key components of ML-input, output, and algorithms. In particular, some representation algorithms commonly used in medical research are discussed. Subsequently, we review ML applications in otology research, including diagnosis, influential identification, and surgical outcome prediction. In the context of surgical outcome prediction, specific surgical treatments, including cochlear implantation, active middle ear implantation, tympanoplasty, and vestibular schwannoma resection, are considered. Finally, we highlight the obstacles and challenges that need to be overcome in future research.

Radiomics in esophagogastric junction cancer: A scoping review of current status and advances

PURPOSE

This scoping review aimed to understand the advances in radiomics in esophagogastric junction (EGJ) cancer and assess the current status of radiomics in EGJ cancer.

METHODS

We conducted systematic searches of PubMed, Embase, and Web of Science databases from January 18, 2012, to January 15, 2023, to identify radiomics articles related to EGJ cancer. Two researchers independently screened the literature, extracted data, and assessed the quality of the studies using the Radiomics Quality Score (RQS) and the METhodological RadiomICs Score (METRICS) tool, respectively.

RESULTS

A total of 120 articles were retrieved from the three databases, and after screening, only six papers met the inclusion criteria. These studies investigated the role of radiomics in differentiating adenocarcinoma from squamous carcinoma, diagnosing T-stage, evaluating HER2 overexpression, predicting response to neoadjuvant therapy, and prognosis in EGJ cancer. The median score percentage of RQS was 34.7% (range from 22.2% to 38.9%). The median score percentage of METRICS was 71.2% (range from 58.2% to 84.9%).

CONCLUSION

Although there is a considerable difference between the RQS and METRICS scores of the included literature, we believe that the research value of radiomics in EGJ cancer has been revealed. In the future, while actively exploring more diagnostic, prognostic, and biological correlation studies in EGJ cancer, greater emphasis should be placed on the standardization and clinical application of radiomics.

Deep Learning Model Using Stool Pictures for Predicting Endoscopic Mucosal Inflammation in Patients With Ulcerative Colitis

INTRODUCTION

Stool characteristics may change depending on the endoscopic activity of ulcerative colitis (UC). We developed a deep learning model using stool photographs of patients with UC (DLSUC) to predict endoscopic mucosal inflammation.

METHODS

This was a prospective multicenter study conducted in 6 tertiary referral hospitals. Patients scheduled to undergo endoscopy for mucosal inflammation monitoring were asked to take photographs of their stool using smartphones within 1 week before the day of endoscopy. DLSUC was developed using 2,161 stool pictures from 306 patients and tested on 1,047 stool images from 126 patients. The UC endoscopic index of severity was used to define endoscopic activity. The performance of DLSUC in endoscopic activity prediction was compared with that of fecal calprotectin (Fcal).

RESULTS

The area under the receiver operating characteristic curve (AUC) of DLSUC for predicting endoscopic activity was 0.801 (95% confidence interval [CI] 0.717-0.873), which was not statistically different from the AUC of Fcal (0.837 [95% CI, 0.767-0.899, DeLong P = 0.458]). When rectal-sparing cases (23/126, 18.2%) were excluded, the AUC of DLSUC increased to 0.849 (95% CI, 0.760-0.919). The accuracy, sensitivity, and specificity of DLSUC in predicting endoscopic activity were 0.746, 0.662, and 0.877 in all patients and 0.845, 0.745, and 0.958 in patients without rectal sparing, respectively. Active patients classified by DLSUC were more likely to experience disease relapse during a median 8-month follow-up (log-rank test, P = 0.002).

DISCUSSION

DLSUC demonstrated a good discriminating power similar to that of Fcal in predicting endoscopic activity with improved accuracy in patients without rectal sparing. This study implies that stool photographs are a useful monitoring tool for typical UC.

Introducing Attribute Association Graphs to Facilitate Medical Data Exploration: Development and Evaluation Using Epidemiological Study Data

BACKGROUND

Interpretability and intuitive visualization facilitate medical knowledge generation through big data. In addition, robustness to high-dimensional and missing data is a requirement for statistical approaches in the medical domain. A method tailored to the needs of physicians must meet all the abovementioned criteria.

OBJECTIVE

This study aims to develop an accessible tool for visual data exploration without the need for programming knowledge, adjusting complex parameterizations, or handling missing data. We sought to use statistical analysis using the setting of disease and control cohorts familiar to clinical researchers. We aimed to guide the user by identifying and highlighting data patterns associated with disease and reveal relations between attributes within the data set.

METHODS

We introduce the attribute association graph, a novel graph structure designed for visual data exploration using robust statistical metrics. The nodes capture frequencies of participant attributes in disease and control cohorts as well as deviations between groups. The edges represent conditional relations between attributes. The graph is visualized using the Neo4j (Neo4j, Inc) data platform and can be interactively explored without the need for technical knowledge. Nodes with high deviations between cohorts and edges of noticeable conditional relationship are highlighted to guide the user during the exploration. The graph is accompanied by a dashboard visualizing variable distributions. For evaluation, we applied the graph and dashboard to the Hamburg City Health Study data set, a large cohort study conducted in the city of Hamburg, Germany. All data structures can be accessed freely by researchers, physicians, and patients. In addition, we developed a user test conducted with physicians incorporating the System Usability Scale, individual questions, and user tasks.

RESULTS

We evaluated the attribute association graph and dashboard through an exemplary data analysis of participants with a general cardiovascular disease in the Hamburg City Health Study data set. All results extracted from the graph structure and dashboard are in accordance with findings from the literature, except for unusually low cholesterol levels in participants with cardiovascular disease, which could be induced by medication. In addition, 95% CIs of Pearson correlation coefficients were calculated for all associations identified during the data analysis, confirming the results. In addition, a user test with 10 physicians assessing the usability of the proposed methods was conducted. A System Usability Scale score of 70.5% and average successful task completion of 81.4% were reported.

CONCLUSIONS

The proposed attribute association graph and dashboard enable intuitive visual data exploration. They are robust to high-dimensional as well as missing data and require no parameterization. The usability for clinicians was confirmed via a user test, and the validity of the statistical results was confirmed by associations known from literature and standard statistical inference.

Knowledge, attitude, and perception of Arab medical students towards artificial intelligence in medicine and radiology: A multi-national cross-sectional study

OBJECTIVES

We aimed to assess undergraduate medical students' knowledge, attitude, and perception regarding artificial intelligence (AI) in medicine.

METHODS

A multi-national, multi-center cross-sectional study was conducted from March to April 2022, targeting undergraduate medical students in nine Arab countries. The study utilized a web-based questionnaire, with data collection carried out with the help of national leaders and local collaborators. Logistic regression analysis was performed to identify predictors of knowledge, attitude, and perception among the participants. Additionally, cluster analysis was employed to identify shared patterns within their responses.

RESULTS

Of the 4492 students surveyed, 92.4% had not received formal AI training. Regarding AI and deep learning (DL), 87.1% exhibited a low level of knowledge. Most students (84.9%) believed AI would revolutionize medicine and radiology, with 48.9% agreeing that it could reduce the need for radiologists. Students with high/moderate AI knowledge and training had higher odds of agreeing to endorse AI replacing radiologists, reducing their numbers, and being less likely to consider radiology as a career compared to those with low knowledge/no AI training. Additionally, the majority agreed that AI would aid in the automated detection and diagnosis of pathologies.

CONCLUSIONS

Arab medical students exhibit a notable deficit in their knowledge and training pertaining to AI. Despite this, they hold a positive perception of AI implementation in medicine and radiology, demonstrating a clear understanding of its significance for the healthcare system and medical curriculum.

CLINICAL RELEVANCE STATEMENT

This study highlights the need for widespread education and training in artificial intelligence for Arab medical students, indicating its significance for healthcare systems and medical curricula.

KEY POINTS

• Arab medical students demonstrate a significant knowledge and training gap when it comes to using AI in the fields of medicine and radiology. • Arab medical students recognize the importance of integrating AI into the medical curriculum. Students with a deeper understanding of AI were more likely to agree that all medical students should receive AI education. However, those with previous AI training were less supportive of this idea. • Students with moderate/high AI knowledge and training displayed increased odds of agreeing that AI has the potential to replace radiologists, reduce the demand for their services, and were less inclined to pursue a career in radiology, when compared to students with low knowledge/no AI training.

Challenges and advances in the management of inflammation in atherosclerosis

INTRODUCTION

Atherosclerosis, traditionally considered a lipid-related disease, is now understood as a chronic inflammatory condition with significant global health implications.

OBJECTIVES

This review aims to delve into the complex interactions among immune cells, cytokines, and the inflammatory cascade in atherosclerosis, shedding light on how these elements influence both the initiation and progression of the disease.

METHODS

This review draws on recent clinical research to elucidate the roles of key immune cells, macrophages, T cells, endothelial cells, and clonal hematopoiesis in atherosclerosis development. It focuses on how these cells and process contribute to disease initiation and progression, particularly through inflammation-driven processes that lead to plaque formation and stabilization. Macrophages ingest oxidized low-density lipoprotein (oxLDL), which partially converts to high-density lipoprotein (HDL) or accumulates as lipid droplets, forming foam cells crucial for plaque stability. Additionally, macrophages exhibit diverse phenotypes within plaques, with pro-inflammatory types predominating and others specializing in debris clearance at rupture sites. The involvement of CD4+ T and CD8+ T cells in these processes promotes inflammatory macrophage states, suppresses vascular smooth muscle cell proliferation, and enhances plaque instability.

RESULTS

The nuanced roles of macrophages, T cells, and the related immune cells within the atherosclerotic microenvironment are explored, revealing insights into the cellular and molecular pathways that fuel inflammation. This review also addresses recent advancements in imaging and biomarker technology that enhance our understanding of disease progression. Moreover, it points out the limitations of current treatment and highlights the potential of emerging anti-inflammatory strategies, including clinical trials for agents such as p38MAPK, tumor necrosis factor α (TNF-α), and IL-1β, their preliminary outcomes, and the promising effects of canakinumab, colchicine, and IL-6R antagonists.

CONCLUSION

This review explores cutting-edge anti-inflammatory interventions, their potential efficacy in preventing and alleviating atherosclerosis, and the role of nanotechnology in delivering drugs more effectively and safely.

Evaluation of an artificial intelligence-based decision support for the detection of cutaneous melanoma in primary care: a prospective real-life clinical trial

BACKGROUND

Use of artificial intelligence (AI), or machine learning, to assess dermoscopic images of skin lesions to detect melanoma has, in several retrospective studies, shown high levels of diagnostic accuracy on par with - or even outperforming - experienced dermatologists. However, the enthusiasm around these algorithms has not yet been matched by prospective clinical trials performed in authentic clinical settings. In several European countries, including Sweden, the initial clinical assessment of suspected skin cancer is principally conducted in the primary healthcare setting by primary care physicians, with or without access to teledermoscopic support from dermatology clinics.

OBJECTIVES

To determine the diagnostic performance of an AI-based clinical decision support tool for cutaneous melanoma detection, operated by a smartphone application (app), when used prospectively by primary care physicians to assess skin lesions of concern due to some degree of melanoma suspicion.

METHODS

This prospective multicentre clinical trial was conducted at 36 primary care centres in Sweden. Physicians used the smartphone app on skin lesions of concern by photographing them dermoscopically, which resulted in a dichotomous decision support text regarding evidence for melanoma. Regardless of the app outcome, all lesions underwent standard diagnostic procedures (surgical excision or referral to a dermatologist). After investigations were complete, lesion diagnoses were collected from the patients' medical records and compared with the app's outcome and other lesion data.

RESULTS

In total, 253 lesions of concern in 228 patients were included, of which 21 proved to be melanomas, with 11 thin invasive melanomas and 10 melanomas in situ. The app's accuracy in identifying melanomas was reflected in an area under the receiver operating characteristic (AUROC) curve of 0.960 [95% confidence interval (CI) 0.928-0.980], corresponding to a maximum sensitivity and specificity of 95.2% and 84.5%, respectively. For invasive melanomas alone, the AUROC was 0.988 (95% CI 0.965-0.997), corresponding to a maximum sensitivity and specificity of 100% and 92.6%, respectively.

CONCLUSIONS

The clinical decision support tool evaluated in this investigation showed high diagnostic accuracy when used prospectively in primary care patients, which could add significant clinical value for primary care physicians assessing skin lesions for melanoma.

Development of a predictive model for 1-year postoperative recovery in patients with lumbar disk herniation based on deep learning and machine learning

Background

The aim of this study is to develop a predictive model utilizing deep learning and machine learning techniques that will inform clinical decision-making by predicting the 1-year postoperative recovery of patients with lumbar disk herniation.

Methods

The clinical data of 470 inpatients who underwent tubular microdiscectomy (TMD) between January 2018 and January 2021 were retrospectively analyzed as variables. The dataset was randomly divided into a training set (n = 329) and a test set (n = 141) using a 10-fold cross-validation technique. Various deep learning and machine learning algorithms including Random Forests, Extreme Gradient Boosting, Support Vector Machines, Extra Trees, K-Nearest Neighbors, Logistic Regression, Light Gradient Boosting Machine, and MLP (Artificial Neural Networks) were employed to develop predictive models for the recovery of patients with lumbar disk herniation 1 year after surgery. The cure rate score of lumbar JOA score 1 year after TMD was used as an outcome indicator. The primary evaluation metric was the area under the receiver operating characteristic curve (AUC), with additional measures including decision curve analysis (DCA), accuracy, sensitivity, specificity, and others.

Results

The heat map of the correlation matrix revealed low inter-feature correlation. The predictive model employing both machine learning and deep learning algorithms was constructed using 15 variables after feature engineering. Among the eight algorithms utilized, the MLP algorithm demonstrated the best performance.

Conclusion

Our study findings demonstrate that the MLP algorithm provides superior predictive performance for the recovery of patients with lumbar disk herniation 1 year after surgery.

Deep Learning for Automated Detection and Localization of Traumatic Abdominal Solid Organ Injuries on CT Scans

Computed tomography (CT) is the most commonly used diagnostic modality for blunt abdominal trauma (BAT), significantly influencing management approaches. Deep learning models (DLMs) have shown great promise in enhancing various aspects of clinical practice. There is limited literature available on the use of DLMs specifically for trauma image evaluation. In this study, we developed a DLM aimed at detecting solid organ injuries to assist medical professionals in rapidly identifying life-threatening injuries. The study enrolled patients from a single trauma center who received abdominal CT scans between 2008 and 2017. Patients with spleen, liver, or kidney injury were categorized as the solid organ injury group, while others were considered negative cases. Only images acquired from the trauma center were enrolled. A subset of images acquired in the last year was designated as the test set, and the remaining images were utilized to train and validate the detection models. The performance of each model was assessed using metrics such as the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, positive predictive value, and negative predictive value based on the best Youden index operating point. The study developed the models using 1302 (87%) scans for training and tested them on 194 (13%) scans. The spleen injury model demonstrated an accuracy of 0.938 and a specificity of 0.952. The accuracy and specificity of the liver injury model were reported as 0.820 and 0.847, respectively. The kidney injury model showed an accuracy of 0.959 and a specificity of 0.989. We developed a DLM that can automate the detection of solid organ injuries by abdominal CT scans with acceptable diagnostic accuracy. It cannot replace the role of clinicians, but we can expect it to be a potential tool to accelerate the process of therapeutic decisions for trauma care.

Application of Artificial Intelligence in Shoulder Pathology

Artificial intelligence (AI) refers to the science and engineering of creating intelligent machines for imitating and expanding human intelligence. Given the ongoing evolution of the multidisciplinary integration trend in modern medicine, numerous studies have investigated the power of AI to address orthopedic-specific problems. One particular area of investigation focuses on shoulder pathology, which is a range of disorders or abnormalities of the shoulder joint, causing pain, inflammation, stiffness, weakness, and reduced range of motion. There has not yet been a comprehensive review of the recent advancements in this field. Therefore, the purpose of this review is to evaluate current AI applications in shoulder pathology. This review mainly summarizes several crucial stages of the clinical practice, including predictive models and prognosis, diagnosis, treatment, and physical therapy. In addition, the challenges and future development of AI technology are also discussed.

A Comprehensive Evaluation of Deep Learning Models on Knee MRIs for the Diagnosis and Classification of Meniscal Tears: A Systematic Review and Meta-Analysis

OBJECTIVES

This study delves into the cutting-edge field of deep learning techniques, particularly deep convolutional neural networks (DCNNs), which have demonstrated unprecedented potential in assisting radiologists and orthopedic surgeons in precisely identifying meniscal tears. This research aims to evaluate the effectiveness of deep learning models in recognizing, localizing, describing, and categorizing meniscal tears in magnetic resonance images (MRIs).

MATERIALS AND METHODS

This systematic review was rigorously conducted, strictly following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Extensive searches were conducted on MEDLINE (PubMed), Web of Science, Cochrane Library, and Google Scholar. All identified articles underwent a comprehensive risk of bias analysis. Predictive performance values were either extracted or calculated for quantitative analysis, including sensitivity and specificity. The meta-analysis was performed for all prediction models that identified the presence and location of meniscus tears.

RESULTS

This study's findings underscore that a range of deep learning models exhibit robust performance in detecting and classifying meniscal tears, in one case surpassing the expertise of musculoskeletal radiologists. Most studies in this review concentrated on identifying tears in the medial or lateral meniscus and even precisely locating tears-whether in the anterior or posterior horn-with exceptional accuracy, as demonstrated by AUC values ranging from 0.83 to 0.94.

CONCLUSIONS

Based on these findings, deep learning models have showcased significant potential in analyzing knee MR images by learning intricate details within images. They offer precise outcomes across diverse tasks, including segmenting specific anatomical structures and identifying pathological regions. Contributions: This study focused exclusively on DL models for identifying and localizing meniscus tears. It presents a meta-analysis that includes eight studies for detecting the presence of a torn meniscus and a meta-analysis of three studies with low heterogeneity that localize and classify the menisci. Another novelty is the analysis of arthroscopic surgery as ground truth. The quality of the studies was assessed against the CLAIM checklist, and the risk of bias was determined using the QUADAS-2 tool.

VER-Net: a hybrid transfer learning model for lung cancer detection using CT scan images

BACKGROUND

Lung cancer is the second most common cancer worldwide, with over two million new cases per year. Early identification would allow healthcare practitioners to handle it more effectively. The advancement of computer-aided detection systems significantly impacted clinical analysis and decision-making on human disease. Towards this, machine learning and deep learning techniques are successfully being applied. Due to several advantages, transfer learning has become popular for disease detection based on image data.

METHODS

In this work, we build a novel transfer learning model (VER-Net) by stacking three different transfer learning models to detect lung cancer using lung CT scan images. The model is trained to map the CT scan images with four lung cancer classes. Various measures, such as image preprocessing, data augmentation, and hyperparameter tuning, are taken to improve the efficacy of VER-Net. All the models are trained and evaluated using multiclass classifications chest CT images.

RESULTS

The experimental results confirm that VER-Net outperformed the other eight transfer learning models compared with. VER-Net scored 91%, 92%, 91%, and 91.3% when tested for accuracy, precision, recall, and F1-score, respectively. Compared to the state-of-the-art, VER-Net has better accuracy.

CONCLUSION

VER-Net is not only effectively used for lung cancer detection but may also be useful for other diseases for which CT scan images are available.

Development and Validation of an Explainable Deep Learning Model to Predict In-Hospital Mortality for Patients With Acute Myocardial Infarction: Algorithm Development and Validation Study

BACKGROUND

Acute myocardial infarction (AMI) is one of the most severe cardiovascular diseases and is associated with a high risk of in-hospital mortality. However, the current deep learning models for in-hospital mortality prediction lack interpretability.

OBJECTIVE

This study aims to establish an explainable deep learning model to provide individualized in-hospital mortality prediction and risk factor assessment for patients with AMI.

METHODS

In this retrospective multicenter study, we used data for consecutive patients hospitalized with AMI from the Chongqing University Central Hospital between July 2016 and December 2022 and the Electronic Intensive Care Unit Collaborative Research Database. These patients were randomly divided into training (7668/10,955, 70%) and internal test (3287/10,955, 30%) data sets. In addition, data of patients with AMI from the Medical Information Mart for Intensive Care database were used for external validation. Deep learning models were used to predict in-hospital mortality in patients with AMI, and they were compared with linear and tree-based models. The Shapley Additive Explanations method was used to explain the model with the highest area under the receiver operating characteristic curve in both the internal test and external validation data sets to quantify and visualize the features that drive predictions.

RESULTS

A total of 10,955 patients with AMI who were admitted to Chongqing University Central Hospital or included in the Electronic Intensive Care Unit Collaborative Research Database were randomly divided into a training data set of 7668 (70%) patients and an internal test data set of 3287 (30%) patients. A total of 9355 patients from the Medical Information Mart for Intensive Care database were included for independent external validation. In-hospital mortality occurred in 8.74% (670/7668), 8.73% (287/3287), and 9.12% (853/9355) of the patients in the training, internal test, and external validation cohorts, respectively. The Self-Attention and Intersample Attention Transformer model performed best in both the internal test data set and the external validation data set among the 9 prediction models, with the highest area under the receiver operating characteristic curve of 0.86 (95% CI 0.84-0.88) and 0.85 (95% CI 0.84-0.87), respectively. Older age, high heart rate, and low body temperature were the 3 most important predictors of increased mortality, according to the explanations of the Self-Attention and Intersample Attention Transformer model.

CONCLUSIONS

The explainable deep learning model that we developed could provide estimates of mortality and visual contribution of the features to the prediction for a patient with AMI. The explanations suggested that older age, unstable vital signs, and metabolic disorders may increase the risk of mortality in patients with AMI.

The use of artificial intelligence in reconstructive surgery for head and neck cancer: a systematic review

OBJECTIVES

The popularity of artificial intelligence (AI) in head and neck cancer (HNC) management is increasing, but postoperative complications remain prevalent and are the main factor that impact prognosis after surgery. Hence, recent studies aim to assess new AI models to evaluate their ability to predict free flap complications more effectively than traditional algorithms. This systematic review aims to summarize current evidence on the utilization of AI models to predict complications following reconstructive surgery for HNC.

METHODS

A combination of MeSH terms and keywords was used to cover the following three subjects: "HNC," "artificial intelligence," and "free flap or reconstructive surgery." The electronic literature search was performed in three relevant databases: Medline (Ovid), Embase (Ovid), and Cochrane. Quality appraisal of the included study was conducted using the TRIPOD Statement.

RESULTS

The review included a total of 5 manuscripts (n = 5) for a total of 7524 patients. Across studies, the highest area under the receiver operating characteristic (AUROC) value achieved was 0.824 by the Auto-WEKA model. However, only 20% of reported AUROCs exceeded 0.70. One study concluded that most AI models were comparable or inferior in performance to conventional logistic regression. The highest predictors of complications were flap type, smoking status, tumour location, and age.

DISCUSSION

Some models showed promising results. Predictors identified across studies were different than those found in existing literature, showing the added value of AI models. However, the algorithms showed inconsistent results, underlying the need for better-powered studies with larger databases before clinical implementation.

GAN-based generation of realistic 3D volumetric data: A systematic review and taxonomy

With the massive proliferation of data-driven algorithms, such as deep learning-based approaches, the availability of high-quality data is of great interest. Volumetric data is very important in medicine, as it ranges from disease diagnoses to therapy monitoring. When the dataset is sufficient, models can be trained to help doctors with these tasks. Unfortunately, there are scenarios where large amounts of data is unavailable. For example, rare diseases and privacy issues can lead to restricted data availability. In non-medical fields, the high cost of obtaining enough high-quality data can also be a concern. A solution to these problems can be the generation of realistic synthetic data using Generative Adversarial Networks (GANs). The existence of these mechanisms is a good asset, especially in healthcare, as the data must be of good quality, realistic, and without privacy issues. Therefore, most of the publications on volumetric GANs are within the medical domain. In this review, we provide a summary of works that generate realistic volumetric synthetic data using GANs. We therefore outline GAN-based methods in these areas with common architectures, loss functions and evaluation metrics, including their advantages and disadvantages. We present a novel taxonomy, evaluations, challenges, and research opportunities to provide a holistic overview of the current state of volumetric GANs.

A review of the application of deep learning in obesity: From early prediction aid to advanced management assistance

BACKGROUND AND AIMS

Obesity is a chronic disease which can cause severe metabolic disorders. Machine learning (ML) techniques, especially deep learning (DL), have proven to be useful in obesity research. However, there is a dearth of systematic reviews of DL applications in obesity. This article aims to summarize the current trend of DL usage in obesity research.

METHODS

An extensive literature review was carried out across multiple databases, including PubMed, Embase, Web of Science, Scopus, and Medline, to collate relevant studies published from January 2018 to September 2023. The focus was on research detailing the application of DL in the context of obesity. We have distilled critical insights pertaining to the utilized learning models, encompassing aspects of their development, principal results, and foundational methodologies.

RESULTS

Our analysis culminated in the synthesis of new knowledge regarding the application of DL in the context of obesity. Finally, 40 research articles were included. The final collection of these research can be divided into three categories: obesity prediction (n = 16); obesity management (n = 13); and body fat estimation (n = 11).

CONCLUSIONS

This is the first review to examine DL applications in obesity. It reveals DL's superiority in obesity prediction over traditional ML methods, showing promise for multi-omics research. DL also innovates in obesity management through diet, fitness, and environmental analyses. Additionally, DL improves body fat estimation, offering affordable and precise monitoring tools. The study is registered with PROSPERO (ID: CRD42023475159).

PECI-Net: Bolus segmentation from video fluoroscopic swallowing study images using preprocessing ensemble and cascaded inference

Bolus segmentation is crucial for the automated detection of swallowing disorders in videofluoroscopic swallowing studies (VFSS). However, it is difficult for the model to accurately segment a bolus region in a VFSS image because VFSS images are translucent, have low contrast and unclear region boundaries, and lack color information. To overcome these challenges, we propose PECI-Net, a network architecture for VFSS image analysis that combines two novel techniques: the preprocessing ensemble network (PEN) and the cascaded inference network (CIN). PEN enhances the sharpness and contrast of the VFSS image by combining multiple preprocessing algorithms in a learnable way. CIN reduces ambiguity in bolus segmentation by using context from other regions through cascaded inference. Moreover, CIN prevents undesirable side effects from unreliably segmented regions by referring to the context in an asymmetric way. In experiments, PECI-Net exhibited higher performance than four recently developed baseline models, outperforming TernausNet, the best among the baseline models, by 4.54% and the widely used UNet by 10.83%. The results of the ablation studies confirm that CIN and PEN are effective in improving bolus segmentation performance.

Deep learning of movement behavior profiles and their association with markers of cardiometabolic health

BACKGROUND

Traditionally, existing studies assessing the health associations of accelerometer-measured movement behaviors have been performed with few averaged values, mainly representing the duration of physical activities and sedentary behaviors. Such averaged values cannot naturally capture the complex interplay between the duration, timing, and patterns of accumulation of movement behaviors, that altogether may be codependently related to health outcomes in adults. In this study, we introduce a novel approach to visually represent recorded movement behaviors as images using original accelerometer outputs. Subsequently, we utilize these images for cluster analysis employing deep convolutional autoencoders.

METHODS

Our method involves converting minute-by-minute accelerometer outputs (activity counts) into a 2D image format, capturing the entire spectrum of movement behaviors performed by each participant. By utilizing convolutional autoencoders, we enable the learning of these image-based representations. Subsequently, we apply the K-means algorithm to cluster these learned representations. We used data from 1812 adult (20-65 years) participants in the National Health and Nutrition Examination Survey (NHANES, 2003-2006 cycles) study who worn a hip-worn accelerometer for 7 seven consecutive days and provided valid accelerometer data.

RESULTS

Deep convolutional autoencoders were able to learn the image representation, encompassing the entire spectrum of movement behaviors. The images were encoded into 32 latent variables, and cluster analysis based on these learned representations for the movement behavior images resulted in the identification of four distinct movement behavior profiles characterized by varying levels, timing, and patterns of accumulation of movement behaviors. After adjusting for potential covariates, the movement behavior profile characterized as "Early-morning movers" and the profile characterized as "Highest activity" both had lower levels of insulin (P < 0.01 for both), triglycerides (P < 0.05 and P < 0.01, respectively), HOMA-IR (P < 0.01 for both), and plasma glucose (P < 0.05 and P < 0.1, respectively) compared to the "Lowest activity" profile. No significant differences were observed for the "Least sedentary movers" profile compared to the "Lowest activity" profile.

CONCLUSIONS

Deep learning of movement behavior profiles revealed that, in addition to duration and patterns of movement behaviors, the timing of physical activity may also be crucial for gaining additional health benefits.

Machine Learning Models for Prediction of Diabetic Microvascular Complications

IMPORTANCE AND AIMS

Diabetic microvascular complications significantly impact morbidity and mortality. This review focuses on machine learning/artificial intelligence (ML/AI) in predicting diabetic retinopathy (DR), diabetic kidney disease (DKD), and diabetic neuropathy (DN).

METHODS

A comprehensive PubMed search from 1990 to 2023 identified studies on ML/AI models for diabetic microvascular complications. The review analyzed study design, cohorts, predictors, ML techniques, prediction horizon, and performance metrics.

RESULTS

Among the 74 identified studies, 256 featured internally validated ML models and 124 had externally validated models, with about half being retrospective. Since 2010, there has been a rise in the use of ML for predicting microvascular complications, mainly driven by DKD research across 27 countries. A more modest increase in ML research on DR and DN was observed, with publications from fewer countries. For all microvascular complications, predictive models achieved a mean (standard deviation) c-statistic of 0.79 (0.09) on internal validation and 0.72 (0.12) on external validation. Diabetic kidney disease models had the highest discrimination, with c-statistics of 0.81 (0.09) on internal validation and 0.74 (0.13) on external validation, respectively. Few studies externally validated prediction of DN. The prediction horizon, outcome definitions, number and type of predictors, and ML technique significantly influenced model performance.

CONCLUSIONS AND RELEVANCE

There is growing global interest in using ML for predicting diabetic microvascular complications. Research on DKD is the most advanced in terms of publication volume and overall prediction performance. Both DR and DN require more research. External validation and adherence to recommended guidelines are crucial.

Shedding light on ai in radiology: A systematic review and taxonomy of eye gaze-driven interpretability in deep learning

X-ray imaging plays a crucial role in diagnostic medicine. Yet, a significant portion of the global population lacks access to this essential technology due to a shortage of trained radiologists. Eye-tracking data and deep learning models can enhance X-ray analysis by mapping expert focus areas, guiding automated anomaly detection, optimizing workflow efficiency, and bolstering training methods for novice radiologists. However, the literature shows contradictory results regarding the usefulness of eye-tracking data in deep-learning architectures for abnormality detection. We argue that these discrepancies between studies in the literature are due to (a) the way eye-tracking data is (or is not) processed, (b) the types of deep learning architectures chosen, and (c) the type of application that these architectures will have. We conducted a systematic literature review using PRISMA to address these contradicting results. We analyzed 60 studies that incorporated eye-tracking data in a deep-learning approach for different application goals in radiology. We performed a comparative analysis to understand if eye gaze data contains feature maps that can be useful under a deep learning approach and whether they can promote more interpretable predictions. To the best of our knowledge, this is the first survey in the area that performs a thorough investigation of eye gaze data processing techniques and their impacts in different deep learning architectures for applications such as error detection, classification, object detection, expertise level analysis, fatigue estimation and human attention prediction in medical imaging data. Our analysis resulted in two main contributions: (1) taxonomy that first divides the literature by task, enabling us to analyze the value eye movement can bring for each case and build guidelines regarding architectures and gaze processing techniques adequate for each application, and (2) an overall analysis of how eye gaze data can promote explainability in radiology.

U-PASS: An uncertainty-guided deep learning pipeline for automated sleep staging

With the increasing prevalence of machine learning in critical fields like healthcare, ensuring the safety and reliability of these systems is crucial. Estimating uncertainty plays a vital role in enhancing reliability by identifying areas of high and low confidence and reducing the risk of errors. This study introduces U-PASS, a specialized human-centered machine learning pipeline tailored for clinical applications, which effectively communicates uncertainty to clinical experts and collaborates with them to improve predictions. U-PASS incorporates uncertainty estimation at every stage of the process, including data acquisition, training, and model deployment. Training is divided into a supervised pre-training step and a semi-supervised recording-wise finetuning step. We apply U-PASS to the challenging task of sleep staging and demonstrate that it systematically improves performance at every stage. By optimizing the training dataset, actively seeking feedback from domain experts for informative samples, and deferring the most uncertain samples to experts, U-PASS achieves an impressive expert-level accuracy of 85% on a challenging clinical dataset of elderly sleep apnea patients. This represents a significant improvement over the starting point at 75% accuracy. The largest improvement gain is due to the deferral of uncertain epochs to a sleep expert. U-PASS presents a promising AI approach to incorporating uncertainty estimation in machine learning pipelines, improving their reliability and unlocking their potential in clinical settings.

A comprehensive radiopathological nomogram for the prediction of pathological staging in gastric cancer using CT-derived and WSI-based features

OBJECTIVE

This study aims to develop and validate an innovative radiopathomics model that combines radiomics and pathomics features to effectively differentiate between stages I-II and stage III gastric cancer (pathological staging).

METHODS

Our study included 200 patients with well-defined stages of gastric cancer divided into a training cohort (n = 140) and a test cohort (n = 60). Radiomics features were extracted from contrast-enhanced CT images using PyRadiomics, while pathomics features were obtained from whole slide images of pathological specimens through a fine-tuned deep learning model (ResNet-18). After rigorous feature dimensionality reduction and selection, we constructed radiomics models (SVM_rad, LR_rad, and MLP_rad) and pathomics models (SVM_path, LR_path, and MLP_path) utilizing support vector machine (SVM), logistic regression (LR), and multilayer perceptron (MLP) algorithms. The optimal radiomics and pathomics models were chosen based on comprehensive evaluation criteria such as ROC curves, Hosmer‒Lemeshow tests, and calibration curve tests. Feature patterns extracted from the best-performing radiomics model (MLP_rad) and pathomics model (SVM_rad) were integrated to create a powerful radiopathomics nomogram.

RESULTS

From a pool of 1834 radiomics features extracted from CT images, 14 were selected to construct radiomics models. Among these, the MLP_rad model exhibited the most robust predictive performance (AUC, training cohort: 0.843; test cohort: 0.797). Likewise, 10 pathomics features were chosen from 512 extracted from whole slide images to build pathomics models, with the SVM_path model demonstrating the highest predictive efficiency (AUC, training cohort: 0.937; test cohort: 0.792). The combined radiopathomics nomogram model exhibited optimal discriminative ability (AUC, training cohort: 0.951; test cohort: 0.837), as confirmed by decision curve analysis (DCA), which indicated superior clinical effectiveness.

CONCLUSION

This study presents a cutting-edge radiopathomics nomogram model designed to predict pathological staging in gastric cancer, distinguishing between stages I-II and stage III. Our research leverages preoperative CT images and histopathological slides to forecast gastric cancer staging accurately, potentially facilitating the estimation of staging before radical gastric cancer surgery in the future.

Artificial Intelligence Applications in the Treatment of Colorectal Cancer: A Narrative Review

Colorectal cancer is the third most prevalent cancer worldwide, and its treatment has been a demanding clinical problem. Beyond traditional surgical therapy and chemotherapy, newly revealed molecular mechanisms diversify therapeutic approaches for colorectal cancer. However, the selection of personalized treatment among multiple treatment options has become another challenge in the era of precision medicine. Artificial intelligence has recently been increasingly investigated in the treatment of colorectal cancer. This narrative review mainly discusses the applications of artificial intelligence in the treatment of colorectal cancer patients. A comprehensive literature search was conducted in MEDLINE, EMBASE, and Web of Science to identify relevant papers, resulting in 49 articles being included. The results showed that, based on different categories of data, artificial intelligence can predict treatment outcomes and essential guidance information of traditional and novel therapies, thus enabling individualized treatment strategy selection for colorectal cancer patients. Some frequently implemented machine learning algorithms and deep learning frameworks have also been employed for long-term prognosis prediction in patients with colorectal cancer. Overall, artificial intelligence shows encouraging results in treatment strategy selection and prognosis evaluation for colorectal cancer patients.

Artificial intelligence as a new answer to old challenges in maternal-fetal medicine and obstetrics

BACKGROUND

Following the latest trends in the development of artificial intelligence (AI), the possibility of processing an immense amount of data has created a breakthrough in the medical field. Practitioners can now utilize AI tools to advance diagnostic protocols and improve patient care.

OBJECTIVE

The aim of this article is to present the importance and modalities of AI in maternal-fetal medicine and obstetrics and its usefulness in daily clinical work and decision-making process.

METHODS

A comprehensive literature review was performed by searching PubMed for articles published from inception up until August 2023, including the search terms "artificial intelligence in obstetrics", "maternal-fetal medicine", and "machine learning" combined through Boolean operators. In addition, references lists of identified articles were further reviewed for inclusion.

RESULTS

According to recent research, AI has demonstrated remarkable potential in improving the accuracy and timeliness of diagnoses in maternal-fetal medicine and obstetrics, e.g., advancing perinatal ultrasound technique, monitoring fetal heart rate during labor, or predicting mode of delivery. The combination of AI and obstetric ultrasound can help optimize fetal ultrasound assessment by reducing examination time and improving diagnostic accuracy while reducing physician workload.

CONCLUSION

The integration of AI in maternal-fetal medicine and obstetrics has the potential to significantly improve patient outcomes, enhance healthcare efficiency, and individualized care plans. As technology evolves, AI algorithms are likely to become even more sophisticated. However, the successful implementation of AI in maternal-fetal medicine and obstetrics needs to address challenges related to interpretability and reliability.

k-strip: A novel segmentation algorithm in k-space for the application of skull stripping

BACKGROUND AND OBJECTIVE

We present a novel deep learning-based skull stripping algorithm for magnetic resonance imaging (MRI) that works directly in the information rich complex valued k-space.

METHODS

Using four datasets from different institutions with a total of around 200,000 MRI slices, we show that our network can perform skull-stripping on the raw data of MRIs while preserving the phase information which no other skull stripping algorithm is able to work with. For two of the datasets, skull stripping performed by HD-BET (Brain Extraction Tool) in the image domain is used as the ground truth, whereas the third and fourth dataset comes with per-hand annotated brain segmentations.

RESULTS

All four datasets were very similar to the ground truth (DICE scores of 92 %-99 % and Hausdorff distances of under 5.5 pixel). Results on slices above the eye-region reach DICE scores of up to 99 %, whereas the accuracy drops in regions around the eyes and below, with partially blurred output. The output of k-Strip often has smoothed edges at the demarcation to the skull. Binary masks are created with an appropriate threshold.

CONCLUSION

With this proof-of-concept study, we were able to show the feasibility of working in the k-space frequency domain, preserving phase information, with consistent results. Besides preserving valuable information for further diagnostics, this approach makes an immediate anonymization of patient data possible, already before being transformed into the image domain. Future research should be dedicated to discovering additional ways the k-space can be used for innovative image analysis and further workflows.

Deep-Learning-Based Arrhythmia Detection Using ECG Signals: A Comparative Study and Performance Evaluation

Heart diseases is the world's principal cause of death, and arrhythmia poses a serious risk to the health of the patient. Electrocardiogram (ECG) signals can be used to detect arrhythmia early and accurately, which is essential for immediate treatment and intervention. Deep learning approaches have played an important role in automatically identifying complicated patterns from ECG data, which can be further used to identify arrhythmia. In this paper, deep-learning-based methods for arrhythmia identification using ECG signals are thoroughly studied and their performances evaluated on the basis of accuracy, specificity, precision, and F1 score. We propose the development of a small CNN, and its performance is compared against pretrained models like GoogLeNet. The comparative study demonstrates the promising potential of deep-learning-based arrhythmia identification using ECG signals.

Machine Learning and Artificial Intelligence Applications to Epilepsy: a Review for the Practicing Epileptologist

PURPOSE OF REVIEW

Machine Learning (ML) and Artificial Intelligence (AI) are data-driven techniques to translate raw data into applicable and interpretable insights that can assist in clinical decision making. Some of these tools have extremely promising initial results, earning both great excitement and creating hype. This non-technical article reviews recent developments in ML/AI in epilepsy to assist the current practicing epileptologist in understanding both the benefits and limitations of integrating ML/AI tools into their clinical practice.

RECENT FINDINGS

ML/AI tools have been developed to assist clinicians in almost every clinical decision including (1) predicting future epilepsy in people at risk, (2) detecting and monitoring for seizures, (3) differentiating epilepsy from mimics, (4) using data to improve neuroanatomic localization and lateralization, and (5) tracking and predicting response to medical and surgical treatments. We also discuss practical, ethical, and equity considerations in the development and application of ML/AI tools including chatbots based on Large Language Models (e.g., ChatGPT). ML/AI tools will change how clinical medicine is practiced, but, with rare exceptions, the transferability to other centers, effectiveness, and safety of these approaches have not yet been established rigorously. In the future, ML/AI will not replace epileptologists, but epileptologists with ML/AI will replace epileptologists without ML/AI.

Liver fibrosis MR images classification based on higher-order interaction and sample distribution rebalancing

The fractal features of liver fibrosis MR images exhibit an irregular fragmented distribution, and the diffuse feature distribution lacks interconnectivity, result- ing in incomplete feature learning and poor recognition accuracy. In this paper, we insert recursive gated convolution into the ResNet18 network to introduce spatial information interactions during the feature learning process and extend it to higher orders using recursion. Higher-order spatial information interactions enhance the correlation between features and enable the neural network to focus more on the pixel-level dependencies, enabling a global interpretation of liver MR images. Additionally, the existence of light scattering and quantum noise during the imaging process, coupled with environmental factors such as breathing artifacts caused by long time breath holding, affects the quality of the MR images. To improve the classification performance of the neural network and better cap- ture sample features, we introduce the Adaptive Rebalance loss function and incorporate the feature paradigm as a learnable adaptive attribute into the angular margin auxiliary function. Adaptive Rebalance loss function can expand the inter-class distance and narrow the intra-class difference to further enhance discriminative ability of the model. We conduct extensive experiments on liver fibrosis MR imaging involving 209 patients. The results demonstrate an average improvement of two percent in recognition accuracy compared to ResNet18. The github is at https://github.com/XZN1233/paper.git.

Deep learning prediction model for central lymph node metastasis in papillary thyroid microcarcinoma based on cytology

Controversy exists regarding whether patients with low-risk papillary thyroid microcarcinoma (PTMC) should undergo surgery or active surveillance; the inaccuracy of the preoperative clinical lymph node status assessment is one of the primary factors contributing to the controversy. It is imperative to accurately predict the lymph node status of PTMC before surgery. We selected 208 preoperative fine-needle aspiration (FNA) liquid-based preparations of PTMC as our research objects; all of these instances underwent lymph node dissection and, aside from lymph node status, were consistent with low-risk PTMC. We separated them into two groups according to whether the postoperative pathology showed central lymph node metastases. The deep learning model was expected to predict, based on the preoperative thyroid FNA liquid-based preparation, whether PTMC was accompanied by central lymph node metastases. Our deep learning model attained a sensitivity, specificity, positive prediction value (PPV), negative prediction value (NPV), and accuracy of 78.9% (15/19), 73.9% (17/23), 71.4% (15/21), 81.0% (17/21), and 76.2% (32/42), respectively. The area under the receiver operating characteristic curve (value was 0.8503. The predictive performance of the deep learning model was superior to that of the traditional clinical evaluation, and further analysis revealed the cell morphologies that played key roles in model prediction. Our study suggests that the deep learning model based on preoperative thyroid FNA liquid-based preparation is a reliable strategy for predicting central lymph node metastases in thyroid micropapillary carcinoma, and its performance surpasses that of traditional clinical examination.

Deep learning in precision medicine and focus on glioma

Deep learning (DL) has been successfully applied to different fields for a range of tasks. In medicine, DL methods have been also used to improve the efficiency of disease diagnosis. In this review, we first summarize the history of the development of artificial intelligence models, demonstrate the features of the subtypes of machine learning and different DL networks, and then explore their application in the different fields of precision medicine, such as cardiology, gastroenterology, ophthalmology, dermatology, and oncology. By digging more information and extracting multilevel features from medical data, we found that DL helps doctors assess diseases automatically and monitor patients' physical health. In gliomas, research regarding application prospect of DL was mainly shown through magnetic resonance imaging and then by pathological slides. However, multi-omics data, such as whole exome sequence, RNA sequence, proteomics, and epigenomics, have not been covered thus far. In general, the quality and quantity of DL datasets still need further improvements, and more fruitful multi-omics characteristics will bring more comprehensive and accurate diagnosis in precision medicine and glioma.

The Constrained-Disorder Principle Assists in Overcoming Significant Challenges in Digital Health: Moving from "Nice to Have" to Mandatory Systems

The success of artificial intelligence depends on whether it can penetrate the boundaries of evidence-based medicine, the lack of policies, and the resistance of medical professionals to its use. The failure of digital health to meet expectations requires rethinking some of the challenges faced. We discuss some of the most significant challenges faced by patients, physicians, payers, pharmaceutical companies, and health systems in the digital world. The goal of healthcare systems is to improve outcomes. Assisting in diagnosing, collecting data, and simplifying processes is a "nice to have" tool, but it is not essential. Many of these systems have yet to be shown to improve outcomes. Current outcome-based expectations and economic constraints make "nice to have," "assists," and "ease processes" insufficient. Complex biological systems are defined by their inherent disorder, bounded by dynamic boundaries, as described by the constrained disorder principle (CDP). It provides a platform for correcting systems' malfunctions by regulating their degree of variability. A CDP-based second-generation artificial intelligence system provides solutions to some challenges digital health faces. Therapeutic interventions are held to improve outcomes with these systems. In addition to improving clinically meaningful endpoints, CDP-based second-generation algorithms ensure patient and physician engagement and reduce the health system's costs.

What Is Machine Learning, Artificial Neural Networks and Deep Learning?-Examples of Practical Applications in Medicine

Machine learning (ML), artificial neural networks (ANNs), and deep learning (DL) are all topics that fall under the heading of artificial intelligence (AI) and have gained popularity in recent years. ML involves the application of algorithms to automate decision-making processes using models that have not been manually programmed but have been trained on data. ANNs that are a part of ML aim to simulate the structure and function of the human brain. DL, on the other hand, uses multiple layers of interconnected neurons. This enables the processing and analysis of large and complex databases. In medicine, these techniques are being introduced to improve the speed and efficiency of disease diagnosis and treatment. Each of the AI techniques presented in the paper is supported with an example of a possible medical application. Given the rapid development of technology, the use of AI in medicine shows promising results in the context of patient care. It is particularly important to keep a close eye on this issue and conduct further research in order to fully explore the potential of ML, ANNs, and DL, and bring further applications into clinical use in the future.

Spatial Omics Driven Crossmodal Pretraining Applied to Graph-based Deep Learning for Cancer Pathology Analysis

Graph-based deep learning has shown great promise in cancer histopathology image analysis by contextualizing complex morphology and structure across whole slide images to make high quality downstream outcome predictions (ex: prognostication). These methods rely on informative representations (i.e., embeddings) of image patches comprising larger slides, which are used as node attributes in slide graphs. Spatial omics data, including spatial transcriptomics, is a novel paradigm offering a wealth of detailed information. Pairing this data with corresponding histological imaging localized at 50-micron resolution, may facilitate the development of algorithms which better appreciate the morphological and molecular underpinnings of carcinogenesis. Here, we explore the utility of leveraging spatial transcriptomics data with a contrastive crossmodal pretraining mechanism to generate deep learning models that can extract molecular and histological information for graph-based learning tasks. Performance on cancer staging, lymph node metastasis prediction, survival prediction, and tissue clustering analyses indicate that the proposed methods bring improvement to graph based deep learning models for histopathological slides compared to leveraging histological information from existing schemes, demonstrating the promise of mining spatial omics data to enhance deep learning for pathology workflows.

Research Hotspots and Trends of Deep Learning in Critical Care Medicine: A Bibliometric and Visualized Study

Background

Interest in the application of deep learning (DL) in critical care medicine (CCM) is growing rapidly. However, comprehensive bibliometric research that analyze and measure the global literature is still lacking.

Objective

The present study aimed to systematically evaluate the research hotspots and trends of DL in CCM worldwide based on the output of publications, cooperative relationships of research, citations, and the co-occurrence of keywords.

Methods

A total of 1708 articles in all were obtained from Web of Science. Bibliometric analysis was performed by Bibliometrix package in R software (4.2.2), Microsoft Excel 2019, VOSviewer (1.6.18), and CiteSpace (5.8.R3).

Results

The annual publications increased steeply in the past five years, accounting for 95.67% (1634/1708) of all the included literature. China and USA contributed to approximately 71.66% (1244/1708) of all publications. Seven of the top ten most productive organizations rank in the top 100 universities globally. Hot spots in research on the application of DL in CCM have focused on classifying disease phenotypes, predicting early signs of clinical deterioration, and forecasting disease progression, prognosis, and death. Convolutional neural networks, long and short-term memory networks, recurrent neural networks, transformer models, and attention mechanisms were all commonly used DL technologies.

Conclusion

Hot spots in research on the application of DL in CCM have focused on classifying disease phenotypes, predicting early signs of clinical deterioration, and forecasting disease progression, prognosis, and death. Extensive collaborative research to improve the maturity and robustness of the model remains necessary to make DL-based model applications sufficiently compelling for conventional CCM practice.

New Technologies in Digestive Endoscopy for Ulcerative Colitis Patients

Ulcerative colitis (UC) is a chronic inflammatory bowel disease primarily affecting the colon and rectum. Endoscopy plays a crucial role in the diagnosis and management of UC. Recent advancements in endoscopic technology, including chromoendoscopy, confocal laser endomicroscopy, endocytoscopy and the use of artificial intelligence, have revolutionized the assessment and treatment of UC patients. These innovative techniques enable early detection of dysplasia and cancer, more precise characterization of disease extent and severity and more targeted biopsies, leading to improved diagnosis and disease monitoring. Furthermore, these advancements have significant implications for therapeutic decision making, empowering clinicians to carefully consider a range of treatment options, including pharmacological therapies, endoscopic interventions and surgical approaches. In this review, we provide an overview of the latest endoscopic technologies and their applications for diagnosing and monitoring UC. We also discuss their impact on treatment decision making, highlighting the potential benefits and limitations of each technique.

CPAE: Contrastive predictive autoencoder for unsupervised pre-training in health status prediction

BACKGROUND AND OBJECTIVE

Fully-supervised learning approaches have shown promising results in some health status prediction tasks using Electronic Health Records (EHRs). These traditional approaches rely on sufficient labeled data to learn from. However, in practice, acquiring large-scaled labeled medical data for various prediction tasks is often not feasible. Thus, it is of great interest to utilize contrastive pre-training to leverage the unlabeled information.

METHODS

In this work, we propose a novel data-efficient framework, contrastive predictive autoencoder (CPAE), to first learn without labels from the EHR data in the pre-training process, and then fine-tune on the downstream tasks. Our framework comprises of two parts: (i) a contrastive learning process, inherited from contrastive predictive coding (CPC), which aims to extract global slow-varying features, and (ii) a reconstruction process, which forces the encoder to capture local features. We also introduce the attention mechanism in one variant of our framework to balance the above two processes.

RESULTS

Experiments on real-world EHR dataset verify the effectiveness of our proposed framework on two downstream tasks (i.e., in-hospital mortality prediction and length-of-stay prediction), compared to their supervised counterparts, the CPC model, and other baseline models.

CONCLUSIONS

By comprising of both contrastive learning components and reconstruction components, CPAE aims to extract both global slow-varying information and local transient information. The best results on two downstream tasks are all achieved by CPAE. The variant AtCPAE is particularly superior when fine-tuned on very small training data. Further work may incorporate techniques of multi-task learning to optimize the pre-training process of CPAEs. Moreover, this work is based on the benchmark MIMIC-III dataset which only includes 17 variables. Future work may extend to a larger number of variables.

Ensuring privacy protection in the era of big laparoscopic video data: development and validation of an inside outside discrimination algorithm (IODA)

BACKGROUND

Laparoscopic videos are increasingly being used for surgical artificial intelligence (AI) and big data analysis. The purpose of this study was to ensure data privacy in video recordings of laparoscopic surgery by censoring extraabdominal parts. An inside-outside-discrimination algorithm (IODA) was developed to ensure privacy protection while maximizing the remaining video data.

METHODS

IODAs neural network architecture was based on a pretrained AlexNet augmented with a long-short-term-memory. The data set for algorithm training and testing contained a total of 100 laparoscopic surgery videos of 23 different operations with a total video length of 207 h (124 min ± 100 min per video) resulting in 18,507,217 frames (185,965 ± 149,718 frames per video). Each video frame was tagged either as abdominal cavity, trocar, operation site, outside for cleaning, or translucent trocar. For algorithm testing, a stratified fivefold cross-validation was used.

RESULTS

The distribution of annotated classes were abdominal cavity 81.39%, trocar 1.39%, outside operation site 16.07%, outside for cleaning 1.08%, and translucent trocar 0.07%. Algorithm training on binary or all five classes showed similar excellent results for classifying outside frames with a mean F1-score of 0.96 ± 0.01 and 0.97 ± 0.01, sensitivity of 0.97 ± 0.02 and 0.0.97 ± 0.01, and a false positive rate of 0.99 ± 0.01 and 0.99 ± 0.01, respectively.

CONCLUSION

IODA is able to discriminate between inside and outside with a high certainty. In particular, only a few outside frames are misclassified as inside and therefore at risk for privacy breach. The anonymized videos can be used for multi-centric development of surgical AI, quality management or educational purposes. In contrast to expensive commercial solutions, IODA is made open source and can be improved by the scientific community.

Deep learning for diagnosis of malign pleural effusion on computed tomography images

BACKGROUND

The pleura is a serous membrane that surrounds the lungs. The visceral surface secretes fluid into the serous cavity and the parietal surface ensures a regular absorption of this fluid. If this balance is disturbed, fluid accumulation occurs in the pleural space called "Pleural Effusion". Today, accurate diagnosis of pleural diseases is becoming more critical, as advances in treatment protocols have contributed positively to prognosis. Our aim is to perform computer-aided numerical analysis of Computed Tomography (CT) images from patients showing pleural effusion images on CT and to examine the prediction of malignant/benign distinction using deep learning by comparing with the cytology results.

METHODS

The authors classified 408 CT images from 64 patients whose etiology of pleural effusion was investigated using the deep learning method. 378 of the images were used for the training of the system; 15 malignant and 15 benign CT images, which were not included in the training group, were used as the test.

RESULTS

Among the 30 test images evaluated in the system; 14 of 15 malignant patients and 13 of 15 benign patients were estimated with correct diagnosis (PPD: 93.3%, NPD: 86.67%, Sensitivity: 87.5%, Specificity: 92.86%).

CONCLUSION

Advances in computer-aided diagnostic analysis of CT images and obtaining a pre-diagnosis of pleural fluid may reduce the need for interventional procedures by guiding physicians about which patients may have malignancies. Thus, it is cost and time-saving in patient management, allowing earlier diagnosis and treatment.

MFA-Net: Multiple Feature Association Network for medical image segmentation

Medical image segmentation plays a crucial role in computer-aided diagnosis. However, due to the large variability of medical images, accurate segmentation is a highly challenging task. In this paper, we present a novel medical image segmentation network named the Multiple Feature Association Network (MFA-Net), which is based on deep learning techniques. The MFA-Net utilizes an encoder-decoder architecture with skip connections as its backbone network, and a parallelly dilated convolutions arrangement (PDCA) module is integrated between the encoder and the decoder to capture more representative deep features. Furthermore, a multi-scale feature restructuring module (MFRM) is introduced to restructure and fuse the deep features of the encoder. To enhance global attention perception, the proposed global attention stacking (GAS) modules are cascaded on the decoder. The proposed MFA-Net leverages novel global attention mechanisms to improve the segmentation performance at different feature scales. We evaluated our MFA-Net on four segmentation tasks, including lesions in intestinal polyp, liver tumor, prostate cancer, and skin lesion. Our experimental results and ablation study demonstrate that the proposed MFA-Net outperforms state-of-the-art methods in terms of global positioning and local edge recognition.

MLATE: Machine learning for predicting cell behavior on cardiac tissue engineering scaffolds

Cardiovascular disease is one of the leading causes of mortality worldwide and is responsible for millions of deaths annually. One of the most promising approaches to deal with this problem, which has spread recently, is cardiac tissue engineering (CTE). Many researchers have tried developing scaffolds with different materials, cell lines, and fabrication methods to help regenerate heart tissue. Machine learning (ML) is one of the hottest topics in science and technology, revolutionizing many fields and changing our perspective on solving problems. As a result of using ML, some scientific issues have been resolved, including protein-folding, a challenging problem in biology that remained unsolved for 50 years. However, it is not well addressed in tissue engineering. An AI-based software was developed by our group called MLATE (Machine Learning Applications in Tissue Engineering) to tackle tissue engineering challenges, which highly depend on conducting costly and time-consuming experiments. For the first time, to the best of our knowledge, a CTE scaffold dataset was created by collecting specifications from the literature, including different materials, cell lines, and fabrication methods commonly used in CTE scaffold development. These specifications were used as variables in the study. Then, the CTE scaffolds were rated based on cell behaviors such as cell viability, growth, proliferation, and differentiation on the scaffold on a scale of 0-3. These ratings were considered a function of the variables in the gathered dataset. It should be stated that this study was merely based on information available in the literature. Then, twenty-eight ML algorithms were applied to determine the most effective one for predicting cell behavior on CTE scaffolds fabricated by different materials, compositions, and methods. The results indicated the high performance of XGBoost with an accuracy of 87%. Also, by implementing ensemble learning algorithms and using five algorithms with the best performance, an accuracy of 93% with the AdaBoost Classifier and Voting Classifier was achieved. Finally, the open-source software developed in this study was made available for everyone by publishing the best model along with a step-by-step guide to using it online at: https://github.com/saeedrafieyan/MLATE.

Bibliometric analysis of the use of artificial intelligence in COVID-19 based on scientific studies

Background and Aims

One such strategy is citation analysis used by researchers for research planning an article referred to by another article receives a "citation." By using bibliometric analysis, the development of research areas and authors' influence can be investigated. The current study aimed to identify and analyze the characteristics of 100 highly cited articles on the use of artificial intelligence concerning COVID-19.

Methods

On July 27, 2022, this database was searched using the keywords "artificial intelligence" and "COVID-19" in the topic. After extensive searching, all retrieved articles were sorted by the number of citations, and 100 highly cited articles were included based on the number of citations. The following data were extracted: year of publication, type of study, name of journal, country, number of citations, language, and keywords.

Results

The average number of citations for 100 highly cited articles was 138.54. The top three cited articles with 745, 596, and 549 citations. The top 100 articles were all in English and were published in 2020 and 2021. China was the most prolific country with 19 articles, followed by the United States with 15 articles and India with 10 articles.

Conclusion

The current bibliometric analysis demonstrated the significant growth of the use of artificial intelligence for COVID-19. Using these results, research priorities are more clearly defined, and researchers can focus on hot topics.

Harnessing the Promise of Artificial Intelligence Responsibly

This Viewpoint discusses the benefits and potential harms of using artificial intelligence (AI) algorithms in medicine and proposes the collaborative creation of a Code of Conduct for AI in Health Care.

A hierarchical GAN method with ensemble CNN for accurate nodule detection

PURPOSE

Lung cancer can evolve into one of the deadliest diseases whose early detection is one of the major survival factors. However, early detection is a challenging task due to the unclear structure, shape, and the size of the nodule. Hence, radiologists need automated tools to make accurate decisions.

METHODS

This paper develops a new approach based on generative adversarial network (GAN) architecture for nodule detection to propose a two-step GAN model containing lung segmentation and nodule localization. The first generator comprises a U-net network, while the second utilizes a mask R-CNN. The task of lung segmentation involves a two-class classification of the pixels in each image, categorizing lung pixels in one class and the rest in the other. The classifier becomes imbalanced due to numerous non-lung pixels, decreasing the model performance. This problem is resolved by using the focal loss function for training the generator. Moreover, a new loss function is developed as the nodule localization generator to enhance the diagnosis quality. Discriminator nets are implemented in GANs as an ensemble of convolutional neural networks (ECNNs), using multiple CNNs and connecting their outputs to make a final decision.

RESULTS

Several experiments are designed to assess the model on the well-known LUNA dataset. The experiments indicate that the proposed model can reduce the error of the state-of-the-art models on the IoU criterion by about 35 and 16% for lung segmentation and nodule localization, respectively.

CONCLUSION

Unlike recent studies, the proposed method considers two loss functions for generators, further promoting the goal achievements. Moreover, the network of discriminators is regarded as ECNNs, generating rich features for decisions.