Association of Pathological Fibrosis With Renal Survival Using Deep Neural Networks

A multi-class brain tumor grading system based on histopathological images using a hybrid YOLO and RESNET networks

Gliomas are primary brain tumors caused by glial cells. These cancers' classification and grading are crucial for prognosis and treatment planning. Deep learning (DL) can potentially improve the digital pathology investigation of brain tumors. In this paper, we developed a technique for visualizing a predictive tumor grading model on histopathology pictures to help guide doctors by emphasizing characteristics and heterogeneity in forecasts. The proposed technique is a hybrid model based on YOLOv5 and ResNet50. The function of YOLOv5 is to localize and classify the tumor in large histopathological whole slide images (WSIs). The suggested technique incorporates ResNet into the feature extraction of the YOLOv5 framework, and the detection results show that our hybrid network is effective for identifying brain tumors from histopathological images. Next, we estimate the glioma grades using the extreme gradient boosting classifier. The high-dimensional characteristics and nonlinear interactions present in histopathology images are well-handled by this classifier. DL techniques have been used in previous computer-aided diagnosis systems for brain tumor diagnosis. However, by combining the YOLOv5 and ResNet50 architectures into a hybrid model specifically designed for accurate tumor localization and predictive grading within histopathological WSIs, our study presents a new approach that advances the field. By utilizing the advantages of both models, this creative integration goes beyond traditional techniques to produce improved tumor localization accuracy and thorough feature extraction. Additionally, our method ensures stable training dynamics and strong model performance by integrating ResNet50 into the YOLOv5 framework, addressing concerns about gradient explosion. The proposed technique is tested using the cancer genome atlas dataset. During the experiments, our model outperforms the other standard ways on the same dataset. Our results indicate that the proposed hybrid model substantially impacts tumor subtype discrimination between low-grade glioma (LGG) II and LGG III. With 97.2% of accuracy, 97.8% of precision, 98.6% of sensitivity, and the Dice similarity coefficient of 97%, the proposed model performs well in classifying four grades. These results outperform current approaches for identifying LGG from high-grade glioma and provide competitive performance in classifying four categories of glioma in the literature.

Artificial intelligence-assisted quantification and assessment of whole slide images for pediatric kidney disease diagnosis

MOTIVATION

Pediatric kidney disease is a widespread, progressive condition that severely impacts growth and development of children. Chronic kidney disease is often more insidious in children than in adults, usually requiring a renal biopsy for diagnosis. Biopsy evaluation requires copious examination by trained pathologists, which can be tedious and prone to human error. In this study, we propose an artificial intelligence (AI) method to assist pathologists in accurate segmentation and classification of pediatric kidney structures, named as AI-based Pediatric Kidney Diagnosis (APKD).

RESULTS

We collected 2935 pediatric patients diagnosed with kidney disease for the development of APKD. The dataset comprised 93 932 histological structures annotated manually by three skilled nephropathologists. APKD scored an average accuracy of 94% for each kidney structure category, including 99% in the glomerulus. We found strong correlation between the model and manual detection in detected glomeruli (Spearman correlation coefficient r = 0.98, P < .001; intraclass correlation coefficient ICC = 0.98, 95% CI = 0.96-0.98). Compared to manual detection, APKD was approximately 5.5 times faster in segmenting glomeruli. Finally, we show how the pathological features extracted by APKD can identify focal abnormalities of the glomerular capillary wall to aid in the early diagnosis of pediatric kidney disease.

AVAILABILITY AND IMPLEMENTATION

https://github.com/ChunyueFeng/Kidney-DataSet.

Development of a multiple convolutional neural network-facilitated diagnostic screening program for immunofluorescence images of IgA nephropathy and idiopathic membranous nephropathy

Background

Immunoglobulin A nephropathy (IgAN) and idiopathic membranous nephropathy (IMN) are the most common glomerular diseases. Immunofluorescence (IF) tests of renal tissues are crucial for the diagnosis. We developed a multiple convolutional neural network (CNN)-facilitated diagnostic program to assist the IF diagnosis of IgAN and IMN.

Methods

The diagnostic program consisted of four parts: a CNN trained as a glomeruli detection module, an IF intensity comparator, dual-CNN (D-CNN) trained as a deposition appearance and location classifier and a post-processing module. A total of 1573 glomerular IF images from 1009 patients with glomerular diseases were used for the training and validation of the diagnostic program. A total of 1610 images of 426 patients from different hospitals were used as test datasets. The performance of the diagnostic program was compared with nephropathologists.

Results

In >90% of the tested images, the glomerulus location module achieved an intersection over union >0.8. The accuracy of the D-CNN in recognizing irregular granular mesangial deposition and fine granular deposition along the glomerular basement membrane was 96.1% and 93.3%, respectively. As for the diagnostic program, the accuracy, sensitivity and specificity of diagnosing suspected IgAN were 97.6%, 94.4% and 96.0%, respectively. The accuracy, sensitivity and specificity of diagnosing suspected IMN were 91.7%, 88.9% and 95.8%, respectively. The corresponding areas under the curve (AUCs) were 0.983 and 0.935. When tested with images from the outside hospital, the diagnostic program showed stable performance. The AUCs for diagnosing suspected IgAN and IMN were 0.972 and 0.948, respectively. Compared with inexperienced nephropathologists, the program showed better performance.

Conclusion

The proposed diagnostic program could assist the IF diagnosis of IgAN and IMN.

Clustering-based spatial analysis (CluSA) framework through graph neural network for chronic kidney disease prediction using histopathology images

Machine learning applied to digital pathology has been increasingly used to assess kidney function and diagnose the underlying cause of chronic kidney disease (CKD). We developed a novel computational framework, clustering-based spatial analysis (CluSA), that leverages unsupervised learning to learn spatial relationships between local visual patterns in kidney tissue. This framework minimizes the need for time-consuming and impractical expert annotations. 107,471 histopathology images obtained from 172 biopsy cores were used in the clustering and in the deep learning model. To incorporate spatial information over the clustered image patterns on the biopsy sample, we spatially encoded clustered patterns with colors and performed spatial analysis through graph neural network. A random forest classifier with various groups of features were used to predict CKD. For predicting eGFR at the biopsy, we achieved a sensitivity of 0.97, specificity of 0.90, and accuracy of 0.95. AUC was 0.96. For predicting eGFR changes in one-year, we achieved a sensitivity of 0.83, specificity of 0.85, and accuracy of 0.84. AUC was 0.85. This study presents the first spatial analysis based on unsupervised machine learning algorithms. Without expert annotation, CluSA framework can not only accurately classify and predict the degree of kidney function at the biopsy and in one year, but also identify novel predictors of kidney function and renal prognosis.

A novel technique based on mutual information weighted feature selection to predict chronic kidney disease

Chronic Kidney Disease (CKD) is a crucial life-threatening condition due to impaired kidney functionality and renal disease. In recent studies, Kidney disorder is considered one of the essential and deadliest issues that threaten patients’ survival with the lack of earlier prediction and classification. The earlier prediction process and the proper diagnosis help delay or stop the chronic disease progression into its final stage, where renal transplantation or dialysis is a known way of saving the patient’s life. Global studies reveal that nearly 10% of the population is affected by Chronic Kidney Disease (CKD), and millions die because of non-affordable treatment. Early detection of CKD from the biological parameters would save people from this crisis. Machine Learning algorithms are playing a predominant role in disease diagnosis and prognosis. This work generates compound features from CKD indicators by two novel algorithms: Correlation-based Weighted Compound Feature (CWCF) and Feature Significance based Weighted Compound Feature (FSWCF). Any learning algorithm is as good as its features. Hence, the features generated by these algorithms are validated on different machine learning algorithms as a test for generality. The simulation is done in MATLAB 2020a environment where various metrics like prediction accuracy gives superior results compared to multiple other approaches. The accuracy of CWCF over different methods like LR is 97.23%, Gaussian NB is 99%, SVM is 99.18%, and RF is 99.89%, which is substantially higher than the approaches without proper methods feature analysis. The results suggest that generated compound features improve the predictive power of the algorithms.

Precision nephrology identified tumor necrosis factor activation variability in minimal change disease and focal segmental glomerulosclerosis

The diagnosis of nephrotic syndrome relies on clinical presentation and descriptive patterns of injury on kidney biopsies, but not specific to underlying pathobiology. Consequently, there are variable rates of progression and response to therapy within diagnoses. Here, an unbiased transcriptomic-driven approach was used to identify molecular pathways which are shared by subgroups of patients with either minimal change disease (MCD) or focal segmental glomerulosclerosis (FSGS). Kidney tissue transcriptomic profile-based clustering identified three patient subgroups with shared molecular signatures across independent, North American, European, and African cohorts. One subgroup had significantly greater disease progression (Hazard Ratio 5.2) which persisted after adjusting for diagnosis and clinical measures (Hazard Ratio 3.8). Inclusion in this subgroup was retained even when clustering was limited to those with less than 25% interstitial fibrosis. The molecular profile of this subgroup was largely consistent with tumor necrosis factor (TNF) pathway activation. Two TNF pathway urine markers were identified, tissue inhibitor of metalloproteinases-1 (TIMP-1) and monocyte chemoattractant protein-1 (MCP-1), that could be used to predict an individual's TNF pathway activation score. Kidney organoids and single-nucleus RNA-sequencing of participant kidney biopsies, validated TNF-dependent increases in pathway activation score, transcript and protein levels of TIMP-1 and MCP-1, in resident kidney cells. Thus, molecular profiling identified a subgroup of patients with either MCD or FSGS who shared kidney TNF pathway activation and poor outcomes. A clinical trial testing targeted therapies in patients selected using urinary markers of TNF pathway activation is ongoing.

Predict, diagnose, and treat chronic kidney disease with machine learning: a systematic literature review

OBJECTIVES

In this systematic review we aimed at assessing how artificial intelligence (AI), including machine learning (ML) techniques have been deployed to predict, diagnose, and treat chronic kidney disease (CKD). We systematically reviewed the available evidence on these innovative techniques to improve CKD diagnosis and patient management.

METHODS

We included English language studies retrieved from PubMed. The review is therefore to be classified as a "rapid review", since it includes one database only, and has language restrictions; the novelty and importance of the issue make missing relevant papers unlikely. We extracted 16 variables, including: main aim, studied population, data source, sample size, problem type (regression, classification), predictors used, and performance metrics. We followed the Preferred Reporting Items for Systematic Reviews (PRISMA) approach; all main steps were done in duplicate.

RESULTS

From a total of 648 studies initially retrieved, 68 articles met the inclusion criteria. Models, as reported by authors, performed well, but the reported metrics were not homogeneous across articles and therefore direct comparison was not feasible. The most common aim was prediction of prognosis, followed by diagnosis of CKD. Algorithm generalizability, and testing on diverse populations was rarely taken into account. Furthermore, the clinical evaluation and validation of the models/algorithms was perused; only a fraction of the included studies, 6 out of 68, were performed in a clinical context.

CONCLUSIONS

Machine learning is a promising tool for the prediction of risk, diagnosis, and therapy management for CKD patients. Nonetheless, future work is needed to address the interpretability, generalizability, and fairness of the models to ensure the safe application of such technologies in routine clinical practice.

Artificial Intelligence You Can Trust: What Matters Beyond Performance When Applying Artificial Intelligence to Renal Histopathology?

Although still in its infancy, artificial intelligence (AI) analysis of kidney biopsy images is anticipated to become an integral aspect of renal histopathology. As these systems are developed, the focus will understandably be on developing ever more accurate models, but successful translation to the clinic will also depend upon other characteristics of the system.In the extreme, deployment of highly performant but "black box" AI is fraught with risk, and high-profile errors could damage future trust in the technology. Furthermore, a major factor determining whether new systems are adopted in clinical settings is whether they are "trusted" by clinicians. Key to unlocking trust will be designing platforms optimized for intuitive human-AI interactions and ensuring that, where judgment is required to resolve ambiguous areas of assessment, the workings of the AI image classifier are understandable to the human observer. Therefore, determining the optimal design for AI systems depends on factors beyond performance, with considerations of goals, interpretability, and safety constraining many design and engineering choices.In this article, we explore challenges that arise in the application of AI to renal histopathology, and consider areas where choices around model architecture, training strategy, and workflow design may be influenced by factors beyond the final performance metrics of the system.

Artificial intelligence in glomerular diseases

In this narrative review, we focus on the application of artificial intelligence in the clinical history of patients with glomerular disease, digital pathology in kidney biopsy, renal ultrasonography imaging, and prediction of chronic kidney disease (CKD). With the development of natural language processing, the clinical history of a patient can be used to identify a computable phenotype. In kidney pathology, digital imaging has adopted innovative deep learning algorithms (DLAs) that can improve the predictive capability of the examined lesions. However, at this time, these applications can only be used in research because there is no recognized validation to replace the conventional diagnostic applications. Kidney ultrasonography, used in the clinical examination of patients, provides information about the progression of kidney damage. Machine learning algorithms (MLAs) with promising results for the early detection of CKD have been proposed, but, still, they are not solid enough to be incorporated into the clinical practice. A few tools for glomerulonephritis, based on MLAs, are available in clinical practice. They can be downloaded on computers and cellular phones but can only be applied to uniracial cohorts of patients. To improve their performance, it is necessary to organize large consortia with multiracial cohorts. Finally, in many studies MLA development has been carried out using retrospective cohorts. The performance of the models might differ in retrospective cohorts compared to real-world data. Therefore, the models should be validated in prospective external large cohorts.

Machine Learning Sensors for Diagnosis of COVID-19 Disease Using Routine Blood Values for Internet of Things Application

Healthcare digitalization requires effective applications of human sensors, when various parameters of the human body are instantly monitored in everyday life due to the Internet of Things (IoT). In particular, machine learning (ML) sensors for the prompt diagnosis of COVID-19 are an important option for IoT application in healthcare and ambient assisted living (AAL). Determining a COVID-19 infected status with various diagnostic tests and imaging results is costly and time-consuming. This study provides a fast, reliable and cost-effective alternative tool for the diagnosis of COVID-19 based on the routine blood values (RBVs) measured at admission. The dataset of the study consists of a total of 5296 patients with the same number of negative and positive COVID-19 test results and 51 routine blood values. In this study, 13 popular classifier machine learning models and the LogNNet neural network model were exanimated. The most successful classifier model in terms of time and accuracy in the detection of the disease was the histogram-based gradient boosting (HGB) (accuracy: 100%, time: 6.39 sec). The HGB classifier identified the 11 most important features (LDL, cholesterol, HDL-C, MCHC, triglyceride, amylase, UA, LDH, CK-MB, ALP and MCH) to detect the disease with 100% accuracy. In addition, the importance of single, double and triple combinations of these features in the diagnosis of the disease was discussed. We propose to use these 11 features and their binary combinations as important biomarkers for ML sensors in the diagnosis of the disease, supporting edge computing on Arduino and cloud IoT service.

Convolutional Neural Networks for the Evaluation of Chronic and Inflammatory Lesions in Kidney Transplant Biopsies

In kidney transplant biopsies, both inflammation and chronic changes are important features that predict long-term graft survival. Quantitative scoring of these features is important for transplant diagnostics and kidney research. However, visual scoring is poorly reproducible and labor intensive. The goal of this study was to investigate the potential of convolutional neural networks (CNNs) to quantify inflammation and chronic features in kidney transplant biopsies. A structure segmentation CNN and a lymphocyte detection CNN were applied on 125 whole-slide image pairs of periodic acid-Schiff- and CD3-stained slides. The CNN results were used to quantify healthy and sclerotic glomeruli, interstitial fibrosis, tubular atrophy, and inflammation within both nonatrophic and atrophic tubuli, and in areas of interstitial fibrosis. The computed tissue features showed high correlation with Banff lesion scores of five pathologists (A.A., A.Dend., J.H.B., J.K., and T.N.). Analyses on a small subset showed a moderate correlation toward higher CD3⁺ cell density within scarred regions and higher CD3⁺ cell count inside atrophic tubuli correlated with long-term change of estimated glomerular filtration rate. The presented CNNs are valid tools to yield objective quantitative information on glomeruli number, fibrotic tissue, and inflammation within scarred and non-scarred kidney parenchyma in a reproducible manner. CNNs have the potential to improve kidney transplant diagnostics and will benefit the community as a novel method to generate surrogate end points for large-scale clinical studies.

Prognostic Implications of a Morphometric Evaluation for Chronic Changes on All Diagnostic Native Kidney Biopsies

BACKGROUND

Semiquantitative visual inspection for glomerulosclerosis, interstitial fibrosis, and arteriosclerosis is often used to assess chronic changes in native kidney biopsies. Morphometric evaluation of these and other chronic changes may improve the prognostic assessment.

METHODS

We studied a historical cohort of patients who underwent a native kidney biopsy between 1993 and 2015 and were followed through 2021 for ESKD and for progressive CKD (defined as experiencing 50% eGFR decline, temporary dialysis, or ESKD). Pathologist scores for the percentages of globally sclerosed glomeruli (GSG), interstitial fibrosis and tubular atrophy (IFTA), and arteriosclerosis (luminal stenosis) were available. We scanned biopsy sections into high-resolution images to trace microstructures. Morphometry measures were percentage of GSG; percentage of glomerulosclerosis (percentage of GSG, ischemic-appearing glomeruli, or segmentally sclerosed glomeruli); percentage of IFTA; IFTA foci density; percentage of artery luminal stenosis; arteriolar hyalinosis counts; and measures of nephron size. Models assessed risk of ESKD or progressive CKD with biopsy measures adjusted for age, hypertension, diabetes, body mass index, eGFR, and proteinuria.

RESULTS

Of 353 patients (followed for a median 7.5 years), 75 developed ESKD and 139 experienced progressive CKD events. Visually estimated scores by pathologists versus morphometry measures for percentages of GSG, IFTA, and luminal stenosis did not substantively differ in predicting outcomes. However, adding percentage of glomerulosclerosis, IFTA foci density, and arteriolar hyalinosis improved outcome prediction. A 10-point score using percentage of glomerulosclerosis, percentage of IFTA, IFTA foci density, and any arteriolar hyalinosis outperformed a 10-point score based on percentages of GSG, IFTA, and luminal stenosis >50% in discriminating risk of ESKD or progressive CKD.

CONCLUSION

Morphometric characterization of glomerulosclerosis, IFTA, and arteriolar hyalinosis on kidney biopsy improves prediction of long-term kidney outcomes.

Recent Advances and Future Perspectives in the Use of Machine Learning and Mathematical Models in Nephrology

We reviewed some of the latest advancements in the use of mathematical models in nephrology. We looked over 2 distinct categories of mathematical models that are widely used in biological research and pointed out some of their strengths and weaknesses when applied to health care, especially in the context of nephrology. A mechanistic dynamical system allows the representation of causal relations among the system variables but with a more complex and longer development/implementation phase. Artificial intelligence/machine learning provides predictive tools that allow identifying correlative patterns in large data sets, but they are usually harder-to-interpret black boxes. Chronic kidney disease (CKD), a major worldwide health problem, generates copious quantities of data that can be leveraged by choice of the appropriate model; also, there is a large number of dialysis parameters that need to be determined at every treatment session that can benefit from predictive mechanistic models. Following important steps in the use of mathematical methods in medical science might be in the intersection of seemingly antagonistic frameworks, by leveraging the strength of each to provide better care.

Glo-In-One: holistic glomerular detection, segmentation, and lesion characterization with large-scale web image mining

Purpose: The quantitative detection, segmentation, and characterization of glomeruli from high-resolution whole slide imaging (WSI) play essential roles in the computer-assisted diagnosis and scientific research in digital renal pathology. Historically, such comprehensive quantification requires extensive programming skills to be able to handle heterogeneous and customized computational tools. To bridge the gap of performing glomerular quantification for non-technical users, we develop the Glo-In-One toolkit to achieve holistic glomerular detection, segmentation, and characterization via a single line of command. Additionally, we release a large-scale collection of 30,000 unlabeled glomerular images to further facilitate the algorithmic development of self-supervised deep learning. Approach: The inputs of the Glo-In-One toolkit are WSIs, while the outputs are (1) WSI-level multi-class circle glomerular detection results (which can be directly manipulated with ImageScope), (2) glomerular image patches with segmentation masks, and (3) different lesion types. In the current version, the fine-grained global glomerulosclerosis (GGS) characterization is provided, including assessed-solidified-GSS (associated with hypertension-related injury), disappearing-GSS (a further end result of the SGGS becoming contiguous with fibrotic interstitium), and obsolescent-GSS (nonspecific GGS increasing with aging) glomeruli. To leverage the performance of the Glo-In-One toolkit, we introduce self-supervised deep learning to glomerular quantification via large-scale web image mining. Results: The GGS fine-grained classification model achieved a decent performance compared with baseline supervised methods while only using 10% of the annotated data. The glomerular detection achieved an average precision of 0.627 with circle representations, while the glomerular segmentation achieved a 0.955 patch-wise Dice dimilarity coefficient. Conclusion: We develop and release an open-source Glo-In-One toolkit, a software with holistic glomerular detection, segmentation, and lesion characterization. This toolkit is user-friendly to non-technical users via a single line of command. The toolbox and the 30,000 web mined glomerular images have been made publicly available at https://github.com/hrlblab/Glo-In-One.

Artificial Intelligence-Assisted Renal Pathology: Advances and Prospects

Digital imaging and advanced microscopy play a pivotal role in the diagnosis of kidney diseases. In recent years, great achievements have been made in digital imaging, providing novel approaches for precise quantitative assessments of nephropathology and relieving burdens of renal pathologists. Developing novel methods of artificial intelligence (AI)-assisted technology through multidisciplinary interaction among computer engineers, renal specialists, and nephropathologists could prove beneficial for renal pathology diagnoses. An increasing number of publications has demonstrated the rapid growth of AI-based technology in nephrology. In this review, we offer an overview of AI-assisted renal pathology, including AI concepts and the workflow of processing digital image data, focusing on the impressive advances of AI application in disease-specific backgrounds. In particular, this review describes the applied computer vision algorithms for the segmentation of kidney structures, diagnosis of specific pathological changes, and prognosis prediction based on images. Lastly, we discuss challenges and prospects to provide an objective view of this topic.

Automated Computer-Assisted Image Analysis for the Fast Quantification of Kidney Fibrosis

Simple Summary

Chronic kidney disease is a health problem in which the kidneys cannot function normally. Thus, they cannot filter blood effectively and cause waste accumulation in the organism, leading to serious health problems. Researchers use animals as models to replicate the human body’s behavior to understand this disease. In these studies, it is essential to evaluate the percentage of fibrosis (growth of fibrotic tissue similar to a scar in response to damage) to know the degree of kidney damage. Some researchers use programs to make the evaluation of fibrosis easier. However, this analysis is time-consuming because it needs to be made one image at a time and there are hundreds of samples in an animal model study. Here, we explain a method to conduct the same analysis but in a faster automated way with the assistance of a computer and a software package called CellProfiler™. The percentage of fibrosis using CellProfiler™ is similar to that obtained with the most widely used software for this kind of analysis called ImageJ. With the help of this approach, researchers can make more studies faster and easier and find new antifibrogenic therapies to address the common and worldwide health problem caused by chronic kidney disease.

Abstract

Chronic kidney disease (CKD) is a common and worldwide health problem and one of the most important causes of morbidity and mortality. Most primary research on this disease requires evaluating the fibrosis index in animal model kidneys, specifically using Masson’s trichrome stain. Different programs are used to calculate the percentage of fibrosis; however, the analysis is time-consuming since one image must be performed at a time. CellProfiler™ is a program designed to analyze data obtained from biological samples and can process multiple images through pipelines, and the results can be exported to databases. This article explains how CellProfiler™ can be used to automatically analyze kidney histology photomicrographs from samples stained with Masson’s trichrome stain to assess the percentage of fibrosis in an experimental animal model of CKD. A pipeline was created to analyze Masson’s trichrome-stained slides in a model of CDK induced by adenine at doses of 50 mg/kg and 100 mg/kg, in addition to samples with the vehicle (75% glycerin). The results were compared with those obtained by ImageJ, and no significant differences were found between both programs. The CellProfiler™ pipeline made here is a reliable, fast, and easy alternative for kidney fibrosis analysis and quantification in experimental animal models.

Vascular Implications of COVID-19: Role of Radiological Imaging, Artificial Intelligence, and Tissue Characterization: A Special Report

The SARS-CoV-2 virus has caused a pandemic, infecting nearly 80 million people worldwide, with mortality exceeding six million. The average survival span is just 14 days from the time the symptoms become aggressive. The present study delineates the deep-driven vascular damage in the pulmonary, renal, coronary, and carotid vessels due to SARS-CoV-2. This special report addresses an important gap in the literature in understanding (i) the pathophysiology of vascular damage and the role of medical imaging in the visualization of the damage caused by SARS-CoV-2, and (ii) further understanding the severity of COVID-19 using artificial intelligence (AI)-based tissue characterization (TC). PRISMA was used to select 296 studies for AI-based TC. Radiological imaging techniques such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound were selected for imaging of the vasculature infected by COVID-19. Four kinds of hypotheses are presented for showing the vascular damage in radiological images due to COVID-19. Three kinds of AI models, namely, machine learning, deep learning, and transfer learning, are used for TC. Further, the study presents recommendations for improving AI-based architectures for vascular studies. We conclude that the process of vascular damage due to COVID-19 has similarities across vessel types, even though it results in multi-organ dysfunction. Although the mortality rate is ~2% of those infected, the long-term effect of COVID-19 needs monitoring to avoid deaths. AI seems to be penetrating the health care industry at warp speed, and we expect to see an emerging role in patient care, reduce the mortality and morbidity rate.

Cultivating Clinical Clarity through Computer Vision: A Current Perspective on Whole Slide Imaging and Artificial Intelligence

Diagnostic devices, methodological approaches, and traditional constructs of clinical pathology practice, cultivated throughout centuries, have transformed radically in the wake of explosive technological growth and other, e.g., environmental, catalysts of change. Ushered into the fray of modern laboratory medicine are digital imaging devices and machine-learning (ML) software fashioned to mitigate challenges, e.g., practitioner shortage while preparing clinicians for emerging interconnectivity of environments and diagnostic information in the era of big data. As computer vision shapes new constructs for the modern world and intertwines with clinical medicine, cultivating clarity of our new terrain through examining the trajectory and current scope of computational pathology and its pertinence to clinical practice is vital. Through review of numerous studies, we find developmental efforts for ML migrating from research to standardized clinical frameworks while overcoming obstacles that have formerly curtailed adoption of these tools, e.g., generalizability, data availability, and user-friendly accessibility. Groundbreaking validatory efforts have facilitated the clinical deployment of ML tools demonstrating the capacity to effectively aid in distinguishing tumor subtype and grade, classify early vs. advanced cancer stages, and assist in quality control and primary diagnosis applications. Case studies have demonstrated the benefits of streamlined, digitized workflows for practitioners alleviated by decreased burdens.

Evaluating tubulointerstitial compartments in renal biopsy specimens using a deep learning-based approach for classifying normal and abnormal tubules

Renal pathology is essential for diagnosing and assessing the severity and prognosis of kidney diseases. Deep learning-based approaches have developed rapidly and have been applied in renal pathology. However, methods for the automated classification of normal and abnormal renal tubules remain scarce. Using a deep learning-based method, we aimed to classify normal and abnormal renal tubules, thereby assisting renal pathologists in the evaluation of renal biopsy specimens. Consequently, we developed a U-Net-based segmentation model using randomly selected regions obtained from 21 renal biopsy specimens. Further, we verified its performance in multiclass segmentation by calculating the Dice coefficients (DCs). We used 15 cases of tubulointerstitial nephritis to assess its applicability in aiding routine diagnoses conducted by renal pathologists and calculated the agreement ratio between diagnoses conducted by two renal pathologists and the time taken for evaluation. We also determined whether such diagnoses were improved when the output of segmentation was considered. The glomeruli and interstitium had the highest DCs, whereas the normal and abnormal renal tubules had intermediate DCs. Following the detailed evaluation of the tubulointerstitial compartments, the proximal, distal, atrophied, and degenerated tubules had intermediate DCs, whereas the arteries and inflamed tubules had low DCs. The annotation and output areas involving normal and abnormal tubules were strongly correlated in each class. The pathological concordance for the glomerular count, t, ct, and ci scores of the Banff classification of renal allograft pathology remained high with or without the segmented images. However, in terms of time consumption, the quantitative assessment of tubulitis, tubular atrophy, degenerated tubules, and the interstitium was improved significantly when renal pathologists considered the segmentation output. Deep learning algorithms can assist renal pathologists in the classification of normal and abnormal tubules in renal biopsy specimens, thereby facilitating the enhancement of renal pathology and ensuring appropriate clinical decisions.

Histopathological prognostic factors in ANCA-associated glomerulonephritis

Anti-neutrophil cytoplasmic antibody (ANCA)-associated vasculitis (AAV) are a group of multisystemic autoimmune diseases characterized by necrotizing inflammation of small vessels. Kidney involvement is frequent in granulomatosis with polyangiitis (GPA) and microscopic polyangiitis (MPA), and accounts for a significant proportion of the morbidity and mortality related to these diseases. Despite improvement in therapeutic management of ANCA-glomerulonephritis (ANCA-GN), end-stage kidney disease (ESKD) still occurs in up to 30% of affected patients within 5 years following diagnosis. Thus, identifying patients for whom aggressive immunosuppressive therapy will be more beneficial than deleterious is of great importance. Several clinical, biological and histological factors have been proposed as predictors of ESKD. The kidney biopsy is essential not only for the diagnosis, but also for evaluating renal prognosis. In this review, we discuss the prognostic value of renal lesions at the diagnosis of ANCA-GN by analyzing each compartment of the nephron. We also review existing ESKD risk classification in ANCA-GN and finally propose an example of a standardized pathology report that could be used in routine practice.

The promise of artificial intelligence for kidney pathophysiology

PURPOSE OF REVIEW

We seek to determine recent advances in kidney pathophysiology that have been enabled or enhanced by artificial intelligence. We describe some of the challenges in the field as well as future directions.

RECENT FINDINGS

We first provide an overview of artificial intelligence terminologies and methodologies. We then describe the use of artificial intelligence in kidney diseases to discover risk factors from clinical data for disease progression, annotate whole slide imaging and decipher multiomics data. We delineate key examples of risk stratification and prognostication in acute kidney injury (AKI) and chronic kidney disease (CKD). We contextualize these applications in kidney disease oncology, one of the subfields to benefit demonstrably from artificial intelligence using all if these approaches. We conclude by elucidating technical challenges and ethical considerations and briefly considering future directions.

SUMMARY

The integration of clinical data, patient derived data, histology and proteomics and genomics can enhance the work of clinicians in providing more accurate diagnoses and elevating understanding of disease progression. Implementation research needs to be performed to translate these algorithms to the clinical setting.

Usability of deep learning and H&E images predict disease outcome-emerging tool to optimize clinical trials

Understanding factors that impact prognosis for cancer patients have high clinical relevance for treatment decisions and monitoring of the disease outcome. Advances in artificial intelligence (AI) and digital pathology offer an exciting opportunity to capitalize on the use of whole slide images (WSIs) of hematoxylin and eosin (H&E) stained tumor tissue for objective prognosis and prediction of response to targeted therapies. AI models often require hand-delineated annotations for effective training which may not be readily available for larger data sets. In this study, we investigated whether AI models can be trained without region-level annotations and solely on patient-level survival data. We present a weakly supervised survival convolutional neural network (WSS-CNN) approach equipped with a visual attention mechanism for predicting overall survival. The inclusion of visual attention provides insights into regions of the tumor microenvironment with the pathological interpretation which may improve our understanding of the disease pathomechanism. We performed this analysis on two independent, multi-center patient data sets of lung (which is publicly available data) and bladder urothelial carcinoma. We perform univariable and multivariable analysis and show that WSS-CNN features are prognostic of overall survival in both tumor indications. The presented results highlight the significance of computational pathology algorithms for predicting prognosis using H&E stained images alone and underpin the use of computational methods to improve the efficiency of clinical trial studies.

A tool for federated training of segmentation models on whole slide images

The largest bottleneck to the development of convolutional neural network (CNN) models in the computational pathology domain is the collection and curation of diverse training datasets. Training CNNs requires large cohorts of image data, and model generalizability is dependent on training data heterogeneity. Including data from multiple centers enhances the generalizability of CNN-based models, but this is hindered by the logistical challenges of sharing medical data. In this paper, we explore the feasibility of training our recently developed cloud-based segmentation tool (Histo-Cloud) using federated learning. Using a dataset of renal tissue biopsies we show that federated training to segment interstitial fibrosis and tubular atrophy (IFTA) using datasets from three institutions is not found to be different from a training by pooling the data on one server when tested on a fourth (holdout) institution’s data. Further, training a model to segment glomeruli for a federated dataset (split by staining) demonstrates similar performance.

Unsupervised machine learning for identifying important visual features through bag-of-words using histopathology data from chronic kidney disease

Pathologists use visual classification to assess patient kidney biopsy samples when diagnosing the underlying cause of kidney disease. However, the assessment is qualitative, or semi-quantitative at best, and reproducibility is challenging. To discover previously unknown features which predict patient outcomes and overcome substantial interobserver variability, we developed an unsupervised bag-of-words model. Our study applied to the C-PROBE cohort of patients with chronic kidney disease (CKD). 107,471 histopathology images were obtained from 161 biopsy cores and identified important morphological features in biopsy tissue that are highly predictive of the presence of CKD both at the time of biopsy and in one year. To evaluate the performance of our model, we estimated the AUC and its 95% confidence interval. We show that this method is reliable and reproducible and can achieve 0.93 AUC at predicting glomerular filtration rate at the time of biopsy as well as predicting a loss of function at one year. Additionally, with this method, we ranked the identified morphological features according to their importance as diagnostic markers for chronic kidney disease. In this study, we have demonstrated the feasibility of using an unsupervised machine learning method without human input in order to predict the level of kidney function in CKD. The results from our study indicate that the visual dictionary, or visual image pattern, obtained from unsupervised machine learning can predict outcomes using machine-derived values that correspond to both known and unknown clinically relevant features.

Identification of glomerulosclerosis using IBM Watson and shallow neural networks

Background

Advanced stages of different renal diseases feature glomerular sclerosis at a histological level which is observed by light microscopy on tissue samples obtained by performing a kidney biopsy. Computer-aided diagnosis (CAD) systems leverage the potential of artificial intelligence (AI) in healthcare to support physicians in the diagnostic process.

Methods

We propose a novel CAD system that processes histological images and discriminates between sclerotic and non-sclerotic glomeruli. To this goal, we designed, tested, and compared two artificial neural network (ANN) classifiers. The former implements a shallow ANN classifying hand-crafted features extracted from Regions of Interest (ROIs) by means of image-processing procedures. The latter, instead, employs the IBM Watson Visual Recognition System, which uses a deep artificial neural network making decisions taking the images as input, without the need to design any procedure for describing images with features. The input dataset consisted of 428 sclerotic glomeruli and 2344 non-sclerotic glomeruli derived from images of kidney biopsies scanned by the Aperio ScanScope System.

Results

Both AI approaches allowed to very accurately distinguish (mean MCC 0.95 and mean Accuracy 0.99) between sclerotic and non-sclerotic glomeruli. Although the systems may seem interchangeable, the approach based on feature extraction and classification would allow clinicians to gain information on the most discriminating features. In fact, further procedures could explain the classifier’s decision by analysing which subset of features impacted the most on the final decision.

Conclusions

We developed a customizable support system that can facilitate the work of renal pathologists both in clinical and research settings.

Graphical abstract

Supplementary Information

The online version contains supplementary material available at 10.1007/s40620-021-01200-0.

Systematic reporting of medical kidney biopsies

The medical kidney biopsy has an important added value in patient care in nephrology. In order to facilitate communication between the pathologist and the nephrologist and optimize patient care, both the content and form of the medical kidney biopsy report matter. With some exceptions, current guidelines in nephropathology focus on content rather than form and, not surprisingly, medical kidney biopsy reports mostly consist of unformatted and often lengthy free text. In contrast, in oncology, a more systematic reporting called synoptic reporting has become the dominant method. Synoptic formats enable complete, concise and clear reports that comply with agreed upon standards. In this review we discuss the possibilities of systematic reporting in nephropathology (including synoptic reporting). Furthermore, we explore applications of electronic formats with structured data and usage of international terminologies or coding systems. The benefits include the timely collection of high-quality data for benchmarking between centres as well as for epidemiologic and other research studies. Based on these developments, a scenario for future medical kidney biopsy reporting is drafted.

Assessing and counteracting fibrosis is a cornerstone of the treatment of CKD secondary to systemic and renal limited autoimmune disorders

Chronic kidney disease (CKD) is an increasing cause of morbidity and mortality worldwide. Besides the higher prevalence of diabetes, hypertension and aging worldwide, immune mediated disorders remain an important cause of kidney disease and are especially prevalent in young adults. Regardless of the initial insult, final pathway to CKD and kidney failure is always the loss of normal tissue and fibrosis development, in which the dynamic equilibrium between extracellular matrix synthesis and degradation is disturbed, leading to excessive production and accumulation. During fibrosis, a multitude of cell types intervene at different levels, but myofibroblasts and inflammatory cells are considered critical in the process. They exert their effects through different molecular pathways, of which transforming growth factor β (TGF-β) has demonstrated to be of particular importance. Additionally, CKD itself promotes fibrosis due to the accumulation of toxins and hormonal changes, and proteinuria is simultaneously a manifestation of CKD and a specific driver of renal fibrosis. Pathways involved in renal fibrosis and CKD are closely interrelated, and although important advances have been made in our knowledge of them, it is still necessary to translate them into clinical practice. Given the complexity of this process, it is highly likely that its treatment will require a multi-target strategy to control the origin of the damage but also the mechanisms that perpetuate it. Fortunately, rapid technology development over the last years and new available drugs in the nephrologist's armamentarium give reasons for optimism that more personalized assistance for CKD and renal fibrosis will appear in the future.

Artificial Intelligence Assessment of Renal Scarring (AIRS Study)

Background

The goal of the Artificial Intelligence in Renal Scarring (AIRS) study is to develop machine learning tools for noninvasive quantification of kidney fibrosis from imaging scans.

Methods

We conducted a retrospective analysis of patients who had one or more abdominal computed tomography (CT) scans within 6 months of a kidney biopsy. The final cohort encompassed 152 CT scans from 92 patients, which included images of 300 native kidneys and 76 transplant kidneys. Two different convolutional neural networks (slice-level and voxel-level classifiers) were tested to differentiate severe versus mild/moderate kidney fibrosis (≥50% versus <50%). Interstitial fibrosis and tubular atrophy scores from kidney biopsy reports were used as ground-truth.

Results

The two machine learning models demonstrated similar positive predictive value (0.886 versus 0.935) and accuracy (0.831 versus 0.879).

Conclusions

In summary, machine learning algorithms are a promising noninvasive diagnostic tool to quantify kidney fibrosis from CT scans. The clinical utility of these prediction tools, in terms of avoiding renal biopsy and associated bleeding risks in patients with severe fibrosis, remains to be validated in prospective clinical trials.

A Higher Foci Density of Interstitial Fibrosis and Tubular Atrophy Predicts Progressive CKD after a Radical Nephrectomy for Tumor

BACKGROUND

Chronic tubulointerstitial injury on kidney biopsy is usually quantified by the percentage of cortex with interstitial fibrosis/tubular atrophy (IF/TA). Whether other patterns of IF/TA or inflammation in the tubulointerstitium have prognostic importance beyond percentage IF/TA is unclear.

METHODS

We obtained, stained, and digitally scanned full cortical thickness wedge sections of renal parenchyma from patients who underwent a radical nephrectomy for a tumor over 2000-2015, and morphometrically analyzed the tubulointerstitium of the cortex for percentage IF/TA, IF/TA density (foci per mm² cortex), percentage subcapsular IF/TA, striped IF/TA, percentage inflammation (both within and outside IF/TA regions), and percentage subcapsular inflammation. Patients were followed with visits every 6-12 months. Progressive CKD was defined as dialysis, kidney transplantation, or 40% decline from the postnephrectomy eGFR. Cox models assessed the risk of CKD or noncancer mortality with morphometric measures of tubulointerstitial injury after adjustment for the percentage IF/TA and clinical characteristics.

RESULTS

Among 936 patients (mean age, 64 years; postnephrectomy baseline eGFR, 48 ml/min per 1.73m²), 117 progressive CKD events and 183 noncancer deaths occurred over a median 6.4 years. Higher IF/TA density predicted both progressive CKD and noncancer mortality after adjustment for percentage IF/TA and predicted progressive CKD after further adjustment for clinical characteristics. Independent of percentage IF/TA, age, and sex, higher IF/TA density correlated with lower eGFR, smaller nonsclerosed glomeruli, more global glomerulosclerosis, and smaller total cortical volume.

CONCLUSIONS

Higher density of IF/TA foci (a more scattered pattern with more and smaller foci) predicts higher risk of progressive CKD after radical nephrectomy compared with the same percentage of IF/TA but with fewer and larger foci.

Glomerular Disease Classification and Lesion Identification by Machine Learning

Background

Classification of glomerular diseases and identification of glomerular lesions require careful morphological examination by experienced nephropathologists, which is labor-intensive, time-consuming, and prone to interobserver variability. In this regard, recent advance in machine learning-based image analysis is promising.

Methods

We combined Mask Region-based Convolutional Neural Networks (Mask R–CNN) with an additional classification step to build a glomerulus detection model using human kidney biopsy samples. A Long Short-Term Memory (LSTM) recurrent neural network was applied for glomerular disease classification, and another two-stage model using ResNeXt-101 was constructed for glomerular lesion identification in cases of lupus nephritis.

Results

The detection model showed state-of-the-art performance on variedly stained slides with F1 scores up to 0.944. The disease classification model showed good accuracies up to 0.940 on recognizing different glomerular diseases based on H&E whole slide images. The lesion identification model demonstrated high discriminating power with area under the receiver operating characteristic curve up to 0.947 for various glomerular lesions. Models showed good generalization on external testing datasets.

Conclusion

This study is the first-of-its-kind showing how each step of kidney biopsy interpretation carried out by nephropathologists can be captured and simulated by machine learning models. The models were integrated into a whole slide image viewing and annotating platform to enable nephropathologists to review, correct, and confirm the inference results. Further improvement on model performances and incorporating inputs from immunofluorescence, electron microscopy, and clinical data might realize actual clinical use.

Machine Learning Applications in Nephrology: A Bibliometric Analysis Comparing Kidney Studies to Other Medicine Subspecialities

RATIONALE & OBJECTIVES

Artificial intelligence driven by machine learning algorithms is being increasingly employed for early detection, disease diagnosis, and clinical management. We explored the use of machine learning-driven advancements in kidney research compared with other organ-specific fields.

STUDY DESIGN

Cross-sectional bibliometric analysis.

SETTING & PARTICIPANTS

ISI Web of Science database was queried using specific Medical Subject Headings (MeSH) terms about the organ system, journal International Standard Serial Number, and research methodology. In parallel, we screened the National Institutes of Health (NIH) RePORTER website to explore funded grants that proposed the use of machine learning as a methodology.

PREDICTORS

Number of publications using machine learning as a research method.

OUTCOME

Articles were characterized by research methodology among 5 organ systems (brain, heart, kidney, liver, and lung). Grants funded by NIH for machine learning were characterized by study sections.

ANALYTICAL APPROACH

Percentages of articles using machine learning and other research methodologies were compared among 5 organ systems.

RESULTS

Machine learning-based articles that are focused on the kidney accounted for 3.2% of the total relevant articles from the 5 organ systems. Specifically, brain research published over 19-fold higher number of articles than kidney research. As compared with machine learning, conventional statistical approaches such as the Cox proportional hazard model were used 9-fold higher in articles related to kidney research. In general, a lower utilization of machine learning-based approaches was observed in organ-specific specialty journals than the broad interdisciplinary journals. The digestive disease, kidney, and urology study sections funded 122 applications proposing machine learning-based approaches compared to 265 applications from the neurology, neuropsychology, and neuropathology study sections.

LIMITATIONS

Observational study.

CONCLUSIONS

Our analysis suggests lowest use of machine learning as a research tool among kidney researchers compared with other organ-specific researchers, underscoring a need to better inform the kidney research community about this emerging data analytic tool.

Deep-Learning-Driven Quantification of Interstitial Fibrosis in Digitized Kidney Biopsies

Interstitial fibrosis and tubular atrophy (IFTA) on a renal biopsy are strong indicators of disease chronicity and prognosis. Techniques that are typically used for IFTA grading remain manual, leading to variability among pathologists. Accurate IFTA estimation using computational techniques can reduce this variability and provide quantitative assessment. Using trichrome-stained whole-slide images (WSIs) processed from human renal biopsies, we developed a deep-learning framework that captured finer pathologic structures at high resolution and overall context at the WSI level to predict IFTA grade. WSIs (n = 67) were obtained from The Ohio State University Wexner Medical Center. Five nephropathologists independently reviewed them and provided fibrosis scores that were converted to IFTA grades: ≤10% (none or minimal), 11% to 25% (mild), 26% to 50% (moderate), and >50% (severe). The model was developed by associating the WSIs with the IFTA grade determined by majority voting (reference estimate). Model performance was evaluated on WSIs (n = 28) obtained from the Kidney Precision Medicine Project. There was good agreement on the IFTA grading between the pathologists and the reference estimate (κ = 0.622 ± 0.071). The accuracy of the deep-learning model was 71.8% ± 5.3% on The Ohio State University Wexner Medical Center and 65.0% ± 4.2% on Kidney Precision Medicine Project data sets. Our approach to analyzing microscopic- and WSI-level changes in renal biopsies attempts to mimic the pathologist and provides a regional and contextual estimation of IFTA. Such methods can assist clinicopathologic diagnosis.

Image Analysis Pipeline for Renal Allograft Evaluation and Fibrosis Quantification

INTRODUCTION

Digital pathology improves the standardization and reproducibility of kidney biopsy specimen assessment. We developed a pipeline allowing the analysis of many images without requiring human preprocessing and illustrate its use with a simple algorithm for quantification of interstitial fibrosis on a large dataset of kidney allograft biopsy specimens.

METHODS

Masson trichrome-stained images from kidney allograft biopsy specimens were used to train and validate a glomeruli detection algorithm using a VGG19 convolutional neural network and an automatic cortical region of interest (ROI) selection algorithm including cortical regions containing all predicted glomeruli. A positive-pixel count algorithm was used to quantify interstitial fibrosis on the ROIs and the association between automatic fibrosis and pathologist evaluation, estimated glomerular filtration rate (GFR) and allograft survival was assessed.

RESULTS

The glomeruli detection (F1 score of 0.87) and ROIs selection (F1 score 0.83 [SD 0.13]) algorithms displayed high accuracy. The correlation between the automatic fibrosis quantification on manually and automatically selected ROIs was high (r = 1.00 [0.99-1.00]). Automatic fibrosis quantification was only moderately correlated with pathologists' assessment and was not significantly associated with eGFR or allograft survival.

CONCLUSION

This pipeline can automatically and accurately detect glomeruli and select cortical ROIs that can easily be used to develop, validate, and apply image analysis algorithms.

AI applications in renal pathology

The explosive growth of artificial intelligence (AI) technologies, especially deep learning methods, has been translated at revolutionary speed to efforts in AI-assisted healthcare. New applications of AI to renal pathology have recently become available, driven by the successful AI deployments in digital pathology. However, synergetic developments of renal pathology and AI require close interdisciplinary collaborations between computer scientists and renal pathologists. Computer scientists should understand that not every AI innovation is translatable to renal pathology, while renal pathologists should capture high-level principles of the relevant AI technologies. Herein, we provide an integrated review on current and possible future applications in AI-assisted renal pathology, by including perspectives from computer scientists and renal pathologists. First, the standard stages, from data collection to analysis, in full-stack AI-assisted renal pathology studies are reviewed. Second, representative renal pathology-optimized AI techniques are introduced. Last, we review current clinical AI applications, as well as promising future applications with the recent advances in AI.

An Ensemble Model for Prediction of Vancomycin Trough Concentrations in Pediatric Patients

Purpose

This study aimed to establish an optimal model to predict vancomycin trough concentrations by using machine learning.

Patients and Methods

We enrolled 407 pediatric patients (age < 18 years) who received vancomycin intravenously and underwent therapeutic drug monitoring from June 2013 to April 2020 at Xinhua Hospital affiliated to Shanghai Jiaotong University School of Medicine. The median (interquartile range) age and weight of the patients were 2 (0.63–5) years and 12 (7.8–19) kg. Vancomycin trough concentrations were considered as the target variable, and eight different algorithms were used for predictive performance comparison. The whole dataset (407 cases) was divided into training group and testing group at the ratio of 80%: 20%, which were 325 and 82 cases, respectively.

Results

Ultimately, five algorithms (XGBoost, GBRT, Bagging, ExtraTree and decision tree) with high R² (0.657, 0.514, 0.468, 0.425 and 0.450, respectively) were selected and further ensembled to establish the final model and achieve an optimal result. For missing data, through filling the missing values and model ensemble, we obtained R²=0.614, MAE=3.32, MSE=24.39, RMSE=4.94 and a prediction accuracy of 51.22% (predicted trough concentration within ±30% of the actual trough concentration). In comparison with the pharmacokinetic models (R²=0.3), the machine learning model works better in model fitting and has better prediction accuracy.

Conclusion

Therefore, the ensemble model is useful for the vancomycin concentration prediction, especially in the population of children with great individual variation. As machine learning methods evolve, the clinical value of the ensemble model will be demonstrated in the clinical practice.

Prediction of vancomycin dose on high-dimensional data using machine learning techniques

OBJECTIVES

Despite therapeutic vancomycin is regularly monitored, its dose requirements vary considerably between individuals. Various innovative vancomycin dosing strategies have been developed for dose optimization; however, the utilization of individual factors and extensibility is insufficient. We aimed to develop an optimal dosing algorithm for vancomycin based on the high-dimensional data using the proposed variable engineering and machine-learning methods.

METHODS

This study proposed a variable engineering process that automatically generates second-order variable interactions. We performed an initial examination of independent variables and interactive variables using eXtreme Gradient Boosting. The vancomycin dose prediction model was established based on the derived variables.

RESULTS

Based on the evaluation of the model performance in the validation cohort, our algorithm accounted for 67.5% of variations in the vancomycin doses. Subgroup analysis showed better performance in patients with medium and high body weight (with the ideal predictive percentage of 72.7% and 73.7%), and low and medium levels of serum creatinine (with the ideal predictive percentage of 77.8% and 73.1%) than in other groups.

CONCLUSION

The new vancomycin dose prediction model is potentially useful for patients whose population profiles are similar to those of our patients and yielded desired reference of clinical indicators with specific breakpoints.

Automated Computational Detection of Interstitial Fibrosis, Tubular Atrophy, and Glomerulosclerosis

BACKGROUND

Interstitial fibrosis, tubular atrophy (IFTA), and glomerulosclerosis are indicators of irrecoverable kidney injury. Modern machine learning (ML) tools have enabled robust, automated identification of image structures that can be comparable with analysis by human experts. ML algorithms were developed and tested for the ability to replicate the detection and quantification of IFTA and glomerulosclerosis that renal pathologists perform.

METHODS

A renal pathologist annotated renal biopsy specimens from 116 whole-slide images (WSIs) for IFTA and glomerulosclerosis. A total of 79 WSIs were used for training different configurations of a convolutional neural network (CNN), and 17 and 20 WSIs were used as internal and external testing cases, respectively. The best model was compared against the input of four renal pathologists on 20 new testing slides. Further, for 87 testing biopsy specimens, IFTA and glomerulosclerosis measurements made by pathologists and the CNN were correlated to patient outcome using classic statistical tools.

RESULTS

The best average performance across all image classes came from a DeepLab version 2 network trained at 40× magnification. IFTA and glomerulosclerosis percentages derived from this CNN achieved high levels of agreement with four renal pathologists. The pathologist- and CNN-based analyses of IFTA and glomerulosclerosis showed statistically significant and equivalent correlation with all patient-outcome variables.

CONCLUSIONS

ML algorithms can be trained to replicate the IFTA and glomerulosclerosis assessment performed by renal pathologists. This suggests computational methods may be able to provide a standardized approach to evaluate the extent of chronic kidney injury in situations in which renal-pathologist time is restricted or unavailable.

Microscope-Based Automated Quantification of Liver Fibrosis in Mice Using a Deep Learning Algorithm

In preclinical studies that involve animal models for hepatic fibrosis, accurate quantification of the fibrosis is of utmost importance. The use of digital image analysis based on deep learning artificial intelligence (AI) algorithms can facilitate accurate evaluation of liver fibrosis in these models. In the present study, we compared the quantitative evaluation of collagen proportionate area in the carbon tetrachloride model of liver fibrosis in the mouse by a newly developed AI algorithm to the semiquantitative assessment of liver fibrosis performed by a board-certified toxicologic pathologist. We found an excellent correlation between the 2 methods of assessment, most evident in the higher magnification (×40) as compared to the lower magnification (×10). These findings strengthen the confidence of using digital tools in the toxicologic pathology field as an adjunct to an expert toxicologic pathologist.

Artificial intelligence and algorithmic computational pathology: an introduction with renal allograft examples

Whole slide imaging, which is an important technique in the field of digital pathology, has recently been the subject of increased interest and avenues for utilisation, and with more widespread whole slide image (WSI) utilisation, there will also be increased interest in and implementation of image analysis (IA) techniques. IA includes artificial intelligence (AI) and targeted or hypothesis-driven algorithms. In the overall pathology field, the number of citations related to these topics has increased in recent years. Renal pathology is one anatomical pathology subspecialty that has utilised WSIs and IA algorithms; it can be argued that renal transplant pathology could be particularly suited for whole slide imaging and IA, as renal transplant pathology is frequently classified by use of the semiquantitative Banff classification of renal allograft pathology. Hypothesis-driven/targeted algorithms have been used in the past for the assessment of a variety of features in the kidney (e.g. interstitial fibrosis, tubular atrophy, inflammation); in recent years, the amount of research has particularly increased in the area of AI/machine learning for the identification of glomeruli, for histological segmentation, and for other applications. Deep learning is the form of machine learning that is most often used for such AI approaches to the 'big data' of pathology WSIs, and deep learning methods such as artificial neural networks (ANNs)/convolutional neural networks (CNNs) are utilised. Unsupervised and supervised AI algorithms can be employed to accomplish image or semantic classification. In this review, AI and other IA algorithms applied to WSIs are discussed, and examples from renal pathology are covered, with an emphasis on renal transplant pathology.

Deep learning for the classification of medical kidney disease: a pilot study for electron microscopy

Artificial intelligence (AI) is a new frontier and often enigmatic for medical professionals. Cloud computing could open up the field of computer vision to a wider medical audience and deep learning on the cloud allows one to design, develop, train and deploy applications with ease. In the field of histopathology, the implementation of various applications in AI has been successful for whole slide images rich in biological diversity. However, the analysis of other tissue medias, including electron microscopy, is yet to be explored. The present study aims to evaluate deep learning for the classification of medical kidney disease on electron microscopy images: amyloidosis, diabetic glomerulosclerosis, membranous nephropathy, membranoproliferative glomerulonephritis (MPGN), and thin basement membrane disease (TBMD). We found good overall classification with the MedKidneyEM-v1 Classifier and when looking at normal and diseased kidneys, the average area under the curve for precision and recall was 0.841. The average area under the curve for precision and recall on the disease only cohort was 0.909. Digital pathology will shape a new era for medical kidney disease and the present study demonstrates the feasibility of deep learning for electron microscopy. Future approaches could be used by renal pathologists to improve diagnostic concordance, determine therapeutic strategies, and optimize patient outcomes in a true clinical environment.

Kidney Level Lupus Nephritis Classification Using Uncertainty Guided Bayesian Convolutional Neural Networks

The kidney biopsy based diagnosis of Lupus Nephritis (LN) is characterized by low inter-observer agreement, with misdiagnosis being associated with increased patient morbidity and mortality. Although various Computer Aided Diagnosis (CAD) systems have been developed for other nephrohistopathological applications, little has been done to accurately classify kidneys based on their kidney level Lupus Glomerulonephritis (LGN) scores. The successful implementation of CAD systems has also been hindered by the diagnosing physician's perceived classifier strengths and weaknesses, which has been shown to have a negative effect on patient outcomes. We propose an Uncertainty-Guided Bayesian Classification (UGBC) scheme that is designed to accurately classify control, class I/II, and class III/IV LGN (3 class) at both the glomerular-level classification task (26,634 segmented glomerulus images) and the kidney-level classification task (87 MRL/lpr mouse kidney sections). Data annotation was performed using a high throughput, bulk labeling scheme that is designed to take advantage of Deep Neural Network's (or DNNs) resistance to label noise. Our augmented UGBC scheme achieved a 94.5% weighted glomerular-level accuracy while achieving a weighted kidney-level accuracy of 96.6%, improving upon the standard Convolutional Neural Network (CNN) architecture by 11.8% and 3.5% respectively.

Artificial intelligence driven next-generation renal histomorphometry

PURPOSE OF REVIEW

Successful integration of artificial intelligence into extant clinical workflows is contingent upon a number of factors including clinician comprehension and interpretation of computer vision. This article discusses how image analysis and machine learning have enabled comprehensive characterization of kidney morphology for development of automated diagnostic and prognostic renal pathology applications.

RECENT FINDINGS

The primordial digital pathology informatics work employed classical image analysis and machine learning to prognosticate renal disease. Although this classical approach demonstrated tremendous potential, subsequent advancements in hardware technology rendered artificial neural networks '(ANNs) the method of choice for machine vision in computational pathology'. Offering rapid and reproducible detection, characterization and classification of kidney morphology, ANNs have facilitated the development of diagnostic and prognostic applications. In addition, modern machine learning with ANNs has revealed novel biomarkers in kidney disease, demonstrating the potential for machine vision to elucidate novel pathologic mechanisms beyond extant clinical knowledge.

SUMMARY

Despite the revolutionary developments potentiated by modern machine learning, several challenges remain, including data quality control and curation, image annotation and ontology, integration of multimodal data and interpretation of machine vision or 'opening the black box'. Resolution of these challenges will not only revolutionize diagnostic pathology but also pave the way for precision medicine and integration of artificial intelligence in the process of care.

Machine learning in nephrology: scratching the surface

Machine learning shows enormous potential in facilitating decision-making regarding kidney diseases. With the development of data preservation and processing, as well as the advancement of machine learning algorithms, machine learning is expected to make remarkable breakthroughs in nephrology. Machine learning models have yielded many preliminaries to moderate and several excellent achievements in the fields, including analysis of renal pathological images, diagnosis and prognosis of chronic kidney diseases and acute kidney injury, as well as management of dialysis treatments. However, it is just scratching the surface of the field; at the same time, machine learning and its applications in renal diseases are facing a number of challenges. In this review, we discuss the application status, challenges and future prospects of machine learning in nephrology to help people further understand and improve the capacity for prediction, detection, and care quality in kidney diseases.

Recent advances in medical image processing for the evaluation of chronic kidney disease

Assessment of renal function and structure accurately remains essential in the diagnosis and prognosis of Chronic Kidney Disease (CKD). Advanced imaging, including Magnetic Resonance Imaging (MRI), Ultrasound Elastography (UE), Computed Tomography (CT) and scintigraphy (PET, SPECT) offers the opportunity to non-invasively retrieve structural, functional and molecular information that could detect changes in renal tissue properties and functionality. Currently, the ability of artificial intelligence to turn conventional medical imaging into a full-automated diagnostic tool is widely investigated. In addition to the qualitative analysis performed on renal medical imaging, texture analysis was integrated with machine learning techniques as a quantification of renal tissue heterogeneity, providing a promising complementary tool in renal function decline prediction. Interestingly, deep learning holds the ability to be a novel approach of renal function diagnosis. This paper proposes a survey that covers both qualitative and quantitative analysis applied to novel medical imaging techniques to monitor the decline of renal function. First, we summarize the use of different medical imaging modalities to monitor CKD and then, we show the ability of Artificial Intelligence (AI) to guide renal function evaluation from segmentation to disease prediction, discussing how texture analysis and machine learning techniques have emerged in recent clinical researches in order to improve renal dysfunction monitoring and prediction. The paper gives a summary about the role of AI in renal segmentation.

Fibrosis in Chronic Kidney Disease: Pathogenesis and Consequences

Fibrosis is a process characterized by an excessive accumulation of the extracellular matrix as a response to different types of tissue injuries, which leads to organ dysfunction. The process can be initiated by multiple and different stimuli and pathogenic factors which trigger the cascade of reparation converging in molecular signals responsible of initiating and driving fibrosis. Though fibrosis can play a defensive role, in several circumstances at a certain stage, it can progressively become an uncontrolled irreversible and self-maintained process, named pathological fibrosis. Several systems, molecules and responses involved in the pathogenesis of the pathological fibrosis of chronic kidney disease (CKD) will be discussed in this review, putting special attention on inflammation, renin-angiotensin system (RAS), parathyroid hormone (PTH), fibroblast growth factor 23 (FGF23), Klotho, microRNAs (miRs), and the vitamin D hormonal system. All of them are key factors of the core and regulatory pathways which drive fibrosis, having a great negative kidney and cardiac impact in CKD.