Deep Learning Global Glomerulosclerosis in Transplant Kidney Frozen Sections

Recruiting Teacher IF Modality for Nephropathy Diagnosis: A Customized Distillation Method With Attention-Based Diffusion Network

The joint use of multiple modalities for medical image processing has been widely studied in recent years. The fusion of information from different modalities has demonstrated the performance improvement for a lot of medical tasks. For nephropathy diagnosis, immunofluorescence (IF) is one of the most widely-used multi-modality medical images due to its ease of acquisition and the effectiveness for certain nephropathy. However, the existing methods mainly assume different modalities have the equal effect on the diagnosis task, failing to exploit multi-modality knowledge in details. To avoid this disadvantage, this paper proposes a novel customized multi-teacher knowledge distillation framework to transfer knowledge from the trained single-modality teacher networks to a multi-modality student network. Specifically, a new attention-based diffusion network is developed for IF based diagnosis, considering global, local, and modality attention. Besides, a teacher recruitment module and diffusion-aware distillation loss are developed to learn to select the effective teacher networks based on the medical priors of the input IF sequence. The experimental results in the test and external datasets show that the proposed method has a better nephropathy diagnosis performance and generalizability, in comparison with the state-of-the-art methods.

Multi-stain deep learning prediction model of treatment response in lupus nephritis based on renal histopathology

The response of the kidney after induction treatment is one of the determinants of prognosis in lupus nephritis, but effective predictive tools are lacking. Here, we sought to apply deep learning approaches on kidney biopsies for treatment response prediction in lupus nephritis. Patients who received cyclophosphamide or mycophenolate mofetil as induction treatment were included, and the primary outcome was 12-month treatment response, complete response defined as 24-h urinary protein under 0.5 g with normal estimated glomerular filtration rate or within 10% of normal range. The model development cohort included 245 patients (880 digital slides), and the external test cohort had 71 patients (258 digital slides). Deep learning models were trained independently on hematoxylin and eosin-, periodic acid-Schiff-, periodic Schiff-methenamine silver- and Masson's trichrome-stained slides at multiple magnifications and integrated to predict the primary outcome of complete response to therapy at 12 months. Single-stain models showed area under the curves of 0.813, 0.841, 0.823, and 0.862, respectively. Further, integration of the four models into a multi-stain model achieved area under the curves of 0.901 and 0.840 on internal validation and external testing, respectively, which outperformed conventional clinicopathologic parameters including estimated glomerular filtration rate, chronicity index and reduction in proteinuria at three months. Decisive features uncovered by visualization for model prediction included tertiary lymphoid structures, glomerulosclerosis, interstitial fibrosis and tubular atrophy. Our study demonstrated the feasibility of utilizing deep learning on kidney pathology to predict treatment response for lupus patients. Further validation is required before the model could be implemented for risk stratification and to aid in making therapeutic decisions in clinical practice.

Detection of metastatic breast carcinoma in sentinel lymph node frozen sections using an artificial intelligence-assisted system

We developed an automatic method based on a convolutional neural network (CNN) that identifies metastatic lesions in whole slide images (WSI) of intraoperative frozen sections from sentinel lymph nodes in breast cancer. A total of 954 sentinel lymph node frozen sections, encompassing all types of breast cancer, were collected and examined at our institution between January 1, 2021, and September 27, 2022. Seventy-two cases from a total of 954 cases, including 50 macrometastases, 16 micrometastases, and 6 negatives, were selected and annotated for training a model, which was a self-developed platform (EasyPath) built using R 4.1.3 accompanied by Python 3.7 as the reticulate package. Another 105 metastasis-positive and 80 metastasis-negative cases from the remaining 882 cases were collected to validate and test the algorithm. Our algorithm successfully identified 103 cases (98 %) of metastases, including 85 cases of macrometastases and 18 cases of micrometastasis, with the inference time averaging 87.3 seconds per case. The algorithm correctly identified all of the macrometastases and 90 % of the micrometastases. The sensitivity for detecting micrometastases significantly outperformed that of the pathologists (p = 0.014, McNemar's test). Furthermore, we provide a workflow that deploys our algorithm into the daily practice of assessing intraoperative frozen sections. Our algorithm provides a robust backup for detecting metastases, particularly for high sensitivity for micrometastases, which will minimize errors in the pathological assessment of intraoperative frozen section of sentinel lymph nodes.

Detection and classification of glomerular lesions in kidney graft biopsies using 2-stage deep learning approach

Acute allograft rejection in patients undergoing renal transplantation is diagnosed through histopathological analysis of renal graft biopsies, which can be used to quantify elementary lesions. However, quantification of elementary lesions requires considerable expertise, time, and effort. Using a 2-stage classification strategy, we sought to examine the effectiveness of deep learning in detecting and classifying glomeruli into 4 groups, namely normal, abnormal, sclerotic, and glomerulitis, as a potential biopsy triage system focused on transplant rejection. We used the U-Net model to build a glomeruli detection model using 137 kidney biopsy slides obtained from 80 kidney transplant patients. The median age of the patients was 52 (19-74) years, with 65% being men and 35% women. MobileNetV2 and VGG16 models were compared using a 2-stage classification strategy. In the first classification step, the models classified glomeruli into sclerotic and nonsclerotic glomeruli. In the second classification step, the nonsclerotic glomeruli from the first step were classified as normal, abnormal, or glomerulitis. The U-Net model achieved satisfactory detection (Dice coefficient = 0.90), and the MobileNetV2 model was the best for the 2 classification steps, with F1 scores of 0.85, 0.91, 0.98, and 0.92 for normal, abnormal, sclerotic, and glomerulitis, respectively. The 2-stage classification strategy identifies sclerotic glomeruli and abnormal glomeruli relative to permeable glomeruli and quantifies glomerulitis with significant accuracy while avoiding bias from abnormal glomeruli that do not have glomerulitis, providing valuable diagnostic information.

A novel automated method for comprehensive renal cast quantification from rat kidney sections using QuPath

The presence of tubular casts within the kidney serves as an important feature when assessing the degree of renal injury. Quantification of renal tubular casts has been historically difficult due to varying cast morphologies, protein composition, and stain uptake properties, even within the same kidney. Color thresholding remains one of the most common methods of quantification in the laboratory when assessing the percentage of renal casting; however, this method is unable to account for tubule casts stained a variety of colors. We have developed a novel method of automated cast quantification using the machine learning pixel classification tool within QuPath, an open-source software designed for digital pathology. We demonstrated the usability of this method in male and female Dahl salt-sensitive rats fed either low or high salt for 2 wk and male Sprague-Dawley rats treated with podotoxin puromycin aminonucleoside (PAN). Briefly, the pixel classifier was trained to identify kidney tissue, various cast color types, and slide backgrounds. Following the development of the pixel classifier, we applied it to the sample population and compared the results with those of other methods of cast quantification, including color thresholding and manual quantification. We found that the automated pixel classifier designed in QuPath was able to comprehensively quantify metachromatic tubular casts compared with color thresholding. This novel method of cast quantification provides researchers with the ability to reliably automate cast quantification that is both comprehensive and efficient.NEW & NOTEWORTHY We developed a method of automated renal tubule cast quantification using a machine learning-based pixel classifier within QuPath, an open-source image analysis software. The advantages of this approach are demonstrated by rigorous comparison of quantification methods on a set of Masson's trichrome-stained kidney sections from high- and low-salt fed salt-sensitive Dahl rats. Researchers are provided with step-by-step instructions for creating and training a pixel classifier in QuPath for application to image analysis.

Development of a deep learning algorithm for Paneth cell density quantification for inflammatory bowel disease

BACKGROUND

Alterations in ileal Paneth cell (PC) density have been described in gut inflammatory diseases such as Crohn's disease (CD) and could be used as a biomarker for disease prognosis. However, quantifying PCs is time-intensive, a barrier for clinical workflow. Deep learning (DL) has transformed the development of robust and accurate tools for complex image evaluation. Our aim was to use DL to quantify PCs for use as a quantitative biomarker.

METHODS

A retrospective cohort of whole slide images (WSI) of ileal tissue samples from patients with/without inflammatory bowel disease (IBD) was used for the study. A pathologist-annotated training set of WSI were used to train a U-net two-stage DL model to quantify PC number, crypt number, and PC density. For validation, a cohort of 48 WSIs were manually quantified by study pathologists and compared to the DL algorithm, using root mean square error (RMSE) and the coefficient of determination (r2) as metrics. To test the value of PC quantification as a biomarker, resection specimens from patients with CD (n = 142) and without IBD (n = 48) patients were analysed with the DL model. Finally, we compared time to disease recurrence in patients with CD with low versus high DL-quantified PC density using Log-rank test.

FINDINGS

Initial one-stage DL model showed moderate accuracy in predicting PC density in cross-validation tests (RMSE = 1.880, r2 = 0.641), but adding a second stage significantly improved accuracy (RMSE = 0.802, r2 = 0.748). In the validation of the two-stage model compared to expert pathologists, the algorithm showed good performance up to RMSE = 1.148, r2 = 0.708. The retrospective cross-sectional cohort had mean ages of 62.1 years in the patients without IBD and 38.6 years for the patients with CD. In the non-IBD cohort, 43.75% of the patients were male, compared to 49.3% of the patients with CD. Analysis by the DL model showed significantly higher PC density in non-IBD controls compared to the patients with CD (4.04 versus 2.99 PC/crypt). Finally, the algorithm quantification of PCs density in patients with CD showed patients with the lowest 25% PC density (Quartile 1) have significantly shorter recurrence-free interval (p = 0.0399).

INTERPRETATION

The current model performance demonstrates the feasibility of developing a DL-based tool to measure PC density as a predictive biomarker for future clinical practice.

FUNDING

This study was funded by the National Institutes of Health (NIH).

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Measurement Matters: A Metrological Approach to Renal Preimplantation Biopsy Evaluation to Address Uncertainty in Organ Selection

Background

Preimplantation biopsy combines measurements of injury into a composite index to inform organ acceptance. The uncertainty in these measurements remains poorly characterized, raising concerns variability may contribute to inappropriate clinical decisions.

Methods

We adopted a metrological approach to evaluate biopsy score reliability. Variability was assessed by performing repeat biopsies (n = 293) on discarded allografts (n = 16) using 3 methods (core, punch, and wedge). Uncertainty was quantified using a bootstrapping analysis. Observer effects were controlled by semi-blinded scoring, and the findings were validated by comparison with standard glass evaluation.

Results

The surgical method strongly determined the size (core biopsy area 9.04 mm2, wedge 37.9 mm2) and, therefore, yield (glomerular yield r = 0.94, arterial r = 0.62) of each biopsy. Core biopsies yielded inadequate slides most frequently. Repeat biopsy of the same kidney led to marked variation in biopsy scores. In 10 of 16 cases, scores were contradictory, crossing at least 1 decision boundary (ie, to transplant or to discard). Bootstrapping demonstrated significant uncertainty associated with single-slide assessment; however, scores were similar for paired kidneys from the same donor.

Conclusions

Our investigation highlights the risks of relying on single-slide assessment to quantify organ injury. Biopsy evaluation is subject to uncertainty, meaning each slide is better conceptualized as providing an estimate of the kidney's condition rather than a definitive result. Pooling multiple assessments could improve the reliability of biopsy analysis, enhancing confidence. Where histological quantification is necessary, clinicians should seek to develop new protocols using more tissue and consider automated methods to assist pathologists in delivering analysis within clinical time frames.

Vision transformer introduces a new vitality to the classification of renal pathology

Recent advancements in computer vision within the field of artificial intelligence (AI) have made significant inroads into the medical domain. However, the application of AI for classifying renal pathology remains challenging due to the subtle variations in multiple renal pathological classifications. Vision Transformers (ViT), an adaptation of the Transformer model for image recognition, have demonstrated superior capabilities in capturing global features and providing greater explainability. In our study, we developed a ViT model using a diverse set of stained renal histopathology images to evaluate its effectiveness in classifying renal pathology. A total of 1861 whole slide images (WSI) stained with HE, MASSON, PAS, and PASM were collected from 635 patients. Renal tissue images were then extracted, tiled, and categorized into 14 classes on the basis of renal pathology. We employed the classic ViT model from the Timm library, utilizing images sized 384 × 384 pixels with 16 × 16 pixel patches, to train the classification model. A comparative analysis was conducted to evaluate the performance of the ViT model against traditional convolutional neural network (CNN) models. The results indicated that the ViT model demonstrated superior recognition ability (accuracy: 0.96-0.99). Furthermore, we visualized the identification process of the ViT models to investigate potentially significant pathological ultrastructures. Our study demonstrated that ViT models outperformed CNN models in accurately classifying renal pathology. Additionally, ViT models are able to focus on specific, significant structures within renal histopathology, which could be crucial for identifying novel and meaningful pathological features in the diagnosis and treatment of renal disease.

Integrated multi-omics with machine learning to uncover the intricacies of kidney disease

The development of omics technologies has driven a profound expansion in the scale of biological data and the increased complexity in internal dimensions, prompting the utilization of machine learning (ML) as a powerful toolkit for extracting knowledge and understanding underlying biological patterns. Kidney disease represents one of the major growing global health threats with intricate pathogenic mechanisms and a lack of precise molecular pathology-based therapeutic modalities. Accordingly, there is a need for advanced high-throughput approaches to capture implicit molecular features and complement current experiments and statistics. This review aims to delineate strategies for integrating multi-omics data with appropriate ML methods, highlighting key clinical translational scenarios, including predicting disease progression risks to improve medical decision-making, comprehensively understanding disease molecular mechanisms, and practical applications of image recognition in renal digital pathology. Examining the benefits and challenges of current integration efforts is expected to shed light on the complexity of kidney disease and advance clinical practice.

Deep learning-based glomerulus detection and classification with generative morphology augmentation in renal pathology images

Glomerulus morphology on renal pathology images provides valuable diagnosis and outcome prediction information. To provide better care, an efficient, standardized, and scalable method is urgently needed to optimize the time-consuming and labor-intensive interpretation process by renal pathologists. This paper proposes a deep convolutional neural network (CNN)-based approach to automatically detect and classify glomeruli with different stains in renal pathology images. In the glomerulus detection stage, this paper proposes a flattened Xception with a feature pyramid network (FX-FPN). The FX-FPN is employed as a backbone in the framework of faster region-based CNN to improve glomerulus detection performance. In the classification stage, this paper considers classifications of five glomerulus morphologies using a flattened Xception classifier. To endow the classifier with higher discriminability, this paper proposes a generative data augmentation approach for patch-based glomerulus morphology augmentation. New glomerulus patches of different morphologies are generated for data augmentation through the cycle-consistent generative adversarial network (CycleGAN). The single detection model shows the F1 score up to 0.9524 in H&E and PAS stains. The classification result shows that the average sensitivity and specificity are 0.7077 and 0.9316, respectively, by using the flattened Xception with the original training data. The sensitivity and specificity increase to 0.7623 and 0.9443, respectively, by using the generative data augmentation. Comparisons with different deep CNN models show the effectiveness and superiority of the proposed approach.

Deep learning applications for kidney histology analysis

PURPOSE OF REVIEW

Nephropathology is increasingly incorporating computational methods to enhance research and diagnostic accuracy. The widespread adoption of digital pathology, coupled with advancements in deep learning, will likely transform our pathology practices. Here, we discuss basic concepts of deep learning, recent applications in nephropathology, current challenges in implementation and future perspectives.

RECENT FINDINGS

Deep learning models have been developed and tested in various areas of nephropathology, for example, predicting kidney disease progression or diagnosing diseases based on imaging and clinical data. Despite their promising potential, challenges remain that hinder a wider adoption, for example, the lack of prospective evidence and testing in real-world scenarios.

SUMMARY

Deep learning offers great opportunities to improve quantitative and qualitative kidney histology analysis for research and clinical nephropathology diagnostics. Although exciting approaches already exist, the potential of deep learning in nephropathology is only at its beginning and we can expect much more to come.

Predicting clinical endpoints and visual changes with quality-weighted tissue-based renal histological features

Two common obstacles limiting the performance of data-driven algorithms in digital histopathology classification tasks are the lack of expert annotations and the narrow diversity of datasets. Multi-instance learning (MIL) can address the former challenge for the analysis of whole slide images (WSI), but performance is often inferior to full supervision. We show that the inclusion of weak annotations can significantly enhance the effectiveness of MIL while keeping the approach scalable. An analysis framework was developed to process periodic acid-Schiff (PAS) and Sirius Red (SR) slides of renal biopsies. The workflow segments tissues into coarse tissue classes. Handcrafted and deep features were extracted from these tissues and combined using a soft attention model to predict several slide-level labels: delayed graft function (DGF), acute tubular injury (ATI), and Remuzzi grade components. A tissue segmentation quality metric was also developed to reduce the adverse impact of poorly segmented instances. The soft attention model was trained using 5-fold cross-validation on a mixed dataset and tested on the QUOD dataset containing n = 373 PAS and n = 195 SR biopsies. The average ROC-AUC over different prediction tasks was found to be 0.598 ± 0.011 , significantly higher than using only ResNet50 ( 0.545 ± 0.012 ), only handcrafted features ( 0.542 ± 0.011 ), and the baseline ( 0.532 ± 0.012 ) of state-of-the-art performance. In conjunction with soft attention, weighting tissues by segmentation quality has led to further improvement ( A U C = 0.618 ± 0.010 ) . Using an intuitive visualisation scheme, we show that our approach may also be used to support clinical decision making as it allows pinpointing individual tissues relevant to the predictions.

Algorithm-assisted diagnosis of Hirschsprung's disease - evaluation of robustness and comparative image analysis on data from various labs and slide scanners

BACKGROUND

Differences in the preparation, staining and scanning of digital pathology slides create significant pre-analytic variability. Algorithm-assisted tools must be able to contend with this variability in order to be applicable in clinical practice. In a previous study, a decision support algorithm was developed to assist in the diagnosis of Hirschsprung's disease. In the current study, we tested the robustness of this algorithm while assessing for pre-analytic factors which may affect its performance.

METHODS

The decision support algorithm was used on digital pathology slides obtained from four different medical centers (A-D) and scanned by three different scanner models (by Philips, Hamamatsu and 3DHISTECH). A total of 192 cases and 1782 slides were used in this study. RGB histograms were constructed to compare images from the various medical centers and scanner models and highlight the differences in color and contrast.

RESULTS

The algorithm was able to correctly identify ganglion cells in 99.2% of cases, from all medical centers (All scanned by the Philips slide scanner) as well as 95.5% and 100% of the slides scanned by the 3DHISTECH and Hamamatsu brand slide scanners, respectively. The total error rate for center D was lower than the other medical centers (3.9% vs 7.1%, 10.8% and 6% for centers A-C, respectively), the vast majority of errors being false positives (3.45% vs 0.45% false negatives). The other medical centers showed a higher rate of false negatives in relation to false positives (6.81% vs 0.29%, 9.8% vs 1.2% and 5.37% vs 0.63% for centers A-C, respectively). The total error rates for the Philips, Hamamatsu and 3DHISTECH brand scanners were 3.9%, 3.2% and 9.8%, respectively. RGB histograms demonstrated significant differences in pixel value distribution between the four medical centers, as well as between the 3DHISTECH brand scanner when compared to the Philips and Hamamatsu brand scanners.

CONCLUSIONS

The results reported in this paper suggest that the algorithm-based decision support system has sufficient robustness to be applicable for clinical practice. In addition, the novel method used in its development - Hierarchial-Contexual Analysis (HCA) may be applicable to the development of algorithm-assisted tools in other diseases, for which available datasets are limited. Validation of any given algorithm-assisted support system should nonetheless include data from as many medical centers and scanner models as possible.

A Machine Learning-Driven Virtual Biopsy System For Kidney Transplant Patients

In kidney transplantation, day-zero biopsies are used to assess organ quality and discriminate between donor-inherited lesions and those acquired post-transplantation. However, many centers do not perform such biopsies since they are invasive, costly and may delay the transplant procedure. We aim to generate a non-invasive virtual biopsy system using routinely collected donor parameters. Using 14,032 day-zero kidney biopsies from 17 international centers, we develop a virtual biopsy system. 11 basic donor parameters are used to predict four Banff kidney lesions: arteriosclerosis, arteriolar hyalinosis, interstitial fibrosis and tubular atrophy, and the percentage of renal sclerotic glomeruli. Six machine learning models are aggregated into an ensemble model. The virtual biopsy system shows good performance in the internal and external validation sets. We confirm the generalizability of the system in various scenarios. This system could assist physicians in assessing organ quality, optimizing allograft allocation together with discriminating between donor derived and acquired lesions post-transplantation.

An image inpainting-based data augmentation method for improved sclerosed glomerular identification performance with the segmentation model EfficientNetB3-Unet

The percent global glomerulosclerosis is a key factor in determining the outcome of renal transfer surgery. At present, the rate is typically computed by pathologists, which is labour intensive and nonstandardized. With the development of Deep Learning (DL), DL-based segmentation models can be used to better identify and segment normal and sclerosed glomeruli. Based on this, we can better quantify percent global glomerulosclerosis to reduce the discard rate of donor kidneys. We used 51 whole slide images (WSIs) from different institutions that are publicly available on the internet. However, the number of sclerosed glomeruli is much smaller than that of normal glomeruli in different WSIs, which can reduce the effectiveness of Deep Learning. For better sclerosed glomerular identification and segmentation performance, we modified and trained a GAN (generative adversarial network)-based image inpainting model to obtain more synthetic sclerosed glomeruli. Our proposed inpainting method achieved an average SSIM (Structural Similarity) of 0.8086 and an average PSNR (Peak Signal-to-Noise Ratio) of 22.8943 dB in the area of generated sclerosed glomeruli. We obtained sclerosed glomerular segmentation performance improvement by adding synthetic sclerosed glomerular images and achieved the best Dice of glomerular segmentation in different test sets based on the modified Unet model.

Artificial intelligence-assisted quantification and assessment of whole slide images for pediatric kidney disease diagnosis

MOTIVATION

Pediatric kidney disease is a widespread, progressive condition that severely impacts growth and development of children. Chronic kidney disease is often more insidious in children than in adults, usually requiring a renal biopsy for diagnosis. Biopsy evaluation requires copious examination by trained pathologists, which can be tedious and prone to human error. In this study, we propose an artificial intelligence (AI) method to assist pathologists in accurate segmentation and classification of pediatric kidney structures, named as AI-based Pediatric Kidney Diagnosis (APKD).

RESULTS

We collected 2935 pediatric patients diagnosed with kidney disease for the development of APKD. The dataset comprised 93 932 histological structures annotated manually by three skilled nephropathologists. APKD scored an average accuracy of 94% for each kidney structure category, including 99% in the glomerulus. We found strong correlation between the model and manual detection in detected glomeruli (Spearman correlation coefficient r = 0.98, P < .001; intraclass correlation coefficient ICC = 0.98, 95% CI = 0.96-0.98). Compared to manual detection, APKD was approximately 5.5 times faster in segmenting glomeruli. Finally, we show how the pathological features extracted by APKD can identify focal abnormalities of the glomerular capillary wall to aid in the early diagnosis of pediatric kidney disease.

AVAILABILITY AND IMPLEMENTATION

https://github.com/ChunyueFeng/Kidney-DataSet.

Time for a full digital approach in nephropathology: a systematic review of current artificial intelligence applications and future directions

INTRODUCTION

Artificial intelligence (AI) integration in nephropathology has been growing rapidly in recent years, facing several challenges including the wide range of histological techniques used, the low occurrence of certain diseases, and the need for data sharing. This narrative review retraces the history of AI in nephropathology and provides insights into potential future developments.

METHODS

Electronic searches in PubMed-MEDLINE and Embase were made to extract pertinent articles from the literature. Works about automated image analysis or the application of an AI algorithm on non-neoplastic kidney histological samples were included and analyzed to extract information such as publication year, AI task, and learning type. Prepublication servers and reviews were not included.

RESULTS

Seventy-six (76) original research articles were selected. Most of the studies were conducted in the United States in the last 7 years. To date, research has been mainly conducted on relatively easy tasks, like single-stain glomerular segmentation. However, there is a trend towards developing more complex tasks such as glomerular multi-stain classification.

CONCLUSION

Deep learning has been used to identify patterns in complex histopathology data and looks promising for the comprehensive assessment of renal biopsy, through the use of multiple stains and virtual staining techniques. Hybrid and collaborative learning approaches have also been explored to utilize large amounts of unlabeled data. A diverse team of experts, including nephropathologists, computer scientists, and clinicians, is crucial for the development of AI systems for nephropathology. Collaborative efforts among multidisciplinary experts result in clinically relevant and effective AI tools.

Clinical Decision Support Systems Used in Transplantation: Are They Tools for Success or an Unnecessary Gadget? A Systematic Review

Although clinical decision support systems (CDSSs) have been used since the 1970s for a wide variety of clinical tasks including optimization of medication orders, improved documentation, and improved patient adherence, to date, no systematic reviews have been carried out to assess their utilization and efficacy in transplant medicine. The aim of this study is to systematically review studies that utilized a CDSS and assess impact on patient outcomes. A total of 48 articles were identified as meeting the author-derived inclusion criteria, including tools for posttransplant monitoring, pretransplant risk assessment, waiting list management, immunosuppressant management, and interpretation of histopathology. Studies included 15 984 transplant recipients. Tools aimed at helping with transplant patient immunosuppressant management were the most common (19 studies). Thirty-four studies (85%) found an overall clinical benefit following the implementation of a CDSS in clinical practice. Although there are limitations to the existing literature, current evidence suggests that implementing CDSS in transplant clinical settings may improve outcomes for patients. Limited evidence was found using more advanced technologies such as artificial intelligence in transplantation, and future studies should investigate the role of these emerging technologies.

Banff Digital Pathology Working Group: Image Bank, Artificial Intelligence Algorithm, and Challenge Trial Developments

The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.

A Spatially Guided Machine-Learning Method to Classify and Quantify Glomerular Patterns of Injury in Histology Images

Introduction The diagnosis of glomerular diseases is primarily based on visual assessment of histologic patterns. Semi-quantitative scoring of active and chronic lesions is often required to assess individual characteristics of the disease. Reproducibility of the visual scoring systems remains debatable, while digital and machine-learning technologies present opportunities to detect, classify and quantify glomerular lesions, also considering their inter- and intraglomerular heterogeneity.

MATERIALS AND METHODS

We performed a cross-validated comparison of three modifications of a convolutional neural network (CNN)-based approach for recognition and intraglomerular quantification of nine main glomerular patterns of injury. Reference values provided by two nephropathologists were used for validation. For each glomerular image, visual attention heatmaps were generated with a probability of class attribution for further intraglomerular quantification. The quality of classifier-produced heatmaps was evaluated by intersection over union metrics (IoU) between predicted and ground truth localization heatmaps.

RESULTS

A proposed spatially guided modification of the CNN classifier achieved the highest glomerular pattern classification accuracies, with area under curve (AUC) values up to 0.981. With regards to heatmap overlap area and intraglomerular pattern quantification, the spatially guided classifier achieved a significantly higher generalized mean IoU value compared to single-multiclass and multiple-binary classifiers.

CONCLUSIONS

We propose a spatially guided CNN classifier that in our experiments reveals the potential to achieve high accuracy for the localization of intraglomerular patterns.

Evolution of human kidney allograft pathology diagnostics through 30 years of the Banff classification process

The second half of the previous century witnessed a tremendous rise in the number of clinical kidney transplants worldwide. This activity was, however, accompanied by many issues and challenges. An accurate diagnosis and appropriate management of causes of graft dysfunction were and still are, a big challenge. Kidney allograft biopsy played a vital role in addressing the above challenge. However, its interpretation was not standardized for many years until, in 1991, the Banff process was started to fill this void. Thereafter, regular Banff meetings took place every 2 years for the past 30 years. Marked changes have taken place in the interpretation of kidney allograft biopsies, diagnosis, and classification of rejection and other non-rejection pathologies from the original Banff 93 classification. This review attempts to summarize those changes for increasing the awareness and understanding of kidney allograft pathology through the eyes of the Banff process. It will interest the transplant surgeons, physicians, pathologists, and allied professionals associated with the care of kidney transplant patients.

Artificial intelligence and frozen section histopathology: A systematic review

Frozen sections are a useful pathologic tool, but variable image quality may impede the use of artificial intelligence and machine learning in their interpretation. We aimed to identify the current research on machine learning models trained or tested on frozen section images. We searched PubMed and Web of Science for articles presenting new machine learning models published in any year. Eighteen papers met all inclusion criteria. All papers presented at least one novel model trained or tested on frozen section images. Overall, convolutional neural networks tended to have the best performance. When physicians were able to view the output of the model, they tended to perform better than either the model or physicians alone at the tested task. Models trained on frozen sections performed well when tested on other slide preparations, but models trained on only formalin-fixed tissue performed significantly worse across other modalities. This suggests not only that machine learning can be applied to frozen section image processing, but also use of frozen section images may increase model generalizability. Additionally, expert physicians working in concert with artificial intelligence may be the future of frozen section histopathology.

Glomerulus Detection Using Segmentation Neural Networks

Digital pathology is vital for the correct diagnosis of kidney before transplantation or kidney disease identification. One of the key challenges in kidney diagnosis is glomerulus detection in kidney tissue segments. In this study, we propose a deep learning-based method for glomerulus detection from digitized kidney slide segments. The proposed method applies models based on convolutional neural networks to detect image segments containing the glomerulus region. We employ various networks such as ResNets, UNet, LinkNet, and EfficientNet to train the models. In our experiments on a network trained on the NIH HuBMAP kidney whole slide image dataset, the proposed method achieves the highest scores with Dice coefficient of 0.942.

Segmentation of human functional tissue units in support of a Human Reference Atlas

The Human BioMolecular Atlas Program (HuBMAP) aims to compile a Human Reference Atlas (HRA) for the healthy adult body at the cellular level. Functional tissue units (FTUs), relevant for HRA construction, are of pathobiological significance. Manual segmentation of FTUs does not scale; highly accurate and performant, open-source machine-learning algorithms are needed. We designed and hosted a Kaggle competition that focused on development of such algorithms and 1200 teams from 60 countries participated. We present the competition outcomes and an expanded analysis of the winning algorithms on additional kidney and colon tissue data, and conduct a pilot study to understand spatial location and density of FTUs across the kidney. The top algorithm from the competition, Tom, outperforms other algorithms in the expanded study, while using fewer computational resources. Tom was added to the HuBMAP infrastructure to run kidney FTU segmentation at scale-showcasing the value of Kaggle competitions for advancing research.

European Society for Organ Transplantation (ESOT)-TLJ 3.0 Consensus on Histopathological Analysis of Pre-Implantation Donor Kidney Biopsy: Redefining the Role in the Process of Graft Assessment

The ESOT TLJ 3.0. consensus conference brought together leading experts in transplantation to develop evidence-based guidance on the standardization and clinical utility of pre-implantation kidney biopsy in the assessment of grafts from Expanded Criteria Donors (ECD). Seven themes were selected and underwent in-depth analysis after formulation of PICO (patient/population, intervention, comparison, outcomes) questions. After literature search, the statements for each key question were produced, rated according the GRADE approach [Quality of evidence: High (A), Moderate (B), Low (C); Strength of Recommendation: Strong (1), Weak (2)]. The statements were subsequently presented in-person at the Prague kick-off meeting, discussed and voted. After two rounds of discussion and voting, all 7 statements reached an overall agreement of 100% on the following issues: needle core/wedge/punch technique representatively [B,1], frozen/paraffin embedded section reliability [B,2], experienced/non-experienced on-call renal pathologist reproducibility/accuracy of the histological report [A,1], glomerulosclerosis/other parameters reproducibility [C,2], digital pathology/light microscopy in the measurement of histological variables [A,1], special stainings/Haematoxylin and Eosin alone comparison [A,1], glomerulosclerosis reliability versus other histological parameters to predict the graft survival, graft function, primary non-function [B,1]. This methodology has allowed to reach a full consensus among European experts on important technical topics regarding pre-implantation biopsy in the ECD graft assessment.

Artificial intelligence can accurately distinguish IgA nephropathy from diabetic nephropathy under Masson staining and becomes an important assistant for renal pathologists

Introduction

Hyperplasia of the mesangial area is common in IgA nephropathy (IgAN) and diabetic nephropathy (DN), and it is often difficult to distinguish them by light microscopy alone, especially in the absence of clinical data. At present, artificial intelligence (AI) is widely used in pathological diagnosis, but mainly in tumor pathology. The application of AI in renal pathological is still in its infancy.

Methods

Patients diagnosed as IgAN or DN by renal biopsy in First Affiliated Hospital of Zhejiang Chinese Medicine University from September 1, 2020 to April 30, 2022 were selected as the training set, and patients who diagnosed from May 1, 2022 to June 30, 2022 were selected as the test set. We focused on the glomerulus and captured the field of the glomerulus in Masson staining WSI at 200x magnification, all in 1,000 × 1,000 pixels JPEG format. We augmented the data from training set through minor affine transformation, and then randomly split the training set into training and adjustment data according to 8:2. The training data and the Yolov5 6.1 algorithm were used to train the AI model with constant adjustment of parameters according to the adjusted data. Finally, we obtained the optimal model, tested this model with test set and compared it with renal pathologists.

Results

AI can accurately detect the glomeruli. The overall accuracy of AI glomerulus detection was 98.67% and the omission rate was only 1.30%. No Intact glomerulus was missed. The overall accuracy of AI reached 73.24%, among which the accuracy of IgAN reached 77.27% and DN reached 69.59%. The AUC of IgAN was 0.733 and that of DN was 0.627. In addition, compared with renal pathologists, AI can distinguish IgAN from DN more quickly and accurately, and has higher consistency.

Discussion

We constructed an AI model based on Masson staining images of renal tissue to distinguish IgAN from DN. This model has also been successfully deployed in the work of renal pathologists to assist them in their daily diagnosis and teaching work.

A comprehensive survey of deep learning research on medical image analysis with focus on transfer learning

This survey aims to identify commonly used methods, datasets, future trends, knowledge gaps, constraints, and limitations in the field to provide an overview of current solutions used in medical image analysis in parallel with the rapid developments in transfer learning (TL). Unlike previous studies, this survey grouped the last five years of current studies for the period between January 2017 and February 2021 according to different anatomical regions and detailed the modality, medical task, TL method, source data, target data, and public or private datasets used in medical imaging. Also, it provides readers with detailed information on technical challenges, opportunities, and future research trends. In this way, an overview of recent developments is provided to help researchers to select the most effective and efficient methods and access widely used and publicly available medical datasets, research gaps, and limitations of the available literature.

Accurate Kidney Pathological Image Classification Method Based on Deep Learning and Multi-Modal Fusion Method with Application to Membranous Nephropathy

Membranous nephropathy is one of the most prevalent conditions responsible for nephrotic syndrome in adults. It is clinically nonspecific and mainly diagnosed by kidney biopsy pathology, with three prevalent techniques: light microscopy, electron microscopy, and immunofluorescence microscopy. Manual observation of glomeruli one by one under the microscope is very time-consuming, and there are certain differences in the observation results between physicians. This study makes use of whole-slide images scanned by a light microscope as well as immunofluorescence images to classify patients with membranous nephropathy. The framework mainly includes a glomerular segmentation module, a confidence coefficient extraction module, and a multi-modal fusion module. This framework first identifies and segments the glomerulus from whole-slide images and immunofluorescence images, and then a glomerular classifier is trained to extract the features of each glomerulus. The results are then combined to produce the final diagnosis. The results of the experiments show that the F1-score of image classification results obtained by combining two kinds of features, which can reach 97.32%, is higher than those obtained by using only light-microscopy-observed images or immunofluorescent images, which reach 92.76% and 93.20%, respectively. Experiments demonstrate that considering both WSIs and immunofluorescence images is effective in improving the diagnosis of membranous nephropathy.

Artificial Intelligence You Can Trust: What Matters Beyond Performance When Applying Artificial Intelligence to Renal Histopathology?

Although still in its infancy, artificial intelligence (AI) analysis of kidney biopsy images is anticipated to become an integral aspect of renal histopathology. As these systems are developed, the focus will understandably be on developing ever more accurate models, but successful translation to the clinic will also depend upon other characteristics of the system.In the extreme, deployment of highly performant but "black box" AI is fraught with risk, and high-profile errors could damage future trust in the technology. Furthermore, a major factor determining whether new systems are adopted in clinical settings is whether they are "trusted" by clinicians. Key to unlocking trust will be designing platforms optimized for intuitive human-AI interactions and ensuring that, where judgment is required to resolve ambiguous areas of assessment, the workings of the AI image classifier are understandable to the human observer. Therefore, determining the optimal design for AI systems depends on factors beyond performance, with considerations of goals, interpretability, and safety constraining many design and engineering choices.In this article, we explore challenges that arise in the application of AI to renal histopathology, and consider areas where choices around model architecture, training strategy, and workflow design may be influenced by factors beyond the final performance metrics of the system.

Machine learning in lung transplantation: Where are we?

Lung transplantation has been accepted as a viable treatment for end-stage respiratory failure. While regression models continue to be a standard approach for attempting to predict patients' outcomes after lung transplantation, more sophisticated supervised machine learning (ML) techniques are being developed and show encouraging results. Transplant clinicians could utilize ML as a decision-support tool in a variety of situations (e.g. waiting list mortality, donor selection, immunosuppression, rejection prediction). Although for some topics ML is at an advanced stage of research (i.e. imaging and pathology) there are certain topics in lung transplantation that needs to be aware of the benefits it could provide.

Machine learning in renal pathology

Introduction

When assessing kidney biopsies, pathologists use light microscopy, immunofluorescence, and electron microscopy to describe and diagnose glomerular lesions and diseases. These methods can be laborious, costly, fraught with inter-observer variability, and can have delays in turn-around time. Thus, computational approaches can be designed as screening and/or diagnostic tools, potentially relieving pathologist time, healthcare resources, while also having the ability to identify novel biomarkers, including subvisual features.

Methods

Here, we implement our recently published biomarker feature extraction (BFE) model along with 3 pre-trained deep learning models (VGG16, VGG19, and InceptionV3) to diagnose 3 glomerular diseases using PAS-stained digital pathology images alone. The BFE model extracts a panel of 233 explainable features related to underlying pathology, which are subsequently narrowed down to 10 morphological and microstructural texture features for classification with a linear discriminant analysis machine learning classifier. 45 patient renal biopsies (371 glomeruli) from minimal change disease (MCD), membranous nephropathy (MN), and thin-basement membrane nephropathy (TBMN) were split into training/validation and held out sets. For the 3 deep learningmodels, data augmentation and Grad-CAM were used for better performance and interpretability.

Results

The BFE model showed glomerular validation accuracy of 67.6% and testing accuracy of 76.8%. All deep learning approaches had higher validation accuracies (most for VGG16 at 78.5%) but lower testing accuracies. The highest testing accuracy at the glomerular level was VGG16 at 71.9%, while at the patient-level was InceptionV3 at 73.3%.

Discussion

The results highlight the potential of both traditional machine learning and deep learning-based approaches for kidney biopsy evaluation.

Multi-modality artificial intelligence in digital pathology

In common medical procedures, the time-consuming and expensive nature of obtaining test results plagues doctors and patients. Digital pathology research allows using computational technologies to manage data, presenting an opportunity to improve the efficiency of diagnosis and treatment. Artificial intelligence (AI) has a great advantage in the data analytics phase. Extensive research has shown that AI algorithms can produce more up-to-date and standardized conclusions for whole slide images. In conjunction with the development of high-throughput sequencing technologies, algorithms can integrate and analyze data from multiple modalities to explore the correspondence between morphological features and gene expression. This review investigates using the most popular image data, hematoxylin-eosin stained tissue slide images, to find a strategic solution for the imbalance of healthcare resources. The article focuses on the role that the development of deep learning technology has in assisting doctors' work and discusses the opportunities and challenges of AI.

The current status and future prospects for molecular imaging-guided precision surgery

Molecular imaging technologies are increasingly used to diagnose, monitor, and guide treatment of i.e., cancer. In this review, the current status and future prospects of the use of molecular imaging as an instrument to help realize precision surgery is addressed with focus on the main components that form the conceptual basis of intraoperative molecular imaging. Paramount for successful interventions is the relevance and accessibility of surgical targets. In addition, selection of the correct combination of imaging agents and modalities is critical to visualize both microscopic and bulk disease sites with high affinity and specificity. In this context developments within engineering/imaging physics continue to drive the growth of image-guided surgery. Particularly important herein is enhancement of sensitivity through improved contrast and spatial resolution, features that are critical if sites of cancer involvement are not to be overlooked during surgery. By facilitating the connection between surgical planning and surgical execution, digital surgery technologies such as computer-aided visualization nicely complement these technologies. The complexity of image guidance, combined with the plurality of technologies that are becoming available, also drives the need for evaluation mechanisms that can objectively score the impact that technologies exert on the performance of healthcare professionals and outcome improvement for patients.

Boundary-aware glomerulus segmentation: Toward one-to-many stain generalization

The growing availability of scanned whole-slide images (WSIs) has allowed nephropathology to open new possibilities for medical decision-making over high-resolution images. Diagnosis of renal WSIs includes locating and identifying specific structures in the tissue. Considering the glomerulus as one of the first structures analyzed by pathologists, we propose here a novel convolutional neural network for glomerulus segmentation. Our end-to-end network, named DS-FNet, combines the strengths of semantic segmentation and semantic boundary detection networks via an attention-aware mechanism. Although we trained the proposed network on periodic acid-Schiff (PAS)-stained WSIs, we found that our network was capable to segment glomeruli on WSIs stained with different techniques, such as periodic acid-methenamine silver (PAMS), hematoxylin-eosin (HE), and Masson trichrome (TRI). To assess the performance of the proposed method, we used three public data sets: HuBMAP (available in a Kaggle competition), a subset of the NEPTUNE data set, and a novel challenging data set, called WSI_Fiocruz. We compared the DS-FNet with six other deep learning networks: original U-Net, our attention version of U-Net called AU-Net, U-Net++, U-Net3Plus, ResU-Net, and DeepLabV3+. Results showed that DS-FNet achieved equivalent or superior results on all data sets: On the HuBMAP data set, it reached a dice score (DSC) of 95.05%, very close to the first place (95.15%); on the NEPTUNE and WSI_Fiocruz data sets, DS-FNet obtained the highest average DSC, whether on PAS-stained images or images stained with other techniques. To the best we know, this is the first work to show consistently high performance in a one-to-many-stain glomerulus segmentation following a thorough protocol on data sets from different medical labs.

Artificial intelligence applications for pre-implantation kidney biopsy pathology practice: a systematic review

BACKGROUND

Transplant nephropathology is a highly specialized field of pathology comprising both the evaluation of organ donor biopsy for organ allocation and post-transplant graft biopsy for assessment of rejection or graft damage. The introduction of digital pathology with whole-slide imaging (WSI) in clinical research, trials and practice has catalyzed the application of artificial intelligence (AI) for histopathology, with development of novel machine-learning models for tissue interrogation and discovery. We aimed to review the literature for studies specifically applying AI algorithms to WSI-digitized pre-implantation kidney biopsy.

METHODS

A systematic search was carried out in the electronic databases PubMed-MEDLINE and Embase until 25th September, 2021 with a combination of the key terms "kidney", "biopsy", "transplantation" and "artificial intelligence" and their aliases. Studies dealing with the application of AI algorithms coupled with WSI in pre-implantation kidney biopsies were included. The main theme addressed was detection and quantification of tissue components. Extracted data were: author, year and country of the study, type of biopsy features investigated, number of cases, type of algorithm deployed, main results of the study in terms of diagnostic outcome, and the main limitations of the study.

RESULTS

Of 5761 retrieved articles, 7 met our inclusion criteria. All studies focused largely on AI-based detection and classification of glomerular structures and to a lesser extent on tubular and vascular structures. Performance of AI algorithms was excellent and promising.

CONCLUSION

All studies highlighted the importance of expert pathologist annotation to reliably train models and the need to acknowledge clinical nuances of the pre-implantation setting. Close cooperation between computer scientists and practicing as well as expert renal pathologists is needed, helping to refine the performance of AI-based models for routine pre-implantation kidney biopsy clinical practice.

Glo-In-One: holistic glomerular detection, segmentation, and lesion characterization with large-scale web image mining

Purpose: The quantitative detection, segmentation, and characterization of glomeruli from high-resolution whole slide imaging (WSI) play essential roles in the computer-assisted diagnosis and scientific research in digital renal pathology. Historically, such comprehensive quantification requires extensive programming skills to be able to handle heterogeneous and customized computational tools. To bridge the gap of performing glomerular quantification for non-technical users, we develop the Glo-In-One toolkit to achieve holistic glomerular detection, segmentation, and characterization via a single line of command. Additionally, we release a large-scale collection of 30,000 unlabeled glomerular images to further facilitate the algorithmic development of self-supervised deep learning. Approach: The inputs of the Glo-In-One toolkit are WSIs, while the outputs are (1) WSI-level multi-class circle glomerular detection results (which can be directly manipulated with ImageScope), (2) glomerular image patches with segmentation masks, and (3) different lesion types. In the current version, the fine-grained global glomerulosclerosis (GGS) characterization is provided, including assessed-solidified-GSS (associated with hypertension-related injury), disappearing-GSS (a further end result of the SGGS becoming contiguous with fibrotic interstitium), and obsolescent-GSS (nonspecific GGS increasing with aging) glomeruli. To leverage the performance of the Glo-In-One toolkit, we introduce self-supervised deep learning to glomerular quantification via large-scale web image mining. Results: The GGS fine-grained classification model achieved a decent performance compared with baseline supervised methods while only using 10% of the annotated data. The glomerular detection achieved an average precision of 0.627 with circle representations, while the glomerular segmentation achieved a 0.955 patch-wise Dice dimilarity coefficient. Conclusion: We develop and release an open-source Glo-In-One toolkit, a software with holistic glomerular detection, segmentation, and lesion characterization. This toolkit is user-friendly to non-technical users via a single line of command. The toolbox and the 30,000 web mined glomerular images have been made publicly available at https://github.com/hrlblab/Glo-In-One.

Artificial Intelligence-Assisted Renal Pathology: Advances and Prospects

Digital imaging and advanced microscopy play a pivotal role in the diagnosis of kidney diseases. In recent years, great achievements have been made in digital imaging, providing novel approaches for precise quantitative assessments of nephropathology and relieving burdens of renal pathologists. Developing novel methods of artificial intelligence (AI)-assisted technology through multidisciplinary interaction among computer engineers, renal specialists, and nephropathologists could prove beneficial for renal pathology diagnoses. An increasing number of publications has demonstrated the rapid growth of AI-based technology in nephrology. In this review, we offer an overview of AI-assisted renal pathology, including AI concepts and the workflow of processing digital image data, focusing on the impressive advances of AI application in disease-specific backgrounds. In particular, this review describes the applied computer vision algorithms for the segmentation of kidney structures, diagnosis of specific pathological changes, and prognosis prediction based on images. Lastly, we discuss challenges and prospects to provide an objective view of this topic.

Cultivating Clinical Clarity through Computer Vision: A Current Perspective on Whole Slide Imaging and Artificial Intelligence

Diagnostic devices, methodological approaches, and traditional constructs of clinical pathology practice, cultivated throughout centuries, have transformed radically in the wake of explosive technological growth and other, e.g., environmental, catalysts of change. Ushered into the fray of modern laboratory medicine are digital imaging devices and machine-learning (ML) software fashioned to mitigate challenges, e.g., practitioner shortage while preparing clinicians for emerging interconnectivity of environments and diagnostic information in the era of big data. As computer vision shapes new constructs for the modern world and intertwines with clinical medicine, cultivating clarity of our new terrain through examining the trajectory and current scope of computational pathology and its pertinence to clinical practice is vital. Through review of numerous studies, we find developmental efforts for ML migrating from research to standardized clinical frameworks while overcoming obstacles that have formerly curtailed adoption of these tools, e.g., generalizability, data availability, and user-friendly accessibility. Groundbreaking validatory efforts have facilitated the clinical deployment of ML tools demonstrating the capacity to effectively aid in distinguishing tumor subtype and grade, classify early vs. advanced cancer stages, and assist in quality control and primary diagnosis applications. Case studies have demonstrated the benefits of streamlined, digitized workflows for practitioners alleviated by decreased burdens.

The promise of artificial intelligence for kidney pathophysiology

PURPOSE OF REVIEW

We seek to determine recent advances in kidney pathophysiology that have been enabled or enhanced by artificial intelligence. We describe some of the challenges in the field as well as future directions.

RECENT FINDINGS

We first provide an overview of artificial intelligence terminologies and methodologies. We then describe the use of artificial intelligence in kidney diseases to discover risk factors from clinical data for disease progression, annotate whole slide imaging and decipher multiomics data. We delineate key examples of risk stratification and prognostication in acute kidney injury (AKI) and chronic kidney disease (CKD). We contextualize these applications in kidney disease oncology, one of the subfields to benefit demonstrably from artificial intelligence using all if these approaches. We conclude by elucidating technical challenges and ethical considerations and briefly considering future directions.

SUMMARY

The integration of clinical data, patient derived data, histology and proteomics and genomics can enhance the work of clinicians in providing more accurate diagnoses and elevating understanding of disease progression. Implementation research needs to be performed to translate these algorithms to the clinical setting.

Transfer learning for medical image classification: a literature review

BACKGROUND

Transfer learning (TL) with convolutional neural networks aims to improve performances on a new task by leveraging the knowledge of similar tasks learned in advance. It has made a major contribution to medical image analysis as it overcomes the data scarcity problem as well as it saves time and hardware resources. However, transfer learning has been arbitrarily configured in the majority of studies. This review paper attempts to provide guidance for selecting a model and TL approaches for the medical image classification task.

METHODS

425 peer-reviewed articles were retrieved from two databases, PubMed and Web of Science, published in English, up until December 31, 2020. Articles were assessed by two independent reviewers, with the aid of a third reviewer in the case of discrepancies. We followed the PRISMA guidelines for the paper selection and 121 studies were regarded as eligible for the scope of this review. We investigated articles focused on selecting backbone models and TL approaches including feature extractor, feature extractor hybrid, fine-tuning and fine-tuning from scratch.

RESULTS

The majority of studies (n = 57) empirically evaluated multiple models followed by deep models (n = 33) and shallow (n = 24) models. Inception, one of the deep models, was the most employed in literature (n = 26). With respect to the TL, the majority of studies (n = 46) empirically benchmarked multiple approaches to identify the optimal configuration. The rest of the studies applied only a single approach for which feature extractor (n = 38) and fine-tuning from scratch (n = 27) were the two most favored approaches. Only a few studies applied feature extractor hybrid (n = 7) and fine-tuning (n = 3) with pretrained models.

CONCLUSION

The investigated studies demonstrated the efficacy of transfer learning despite the data scarcity. We encourage data scientists and practitioners to use deep models (e.g. ResNet or Inception) as feature extractors, which can save computational costs and time without degrading the predictive power.

Intelligent Diagnostic Prediction and Classification Models for Detection of Kidney Disease

Kidney disease is a major public health concern that has only recently emerged. Toxins are removed from the body by the kidneys through urine. In the early stages of the condition, the patient has no problems, but recovery is difficult in the later stages. Doctors must be able to recognize this condition early in order to save the lives of their patients. To detect this illness early on, researchers have used a variety of methods. Prediction analysis based on machine learning has been shown to be more accurate than other methodologies. This research can help us to better understand global disparities in kidney disease, as well as what we can do to address them and coordinate our efforts to achieve global kidney health equity. This study provides an excellent feature-based prediction model for detecting kidney disease. Various machine learning algorithms, including k-nearest neighbors algorithm (KNN), artificial neural networks (ANN), support vector machines (SVM), naive bayes (NB), and others, as well as Re-cursive Feature Elimination (RFE) and Chi-Square test feature-selection techniques, were used to build and analyze various prediction models on a publicly available dataset of healthy and kidney disease patients. The studies found that a logistic regression-based prediction model with optimal features chosen using the Chi-Square technique had the highest accuracy of 98.75 percent. White Blood Cell Count (Wbcc), Blood Glucose Random (bgr), Blood Urea (Bu), Serum Creatinine (Sc), Packed Cell Volume (Pcv), Albumin (Al), Hemoglobin (Hemo), Age, Sugar (Su), Hypertension (Htn), Diabetes Mellitus (Dm), and Blood Pressure (Bp) are examples of these traits.

Deep learning identified pathological abnormalities predictive of graft loss in kidney transplant biopsies

Interstitial fibrosis, tubular atrophy, and inflammation are major contributors to kidney allograft failure. Here we sought an objective, quantitative pathological assessment of these lesions to improve predictive utility and constructed a deep-learning-based pipeline recognizing normal vs. abnormal kidney tissue compartments and mononuclear leukocyte infiltrates. Periodic acid- Schiff stained slides of transplant biopsies (60 training and 33 testing) were used to quantify pathological lesions specific for interstitium, tubules and mononuclear leukocyte infiltration. The pipeline was applied to the whole slide images from 789 transplant biopsies (478 baseline [pre-implantation] and 311 post-transplant 12-month protocol biopsies) in two independent cohorts (GoCAR: 404 patients, AUSCAD: 212 patients) of transplant recipients to correlate composite lesion features with graft loss. Our model accurately recognized kidney tissue compartments and mononuclear leukocytes. The digital features significantly correlated with revised Banff 2007 scores but were more sensitive to subtle pathological changes below the thresholds in the Banff scores. The Interstitial and Tubular Abnormality Score (ITAS) in baseline samples was highly predictive of one-year graft loss, while a Composite Damage Score in 12-month post-transplant protocol biopsies predicted later graft loss. ITASs and Composite Damage Scores outperformed Banff scores or clinical predictors with superior graft loss prediction accuracy. High/intermediate risk groups stratified by ITASs or Composite Damage Scores also demonstrated significantly higher incidence of estimated glomerular filtration rate decline and subsequent graft damage. Thus, our deep-learning approach accurately detected and quantified pathological lesions from baseline or post-transplant biopsies and demonstrated superior ability for prediction of post-transplant graft loss with potential application as a prevention, risk stratification or monitoring tool.

Automatic Evaluation of Histological Prognostic Factors Using Two Consecutive Convolutional Neural Networks on Kidney Samples

BACKGROUND AND OBJECTIVES

The prognosis of patients undergoing kidney tumor resection or kidney donation is linked to many histologic criteria. These criteria notably include glomerular density, glomerular volume, vascular luminal stenosis, and severity of interstitial fibrosis/tubular atrophy. Automated measurements through a deep-learning approach could save time and provide more precise data. This work aimed to develop a free tool to automatically obtain kidney histologic prognostic features.

DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS

In total, 241 samples of healthy kidney tissue were split into three independent cohorts. The "Training" cohort (n=65) was used to train two convolutional neural networks: one to detect the cortex and a second to segment the kidney structures. The "Test" cohort (n=50) assessed their performance by comparing manually outlined regions of interest to predicted ones. The "Application" cohort (n=126) compared prognostic histologic data obtained manually or through the algorithm on the basis of the combination of the two convolutional neural networks.

RESULTS

In the Test cohort, the networks isolated the cortex and segmented the elements of interest with good performances (>90% of the cortex, healthy tubules, glomeruli, and even globally sclerotic glomeruli were detected). In the Application cohort, the expected and predicted prognostic data were significantly correlated. The correlation coefficients r were 0.85 for glomerular volume, 0.51 for glomerular density, 0.75 for interstitial fibrosis, 0.71 for tubular atrophy, and 0.73 for vascular intimal thickness, respectively. The algorithm had a good ability to predict significant (>25%) tubular atrophy and interstitial fibrosis level (receiver operator characteristic curve with an area under the curve, 0.92 and 0.91, respectively) or a significant vascular luminal stenosis (>50%) (area under the curve, 0.85).

CONCLUSION

This freely available tool enables the automated segmentation of kidney tissue to obtain prognostic histologic data in a fast, objective, reliable, and reproducible way.

Combination of Transfer Learning Methods for Kidney Glomeruli Image Classification

The rising global incidence of chronic kidney disease necessitates the development of image categorization of renal glomeruli. COVID-19 has been shown to enter the glomerulus, a tissue structure in the kidney. This study observes the differences between focal-segmental, normal and sclerotic renal glomerular tissue diseases. The splitting and combining of allied and multivariate models was accomplished utilizing a combined technique using existing models. In this study, model combinations are created by using a high-accuracy accuracy-based model to improve other models. This research exhibits excellent accuracy and consistent classification results on the ResNet101V2 combination using a mix of transfer learning methods, with the combined model on ResNet101V2 showing an accuracy of up to 97 percent with an F1-score of 0.97, compared to other models. However, this study discovered that the anticipated time required was higher than the model employed in general, which was mitigated by the usage of high-performance computing in this study.