1
|
Eigbire-Molen OJ, Cassol CA, Kenan DJ, Napier JO, Burdine LJ, Coley SM, Sharma SG. Smartphone-based machine learning model for real-time assessment of medical kidney biopsy. J Pathol Inform 2024; 15:100385. [PMID: 39071542 PMCID: PMC11283020 DOI: 10.1016/j.jpi.2024.100385] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 05/08/2024] [Accepted: 05/27/2024] [Indexed: 07/30/2024] Open
Abstract
Background Kidney biopsy is the gold-standard for diagnosing medical renal diseases, but the accuracy of the diagnosis greatly depends on the quality of the biopsy specimen, particularly the amount of renal cortex obtained. Inadequate biopsies, characterized by insufficient cortex or predominant medulla, can lead to inconclusive or incorrect diagnoses, and repeat biopsy. Unfortunately, there has been a concerning increase in the rate of inadequate kidney biopsies, and not all medical centers have access to trained professionals who can assess biopsy adequacy in real time. In response to this challenge, we aimed to develop a machine learning model capable of assessing the percentage cortex of each biopsy pass using smartphone images of the kidney biopsy tissue at the time of biopsy. Methods 747 kidney biopsy cores and corresponding smartphone macro images were collected from five unused deceased donor kidneys. Each core was imaged, formalin-fixed, sectioned, and stained with Periodic acid-Schiff (PAS) to determine cortex percentage. The fresh unfixed core images were captured using the macro camera on an iPhone 13 Pro. Two experienced renal pathologists independently reviewed the PAS-stained sections to determine the cortex percentage. For the purpose of this study, the biopsies with less than 30% cortex were labeled as inadequate, while those with 30% or more cortex were classified as adequate. The dataset was divided into training (n=643), validation (n=30), and test (n=74) sets. Preprocessing steps involved converting High-Efficiency Image Container iPhone format images to JPEG, normalization, and renal tissue segmentation using a U-Net deep learning model. Subsequently, a classification deep learning model was trained on the renal tissue region of interest and corresponding class label. Results The deep learning model achieved an accuracy of 85% on the training data. On the independent test dataset, the model exhibited an accuracy of 81%. For inadequate samples in the test dataset, the model showed a sensitivity of 71%, suggesting its capability to identify cases with inadequate cortical representation. The area under the receiver-operating curve (AUC-ROC) on the test dataset was 0.80. Conclusion We successfully developed and tested a machine learning model for classifying smartphone images of kidney biopsies as either adequate or inadequate, based on the amount of cortex determined by expert renal pathologists. The model's promising results suggest its potential as a smartphone application to assist real-time assessment of kidney biopsy tissue, particularly in settings with limited access to trained personnel. Further refinements and validations are warranted to optimize the model's performance.
Collapse
Affiliation(s)
| | - Clarissa A. Cassol
- Arkana Laboratories, 10810 Executive Center Dr. Suite 100, Little Rock, AR 72211, USA
| | - Daniel J. Kenan
- Arkana Laboratories, 10810 Executive Center Dr. Suite 100, Little Rock, AR 72211, USA
| | - Johnathan O.H. Napier
- Arkana Laboratories, 10810 Executive Center Dr. Suite 100, Little Rock, AR 72211, USA
| | - Lyle J. Burdine
- Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR 72205, USA
| | - Shana M. Coley
- Arkana Laboratories, 10810 Executive Center Dr. Suite 100, Little Rock, AR 72211, USA
| | - Shree G. Sharma
- Arkana Laboratories, 10810 Executive Center Dr. Suite 100, Little Rock, AR 72211, USA
| |
Collapse
|
2
|
Abstract
The ability to localize hundreds of macromolecules to discrete locations, structures and cell types in a tissue is a powerful approach to understand the cellular and spatial organization of an organ. Spatially resolved transcriptomic technologies enable mapping of transcripts at single-cell or near single-cell resolution in a multiplex manner. The rapid development of spatial transcriptomic technologies has accelerated the pace of discovery in several fields, including nephrology. Its application to preclinical models and human samples has provided spatial information about new cell types discovered by single-cell sequencing and new insights into the cell-cell interactions within neighbourhoods, and has improved our understanding of the changes that occur in response to injury. Integration of spatial transcriptomic technologies with other omics methods, such as proteomics and spatial epigenetics, will further facilitate the generation of comprehensive molecular atlases, and provide insights into the dynamic relationships of molecular components in homeostasis and disease. This Review provides an overview of current and emerging spatial transcriptomic methods, their applications and remaining challenges for the field.
Collapse
Affiliation(s)
- Sanjay Jain
- Division of Nephrology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA.
| | - Michael T Eadon
- Division of Nephrology, Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA.
| |
Collapse
|
3
|
Ma M, Zeng X, Qu L, Sheng X, Ren H, Chen W, Li B, You Q, Xiao L, Wang Y, Dai M, Zhang B, Lu C, Sheng W, Huang D. Advancing Automatic Gastritis Diagnosis: An Interpretable Multilabel Deep Learning Framework for the Simultaneous Assessment of Multiple Indicators. THE AMERICAN JOURNAL OF PATHOLOGY 2024; 194:1538-1549. [PMID: 38762117 DOI: 10.1016/j.ajpath.2024.04.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 03/17/2024] [Accepted: 04/26/2024] [Indexed: 05/20/2024]
Abstract
The evaluation of morphologic features, such as inflammation, gastric atrophy, and intestinal metaplasia, is crucial for diagnosing gastritis. However, artificial intelligence analysis for nontumor diseases like gastritis is limited. Previous deep learning models have omitted important morphologic indicators and cannot simultaneously diagnose gastritis indicators or provide interpretable labels. To address this, an attention-based multi-instance multilabel learning network (AMMNet) was developed to simultaneously achieve the multilabel diagnosis of activity, atrophy, and intestinal metaplasia with only slide-level weak labels. To evaluate AMMNet's real-world performance, a diagnostic test was designed to observe improvements in junior pathologists' diagnostic accuracy and efficiency with and without AMMNet assistance. In this study of 1096 patients from seven independent medical centers, AMMNet performed well in assessing activity [area under the curve (AUC), 0.93], atrophy (AUC, 0.97), and intestinal metaplasia (AUC, 0.93). The false-negative rates of these indicators were only 0.04, 0.08, and 0.18, respectively, and junior pathologists had lower false-negative rates with model assistance (0.15 versus 0.10). Furthermore, AMMNet reduced the time required per whole slide image from 5.46 to 2.85 minutes, enhancing diagnostic efficiency. In block-level clustering analysis, AMMNet effectively visualized task-related patches within whole slide images, improving interpretability. These findings highlight AMMNet's effectiveness in accurately evaluating gastritis morphologic indicators on multicenter data sets. Using multi-instance multilabel learning strategies to support routine diagnostic pathology deserves further evaluation.
Collapse
Affiliation(s)
- Mengke Ma
- Department of Pathology, Fudan University Shanghai Cancer Center, Shanghai, China; Department of Oncology, Fudan University Shanghai Medical College, Shanghai, China; Institute of Pathology, Fudan University, Shanghai, China
| | - Xixi Zeng
- Department of Pathology, Fudan University Shanghai Cancer Center, Shanghai, China; Department of Oncology, Fudan University Shanghai Medical College, Shanghai, China; Institute of Pathology, Fudan University, Shanghai, China
| | - Linhao Qu
- Department of Pathology, Fudan University Shanghai Cancer Center, Shanghai, China; Department of Oncology, Fudan University Shanghai Medical College, Shanghai, China; Institute of Pathology, Fudan University, Shanghai, China
| | - Xia Sheng
- Department of Pathology, Minhang Hospital, Fudan University, Shanghai, China
| | - Hongzheng Ren
- Department of Pathology, Gongli Hospital, Naval Medical University, Shanghai, China
| | - Weixiang Chen
- Department of Pathology, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Bin Li
- Department of Pathology, Shanghai Xu-Hui Central Hospital, Shanghai, China
| | - Qinghua You
- Department of Pathology, Shanghai Pudong Hospital, Fudan University Pudong Medical Center, Shanghai, China
| | - Li Xiao
- Department of Pathology, Huadong Hospital, Shanghai, China
| | - Yi Wang
- Information Center, Fudan University Shanghai Cancer Center, Shanghai, China
| | - Mei Dai
- Information Center, Fudan University Shanghai Cancer Center, Shanghai, China
| | - Boqiang Zhang
- Shanghai Foremost Medical Technology Co. Ltd., Shanghai, China
| | - Changqing Lu
- Shanghai Foremost Medical Technology Co. Ltd., Shanghai, China
| | - Weiqi Sheng
- Department of Pathology, Fudan University Shanghai Cancer Center, Shanghai, China; Department of Oncology, Fudan University Shanghai Medical College, Shanghai, China; Institute of Pathology, Fudan University, Shanghai, China.
| | - Dan Huang
- Department of Pathology, Fudan University Shanghai Cancer Center, Shanghai, China; Department of Oncology, Fudan University Shanghai Medical College, Shanghai, China; Institute of Pathology, Fudan University, Shanghai, China.
| |
Collapse
|
4
|
Bülow RD, Lan YC, Amann K, Boor P. [Artificial intelligence in kidney transplant pathology]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024; 45:277-283. [PMID: 38598097 DOI: 10.1007/s00292-024-01324-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/12/2024] [Indexed: 04/11/2024]
Abstract
BACKGROUND Artificial intelligence (AI) systems have showed promising results in digital pathology, including digital nephropathology and specifically also kidney transplant pathology. AIM Summarize the current state of research and limitations in the field of AI in kidney transplant pathology diagnostics and provide a future outlook. MATERIALS AND METHODS Literature search in PubMed and Web of Science using the search terms "deep learning", "transplant", and "kidney". Based on these results and studies cited in the identified literature, a selection was made of studies that have a histopathological focus and use AI to improve kidney transplant diagnostics. RESULTS AND CONCLUSION Many studies have already made important contributions, particularly to the automation of the quantification of some histopathological lesions in nephropathology. This likely can be extended to automatically quantify all relevant lesions for a kidney transplant, such as Banff lesions. Important limitations and challenges exist in the collection of representative data sets and the updates of Banff classification, making large-scale studies challenging. The already positive study results make future AI support in kidney transplant pathology appear likely.
Collapse
Affiliation(s)
- Roman David Bülow
- Institut für Pathologie, Sektion Nephropathologie, Universitätsklinikum RWTH Aachen, Pauwelsstraße 30, 52074, Aachen, Deutschland
| | - Yu-Chia Lan
- Institut für Pathologie, Sektion Nephropathologie, Universitätsklinikum RWTH Aachen, Pauwelsstraße 30, 52074, Aachen, Deutschland
| | - Kerstin Amann
- Abteilung Nephropathologie, Institut für Pathologie, Universitätsklinikum Erlangen, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Deutschland
| | - Peter Boor
- Institut für Pathologie, Sektion Nephropathologie, Universitätsklinikum RWTH Aachen, Pauwelsstraße 30, 52074, Aachen, Deutschland.
- Medizinische Klinik II, Universitätsklinikum RWTH Aachen, Aachen, Deutschland.
| |
Collapse
|
5
|
Goodman K, Sarullo K, Swamidass SJ, Gaut JP, Jain S. Role of Artificial Intelligence in Kidney Pathology: Promises and Pitfalls. KIDNEY360 2024; 5:1044-1046. [PMID: 39254464 PMCID: PMC11296536 DOI: 10.34067/kid.0000000000000482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
Affiliation(s)
- Kyle Goodman
- Department of Pathology and Immunology, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| | - Kathryn Sarullo
- Department of Pathology and Immunology, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| | - S. Joshua Swamidass
- Department of Pathology and Immunology, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| | - Joseph P. Gaut
- Department of Pathology and Immunology, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Department of Medicine (Nephrology), Washington University School of Medicine in St. Louis, St. Louis, Missouri
| | - Sanjay Jain
- Department of Pathology and Immunology, Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Department of Medicine (Nephrology), Washington University School of Medicine in St. Louis, St. Louis, Missouri
- Department of Pediatrics, Washington University School of Medicine in St. Louis, St. Louis, Missouri
| |
Collapse
|
6
|
Vafaei Sadr A, Bülow R, von Stillfried S, Schmitz NEJ, Pilva P, Hölscher DL, Ha PP, Schweiker M, Boor P. Operational greenhouse-gas emissions of deep learning in digital pathology: a modelling study. Lancet Digit Health 2024; 6:e58-e69. [PMID: 37996339 PMCID: PMC10728828 DOI: 10.1016/s2589-7500(23)00219-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 10/04/2023] [Accepted: 10/16/2023] [Indexed: 11/25/2023]
Abstract
BACKGROUND Deep learning is a promising way to improve health care. Image-processing medical disciplines, such as pathology, are expected to be transformed by deep learning. The first clinically applicable deep-learning diagnostic support tools are already available in cancer pathology, and their number is increasing. However, data on the environmental sustainability of these tools are scarce. We aimed to conduct an environmental-sustainability analysis of a theoretical implementation of deep learning in patient-care pathology. METHODS For this modelling study, we first assembled and calculated relevant data and parameters of a digital-pathology workflow. Data were breast and prostate specimens from the university clinic at the Institute of Pathology of the Rheinisch-Westfälische Technische Hochschule Aachen (Aachen, Germany), for which commercially available deep learning was already available. Only specimens collected between Jan 1 and Dec 31, 2019 were used, to omit potential biases due to the COVID-19 pandemic. Our final selection was based on 2 representative weeks outside holidays, covering different types of specimens. To calculate carbon dioxide (CO2) or CO2 equivalent (CO2 eq) emissions of deep learning in pathology, we gathered relevant data for exact numbers and sizes of whole-slide images (WSIs), which were generated by scanning histopathology samples of prostate and breast specimens. We also evaluated different data input scenarios (including all slide tiles, only tiles containing tissue, or only tiles containing regions of interest). To convert estimated energy consumption from kWh to CO2 eq, we used the internet protocol address of the computational server and the Electricity Maps database to obtain information on the sources of the local electricity grid (ie, renewable vs non-renewable), and estimated the number of trees and proportion of the local and world's forests needed to sequester the CO2 eq emissions. We calculated the computational requirements and CO2 eq emissions of 30 deep-learning models that varied in task and size. The first scenario represented the use of one commercially available deep-learning model for one task in one case (1-task), the second scenario considered two deep-learning models for two tasks per case (2-task), the third scenario represented a future, potentially automated workflow that could handle 7 tasks per case (7-task), and the fourth scenario represented the use of a single potential, large, computer-vision model that could conduct multiple tasks (multitask). We also compared the performance (ie, accuracy) and CO2 eq emissions of different deep-learning models for the classification of renal cell carcinoma on WSIs, also from Rheinisch-Westfälische Technische Hochschule Aachen. We also tested other approaches to reducing CO2 eq emissions, including model pruning and an alternative method for histopathology analysis (pathomics). FINDINGS The pathology database contained 35 552 specimens (237 179 slides), 6420 of which were prostate specimens (10 115 slides) and 11 801 of which were breast specimens (19 763 slides). We selected and subsequently digitised 140 slides from eight breast-cancer cases and 223 slides from five prostate-cancer cases. Applying large deep-learning models on all WSI tiles of prostate and breast pathology cases would result in yearly CO2 eq emissions of 7·65 metric tons (t; 95% CI 7·62-7·68) with the use of a single deep-learning model per case; yearly CO2 eq emissions were up to 100·56 t (100·21-100·99) with the use of seven deep-learning models per case. CO2 eq emissions for different deep-learning model scenarios, data inputs, and deep-learning model sizes for all slides varied from 3·61 t (3·59-3·63) to 2795·30 t (1177·51-6482·13. For the estimated number of overall pathology cases worldwide, the yearly CO2 eq emissions varied, reaching up to 16 megatons (Mt) of CO2 eq, requiring up to 86 590 km2 (0·22%) of world forest to sequester the CO2 eq emissions. Use of the 7-task scenario and small deep-learning models on slides containing tissue only could substantially reduce CO2 eq emissions worldwide by up to 141 times (0·1 Mt, 95% CI 0·1-0·1). Considering the local environment in Aachen, Germany, the maximum CO2 eq emission from the use of deep learning in digital pathology only would require 32·8% (95% CI 13·8-76·6) of the local forest to sequester the CO2 eq emissions. A single pathomics run on a tissue could provide information that was comparable to or even better than the output of multitask deep-learning models, but with 147 times reduced CO2 eq emissions. INTERPRETATION Our findings suggest that widespread use of deep learning in pathology might have considerable global-warming potential. The medical community, policy decision makers, and the public should be aware of this potential and encourage the use of CO2 eq emissions reduction strategies where possible. FUNDING German Research Foundation, European Research Council, German Federal Ministry of Education and Research, Health, Economic Affairs and Climate Action, and the Innovation Fund of the Federal Joint Committee.
Collapse
Affiliation(s)
- Alireza Vafaei Sadr
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany; Department of Public Health Sciences, College of Medicine, Pennsylvania State University, Hershey, PA, USA
| | - Roman Bülow
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Saskia von Stillfried
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Nikolas E J Schmitz
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Pourya Pilva
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - David L Hölscher
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Peiman Pilehchi Ha
- Healthy Living Spaces Lab, Institute for Occupational, Social and Environmental Medicine, Medical Faculty, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Marcel Schweiker
- Healthy Living Spaces Lab, Institute for Occupational, Social and Environmental Medicine, Medical Faculty, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
| | - Peter Boor
- Institute of Pathology, University Hospital Aachen, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany; Department of Nephrology and Immunology, Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany.
| |
Collapse
|
7
|
Gaupp C, Schmid B, Tripal P, Edwards A, Daniel C, Zimmermann S, Goppelt-Struebe M, Willam C, Rosen S, Schley G. Reconfiguration and loss of peritubular capillaries in chronic kidney disease. Sci Rep 2023; 13:19660. [PMID: 37952029 PMCID: PMC10640592 DOI: 10.1038/s41598-023-46146-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 10/27/2023] [Indexed: 11/14/2023] Open
Abstract
Functional and structural alterations of peritubular capillaries (PTCs) are a major determinant of chronic kidney disease (CKD). Using a software-based algorithm for semiautomatic segmentation and morphometric quantification, this study analyzes alterations of PTC shape associated with chronic tubulointerstitial injury in three mouse models and in human biopsies. In normal kidney tissue PTC shape was predominantly elongated, whereas the majority of PTCs associated with chronic tubulointerstitial injury had a rounder shape. This was reflected by significantly reduced PTC luminal area, perimeter and diameters as well as by significantly increased circularity and roundness. These morphological alterations were consistent in all mouse models and human kidney biopsies. The mean circularity of PTCs correlated significantly with categorized glomerular filtration rates and the degree of interstitial fibrosis and tubular atrophy (IFTA) and classified the presence of CKD or IFTA. 3D reconstruction of renal capillaries revealed not only a significant reduction, but more importantly a substantial simplification and reconfiguration of the renal microvasculature in mice with chronic tubulointerstitial injury. Computational modelling predicted that round PTCs can deliver oxygen more homogeneously to the surrounding tissue. Our findings indicate that alterations of PTC shape represent a common and uniform reaction to chronic tubulointerstitial injury independent of the underlying kidney disease.
Collapse
Affiliation(s)
- Charlotte Gaupp
- Department of Nephrology and Hypertension, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and University Hospital Erlangen, Ulmenweg 18, 91054, Erlangen, Germany
| | - Benjamin Schmid
- Optical Imaging Center Erlangen, Friedrich-Alexander University Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Philipp Tripal
- Optical Imaging Center Erlangen, Friedrich-Alexander University Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Aurélie Edwards
- Department of Biomedical Engineering, Boston University, Boston, MA, USA
| | - Christoph Daniel
- Department of Nephropathology, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and University Hospital Erlangen, Erlangen, Germany
| | - Stefan Zimmermann
- Department of Computer Science, University of Applied Sciences Worms, Worms, Germany
| | - Margarete Goppelt-Struebe
- Department of Nephrology and Hypertension, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and University Hospital Erlangen, Ulmenweg 18, 91054, Erlangen, Germany
| | - Carsten Willam
- Department of Nephrology and Hypertension, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and University Hospital Erlangen, Ulmenweg 18, 91054, Erlangen, Germany
| | - Seymour Rosen
- Department of Pathology, Beth Israel Deaconess Medical Center and Harvard Medical School, Boston, MA, USA
| | - Gunnar Schley
- Department of Nephrology and Hypertension, Friedrich-Alexander University Erlangen-Nürnberg (FAU) and University Hospital Erlangen, Ulmenweg 18, 91054, Erlangen, Germany.
| |
Collapse
|
8
|
Deng R, Li Y, Li P, Wang J, Remedios LW, Agzamkhodjaev S, Asad Z, Liu Q, Cui C, Wang Y, Wang Y, Tang Y, Yang H, Huo Y. Democratizing Pathological Image Segmentation with Lay Annotators via Molecular-empowered Learning. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2023; 14225:497-507. [PMID: 38529367 PMCID: PMC10961594 DOI: 10.1007/978-3-031-43987-2_48] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/27/2024]
Abstract
Multi-class cell segmentation in high-resolution Giga-pixel whole slide images (WSI) is critical for various clinical applications. Training such an AI model typically requires labor-intensive pixel-wise manual annotation from experienced domain experts (e.g., pathologists). Moreover, such annotation is error-prone when differentiating fine-grained cell types (e.g., podocyte and mesangial cells) via the naked human eye. In this study, we assess the feasibility of democratizing pathological AI deployment by only using lay annotators (annotators without medical domain knowledge). The contribution of this paper is threefold: (1) We proposed a molecular-empowered learning scheme for multi-class cell segmentation using partial labels from lay annotators; (2) The proposed method integrated Giga-pixel level molecular-morphology cross-modality registration, molecular-informed annotation, and molecular-oriented segmentation model, so as to achieve significantly superior performance via 3 lay annotators as compared with 2 experienced pathologists; (3) A deep corrective learning (learning with imperfect label) method is proposed to further improve the segmentation performance using partially annotated noisy data. From the experimental results, our learning method achieved F1 = 0.8496 using molecular-informed annotations from lay annotators, which is better than conventional morphology-based annotations (F1 = 0.7015) from experienced pathologists. Our method democratizes the development of a pathological segmentation deep model to the lay annotator level, which consequently scales up the learning process similar to a non-medical computer vision task. The official implementation and cell annotations are publicly available at https://github.com/hrlblab/MolecularEL.
Collapse
Affiliation(s)
| | - Yanwei Li
- Vanderbilt University, Nashville TN 37215, USA
| | - Peize Li
- Vanderbilt University, Nashville TN 37215, USA
| | | | | | | | - Zuhayr Asad
- Vanderbilt University, Nashville TN 37215, USA
| | - Quan Liu
- Vanderbilt University, Nashville TN 37215, USA
| | - Can Cui
- Vanderbilt University, Nashville TN 37215, USA
| | - Yaohong Wang
- Vanderbilt University Medical Center, Nashville TN 37232, USA
| | - Yihan Wang
- Vanderbilt University Medical Center, Nashville TN 37232, USA
| | - Yucheng Tang
- NVIDIA Corporation, Santa Clara and Bethesda, USA
| | - Haichun Yang
- Vanderbilt University Medical Center, Nashville TN 37232, USA
| | - Yuankai Huo
- Vanderbilt University, Nashville TN 37215, USA
| |
Collapse
|
9
|
Klinkhammer BM, Boor P. Kidney fibrosis: Emerging diagnostic and therapeutic strategies. Mol Aspects Med 2023; 93:101206. [PMID: 37541106 DOI: 10.1016/j.mam.2023.101206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 07/25/2023] [Indexed: 08/06/2023]
Abstract
An increasing number of patients worldwide suffers from chronic kidney disease (CKD). CKD is accompanied by kidney fibrosis, which affects all compartments of the kidney, i.e., the glomeruli, tubulointerstitium, and vasculature. Fibrosis is the best predictor of progression of kidney diseases. Currently, there is no specific anti-fibrotic therapy for kidney patients and invasive renal biopsy remains the only option for specific detection and quantification of kidney fibrosis. Here we review emerging diagnostic approaches and potential therapeutic options for fibrosis. We discuss how translational research could help to establish fibrosis-specific endpoints for clinical trials, leading to improved patient stratification and potentially companion diagnostics, and facilitating and optimizing development of novel anti-fibrotic therapies for kidney patients.
Collapse
Affiliation(s)
| | - Peter Boor
- Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany; Electron Microscopy Facility, RWTH Aachen University Hospital, Aachen, Germany; Division of Nephrology and Immunology, RWTH Aachen University Hospital, Aachen, Germany.
| |
Collapse
|
10
|
Al-Thelaya K, Gilal NU, Alzubaidi M, Majeed F, Agus M, Schneider J, Househ M. Applications of discriminative and deep learning feature extraction methods for whole slide image analysis: A survey. J Pathol Inform 2023; 14:100335. [PMID: 37928897 PMCID: PMC10622844 DOI: 10.1016/j.jpi.2023.100335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/17/2023] [Accepted: 07/19/2023] [Indexed: 11/07/2023] Open
Abstract
Digital pathology technologies, including whole slide imaging (WSI), have significantly improved modern clinical practices by facilitating storing, viewing, processing, and sharing digital scans of tissue glass slides. Researchers have proposed various artificial intelligence (AI) solutions for digital pathology applications, such as automated image analysis, to extract diagnostic information from WSI for improving pathology productivity, accuracy, and reproducibility. Feature extraction methods play a crucial role in transforming raw image data into meaningful representations for analysis, facilitating the characterization of tissue structures, cellular properties, and pathological patterns. These features have diverse applications in several digital pathology applications, such as cancer prognosis and diagnosis. Deep learning-based feature extraction methods have emerged as a promising approach to accurately represent WSI contents and have demonstrated superior performance in histology-related tasks. In this survey, we provide a comprehensive overview of feature extraction methods, including both manual and deep learning-based techniques, for the analysis of WSIs. We review relevant literature, analyze the discriminative and geometric features of WSIs (i.e., features suited to support the diagnostic process and extracted by "engineered" methods as opposed to AI), and explore predictive modeling techniques using AI and deep learning. This survey examines the advances, challenges, and opportunities in this rapidly evolving field, emphasizing the potential for accurate diagnosis, prognosis, and decision-making in digital pathology.
Collapse
Affiliation(s)
- Khaled Al-Thelaya
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Nauman Ullah Gilal
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Mahmood Alzubaidi
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Fahad Majeed
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Marco Agus
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Jens Schneider
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Mowafa Househ
- Department of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| |
Collapse
|
11
|
Deng R, Liu Q, Cui C, Yao T, Long J, Asad Z, Womick RM, Zhu Z, Fogo AB, Zhao S, Yang H, Huo Y. Omni-Seg: A Scale-Aware Dynamic Network for Renal Pathological Image Segmentation. IEEE Trans Biomed Eng 2023; 70:2636-2644. [PMID: 37030838 PMCID: PMC10517077 DOI: 10.1109/tbme.2023.3260739] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/10/2023]
Abstract
Comprehensive semantic segmentation on renal pathological images is challenging due to the heterogeneous scales of the objects. For example, on a whole slide image (WSI), the cross-sectional areas of glomeruli can be 64 times larger than that of the peritubular capillaries, making it impractical to segment both objects on the same patch, at the same scale. To handle this scaling issue, prior studies have typically trained multiple segmentation networks in order to match the optimal pixel resolution of heterogeneous tissue types. This multi-network solution is resource-intensive and fails to model the spatial relationship between tissue types. In this article, we propose the Omni-Seg network, a scale-aware dynamic neural network that achieves multi-object (six tissue types) and multi-scale (5× to 40× scale) pathological image segmentation via a single neural network. The contribution of this article is three-fold: (1) a novel scale-aware controller is proposed to generalize the dynamic neural network from single-scale to multi-scale; (2) semi-supervised consistency regularization of pseudo-labels is introduced to model the inter-scale correlation of unannotated tissue types into a single end-to-end learning paradigm; and (3) superior scale-aware generalization is evidenced by directly applying a model trained on human kidney images to mouse kidney images, without retraining. By learning from 150,000 human pathological image patches from six tissue types at three different resolutions, our approach achieved superior segmentation performance according to human visual assessment and evaluation of image-omics (i.e., spatial transcriptomics).
Collapse
|
12
|
Liang PI, Lin WC, Wen MC, Huang SC, Fang PW, Chuang HW, Lin YJ, Chien HP, Chen HD, Chen TD. Learning more from the inter-rater reliability of interstitial fibrosis assessment beyond just a statistic. Sci Rep 2023; 13:13260. [PMID: 37582967 PMCID: PMC10427633 DOI: 10.1038/s41598-023-40221-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 08/07/2023] [Indexed: 08/17/2023] Open
Abstract
Interstitial fibrosis assessment by renal pathologists lacks good agreement, and we aimed to investigate its hidden properties and infer possible clinical impact. Fifty kidney biopsies were assessed by 9 renal pathologists and evaluated by intraclass correlation coefficients (ICCs) and kappa statistics. Probabilities of pathologists' assessments that would deviate far from true values were derived from quadratic regression and multilayer perceptron nonlinear regression. Likely causes of variation in interstitial fibrosis assessment were investigated. Possible misclassification rates were inferred on reported large cohorts. We found inter-rater reliabilities ranged from poor to good (ICCs 0.48 to 0.90), and pathologists' assessments had the worst agreements when the extent of interstitial fibrosis was moderate. 33.5% of pathologists' assessments were expected to deviate far from the true values. Variation in interstitial fibrosis assessment was found to be correlated with variation in interstitial inflammation assessment (r2 = 32.1%). Taking IgA nephropathy as an example, the Oxford T scores for interstitial fibrosis were expected to be misclassified in 21.9% of patients. This study demonstrated the complexity of the inter-rater reliability of interstitial fibrosis assessment, and our proposed approaches discovered previously unknown properties in pathologists' practice and inferred a possible clinical impact on patients.
Collapse
Affiliation(s)
- Peir-In Liang
- Department of Pathology, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung, Taiwan
| | - Wei-Chou Lin
- Department of Pathology, National Taiwan University Hospital, Taipei, Taiwan
| | - Mei-Chin Wen
- Department of Pathology, China Medical University Hsinchu Hospital, Hsinchu, Taiwan
| | - Shun-Chen Huang
- Department of Anatomic Pathology, Chang Gung Memorial Hospital Kaohsiung Branch, Kaohsiung, Taiwan
| | - Pei-Wei Fang
- Department of Pathology, Fu Jen Catholic University Hospital, Fu Jen Catholic University, New Taipei City, Taiwan
| | - Hao-Wen Chuang
- Department of Pathology and Laboratory Medicine, Kaohsiung Veterans General Hospital, Kaohsiung, Taiwan
| | - Yi-Jia Lin
- Department of Pathology, Tri-service General Hospital, National Defense Medical Center, Taipei, Taiwan
| | - Hui-Ping Chien
- Department of Pathology and Laboratory Medicine, Shin Kong Wu Ho-Su Memorial Hospital, Taipei, Taiwan
| | - Huan-Da Chen
- Department of Pathology, Kaohsiung Medical University Hospital, Kaohsiung Medical University, Kaohsiung, Taiwan
| | - Tai-Di Chen
- Department of Anatomic Pathology, Chang Gung Memorial Hospital Linkou Main Branch, Taoyuan, Taiwan.
| |
Collapse
|
13
|
Development of a metabolite-based deep learning algorithm for clinical precise diagnosis of the progression of diabetic kidney disease. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
|
14
|
Glomerulosclerosis detection with pre-trained CNNs ensemble. Comput Stat 2022. [DOI: 10.1007/s00180-022-01307-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
|
15
|
Zheng Y, Gindra RH, Green EJ, Burks EJ, Betke M, Beane JE, Kolachalama VB. A Graph-Transformer for Whole Slide Image Classification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3003-3015. [PMID: 35594209 PMCID: PMC9670036 DOI: 10.1109/tmi.2022.3176598] [Citation(s) in RCA: 35] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Deep learning is a powerful tool for whole slide image (WSI) analysis. Typically, when performing supervised deep learning, a WSI is divided into small patches, trained and the outcomes are aggregated to estimate disease grade. However, patch-based methods introduce label noise during training by assuming that each patch is independent with the same label as the WSI and neglect overall WSI-level information that is significant in disease grading. Here we present a Graph-Transformer (GT) that fuses a graph-based representation of an WSI and a vision transformer for processing pathology images, called GTP, to predict disease grade. We selected 4,818 WSIs from the Clinical Proteomic Tumor Analysis Consortium (CPTAC), the National Lung Screening Trial (NLST), and The Cancer Genome Atlas (TCGA), and used GTP to distinguish adenocarcinoma (LUAD) and squamous cell carcinoma (LSCC) from adjacent non-cancerous tissue (normal). First, using NLST data, we developed a contrastive learning framework to generate a feature extractor. This allowed us to compute feature vectors of individual WSI patches, which were used to represent the nodes of the graph followed by construction of the GTP framework. Our model trained on the CPTAC data achieved consistently high performance on three-label classification (normal versus LUAD versus LSCC: mean accuracy = 91.2 ± 2.5%) based on five-fold cross-validation, and mean accuracy = 82.3 ± 1.0% on external test data (TCGA). We also introduced a graph-based saliency mapping technique, called GraphCAM, that can identify regions that are highly associated with the class label. Our findings demonstrate GTP as an interpretable and effective deep learning framework for WSI-level classification.
Collapse
|
16
|
Hermsen M, Ciompi F, Adefidipe A, Denic A, Dendooven A, Smith BH, van Midden D, Bräsen JH, Kers J, Stegall MD, Bándi P, Nguyen T, Swiderska-Chadaj Z, Smeets B, Hilbrands LB, van der Laak JAWM. Convolutional Neural Networks for the Evaluation of Chronic and Inflammatory Lesions in Kidney Transplant Biopsies. THE AMERICAN JOURNAL OF PATHOLOGY 2022; 192:1418-1432. [PMID: 35843265 DOI: 10.1016/j.ajpath.2022.06.009] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2021] [Revised: 06/13/2022] [Accepted: 06/22/2022] [Indexed: 06/15/2023]
Abstract
In kidney transplant biopsies, both inflammation and chronic changes are important features that predict long-term graft survival. Quantitative scoring of these features is important for transplant diagnostics and kidney research. However, visual scoring is poorly reproducible and labor intensive. The goal of this study was to investigate the potential of convolutional neural networks (CNNs) to quantify inflammation and chronic features in kidney transplant biopsies. A structure segmentation CNN and a lymphocyte detection CNN were applied on 125 whole-slide image pairs of periodic acid-Schiff- and CD3-stained slides. The CNN results were used to quantify healthy and sclerotic glomeruli, interstitial fibrosis, tubular atrophy, and inflammation within both nonatrophic and atrophic tubuli, and in areas of interstitial fibrosis. The computed tissue features showed high correlation with Banff lesion scores of five pathologists (A.A., A.Dend., J.H.B., J.K., and T.N.). Analyses on a small subset showed a moderate correlation toward higher CD3+ cell density within scarred regions and higher CD3+ cell count inside atrophic tubuli correlated with long-term change of estimated glomerular filtration rate. The presented CNNs are valid tools to yield objective quantitative information on glomeruli number, fibrotic tissue, and inflammation within scarred and non-scarred kidney parenchyma in a reproducible manner. CNNs have the potential to improve kidney transplant diagnostics and will benefit the community as a novel method to generate surrogate end points for large-scale clinical studies.
Collapse
Affiliation(s)
- Meyke Hermsen
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Francesco Ciompi
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Adeyemi Adefidipe
- Department of Pathology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands
| | - Aleksandar Denic
- Division of Nephrology and Hypertension, Mayo Clinic, Rochester, Minnesota
| | - Amélie Dendooven
- Department of Pathology, Ghent University Hospital, Ghent, Belgium; Faculty of Medicine, University of Antwerp, Wilrijk, Antwerp, Belgium
| | - Byron H Smith
- William J. von Liebig Center for Transplantation and Clinical Regeneration, Mayo Clinic, Rochester, Minnesota; Division of Biomedical Statistics and Informatics, Mayo Clinic, Rochester, Minnesota
| | - Dominique van Midden
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Jan Hinrich Bräsen
- Nephropathology Unit, Institute of Pathology, Hannover Medical School, Hannover, Germany
| | - Jesper Kers
- Department of Pathology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, the Netherlands; Department of Pathology, Leiden University Medical Center, Leiden, the Netherlands; Center for Analytical Sciences Amsterdam, Van 't Hoff Institute for Molecular Sciences, University of Amsterdam, Amsterdam, the Netherlands
| | - Mark D Stegall
- Division of Transplantation Surgery, Mayo Clinic, Rochester, Minnesota
| | - Péter Bándi
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Tri Nguyen
- Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Zaneta Swiderska-Chadaj
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands; Faculty of Electrical Engineering, Warsaw University of Technology, Warsaw, Poland
| | - Bart Smeets
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Luuk B Hilbrands
- Department of Nephrology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Jeroen A W M van der Laak
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands; Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden.
| |
Collapse
|
17
|
Galuzio PP, Cherif A. Recent Advances and Future Perspectives in the Use of Machine Learning and Mathematical Models in Nephrology. Adv Chronic Kidney Dis 2022; 29:472-479. [PMID: 36253031 DOI: 10.1053/j.ackd.2022.07.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 06/21/2022] [Accepted: 07/07/2022] [Indexed: 01/25/2023]
Abstract
We reviewed some of the latest advancements in the use of mathematical models in nephrology. We looked over 2 distinct categories of mathematical models that are widely used in biological research and pointed out some of their strengths and weaknesses when applied to health care, especially in the context of nephrology. A mechanistic dynamical system allows the representation of causal relations among the system variables but with a more complex and longer development/implementation phase. Artificial intelligence/machine learning provides predictive tools that allow identifying correlative patterns in large data sets, but they are usually harder-to-interpret black boxes. Chronic kidney disease (CKD), a major worldwide health problem, generates copious quantities of data that can be leveraged by choice of the appropriate model; also, there is a large number of dialysis parameters that need to be determined at every treatment session that can benefit from predictive mechanistic models. Following important steps in the use of mathematical methods in medical science might be in the intersection of seemingly antagonistic frameworks, by leveraging the strength of each to provide better care.
Collapse
Affiliation(s)
| | - Alhaji Cherif
- Research Division, Renal Research Institute, New York, NY.
| |
Collapse
|
18
|
Bülow RD, Hölscher DL, Boor P. Automatische Bildanalyse und künstliche Intelligenz in der Nephropathologie. DIE NEPHROLOGIE 2022. [PMCID: PMC9360682 DOI: 10.1007/s11560-022-00598-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Hintergrund Fragestellung Material und Methoden Ergebnisse Diskussion
Collapse
Affiliation(s)
- Roman D. Bülow
- Institut für Pathologie, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
| | - David L. Hölscher
- Institut für Pathologie, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
| | - Peter Boor
- Institut für Pathologie, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
- Medizinische Klinik II, Uniklinik RWTH Aachen, Pauwelsstr. 30, 52074 Aachen, Deutschland
| |
Collapse
|
19
|
Patel AU, Shaker N, Mohanty S, Sharma S, Gangal S, Eloy C, Parwani AV. Cultivating Clinical Clarity through Computer Vision: A Current Perspective on Whole Slide Imaging and Artificial Intelligence. Diagnostics (Basel) 2022; 12:diagnostics12081778. [PMID: 35892487 PMCID: PMC9332710 DOI: 10.3390/diagnostics12081778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Revised: 07/10/2022] [Accepted: 07/11/2022] [Indexed: 11/17/2022] Open
Abstract
Diagnostic devices, methodological approaches, and traditional constructs of clinical pathology practice, cultivated throughout centuries, have transformed radically in the wake of explosive technological growth and other, e.g., environmental, catalysts of change. Ushered into the fray of modern laboratory medicine are digital imaging devices and machine-learning (ML) software fashioned to mitigate challenges, e.g., practitioner shortage while preparing clinicians for emerging interconnectivity of environments and diagnostic information in the era of big data. As computer vision shapes new constructs for the modern world and intertwines with clinical medicine, cultivating clarity of our new terrain through examining the trajectory and current scope of computational pathology and its pertinence to clinical practice is vital. Through review of numerous studies, we find developmental efforts for ML migrating from research to standardized clinical frameworks while overcoming obstacles that have formerly curtailed adoption of these tools, e.g., generalizability, data availability, and user-friendly accessibility. Groundbreaking validatory efforts have facilitated the clinical deployment of ML tools demonstrating the capacity to effectively aid in distinguishing tumor subtype and grade, classify early vs. advanced cancer stages, and assist in quality control and primary diagnosis applications. Case studies have demonstrated the benefits of streamlined, digitized workflows for practitioners alleviated by decreased burdens.
Collapse
Affiliation(s)
- Ankush U. Patel
- Mayo Clinic Department of Laboratory Medicine and Pathology, Rochester, MN 55905, USA
- Correspondence: ; Tel.: +1-206-451-3519
| | - Nada Shaker
- Department of Pathology, Wexner Medical Center, The Ohio State University, Columbus, OH 43210, USA; (N.S.); (S.G.); (A.V.P.)
| | - Sambit Mohanty
- CORE Diagnostics, Gurugram 122016, India; (S.M.); (S.S.)
- Advanced Medical Research Institute, Bareilly 243001, India
| | - Shivani Sharma
- CORE Diagnostics, Gurugram 122016, India; (S.M.); (S.S.)
| | - Shivam Gangal
- Department of Pathology, Wexner Medical Center, The Ohio State University, Columbus, OH 43210, USA; (N.S.); (S.G.); (A.V.P.)
- College of Engineering, Biomedical Engineering, The Ohio State University, Columbus, OH 43210, USA
| | - Catarina Eloy
- Institute of Molecular Pathology and Immunology of the University of Porto (IPATIMUP), Rua Júlio Amaral de Carvalho, 45, 4200-135 Porto, Portugal;
- Institute for Research and Innovation in Health (I3S Consortium), Rua Alfredo Allen, 208, 4200-135 Porto, Portugal
| | - Anil V. Parwani
- Department of Pathology, Wexner Medical Center, The Ohio State University, Columbus, OH 43210, USA; (N.S.); (S.G.); (A.V.P.)
- Cooperative Human Tissue Network (CHTN) Midwestern Division, Columbus, OH 43240, USA
| |
Collapse
|
20
|
Hara S, Haneda E, Kawakami M, Morita K, Nishioka R, Zoshima T, Kometani M, Yoneda T, Kawano M, Karashima S, Nambo H. Evaluating tubulointerstitial compartments in renal biopsy specimens using a deep learning-based approach for classifying normal and abnormal tubules. PLoS One 2022; 17:e0271161. [PMID: 35816495 PMCID: PMC9273082 DOI: 10.1371/journal.pone.0271161] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Accepted: 06/27/2022] [Indexed: 12/02/2022] Open
Abstract
Renal pathology is essential for diagnosing and assessing the severity and prognosis of kidney diseases. Deep learning-based approaches have developed rapidly and have been applied in renal pathology. However, methods for the automated classification of normal and abnormal renal tubules remain scarce. Using a deep learning-based method, we aimed to classify normal and abnormal renal tubules, thereby assisting renal pathologists in the evaluation of renal biopsy specimens. Consequently, we developed a U-Net-based segmentation model using randomly selected regions obtained from 21 renal biopsy specimens. Further, we verified its performance in multiclass segmentation by calculating the Dice coefficients (DCs). We used 15 cases of tubulointerstitial nephritis to assess its applicability in aiding routine diagnoses conducted by renal pathologists and calculated the agreement ratio between diagnoses conducted by two renal pathologists and the time taken for evaluation. We also determined whether such diagnoses were improved when the output of segmentation was considered. The glomeruli and interstitium had the highest DCs, whereas the normal and abnormal renal tubules had intermediate DCs. Following the detailed evaluation of the tubulointerstitial compartments, the proximal, distal, atrophied, and degenerated tubules had intermediate DCs, whereas the arteries and inflamed tubules had low DCs. The annotation and output areas involving normal and abnormal tubules were strongly correlated in each class. The pathological concordance for the glomerular count, t, ct, and ci scores of the Banff classification of renal allograft pathology remained high with or without the segmented images. However, in terms of time consumption, the quantitative assessment of tubulitis, tubular atrophy, degenerated tubules, and the interstitium was improved significantly when renal pathologists considered the segmentation output. Deep learning algorithms can assist renal pathologists in the classification of normal and abnormal tubules in renal biopsy specimens, thereby facilitating the enhancement of renal pathology and ensuring appropriate clinical decisions.
Collapse
Affiliation(s)
- Satoshi Hara
- Medical Education Research Center, Graduate School of Medical Sciences, Kanazawa University, Kanazawa, Japan
- Department of Rheumatology, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
| | - Emi Haneda
- School of Electrical Information Communication Engineering, College of Science and Engineering, Kanazawa University, Kanazawa, Japan
| | - Masaki Kawakami
- School of Electrical Information Communication Engineering, College of Science and Engineering, Kanazawa University, Kanazawa, Japan
| | - Kento Morita
- School of Electrical Information Communication Engineering, College of Science and Engineering, Kanazawa University, Kanazawa, Japan
| | - Ryo Nishioka
- Department of Rheumatology, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
| | - Takeshi Zoshima
- Department of Rheumatology, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
| | - Mitsuhiro Kometani
- Department of Endocrinology and Metabolism, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
| | - Takashi Yoneda
- Department of Endocrinology and Metabolism, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
- Department of Health Promotion and Medicine of the Future, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
- Faculty of Transdisciplinary Sciences, Institute of Transdisciplinary Sciences, Kanazawa University, Kanazawa, Japan
| | - Mitsuhiro Kawano
- Department of Rheumatology, Kanazawa University Graduate School of Medicine, Kanazawa, Japan
- * E-mail: (MK); (HN)
| | | | - Hidetaka Nambo
- School of Electrical Information Communication Engineering, College of Science and Engineering, Kanazawa University, Kanazawa, Japan
- * E-mail: (MK); (HN)
| |
Collapse
|
21
|
Bülow RD, Marsh JN, Swamidass SJ, Gaut JP, Boor P. The potential of artificial intelligence-based applications in kidney pathology. Curr Opin Nephrol Hypertens 2022; 31:251-257. [PMID: 35165248 PMCID: PMC9035059 DOI: 10.1097/mnh.0000000000000784] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE OF REVIEW The field of pathology is currently undergoing a significant transformation from traditional glass slides to a digital format dependent on whole slide imaging. Transitioning from glass to digital has opened the field to development and application of image analysis technology, commonly deep learning methods (artificial intelligence [AI]) to assist pathologists with tissue examination. Nephropathology is poised to leverage this technology to improve precision, accuracy, and efficiency in clinical practice. RECENT FINDINGS Through a multidisciplinary approach, nephropathologists, and computer scientists have made significant recent advances in developing AI technology to identify histological structures within whole slide images (segmentation), quantification of histologic structures, prediction of clinical outcomes, and classifying disease. Virtual staining of tissue and automation of electron microscopy imaging are emerging applications with particular significance for nephropathology. SUMMARY AI applied to image analysis in nephropathology has potential to transform the field by improving diagnostic accuracy and reproducibility, efficiency, and prognostic power. Reimbursement, demonstration of clinical utility, and seamless workflow integration are essential to widespread adoption.
Collapse
Affiliation(s)
- Roman D. Bülow
- Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany
| | - Jon N. Marsh
- Washington University School of Medicine in St. Louis, Department of Pathology and Immunology
| | - S. Joshua Swamidass
- Washington University School of Medicine in St. Louis, Department of Pathology and Immunology
| | - Joseph P. Gaut
- Washington University School of Medicine in St. Louis, Department of Pathology and Immunology
| | - Peter Boor
- Institute of Pathology, RWTH Aachen University Hospital, Aachen, Germany
- Department of Nephrology and Immunology, RWTH Aachen University Hospital, Aachen, Germany
- Electron Microscopy Facility, RWTH Aachen University Hospital, Aachen, Germany
| |
Collapse
|
22
|
Eadon MT, Dagher PC, El-Achkar TM. Cellular and molecular interrogation of kidney biopsy specimens. Curr Opin Nephrol Hypertens 2022; 31:160-167. [PMID: 34982521 PMCID: PMC8799512 DOI: 10.1097/mnh.0000000000000770] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
PURPOSE OF REVIEW Traditional histopathology of the kidney biopsy specimen has been an essential and successful tool for the diagnosis and staging of kidney diseases. However, it is likely that the full potential of the kidney biopsy has not been tapped so far. Indeed, there is now a concerted worldwide effort to interrogate kidney biopsy samples at the cellular and molecular levels with unprecedented rigor and depth. This review examines these novel approaches to study kidney biopsy specimens and highlights their potential to refine our understanding of the pathophysiology of kidney disease and lead to precision-based diagnosis and therapy. RECENT FINDINGS Several consortia are now active at studying kidney biopsy samples from various patient cohorts with state-of-the art cellular and molecular techniques. These include advanced imaging approaches as well as deep molecular interrogation with tools such as epigenetics, transcriptomics, proteomics and metabolomics. The emphasis throughout is on rigor, reproducibility and quality control. SUMMARY Although these techniques to study kidney biopsies are complementary, each on its own can yield novel ways to define and classify kidney disease. Therefore, great efforts are needed in order to generate an integrated output that can propel the diagnosis and treatment of kidney disease into the realm of precision medicine.
Collapse
Affiliation(s)
- Michael T Eadon
- Department of Medicine, Division of Nephrology, Indiana University School of Medicine, Indianapolis, Indiana, USA
| | | | | |
Collapse
|
23
|
OUP accepted manuscript. Nephrol Dial Transplant 2022; 37:2093-2101. [DOI: 10.1093/ndt/gfac143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Indexed: 11/12/2022] Open
|