1
|
Hölscher DL, Bülow RD. Decoding pathology: the role of computational pathology in research and diagnostics. Pflugers Arch 2025; 477:555-570. [PMID: 39095655 PMCID: PMC11958429 DOI: 10.1007/s00424-024-03002-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Revised: 07/25/2024] [Accepted: 07/25/2024] [Indexed: 08/04/2024]
Abstract
Traditional histopathology, characterized by manual quantifications and assessments, faces challenges such as low-throughput and inter-observer variability that hinder the introduction of precision medicine in pathology diagnostics and research. The advent of digital pathology allowed the introduction of computational pathology, a discipline that leverages computational methods, especially based on deep learning (DL) techniques, to analyze histopathology specimens. A growing body of research shows impressive performances of DL-based models in pathology for a multitude of tasks, such as mutation prediction, large-scale pathomics analyses, or prognosis prediction. New approaches integrate multimodal data sources and increasingly rely on multi-purpose foundation models. This review provides an introductory overview of advancements in computational pathology and discusses their implications for the future of histopathology in research and diagnostics.
Collapse
Affiliation(s)
- David L Hölscher
- Department for Nephrology and Clinical Immunology, RWTH Aachen University Hospital, Pauwelsstraße 30, 52074, Aachen, Germany
- Institute for Pathology, RWTH Aachen University Hospital, Pauwelsstraße 30, 52074, Aachen, Germany
| | - Roman D Bülow
- Institute for Pathology, RWTH Aachen University Hospital, Pauwelsstraße 30, 52074, Aachen, Germany.
| |
Collapse
|
2
|
Noel S, Kapoor R, Rabb H. New approaches to acute kidney injury. Clin Kidney J 2024; 17:65-81. [PMID: 39583139 PMCID: PMC11581771 DOI: 10.1093/ckj/sfae265] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Indexed: 11/26/2024] Open
Abstract
Acute kidney injury (AKI) is a common and serious clinical syndrome that involves complex interplay between different cellular, molecular, metabolic and immunologic mechanisms. Elucidating these pathophysiologic mechanisms is crucial to identify novel biomarkers and therapies. Recent innovative methodologies and the advancement of existing technologies has accelerated our understanding of AKI and led to unexpected new therapeutic candidates. The aim of this review is to introduce and update the reader about recent developments applying novel technologies in omics, imaging, nanomedicine and artificial intelligence to AKI research, plus to provide examples where this can be translated to improve patient care.
Collapse
Affiliation(s)
- Sanjeev Noel
- Division of Nephrology, Department of Medicine, Johns Hopkins University, Baltimore, MD, USA
| | - Radhika Kapoor
- Division of Nephrology, Department of Medicine, Johns Hopkins University, Baltimore, MD, USA
| | - Hamid Rabb
- Division of Nephrology, Department of Medicine, Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
3
|
Abstract
The ability to localize hundreds of macromolecules to discrete locations, structures and cell types in a tissue is a powerful approach to understand the cellular and spatial organization of an organ. Spatially resolved transcriptomic technologies enable mapping of transcripts at single-cell or near single-cell resolution in a multiplex manner. The rapid development of spatial transcriptomic technologies has accelerated the pace of discovery in several fields, including nephrology. Its application to preclinical models and human samples has provided spatial information about new cell types discovered by single-cell sequencing and new insights into the cell-cell interactions within neighbourhoods, and has improved our understanding of the changes that occur in response to injury. Integration of spatial transcriptomic technologies with other omics methods, such as proteomics and spatial epigenetics, will further facilitate the generation of comprehensive molecular atlases, and provide insights into the dynamic relationships of molecular components in homeostasis and disease. This Review provides an overview of current and emerging spatial transcriptomic methods, their applications and remaining challenges for the field.
Collapse
Affiliation(s)
- Sanjay Jain
- Division of Nephrology, Department of Medicine, Washington University School of Medicine, St. Louis, MO, USA.
| | - Michael T Eadon
- Division of Nephrology, Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA.
| |
Collapse
|
4
|
Border S, Ferreira RM, Lucarelli N, Manthey D, Kumar S, Paul A, Mimar S, Naglah A, Cheng YH, Barisoni L, Ray J, Strekalova Y, Rosenberg AZ, Tomaszewski JE, Hodgin JB, El-Achkar TM, Jain S, Eadon MT, Sarder P. FUSION: A web-based application for in-depth exploration of multi-omics data with brightfield histology. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.07.09.602778. [PMID: 39026885 PMCID: PMC11257503 DOI: 10.1101/2024.07.09.602778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/20/2024]
Abstract
Spatial -OMICS technologies facilitate the interrogation of molecular profiles in the context of the underlying histopathology and tissue microenvironment. Paired analysis of histopathology and molecular data can provide pathologists with otherwise unobtainable insights into biological mechanisms. To connect the disparate molecular and histopathologic features into a single workspace, we developed FUSION (Functional Unit State IdentificatiON in WSIs [Whole Slide Images]), a web-based tool that provides users with a broad array of visualization and analytical tools including deep learning-based algorithms for in-depth interrogation of spatial -OMICS datasets and their associated high-resolution histology images. FUSION enables end-to-end analysis of functional tissue units (FTUs), automatically aggregating underlying molecular data to provide a histopathology-based medium for analyzing healthy and altered cell states and driving new discoveries using "pathomic" features. We demonstrate FUSION using 10x Visium spatial transcriptomics (ST) data from both formalin-fixed paraffin embedded (FFPE) and frozen prepared datasets consisting of healthy and diseased tissue. Through several use-cases, we demonstrate how users can identify spatial linkages between quantitative pathomics, qualitative image characteristics, and spatial --omics.
Collapse
Affiliation(s)
- Samuel Border
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| | | | - Nicholas Lucarelli
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| | | | - Suhas Kumar
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| | - Anindya Paul
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| | - Sayat Mimar
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| | - Ahmed Naglah
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| | - Ying-Hua Cheng
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN
| | - Laura Barisoni
- Department of Pathology, Division of AI and Computational Pathology, Duke University, Durham, NC
- Department of Medicine, Division of Nephrology, Duke University, Durham, NC
| | - Jessica Ray
- Department of Health Outcomes & Biomedical Informatics, University of Florida, Gainesville, FL
| | - Yulia Strekalova
- College of Public Health and Health Professions, University of Florida, Gainesville, FL
| | - Avi Z Rosenberg
- Department of Pathology, Johns Hopkins University School of Medicine Baltimore, MD
| | - John E Tomaszewski
- Department of Pathology & Anatomical Sciences, Jacobs School of Medicine & Biomedical Sciences, University at Buffalo, State University of New York, Buffalo, NY
| | | | - Tarek M El-Achkar
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN
- Indianapolis VA Medical Center, Indianapolis, IN
| | - Sanjay Jain
- Department of Medicine, Division of Nephrology, Washington University School of Medicine, St. Louis, MO
| | - Michael T Eadon
- Department of Medicine, Indiana University School of Medicine, Indianapolis, IN
| | - Pinaki Sarder
- Department of Medicine - Section of Quantitative Health, University of Florida, Gainesville, FL
| |
Collapse
|
5
|
Bigler MR, Baum O. Deep learning-based classification of the capillary ultrastructure in human skeletal muscles. Front Mol Biosci 2024; 11:1363384. [PMID: 38751446 PMCID: PMC11094256 DOI: 10.3389/fmolb.2024.1363384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Accepted: 04/04/2024] [Indexed: 05/18/2024] Open
Abstract
Background Capillary ultrastructure in human skeletal muscles is dynamic and prone to alterations in response to many stimuli, e.g., systemic pathologies such as diabetes mellitus and arterial hypertension. Using transmission electron microscopy (TEM) images, several studies have been conducted to quantify the capillary ultrastructure by means of morphometry. Deep learning techniques like convolutional neural networks (CNNs) are utilized to extract data-driven characteristics and to recognize patterns. Hence, the aim of this study was to train a CNN to identify morphometric patterns that differ between capillaries in muscle biopsies of healthy participants and patients with systemic pathologies for the purpose of hypothesis generation. Methods In this retrospective study we used 1810 electron micrographs from human skeletal muscle capillaries derived from 70 study participants which were classified as "healthy" controls or "patients" in dependence of the absence or presence of a documented history of diabetes mellitus, arterial hypertension or peripheral arterial disease. Using these micrographs, a pre-trained open-access CNN (ResNet101) was trained to discriminate between micrographs of capillaries of the two groups. The CNN with the highest diagnostic accuracies during training were subsequently compared with manual quantitative analysis of the capillary ultrastructure to distinguish between "healthy" controls and patients. Results Using classification into controls or patients as allocation reference, receiver-operating-characteristics (ROC)-analysis of manually obtained BM thickness showed the best diagnostic accuracy of all morphometric indicators (area under the ROC-curve (AUC): 0.657 ± 0.050). The best performing CNN demonstrated a diagnostic accuracy of 79% (sensitivity 93%, specificity 92%). DeLong-Test of the ROC-curves showed a significant difference (p < 0.001) between the AUC of the best performing CNN and the BM thickness. The underlying morphology responsible for the network prediction focuses mainly on debridement of pericytes. Conclusion The hypothesis-generating approach using pretrained CNN distinguishes between capillaries depicted on electron micrographs of "healthy" controls and participants with a systemic pathology more accurately than by commonly used morphometric analysis.
Collapse
Affiliation(s)
- Marius Reto Bigler
- Department of Cardiology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Oliver Baum
- Institut für Physiologie, Charité–Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
6
|
Pilva P, Bülow R, Boor P. Deep learning applications for kidney histology analysis. Curr Opin Nephrol Hypertens 2024; 33:291-297. [PMID: 38411024 DOI: 10.1097/mnh.0000000000000973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/28/2024]
Abstract
PURPOSE OF REVIEW Nephropathology is increasingly incorporating computational methods to enhance research and diagnostic accuracy. The widespread adoption of digital pathology, coupled with advancements in deep learning, will likely transform our pathology practices. Here, we discuss basic concepts of deep learning, recent applications in nephropathology, current challenges in implementation and future perspectives. RECENT FINDINGS Deep learning models have been developed and tested in various areas of nephropathology, for example, predicting kidney disease progression or diagnosing diseases based on imaging and clinical data. Despite their promising potential, challenges remain that hinder a wider adoption, for example, the lack of prospective evidence and testing in real-world scenarios. SUMMARY Deep learning offers great opportunities to improve quantitative and qualitative kidney histology analysis for research and clinical nephropathology diagnostics. Although exciting approaches already exist, the potential of deep learning in nephropathology is only at its beginning and we can expect much more to come.
Collapse
Affiliation(s)
| | | | - Peter Boor
- Institute of Pathology
- Department of Nephrology and Clinical Immunology, RWTH Aachen University Hospital, Aachen, Germany
| |
Collapse
|
7
|
Mimar S, Paul AS, Lucarelli N, Border S, Santo BA, Naglah A, Barisoni L, Hodgin J, Rosenberg AZ, Clapp W, Sarder P. ComPRePS: An Automated Cloud-based Image Analysis tool to democratize AI in Digital Pathology. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.21.586102. [PMID: 38585837 PMCID: PMC10996469 DOI: 10.1101/2024.03.21.586102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Artificial intelligence (AI) has extensive applications in a wide range of disciplines including healthcare and clinical practice. Advances in high-resolution whole-slide brightfield microscopy allow for the digitization of histologically stained tissue sections, producing gigapixel-scale whole-slide images (WSI). The significant improvement in computing and revolution of deep neural network (DNN)-based AI technologies over the last decade allow us to integrate massively parallelized computational power, cutting-edge AI algorithms, and big data storage, management, and processing. Applied to WSIs, AI has created opportunities for improved disease diagnostics and prognostics with the ultimate goal of enhancing precision medicine and resulting patient care. The National Institutes of Health (NIH) has recognized the importance of developing standardized principles for data management and discovery for the advancement of science and proposed the Findable, Accessible, Interoperable, Reusable, (FAIR) Data Principles1 with the goal of building a modernized biomedical data resource ecosystem to establish collaborative research communities. In line with this mission and to democratize AI-based image analysis in digital pathology, we propose ComPRePS: an end-to-end automated Computational Renal Pathology Suite which combines massive scalability, on-demand cloud computing, and an easy-to-use web-based user interface for data upload, storage, management, slide-level visualization, and domain expert interaction. Moreover, our platform is equipped with both in-house and collaborator developed sophisticated AI algorithms in the back-end server for image analysis to identify clinically relevant micro-anatomic functional tissue units (FTU) and to extract image features.
Collapse
Affiliation(s)
- Sayat Mimar
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Anindya S. Paul
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Nicholas Lucarelli
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Samuel Border
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Briana A. Santo
- Department of Pathology and Anatomical Sciences, University at Buffalo, Buffalo, NY
- Canon Stroke and Vascular Research Center, University at Buffalo, Buffalo, NY
| | - Ahmed Naglah
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Laura Barisoni
- Department of Pathology, Division of AI & Computational Pathology, Duke University, Durham, NC
- Department of Medicine, Division of Nephrology, Duke University, Durham, NC
| | - Jeffrey Hodgin
- Department of Pathology, University of Michigan, Ann Arbor, MI
| | - Avi Z Rosenberg
- Department of Pathology, Johns Hopkins University, Baltimore, MD
| | - William Clapp
- Department of Pathology, Immunology and Laboratory Medicine, University of Florida, College of Medicine, Gainesville, FL
| | - Pinaki Sarder
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | | |
Collapse
|
8
|
Mimar S, Paul AS, Lucarelli N, Border S, Naglah A, Barisoni L, Hodgin J, Rosenberg AZ, Clapp W, Sarder P. ComPRePS: An Automated Cloud-based Image Analysis tool to democratize AI in Digital Pathology. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2024; 12933:129330Z. [PMID: 38813089 PMCID: PMC11136532 DOI: 10.1117/12.3008469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2024]
Abstract
Artificial intelligence (AI) has extensive applications in a wide range of disciplines including healthcare and clinical practice. Advances in high-resolution whole-slide brightfield microscopy allow for the digitization of histologically stained tissue sections, producing gigapixel-scale whole-slide images (WSI). The significant improvement in computing and revolution of deep neural network (DNN)-based AI technologies over the last decade allow us to integrate massively parallelized computational power, cutting-edge AI algorithms, and big data storage, management, and processing. Applied to WSIs, AI has created opportunities for improved disease diagnostics and prognostics with the ultimate goal of enhancing precision medicine and resulting patient care. The National Institutes of Health (NIH) has recognized the importance of developing standardized principles for data management and discovery for the advancement of science and proposed the Findable, Accessible, Interoperable, Reusable, (FAIR) Data Principles1 with the goal of building a modernized biomedical data resource ecosystem to establish collaborative research communities. In line with this mission and to democratize AI-based image analysis in digital pathology, we propose ComPRePS: an end-to-end automated Computational Renal Pathology Suite which combines massive scalability, on-demand cloud computing, and an easy-to-use web-based user interface for data upload, storage, management, slide-level visualization, and domain expert interaction. Moreover, our platform is equipped with both in-house and collaborator developed sophisticated AI algorithms in the back-end server for image analysis to identify clinically relevant micro-anatomic functional tissue units (FTU) and to extract image features.
Collapse
Affiliation(s)
- Sayat Mimar
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Anindya S. Paul
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Nicholas Lucarelli
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Samuel Border
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Ahmed Naglah
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| | - Laura Barisoni
- Duke University, Department of Pathology, Division of AI & Computational Pathology, Durham, NC
| | - Jeffrey Hodgin
- Department of Pathology, University of Michigan, Ann Arbor, MI
| | - Avi Z Rosenberg
- Department of Pathology, Johns Hopkins University, Baltimore, MD
| | - William Clapp
- Department of Pathology, Immunology and Laboratory Medicine, University of Florida College of Medicine, Gainesville, FL
| | - Pinaki Sarder
- Quantitative Health Section, Division of Nephrology, Hypertension, and Renal Transplantation, Department of Medicine, University of Florida, Gainesville, FL
| |
Collapse
|