1
|
Multimodal Gated Mixture of Experts Using Whole Slide Image and Flow Cytometry for Multiple Instance Learning Classification of Lymphoma. J Pathol Inform 2024; 15:100359. [PMID: 38322152 PMCID: PMC10844119 DOI: 10.1016/j.jpi.2023.100359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 12/07/2023] [Accepted: 12/23/2023] [Indexed: 02/08/2024] Open
Abstract
In this study, we present a deep-learning-based multimodal classification method for lymphoma diagnosis in digital pathology, which utilizes a whole slide image (WSI) as the primary image data and flow cytometry (FCM) data as auxiliary information. In pathological diagnosis of malignant lymphoma, FCM serves as valuable auxiliary information during the diagnosis process, offering useful insights into predicting the major class (superclass) of subtypes. By incorporating both images and FCM data into the classification process, we can develop a method that mimics the diagnostic process of pathologists, enhancing the explainability. In order to incorporate the hierarchical structure between superclasses and their subclasses, the proposed method utilizes a network structure that effectively combines the mixture of experts (MoE) and multiple instance learning (MIL) techniques, where MIL is widely recognized for its effectiveness in handling WSIs in digital pathology. The MoE network in the proposed method consists of a gating network for superclass classification and multiple expert networks for (sub)class classification, specialized for each superclass. To evaluate the effectiveness of our method, we conducted experiments involving a six-class classification task using 600 lymphoma cases. The proposed method achieved a classification accuracy of 72.3%, surpassing the 69.5% obtained through the straightforward combination of FCM and images, as well as the 70.2% achieved by the method using only images. Moreover, the combination of multiple weights in the MoE and MIL allows for the visualization of specific cellular and tumor regions, resulting in a highly explanatory model that cannot be attained with conventional methods. It is anticipated that by targeting a larger number of classes and increasing the number of expert networks, the proposed method could be effectively applied to the real problem of lymphoma diagnosis.
Collapse
|
2
|
Pathomics Signature for Prognosis and Chemotherapy Benefits in Stage III Colon Cancer. JAMA Surg 2024; 159:519-528. [PMID: 38416471 PMCID: PMC10902777 DOI: 10.1001/jamasurg.2023.8015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Accepted: 11/12/2023] [Indexed: 02/29/2024]
Abstract
Importance The current TNM staging system may not provide adequate information for prognostic purposes and to assess the potential benefits of chemotherapy for patients with stage III colon cancer. Objective To develop and validate a pathomics signature to estimate prognosis and benefit from chemotherapy using hematoxylin-eosin (H-E)-stained slides. Design, Setting, and Participants This retrospective prognostic study used data from consecutive patients with histologically confirmed stage III colon cancer at 2 medical centers between January 2012 and December 2015. A total of 114 pathomics features were extracted from digital H-E-stained images from Nanfang Hospital of Southern Medical University, Guangzhou, China, and a pathomics signature was constructed using a least absolute shrinkage and selection operator Cox regression model in the training cohort. The associations of the pathomics signature with disease-free survival (DFS) and overall survival (OS) were evaluated. Patients at the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China, formed the validation cohort. Data analysis was conducted from September 2022 to March 2023. Main Outcomes and Measures The prognostic accuracy of the pathomics signature as well as its association with chemotherapy response were evaluated. Results This study included 785 patients (mean [SD] age, 62.7 [11.1] years; 437 [55.7%] male). A pathomics signature was constructed based on 4 features. Multivariable analysis revealed that the pathomics signature was an independent factor associated with DFS (hazard ratio [HR], 2.46 [95% CI, 2.89-4.13]; P < .001) and OS (HR, 2.78 [95% CI, 2.34-3.31]; P < .001) in the training cohort. Incorporating the pathomics signature into pathomics nomograms resulted in better performance for the estimation of prognosis than the traditional model in a concordance index comparison in the training cohort (DFS: HR, 0.88 [95% CI, 0.86-0.89] vs HR, 0.73 [95% CI, 0.71-0.75]; P < .001; OS: HR, 0.85 [95% CI, 0.84-0.86] vs HR, 0.74 [95% CI, 0.72-0.76]; P < .001) and validation cohort (DFS: HR, 0.83 [95% CI, 0.82-0.85] vs HR, 0.70 [95% CI, 0.67-0.72]; P < .001; OS: HR, 0.80 [95% CI, 0.78-0.82] vs HR, 0.69 [0.67-0.72]; P < .001). Further analysis revealed that patients with a low pathomics signature were more likely to benefit from chemotherapy (eg, combined cohort: DFS: HR, 0.44 [95% CI, 0.28-0.69]; P = .001; OS: HR, 0.43 [95% CI, 0.29-0.64]; P < .001). Conclusions and Relevance These findings suggest that a pathomics signature could help identify patients most likely to benefit from chemotherapy in stage III colon cancer.
Collapse
|
3
|
Deep learning applications for kidney histology analysis. Curr Opin Nephrol Hypertens 2024; 33:291-297. [PMID: 38411024 DOI: 10.1097/mnh.0000000000000973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/28/2024]
Abstract
PURPOSE OF REVIEW Nephropathology is increasingly incorporating computational methods to enhance research and diagnostic accuracy. The widespread adoption of digital pathology, coupled with advancements in deep learning, will likely transform our pathology practices. Here, we discuss basic concepts of deep learning, recent applications in nephropathology, current challenges in implementation and future perspectives. RECENT FINDINGS Deep learning models have been developed and tested in various areas of nephropathology, for example, predicting kidney disease progression or diagnosing diseases based on imaging and clinical data. Despite their promising potential, challenges remain that hinder a wider adoption, for example, the lack of prospective evidence and testing in real-world scenarios. SUMMARY Deep learning offers great opportunities to improve quantitative and qualitative kidney histology analysis for research and clinical nephropathology diagnostics. Although exciting approaches already exist, the potential of deep learning in nephropathology is only at its beginning and we can expect much more to come.
Collapse
|
4
|
[Artificial intelligence in kidney transplant pathology]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024:10.1007/s00292-024-01324-7. [PMID: 38598097 DOI: 10.1007/s00292-024-01324-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/12/2024] [Indexed: 04/11/2024]
Abstract
BACKGROUND Artificial intelligence (AI) systems have showed promising results in digital pathology, including digital nephropathology and specifically also kidney transplant pathology. AIM Summarize the current state of research and limitations in the field of AI in kidney transplant pathology diagnostics and provide a future outlook. MATERIALS AND METHODS Literature search in PubMed and Web of Science using the search terms "deep learning", "transplant", and "kidney". Based on these results and studies cited in the identified literature, a selection was made of studies that have a histopathological focus and use AI to improve kidney transplant diagnostics. RESULTS AND CONCLUSION Many studies have already made important contributions, particularly to the automation of the quantification of some histopathological lesions in nephropathology. This likely can be extended to automatically quantify all relevant lesions for a kidney transplant, such as Banff lesions. Important limitations and challenges exist in the collection of representative data sets and the updates of Banff classification, making large-scale studies challenging. The already positive study results make future AI support in kidney transplant pathology appear likely.
Collapse
|
5
|
GDF-15 Suppresses Puromycin Aminonucleoside-Induced Podocyte Injury by Reducing Endoplasmic Reticulum Stress and Glomerular Inflammation. Cells 2024; 13:637. [PMID: 38607075 PMCID: PMC11011265 DOI: 10.3390/cells13070637] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 03/22/2024] [Accepted: 03/30/2024] [Indexed: 04/13/2024] Open
Abstract
GDF15, also known as MIC1, is a member of the TGF-beta superfamily. Previous studies reported elevated serum levels of GDF15 in patients with kidney disorder, and its association with kidney disease progression, while other studies identified GDF15 to have protective effects. To investigate the potential protective role of GDF15 on podocytes, we first performed in vitro studies using a Gdf15-deficient podocyte cell line. The lack of GDF15 intensified puromycin aminonucleoside (PAN)-triggered endoplasmic reticulum stress and induced cell death in cultivated podocytes. This was evidenced by elevated expressions of Xbp1 and ER-associated chaperones, alongside AnnexinV/PI staining and LDH release. Additionally, we subjected mice to nephrotoxic PAN treatment. Our observations revealed a noteworthy increase in both GDF15 expression and secretion subsequent to PAN administration. Gdf15 knockout mice displayed a moderate loss of WT1+ cells (podocytes) in the glomeruli compared to wild-type controls. However, this finding could not be substantiated through digital evaluation. The parameters of kidney function, including serum BUN, creatinine, and albumin-creatinine ratio (ACR), were increased in Gdf15 knockout mice as compared to wild-type mice upon PAN treatment. This was associated with an increase in the number of glomerular macrophages, neutrophils, inflammatory cytokines, and chemokines in Gdf15-deficient mice. In summary, our findings unveil a novel renoprotective effect of GDF15 during kidney injury and inflammation by promoting podocyte survival and regulating endoplasmic reticulum stress in podocytes, and, subsequently, the infiltration of inflammatory cells via paracrine effects on surrounding glomerular cells.
Collapse
|
6
|
The Challenge of Assessing Remission and Relapse in ANCA Kidney Disease. J Am Soc Nephrol 2024; 35:395-397. [PMID: 38557787 PMCID: PMC11000735 DOI: 10.1681/asn.0000000000000331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024] Open
|
7
|
Podocyte number and glomerulosclerosis indices are associated with the response to therapy for primary focal segmental glomerulosclerosis. Front Med (Lausanne) 2024; 11:1343161. [PMID: 38510448 PMCID: PMC10951056 DOI: 10.3389/fmed.2024.1343161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Accepted: 02/19/2024] [Indexed: 03/22/2024] Open
Abstract
Corticosteroid therapy, often in combination with inhibition of the renin-angiotensin system, is first-line therapy for primary focal and segmental glomerulosclerosis (FSGS) with nephrotic-range proteinuria. However, the response to treatment is variable, and therefore new approaches to indicate the response to therapy are required. Podocyte depletion is a hallmark of early FSGS, and here we investigated whether podocyte number, density and/or size in diagnostic biopsies and/or the degree of glomerulosclerosis could indicate the clinical response to first-line therapy. In this retrospective single center cohort study, 19 participants (13 responders, 6 non-responders) were included. Biopsies obtained at diagnosis were prepared for analysis of podocyte number, density and size using design-based stereology. Renal function and proteinuria were assessed 6 months after therapy commenced. Responders and non-responders had similar levels of proteinuria at the time of biopsy and similar kidney function. Patients who did not respond to treatment at 6 months had a significantly higher percentage of glomeruli with global sclerosis than responders (p < 0.05) and glomerulosclerotic index (p < 0.05). Podocyte number per glomerulus in responders was 279 (203-507; median, IQR), 50% greater than that of non-responders (186, 118-310; p < 0.05). These findings suggest that primary FSGS patients with higher podocyte number per glomerulus and less advanced glomerulosclerosis are more likely to respond to first-line therapy at 6 months. A podocyte number less than approximately 216 per glomerulus, a GSI greater than 1 and percentage global sclerosis greater than approximately 20% are associated with a lack of response to therapy. Larger, prospective studies are warranted to confirm whether these parameters may help inform therapeutic decision making at the time of diagnosis of primary FSGS.
Collapse
|
8
|
tRigon: an R package and Shiny App for integrative (path-)omics data analysis. BMC Bioinformatics 2024; 25:98. [PMID: 38443821 PMCID: PMC10916305 DOI: 10.1186/s12859-024-05721-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 02/26/2024] [Indexed: 03/07/2024] Open
Abstract
BACKGROUND Pathomics facilitates automated, reproducible and precise histopathology analysis and morphological phenotyping. Similar to molecular omics, pathomics datasets are high-dimensional, but also face large outlier variability and inherent data missingness, making quick and comprehensible data analysis challenging. To facilitate pathomics data analysis and interpretation as well as support a broad implementation we developed tRigon (Toolbox foR InteGrative (path-)Omics data aNalysis), a Shiny application for fast, comprehensive and reproducible pathomics analysis. RESULTS tRigon is available via the CRAN repository ( https://cran.r-project.org/web/packages/tRigon ) with its source code available on GitLab ( https://git-ce.rwth-aachen.de/labooratory-ai/trigon ). The tRigon package can be installed locally and its application can be executed from the R console via the command 'tRigon::run_tRigon()'. Alternatively, the application is hosted online and can be accessed at https://labooratory.shinyapps.io/tRigon . We show fast computation of small, medium and large datasets in a low- and high-performance hardware setting, indicating broad applicability of tRigon. CONCLUSIONS tRigon allows researchers without coding abilities to perform exploratory feature analyses of pathomics and non-pathomics datasets on their own using a variety of hardware.
Collapse
|
9
|
Computational pathology model to assess acute and chronic transformations of the tubulointerstitial compartment in renal allograft biopsies. Sci Rep 2024; 14:5345. [PMID: 38438513 PMCID: PMC10912734 DOI: 10.1038/s41598-024-55936-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 02/29/2024] [Indexed: 03/06/2024] Open
Abstract
Managing patients with kidney allografts largely depends on biopsy diagnosis which is based on semiquantitative assessments of rejection features and extent of acute and chronic changes within the renal parenchyma. Current methods lack reproducibility while digital image data-driven computational models enable comprehensive and quantitative assays. In this study we aimed to develop a computational method for automated assessment of histopathology transformations within the tubulointerstitial compartment of the renal cortex. Whole slide images of modified Picrosirius red-stained biopsy slides were used for the training (n = 852) and both internal (n = 172) and external (n = 94) tests datasets. The pipeline utilizes deep learning segmentations of renal tubules, interstitium, and peritubular capillaries from which morphometry features were extracted. Seven indicators were selected for exploring the intrinsic spatial interactions within the tubulointerstitial compartment. A principal component analysis revealed two independent factors which can be interpreted as representing chronic and acute tubulointerstitial injury. A K-means clustering classified biopsies according to potential phenotypes of combined acute and chronic transformations of various degrees. We conclude that multivariate analyses of tubulointerstitial morphometry transformations enable extraction of and quantification of acute and chronic components of injury. The method is developed for renal allograft biopsies; however, the principle can be applied more broadly for kidney pathology assessment.
Collapse
|
10
|
[Advances in computational quantitative nephropathology]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024; 45:140-145. [PMID: 38308066 DOI: 10.1007/s00292-024-01300-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/05/2024] [Indexed: 02/04/2024]
Abstract
BACKGROUND Semiquantitative histological scoring systems are frequently used in nephropathology. In computational nephropathology, the focus is on generating quantitative data from histology (so-called pathomics). Several recent studies have collected such data using next-generation morphometry (NGM) based on segmentations by artificial neural networks and investigated their usability for various clinical or diagnostic purposes. AIM To present an overview of the current state of studies regarding renal pathomics and to identify current challenges and potential solutions. MATERIALS AND METHODS Due to the literature restriction (maximum of 30 references), studies were selected based on a database search that processed as much data as possible, used innovative methodologies, and/or were ideally multicentric in design. RESULTS AND DISCUSSION Pathomics studies in the kidney have impressively demonstrated that morphometric data are useful clinically (for example, for prognosis assessment) and translationally. Further development of NGM requires overcoming some challenges, including better standardization and generation of prospective evidence.
Collapse
|
11
|
Precision Medicine in Nephrology: An Integrative Framework of Multidimensional Data in the Kidney Precision Medicine Project. Am J Kidney Dis 2024; 83:402-410. [PMID: 37839688 PMCID: PMC10922684 DOI: 10.1053/j.ajkd.2023.08.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 08/20/2023] [Accepted: 08/25/2023] [Indexed: 10/17/2023]
Abstract
Chronic kidney disease (CKD) and acute kidney injury (AKI) are heterogeneous syndromes defined clinically by serial measures of kidney function. Each condition possesses strong histopathologic associations, including glomerular obsolescence or acute tubular necrosis, respectively. Despite such characterization, there remains wide variation in patient outcomes and treatment responses. Precision medicine efforts, as exemplified by the Kidney Precision Medicine Project (KPMP), have begun to establish evolving, spatially anchored, cellular and molecular atlases of the cell types, states, and niches of the kidney in health and disease. The KPMP atlas provides molecular context for CKD and AKI disease drivers and will help define subtypes of disease that are not readily apparent from canonical functional or histopathologic characterization but instead are appreciable through advanced clinical phenotyping, pathomic, transcriptomic, proteomic, epigenomic, and metabolomic interrogation of kidney biopsy samples. This perspective outlines the structure of the KPMP, its approach to the integration of these diverse datasets, and its major outputs relevant to future patient care.
Collapse
|
12
|
Ultrastructural characterization of maturing iPSC-derived nephron structures upon transplantation. Microsc Res Tech 2024; 87:495-505. [PMID: 37929605 DOI: 10.1002/jemt.24447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 09/29/2023] [Accepted: 10/14/2023] [Indexed: 11/07/2023]
Abstract
Pluripotent stem cell-derived kidney organoids hold great promise as a potential auxiliary transplant tissue for individuals with end-stage renal disease and as a platform for studying kidney diseases and drug discovery. To establish accurate models, it is crucial to thoroughly characterize the morphological features and maturation stages of the cellular components within these organoids. Nephrons, the functional units of the kidney, possess distinct morphological structures that directly correlate with their specific functions. High spatial resolution imaging emerges as a powerful technique for capturing ultrastructural details that may go unnoticed with other methods such as immunofluorescent imaging and scRNA sequencing. In our study, we have applied software capable of seamlessly stitching virtual slides generated from electron microscopy, resulting in high-definition overviews of tissue slides. With this technology, we can comprehensively characterize the development and maturation of kidney organoids when transplanted under the renal capsule of mice. These organoids exhibit advanced ultrastructural developments upon transplantation, including the formation of the filtration barrier in the renal corpuscle, the presence of microvilli in the proximal tubule, and various types of cell sub-segmentation in the connecting tubule similarly to those seen in the adult kidney. Such ultrastructural characterization provides invaluable insights into the structural development and functional morphology of nephron segments within kidney organoids and how to advance them by interventions such as a transplantation. Research Highlights High-resolution imaging is crucial to determine morphological maturation of hiPSC-derived kidney organoids. Upon transplantation, refined ultrastructural development of nephron segments was observed, such as the development of the glomerular filtration barrier.
Collapse
|
13
|
Artificial Intelligence-Based Treatment Decisions: A New Era for NSCLC. Cancers (Basel) 2024; 16:831. [PMID: 38398222 PMCID: PMC10887017 DOI: 10.3390/cancers16040831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 02/12/2024] [Accepted: 02/17/2024] [Indexed: 02/25/2024] Open
Abstract
Non-small cell lung cancer (NSCLC) is the leading cause of cancer-related mortality among women and men, in developed countries, despite the public health interventions including tobacco-free campaigns, screening and early detection methods, recent therapeutic advances, and ongoing intense research on novel antineoplastic modalities. Targeting oncogenic driver mutations and immune checkpoint inhibition has indeed revolutionized NSCLC treatment, yet there still remains the unmet need for robust and standardized predictive biomarkers to accurately inform clinical decisions. Artificial intelligence (AI) represents the computer-based science concerned with large datasets for complex problem-solving. Its concept has brought a paradigm shift in oncology considering its immense potential for improved diagnosis, treatment guidance, and prognosis. In this review, we present the current state of AI-driven applications on NSCLC management, with a particular focus on radiomics and pathomics, and critically discuss both the existing limitations and future directions in this field. The thoracic oncology community should not be discouraged by the likely long road of AI implementation into daily clinical practice, as its transformative impact on personalized treatment approaches is undeniable.
Collapse
|
14
|
QOT: Efficient Computation of Sample Level Distance Matrix from Single-Cell Omics Data through Quantized Optimal Transport. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.06.578032. [PMID: 38370767 PMCID: PMC10871252 DOI: 10.1101/2024.02.06.578032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
Single-cell technologies have emerged as a transformative technology enabling high-dimensional characterization of cell populations at an unprecedented scale. The data's innate complexity and voluminous nature pose significant computational and analytical challenges, especially in comparative studies delineating cellular architectures across various biological conditions (i.e., generation of sample level distance matrices). Optimal Transport (OT) is a mathematical tool that captures the intrinsic structure of data geometrically and has been applied to many bioinformatics tasks. In this paper, we propose QOT (Quantized Optimal Transport), a new method enables efficient computation of sample level distance matrix from large-scale single-cell omics data through a quantization step. We apply our algorithm to real-world single-cell genomics and pathomics datasets, aiming to extrapolate cell-level insights to inform sample level categorizations. Our empirical study shows that QOT outperforms OT-based algorithms in terms of accuracy and robustness when obtaining a distance matrix at the sample level from high throughput single-cell measures. Moreover, the sample level distance matrix could be used in downstream analysis (i.e. uncover the trajectory of disease progression), highlighting its usage in biomedical informatics and data science.
Collapse
|
15
|
Detection of PatIent-Level distances from single cell genomics and pathomics data with Optimal Transport (PILOT). Mol Syst Biol 2024; 20:57-74. [PMID: 38177382 PMCID: PMC10883279 DOI: 10.1038/s44320-023-00003-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 11/20/2023] [Accepted: 11/24/2023] [Indexed: 01/06/2024] Open
Abstract
Although clinical applications represent the next challenge in single-cell genomics and digital pathology, we still lack computational methods to analyze single-cell or pathomics data to find sample-level trajectories or clusters associated with diseases. This remains challenging as single-cell/pathomics data are multi-scale, i.e., a sample is represented by clusters of cells/structures, and samples cannot be easily compared with each other. Here we propose PatIent Level analysis with Optimal Transport (PILOT). PILOT uses optimal transport to compute the Wasserstein distance between two individual single-cell samples. This allows us to perform unsupervised analysis at the sample level and uncover trajectories or cellular clusters associated with disease progression. We evaluate PILOT and competing approaches in single-cell genomics or pathomics studies involving various human diseases with up to 600 samples/patients and millions of cells or tissue structures. Our results demonstrate that PILOT detects disease-associated samples from large and complex single-cell or pathomics data. Moreover, PILOT provides a statistical approach to find changes in cell populations, gene expression, and tissue structures related to the trajectories or clusters supporting interpretation of predictions.
Collapse
|
16
|
The dawn of multimodal artificial intelligence in nephrology. Nat Rev Nephrol 2024; 20:79-80. [PMID: 38097775 DOI: 10.1038/s41581-023-00799-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2024]
|
17
|
Inferring super-resolution tissue architecture by integrating spatial transcriptomics with histology. Nat Biotechnol 2024:10.1038/s41587-023-02019-9. [PMID: 38168986 DOI: 10.1038/s41587-023-02019-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Accepted: 10/04/2023] [Indexed: 01/05/2024]
Abstract
Spatial transcriptomics (ST) has demonstrated enormous potential for generating intricate molecular maps of cells within tissues. Here we present iStar, a method based on hierarchical image feature extraction that integrates ST data and high-resolution histology images to predict spatial gene expression with super-resolution. Our method enhances gene expression resolution to near-single-cell levels in ST and enables gene expression prediction in tissue sections where only histology images are available.
Collapse
|
18
|
Operational greenhouse-gas emissions of deep learning in digital pathology: a modelling study. Lancet Digit Health 2024; 6:e58-e69. [PMID: 37996339 PMCID: PMC10728828 DOI: 10.1016/s2589-7500(23)00219-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 10/04/2023] [Accepted: 10/16/2023] [Indexed: 11/25/2023]
Abstract
BACKGROUND Deep learning is a promising way to improve health care. Image-processing medical disciplines, such as pathology, are expected to be transformed by deep learning. The first clinically applicable deep-learning diagnostic support tools are already available in cancer pathology, and their number is increasing. However, data on the environmental sustainability of these tools are scarce. We aimed to conduct an environmental-sustainability analysis of a theoretical implementation of deep learning in patient-care pathology. METHODS For this modelling study, we first assembled and calculated relevant data and parameters of a digital-pathology workflow. Data were breast and prostate specimens from the university clinic at the Institute of Pathology of the Rheinisch-Westfälische Technische Hochschule Aachen (Aachen, Germany), for which commercially available deep learning was already available. Only specimens collected between Jan 1 and Dec 31, 2019 were used, to omit potential biases due to the COVID-19 pandemic. Our final selection was based on 2 representative weeks outside holidays, covering different types of specimens. To calculate carbon dioxide (CO2) or CO2 equivalent (CO2 eq) emissions of deep learning in pathology, we gathered relevant data for exact numbers and sizes of whole-slide images (WSIs), which were generated by scanning histopathology samples of prostate and breast specimens. We also evaluated different data input scenarios (including all slide tiles, only tiles containing tissue, or only tiles containing regions of interest). To convert estimated energy consumption from kWh to CO2 eq, we used the internet protocol address of the computational server and the Electricity Maps database to obtain information on the sources of the local electricity grid (ie, renewable vs non-renewable), and estimated the number of trees and proportion of the local and world's forests needed to sequester the CO2 eq emissions. We calculated the computational requirements and CO2 eq emissions of 30 deep-learning models that varied in task and size. The first scenario represented the use of one commercially available deep-learning model for one task in one case (1-task), the second scenario considered two deep-learning models for two tasks per case (2-task), the third scenario represented a future, potentially automated workflow that could handle 7 tasks per case (7-task), and the fourth scenario represented the use of a single potential, large, computer-vision model that could conduct multiple tasks (multitask). We also compared the performance (ie, accuracy) and CO2 eq emissions of different deep-learning models for the classification of renal cell carcinoma on WSIs, also from Rheinisch-Westfälische Technische Hochschule Aachen. We also tested other approaches to reducing CO2 eq emissions, including model pruning and an alternative method for histopathology analysis (pathomics). FINDINGS The pathology database contained 35 552 specimens (237 179 slides), 6420 of which were prostate specimens (10 115 slides) and 11 801 of which were breast specimens (19 763 slides). We selected and subsequently digitised 140 slides from eight breast-cancer cases and 223 slides from five prostate-cancer cases. Applying large deep-learning models on all WSI tiles of prostate and breast pathology cases would result in yearly CO2 eq emissions of 7·65 metric tons (t; 95% CI 7·62-7·68) with the use of a single deep-learning model per case; yearly CO2 eq emissions were up to 100·56 t (100·21-100·99) with the use of seven deep-learning models per case. CO2 eq emissions for different deep-learning model scenarios, data inputs, and deep-learning model sizes for all slides varied from 3·61 t (3·59-3·63) to 2795·30 t (1177·51-6482·13. For the estimated number of overall pathology cases worldwide, the yearly CO2 eq emissions varied, reaching up to 16 megatons (Mt) of CO2 eq, requiring up to 86 590 km2 (0·22%) of world forest to sequester the CO2 eq emissions. Use of the 7-task scenario and small deep-learning models on slides containing tissue only could substantially reduce CO2 eq emissions worldwide by up to 141 times (0·1 Mt, 95% CI 0·1-0·1). Considering the local environment in Aachen, Germany, the maximum CO2 eq emission from the use of deep learning in digital pathology only would require 32·8% (95% CI 13·8-76·6) of the local forest to sequester the CO2 eq emissions. A single pathomics run on a tissue could provide information that was comparable to or even better than the output of multitask deep-learning models, but with 147 times reduced CO2 eq emissions. INTERPRETATION Our findings suggest that widespread use of deep learning in pathology might have considerable global-warming potential. The medical community, policy decision makers, and the public should be aware of this potential and encourage the use of CO2 eq emissions reduction strategies where possible. FUNDING German Research Foundation, European Research Council, German Federal Ministry of Education and Research, Health, Economic Affairs and Climate Action, and the Innovation Fund of the Federal Joint Committee.
Collapse
|
19
|
Learning from deep learning and pathomics. Kidney Int 2023; 104:1050-1053. [PMID: 37336291 DOI: 10.1016/j.kint.2023.06.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2023] [Accepted: 06/06/2023] [Indexed: 06/21/2023]
|
20
|
Correlating Deep Learning-Based Automated Reference Kidney Histomorphometry with Patient Demographics and Creatinine. KIDNEY360 2023; 4:1726-1737. [PMID: 37966063 PMCID: PMC10758512 DOI: 10.34067/kid.0000000000000299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 10/26/2023] [Indexed: 11/16/2023]
Abstract
Key Points The authors leverage the unique benefits of panoptic segmentation to perform the largest ever quantitation of reference kidney morphometry. Kidney features vary with age and sex; and glomeruli size may intricately link to creatinine, defying prior notions. Background Reference histomorphometric data of healthy human kidneys are largely lacking because of laborious quantitation requirements. Correlating histomorphometric features with clinical parameters through machine learning approaches can provide valuable information about natural population variance. To this end, we leveraged deep learning (DL), computational image analysis, and feature analysis to associate the relationship of histomorphometry with patient age, sex, serum creatinine (SCr), and eGFR in a multinational set of reference kidney tissue sections. Methods A panoptic segmentation neural network was developed and used to segment viable and sclerotic glomeruli, cortical and medullary interstitia, tubules, and arteries/arterioles in the digitized images of 79 periodic acid–Schiff-stained human nephrectomy sections showing minimal pathologic changes. Simple morphometrics (e.g. , area, radius, density) were quantified from the segmented classes. Regression analysis aided in determining the association of histomorphometric parameters with age, sex, SCr, and eGFR. Results Our DL model achieved high segmentation performance for all test compartments. The size and density of glomeruli, tubules, and arteries/arterioles varied significantly among healthy humans, with potentially large differences between geographically diverse patients. Glomerular size was significantly correlated with SCr and eGFR. Slight, albeit significant, differences in renal vasculature were observed between sexes. Glomerulosclerosis percentage increased, and cortical density of arteries/arterioles decreased, as a function of increasing age. Conclusions Using DL, we automated precise measurements of kidney histomorphometric features. In the reference kidney tissue, several histomorphometric features demonstrated significant correlation to patient demographics, SCr, and eGFR. DL tools can increase the efficiency and rigor of histomorphometric analysis.
Collapse
|
21
|
Kidney fibrosis: Emerging diagnostic and therapeutic strategies. Mol Aspects Med 2023; 93:101206. [PMID: 37541106 DOI: 10.1016/j.mam.2023.101206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 07/25/2023] [Indexed: 08/06/2023]
Abstract
An increasing number of patients worldwide suffers from chronic kidney disease (CKD). CKD is accompanied by kidney fibrosis, which affects all compartments of the kidney, i.e., the glomeruli, tubulointerstitium, and vasculature. Fibrosis is the best predictor of progression of kidney diseases. Currently, there is no specific anti-fibrotic therapy for kidney patients and invasive renal biopsy remains the only option for specific detection and quantification of kidney fibrosis. Here we review emerging diagnostic approaches and potential therapeutic options for fibrosis. We discuss how translational research could help to establish fibrosis-specific endpoints for clinical trials, leading to improved patient stratification and potentially companion diagnostics, and facilitating and optimizing development of novel anti-fibrotic therapies for kidney patients.
Collapse
|
22
|
Semiautomated pipeline for quantitative analysis of heart histopathology. J Transl Med 2023; 21:666. [PMID: 37752535 PMCID: PMC10523682 DOI: 10.1186/s12967-023-04544-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 09/19/2023] [Indexed: 09/28/2023] Open
Abstract
BACKGROUND Heart diseases are among the leading causes of death worldwide, many of which lead to pathological cardiomyocyte hypertrophy and capillary rarefaction in both patients and animal models, the quantification of which is both technically challenging and highly time-consuming. Here we developed a semiautomated pipeline for quantification of the size of cardiomyocytes and capillary density in cardiac histology, termed HeartJ, by generating macros in ImageJ, a broadly used, open-source, Java-based software. METHODS We have used modified Gomori silver staining, which is easy to perform and digitize in high throughput, or Fluorescein-labeled lectin staining. The latter can be easily combined with other stainings, allowing additional quantitative analysis on the same section, e.g., the size of cardiomyocyte nuclei, capillary density, or single-cardiomyocyte protein expression. We validated the pipeline in a mouse model of cardiac hypertrophy induced by transverse aortic constriction, and in autopsy samples of patients with and without aortic stenosis. RESULTS In both animals and humans, HeartJ-based histology quantification revealed significant hypertrophy of cardiomyocytes reflecting other parameters of hypertrophy and rarefaction of microvasculature and enabling the analysis of protein expression in individual cardiomyocytes. The analysis also revealed that murine and human cardiomyocytes had similar diameters in health and extent of hypertrophy in disease confirming the translatability of our murine cardiac hypertrophy model. HeartJ enables a rapid analysis that would not be feasible by manual methods. The pipeline has little hardware requirements and is freely available. CONCLUSIONS In summary, our analysis pipeline can facilitate effective and objective quantitative histological analyses in preclinical and clinical heart samples.
Collapse
|
23
|
New Challenges for Anatomists in the Era of Omics. Diagnostics (Basel) 2023; 13:2963. [PMID: 37761332 PMCID: PMC10529314 DOI: 10.3390/diagnostics13182963] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 09/08/2023] [Accepted: 09/10/2023] [Indexed: 09/29/2023] Open
Abstract
Anatomic studies have traditionally relied on macroscopic, microscopic, and histological techniques to investigate the structure of tissues and organs. Anatomic studies are essential in many fields, including medicine, biology, and veterinary science. Advances in technology, such as imaging techniques and molecular biology, continue to provide new insights into the anatomy of living organisms. Therefore, anatomy remains an active and important area in the scientific field. The consolidation in recent years of some omics technologies such as genomics, transcriptomics, proteomics, and metabolomics allows for a more complete and detailed understanding of the structure and function of cells, tissues, and organs. These have been joined more recently by "omics" such as radiomics, pathomics, and connectomics, supported by computer-assisted technologies such as neural networks, 3D bioprinting, and artificial intelligence. All these new tools, although some are still in the early stages of development, have the potential to strongly contribute to the macroscopic and microscopic characterization in medicine. For anatomists, it is time to hitch a ride and get on board omics technologies to sail to new frontiers and to explore novel scenarios in anatomy.
Collapse
|
24
|
Quantifying acute kidney injury in an Ischaemia-Reperfusion Injury mouse model using deep-learning-based semantic segmentation in histology. Biol Open 2023; 12:bio059988. [PMID: 37642317 PMCID: PMC10537956 DOI: 10.1242/bio.059988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 08/22/2023] [Indexed: 08/31/2023] Open
Abstract
This study focuses on ischaemia-reperfusion injury (IRI) in kidneys, a cause of acute kidney injury (AKI) and end-stage kidney disease (ESKD). Traditional kidney damage assessment methods are semi-quantitative and subjective. This study aims to use a convolutional neural network (CNN) to segment murine kidney structures after IRI, quantify damage via CNN-generated pathological measurements, and compare this to conventional scoring. The CNN was able to accurately segment the different pathological classes, such as Intratubular casts and Tubular necrosis, with an F1 score of over 0.75. Some classes, such as Glomeruli and Proximal tubules, had even higher statistical values with F1 scores over 0.90. The scoring generated based on the segmentation approach statistically correlated with the semiquantitative assessment (Spearman's rank correlation coefficient=0.94). The heatmap approach localised the intratubular necrosis mainly in the outer stripe of the outer medulla, while the tubular casts were also present in more superficial or deeper portions of the cortex and medullary areas. This study presents a CNN model capable of segmenting multiple classes of interest, including acute IRI-specific pathological changes, in a whole mouse kidney section and can provide insights into the distribution of pathological classes within the whole mouse kidney section.
Collapse
|
25
|
Finerenone Added to RAS/SGLT2 Blockade for CKD in Alport Syndrome. Results of a Randomized Controlled Trial with Col4a3-/- Mice. J Am Soc Nephrol 2023; 34:1513-1520. [PMID: 37428955 PMCID: PMC10482061 DOI: 10.1681/asn.0000000000000186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Accepted: 06/22/2023] [Indexed: 07/12/2023] Open
Abstract
SIGNIFICANCE STATEMENT We hypothesized that triple therapy with inhibitors of the renin-angiotensin system (RAS), sodium-glucose transporter (SGLT)-2, and the mineralocorticoid receptor (MR) would be superior to dual RAS/SGLT2 blockade in attenuating CKD progression in Col4a3 -deficient mice, a model of Alport syndrome. Late-onset ramipril monotherapy or dual ramipril/empagliflozin therapy attenuated CKD and prolonged overall survival by 2 weeks. Adding the nonsteroidal MR antagonist finerenone extended survival by 4 weeks. Pathomics and RNA sequencing revealed significant protective effects on the tubulointerstitium when adding finerenone to RAS/SGLT2 inhibition. Thus, triple RAS/SGLT2/MR blockade has synergistic effects and might attenuate CKD progression in patients with Alport syndrome and possibly other progressive chronic kidney disorders. BACKGROUND Dual inhibition of the renin-angiotensin system (RAS) plus sodium-glucose transporter (SGLT)-2 or the mineralocorticoid receptor (MR) demonstrated additive renoprotective effects in large clinical trials. We hypothesized that triple therapy with RAS/SGLT2/MR inhibitors would be superior to dual RAS/SGLT2 blockade in attenuating CKD progression. METHODS We performed a preclinical randomized controlled trial (PCTE0000266) in Col4a3 -deficient mice with established Alport nephropathy. Treatment was initiated late (age 6 weeks) in mice with elevated serum creatinine and albuminuria and with glomerulosclerosis, interstitial fibrosis, and tubular atrophy. We block-randomized 40 male and 40 female mice to either nil (vehicle) or late-onset food admixes of ramipril monotherapy (10 mg/kg), ramipril plus empagliflozin (30 mg/kg), or ramipril plus empagliflozin plus finerenone (10 mg/kg). Primary end point was mean survival. RESULTS Mean survival was 63.7±10.0 days (vehicle), 77.3±5.3 days (ramipril), 80.3±11.0 days (dual), and 103.1±20.3 days (triple). Sex did not affect outcome. Histopathology, pathomics, and RNA sequencing revealed that finerenone mainly suppressed the residual interstitial inflammation and fibrosis despite dual RAS/SGLT2 inhibition. CONCLUSION Experiments in mice suggest that triple RAS/SGLT2/MR blockade may substantially improve renal outcomes in Alport syndrome and possibly other progressive CKDs because of synergistic effects on the glomerular and tubulointerstitial compartments.
Collapse
|
26
|
Artificial Intelligence Assists in the Detection of Blood Vessels in Whole Slide Images: Practical Benefits for Oncological Pathology. Biomolecules 2023; 13:1327. [PMID: 37759727 PMCID: PMC10526383 DOI: 10.3390/biom13091327] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 08/23/2023] [Accepted: 08/28/2023] [Indexed: 09/29/2023] Open
Abstract
The analysis of the microvasculature and the assessment of angiogenesis have significant prognostic value in various diseases, including cancer. The search for invasion into the blood and lymphatic vessels and the assessment of angiogenesis are important aspects of oncological diagnosis. These features determine the prognosis and aggressiveness of the tumor. Traditional manual evaluation methods are time consuming and subject to inter-observer variability. Blood vessel detection is a perfect task for artificial intelligence, which is capable of rapid analyzing thousands of tissue structures in whole slide images. The development of computer vision solutions requires the segmentation of tissue regions, the extraction of features and the training of machine learning models. In this review, we focus on the methodologies employed by researchers to identify blood vessels and vascular invasion across a range of tumor localizations, including breast, lung, colon, brain, renal, pancreatic, gastric and oral cavity cancers. Contemporary models herald a new era of computational pathology in morphological diagnostics.
Collapse
|
27
|
Extending the landscape of omics technologies by pathomics. NPJ Syst Biol Appl 2023; 9:38. [PMID: 37550386 PMCID: PMC10406938 DOI: 10.1038/s41540-023-00301-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 07/31/2023] [Indexed: 08/09/2023] Open
|
28
|
High-throughput image analysis with deep learning captures heterogeneity and spatial relationships after kidney injury. Sci Rep 2023; 13:6361. [PMID: 37076596 PMCID: PMC10115810 DOI: 10.1038/s41598-023-33433-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 04/12/2023] [Indexed: 04/21/2023] Open
Abstract
Recovery from acute kidney injury can vary widely in patients and in animal models. Immunofluorescence staining can provide spatial information about heterogeneous injury responses, but often only a fraction of stained tissue is analyzed. Deep learning can expand analysis to larger areas and sample numbers by substituting for time-intensive manual or semi-automated quantification techniques. Here we report one approach to leverage deep learning tools to quantify heterogenous responses to kidney injury that can be deployed without specialized equipment or programming expertise. We first demonstrated that deep learning models generated from small training sets accurately identified a range of stains and structures with performance similar to that of trained human observers. We then showed this approach accurately tracks the evolution of folic acid induced kidney injury in mice and highlights spatially clustered tubules that fail to repair. We then demonstrated that this approach captures the variation in recovery across a robust sample of kidneys after ischemic injury. Finally, we showed markers of failed repair after ischemic injury were correlated both spatially within and between animals and that failed repair was inversely correlated with peritubular capillary density. Combined, we demonstrate the utility and versatility of our approach to capture spatially heterogenous responses to kidney injury.
Collapse
|