Artificial Intelligence Improves Pathologist Agreement for Fibrosis Scores in Nonalcoholic Steatohepatitis Patients

Utility of AI digital pathology as an aid for pathologists scoring fibrosis in MASH

BACKGROUND & AIMS

Intra and inter-pathologist variability poses a significant challenge in metabolic dysfunction-associated steatohepatitis (MASH) biopsy evaluation, leading to suboptimal selection of patients and confounded assessment of histological response in clinical trials. We evaluated the utility of an artificial intelligence (AI) digital pathology (DP) platform to help pathologists improve the reliability of fibrosis staging.

METHODS

A total of 120 digitized histology slides from two trials (NCT03517540, NCT03912532) were analyzed by four expert hepatopathologists, with and without AI assistance in a randomized, crossover design. We utilized an AI DP platform consisting of unstained second harmonic generation/two photon excitation fluorescence (SHG/TPEF) images and AI quantitative fibrosis (qFibrosis) values.

RESULTS

AI assistance significantly improved inter-pathologist kappa for fibrosis staging, particularly for early fibrosis (F0-F2), with reduced variance around the median reads. Intra-pathologist kappa was unchanged. AI assistance increased pathologist concordance for identifying clinical trial inclusion cases (F2-F3) from 45% to 71%, exclusion cases (F0/F1/F4) from 38% to 55%, and evaluation of fibrosis response to treatment from 49% to 61%. SHG/TPEF images, qFibrosis continuous values, and qFibrosis stage were considered useful by at least three out of four pathologists in 83%, 55%, and 38% of cases, respectively. In the context of a clinical trial, the increase in inter-pathologist concordance was modeled to result in a ∼25% reduction in the potential need for adjudication as well as a ∼45% increase in the study power for a kappa improvement from ∼0.4 to ∼0.7.

CONCLUSIONS

The use of AI DP enhances inter-rater reliability of fibrosis staging for MASH. This indicates that the SHG/TPEF-based AI DP tool is useful for assisting pathologists in assessing fibrosis, thereby enhancing clinical trial efficiency and reliability of fibrosis readouts in response to treatments.

IMPACT AND IMPLICATIONS

Implementing an AI DP platform as a tool for pathologists significantly improved inter-pathologist agreement on fibrosis staging, particularly for early-stage fibrosis (F0-F2), which is critical for clinical trial eligibility. The second harmonic generation imaging technology used in conjunction with AI quantitative scores provided enhanced visualization of fibrosis with an indication of severity along the disease continuum. This led to increased pathologist confidence in fibrosis staging and, therefore, increased pathologist concordance for the classification of clinical trial inclusion/exclusion and evaluation of treatment, compared to a standard scoring method based on traditional stains without AI assistance. Improved pathologist concordance with AI assistance could streamline clinical trial processes, reducing the need for adjudication and enhancing study power, potentially decreasing required sample sizes. Continued exploration of the utility of AI assistance across a broader range of pathologists and in prospective clinical trials will be essential for validating the effectiveness of AI assistance.

The Emerging Role of Second Harmonic Generation/Two Photon Excitation for Precision Digital Analysis of Liver Fibrosis in MASH Clinical Trials

Conventional histopathological evaluation of liver biopsy slides has been invaluable in assessing the causes of liver injury, the severity of the underlying disease processes, and the degree of resulting fibrosis. However, the use of conventional histologic assessments as endpoints in clinical trials is limited by the reliability of scoring systems, variability in interpretation of histologic features and translation of continuous variables into categorical scores. To increase the precision and reproducibility of liver biopsy assessment, several artificial intelligence/machine learning (AI/ML) approaches have been developed to analyse high resolution digital images of liver biopsy specimens. Multiple AI/ML platforms are in development with promising results in post-hoc analyses of clinical trial biopsies. One such technique employs images generated by Second Harmonic Generation/Two Photon Excitation (SHG/TPE) microscopy that uniquely uses unstained liver biopsies to provide high resolution images of collagen fibres to assess and quantify collagen morphometry, and avoid challenges related to staining variability. One SHG/TPE microscopy methodology coupled with AI/ML based analysis, qFibrosis™, has been used post-hoc as an exploratory endpoint in several clinical trials for metabolic dysfunction-associated steatohepatitis (MASH) demonstrating its ability to provide a consistent and more nuanced assessment of liver fibrosis that still correlates well with traditional staging. This review summarizes the development of qFibrosis and outlines the need for additional studies to validate it as a sensitive marker for changes in fibrosis in the context of treatment trials and correlate these changes with subsequent liver-related outcomes.

Deep learning and digital pathology powers prediction of HCC development in steatotic liver disease

BACKGROUND AND AIMS

Identifying patients with steatotic liver disease who are at a high risk of developing HCC remains challenging. We present a deep learning (DL) model to predict HCC development using hematoxylin and eosin-stained whole-slide images of biopsy-proven steatotic liver disease.

APPROACH AND RESULTS

We included 639 patients who did not develop HCC for ≥7 years after biopsy (non-HCC class) and 46 patients who developed HCC <7 years after biopsy (HCC class). Paired cases of the HCC and non-HCC classes matched by biopsy date and institution were used for training, and the remaining nonpaired cases were used for validation. The DL model was trained using deep convolutional neural networks with 28,000 image tiles cropped from whole-slide images of the paired cases, with an accuracy of 81.0% and an AUC of 0.80 for predicting HCC development. Validation using the nonpaired cases also demonstrated a good accuracy of 82.3% and an AUC of 0.84. These results were comparable to the predictive ability of logistic regression model using fibrosis stage. Notably, the DL model also detected the cases of HCC development in patients with mild fibrosis. The saliency maps generated by the DL model highlighted various pathological features associated with HCC development, including nuclear atypia, hepatocytes with a high nuclear-cytoplasmic ratio, immune cell infiltration, fibrosis, and a lack of large fat droplets.

CONCLUSIONS

The ability of the DL model to capture subtle pathological features beyond fibrosis suggests its potential for identifying early signs of hepatocarcinogenesis in patients with steatotic liver disease.

Quantitative fibrosis identifies biliary tract involvement and is associated with outcomes in pediatric autoimmune liver disease

BACKGROUND

Children with autoimmune liver disease (AILD) may develop fibrosis-related complications necessitating a liver transplant. We hypothesize that tissue-based analysis of liver fibrosis by second harmonic generation (SHG) microscopy with artificial intelligence analysis can yield prognostic biomarkers in AILD.

METHODS

Patients from single-center studies with unstained slides from clinically obtained liver biopsies at AILD diagnosis were identified. Baseline demographics and liver biochemistries at diagnosis and 1 year were collected. Clinical endpoints studied included the presence of varices, variceal bleeding, ascites, HE, and liver transplant. In collaboration with HistoIndex, unstained slides underwent SHG/artificial intelligence analysis to map fibrosis according to 10 quantitative fibrosis parameters based on tissue location, including total, periportal, perisinusoidal, and pericentral area and length of strings.

RESULTS

Sixty-three patients with AIH (51%), primary sclerosing cholangitis (30%), or autoimmune sclerosing cholangitis (19%) at a median of 14 years old (range: 3-24) were included. An unsupervised analysis of quantitative fibrosis parameters representing total and portal fibrosis identified a patient cluster with more primary sclerosing cholangitis/autoimmune sclerosing cholangitis. This group had more fibrosis at diagnosis by METAVIR classification of histopathological review of biopsies (2.5 vs. 2; p = 0.006). This quantitative fibrosis pattern also predicted abnormal 12-month ALT with an OR of 3.6 (1.3-10, p = 0.014), liver complications with an HR of 3.2 (1.3-7.9, p = 0.01), and liver transplantation with an HR of 20.1 (3-135.7, p = 0.002).

CONCLUSIONS

The application of SHG/artificial intelligence algorithms in pediatric-onset AILD provides improved insight into liver histopathology through fibrosis mapping. SHG allows objective identification of patients with biliary tract involvement, which may be associated with a higher risk for refractory disease.

Consensus statements on the current landscape of artificial intelligence applications in endoscopy, addressing roadblocks, and advancing artificial intelligence in gastroenterology

BACKGROUND AND AIMS

The American Society for Gastrointestinal Endoscopy (ASGE) AI Task Force along with experts in endoscopy, technology space, regulatory authorities, and other medical subspecialties initiated a consensus process that analyzed the current literature, highlighted potential areas, and outlined the necessary research in artificial intelligence (AI) to allow a clearer understanding of AI as it pertains to endoscopy currently.

METHODS

A modified Delphi process was used to develop these consensus statements.

RESULTS

Statement 1: Current advances in AI allow for the development of AI-based algorithms that can be applied to endoscopy to augment endoscopist performance in detection and characterization of endoscopic lesions. Statement 2: Computer vision-based algorithms provide opportunities to redefine quality metrics in endoscopy using AI, which can be standardized and can reduce subjectivity in reporting quality metrics. Natural language processing-based algorithms can help with the data abstraction needed for reporting current quality metrics in GI endoscopy effortlessly. Statement 3: AI technologies can support smart endoscopy suites, which may help optimize workflows in the endoscopy suite, including automated documentation. Statement 4: Using AI and machine learning helps in predictive modeling, diagnosis, and prognostication. High-quality data with multidimensionality are needed for risk prediction, prognostication of specific clinical conditions, and their outcomes when using machine learning methods. Statement 5: Big data and cloud-based tools can help advance clinical research in gastroenterology. Multimodal data are key to understanding the maximal extent of the disease state and unlocking treatment options. Statement 6: Understanding how to evaluate AI algorithms in the gastroenterology literature and clinical trials is important for gastroenterologists, trainees, and researchers, and hence education efforts by GI societies are needed. Statement 7: Several challenges regarding integrating AI solutions into the clinical practice of endoscopy exist, including understanding the role of human-AI interaction. Transparency, interpretability, and explainability of AI algorithms play a key role in their clinical adoption in GI endoscopy. Developing appropriate AI governance, data procurement, and tools needed for the AI lifecycle are critical for the successful implementation of AI into clinical practice. Statement 8: For payment of AI in endoscopy, a thorough evaluation of the potential value proposition for AI systems may help guide purchasing decisions in endoscopy. Reliable cost-effectiveness studies to guide reimbursement are needed. Statement 9: Relevant clinical outcomes and performance metrics for AI in gastroenterology are currently not well defined. To improve the quality and interpretability of research in the field, steps need to be taken to define these evidence standards. Statement 10: A balanced view of AI technologies and active collaboration between the medical technology industry, computer scientists, gastroenterologists, and researchers are critical for the meaningful advancement of AI in gastroenterology.

CONCLUSIONS

The consensus process led by the ASGE AI Task Force and experts from various disciplines has shed light on the potential of AI in endoscopy and gastroenterology. AI-based algorithms have shown promise in augmenting endoscopist performance, redefining quality metrics, optimizing workflows, and aiding in predictive modeling and diagnosis. However, challenges remain in evaluating AI algorithms, ensuring transparency and interpretability, addressing governance and data procurement, determining payment models, defining relevant clinical outcomes, and fostering collaboration between stakeholders. Addressing these challenges while maintaining a balanced perspective is crucial for the meaningful advancement of AI in gastroenterology.

Digital quantitation of bridging fibrosis and septa reveals changes in natural history and treatment not seen with conventional histology

BACKGROUND AND AIMS

Metabolic dysfunction-associated steatohepatitis (MASH) with bridging fibrosis is a critical stage in the evolution of fatty liver disease. Second harmonic generation/two-photon excitation fluorescence (SHG/TPEF) microscopy with artificial intelligence (AI) provides sensitive and reproducible quantitation of liver fibrosis. This methodology was applied to gain an in-depth understanding of intra-stage fibrosis changes and septa analyses in a homogenous, well-characterised group with MASH F3 fibrosis.

METHODS

Paired liver biopsies (baseline [BL] and end of treatment [EOT]) of 57 patients (placebo, n = 17 and tropifexor n = 40), with F3 fibrosis stage at BL according to the clinical research network (CRN) scoring, were included. Unstained sections were examined using SHG/TPEF microscopy with AI. Changes in liver fibrosis overall and in five areas of liver lobules were quantitatively assessed by qFibrosis. Progressive, regressive septa, and 12 septa parameters were quantitatively analysed.

RESULTS

qFibrosis demonstrated fibrosis progression or regression in 14/17 (82%) patients receiving placebo, while the CRN scoring categorised 11/17 (65%) as 'no change'. Radar maps with qFibrosis readouts visualised quantitative fibrosis dynamics in different areas of liver lobules even in cases categorised as 'No Change'. Measurement of septa parameters objectively differentiated regressive and progressive septa (p < .001). Quantitative changes in individual septa parameters (BL to EOT) were observed both in the 'no change' and the 'regression' subgroups, as defined by the CRN scoring.

CONCLUSION

SHG/TPEF microscopy with AI provides greater granularity and precision in assessing fibrosis dynamics in patients with bridging fibrosis, thus advancing knowledge development of fibrosis evolution in natural history and in clinical trials.

Envisioning how to advance the MASH field

Since 1980, the cumulative effort of scientists and health-care stakeholders has advanced the prerequisites to address metabolic dysfunction-associated steatotic liver disease (MASLD), a prevalent chronic non-communicable liver disease. This effort has led to, among others, the approval of the first drug specific for metabolic dysfunction-associated steatohepatitis (MASH; formerly known as nonalcoholic steatohepatitis). Despite substantial progress, MASLD is still a leading cause of advanced chronic liver disease, including primary liver cancer. This Perspective contextualizes the nomenclature change from nonalcoholic fatty liver disease to MASLD and proposes important considerations to accelerate further progress in the field, optimize patient-centric multidisciplinary care pathways, advance pharmacological, behavioural and diagnostic research, and address health disparities. Key regulatory and other steps necessary to optimize the approval and access to upcoming additional pharmacological therapeutic agents for MASH are also outlined. We conclude by calling for increased education and awareness, enhanced health system preparedness, and concerted action by policy-makers to further the public health and policy agenda to achieve at least parity with other non-communicable diseases and to aid in growing the community of practice to reduce the human and economic burden and end the public health threat of MASLD and MASH by 2030.

Potential of Using qFibrosis Analysis to Predict Recurrent and Survival Outcome of Patients with Hepatocellular Carcinoma after Hepatic Resection

BACKGROUND

There remains a lack of studies addressing the stromal background and fibrosis features and their prognostic value in liver cancer. qFibrosis can identify, quantify, and visualize the fibrosis features in biopsy samples. In this study, we aim to demonstrate the prognostic value of histological features by using qFibrosis analysis in liver cancer patients.

METHODS

Liver specimens from 201 patients with hepatocellular carcinoma (HCC) who underwent curative resection were imaged and assessed using qFibrosis system and generated a total of 33 and 156 collagen parameters from tumor part and non-tumor liver tissue, respectively. We used these collagen parameters on patients to build two combined indexes, RFS index and OS index, in order to differentiate patients with early recurrence and early death, respectively. The models were validated using the leave-one-out method.

RESULTS

Both combined indexes had significant prediction value for patients' outcome. The RFS index of 0.52 well differentiates patients with early recurrence (p < 0.001), and the OS index of 0.73 well differentiates patients with early death during follow-up (p = 0.02).

CONCLUSIONS

Combined index calculated with qFibrosis from a digital readout of the fibrotic status of peri-tumor liver specimen in patients with HCC has prediction values for their disease and survival outcomes. These results demonstrated the potential to transform histopathological features into quantifiable data that could be used to correlate with clinical outcome.

Artificial intelligence-assisted digital pathology for non-alcoholic steatohepatitis: current status and future directions

The worldwide prevalence of non-alcoholic steatohepatitis (NASH) is increasing, causing a significant medical burden, but no approved therapeutics are currently available. NASH drug development requires histological analysis of liver biopsies by expert pathologists for trial enrolment and efficacy assessment, which can be hindered by multiple issues including sample heterogeneity, inter-reader and intra-reader variability, and ordinal scoring systems. Consequently, there is a high unmet need for accurate, reproducible, quantitative, and automated methods to assist pathologists with histological analysis to improve the precision around treatment and efficacy assessment. Digital pathology (DP) workflows in combination with artificial intelligence (AI) have been established in other areas of medicine and are being actively investigated in NASH to assist pathologists in the evaluation and scoring of NASH histology. DP/AI models can be used to automatically detect, localise, quantify, and score histological parameters and have the potential to reduce the impact of scoring variability in NASH clinical trials. This narrative review provides an overview of DP/AI tools in development for NASH, highlights key regulatory considerations, and discusses how these advances may impact the future of NASH clinical management and drug development. This should be a high priority in the NASH field, particularly to improve the development of safe and effective therapeutics.

Digital pathology for nonalcoholic steatohepatitis assessment

Histological assessment of nonalcoholic fatty liver disease (NAFLD) has anchored knowledge development about the phenotypes of the condition, their natural history and their clinical course. This fact has led to the use of histological assessment as a reference standard for the evaluation of efficacy of drug interventions for nonalcoholic steatohepatitis (NASH) - the more histologically active form of NAFLD. However, certain limitations of conventional histological assessment systems pose challenges in drug development. These limitations have spurred intense scientific and commercial development of machine learning and digital approaches towards the assessment of liver histology in patients with NAFLD. This research field remains an area in rapid evolution. In this Perspective article, we summarize the current conventional assessment of NASH and its limitations, the use of specific digital approaches for histological assessment, and their application to the study of NASH and its response to therapy. Although this is not a comprehensive review, the leading tools currently used to assess therapeutic efficacy in drug development are specifically discussed. The potential translation of these approaches to support routine clinical assessment of NAFLD and an agenda for future research are also discussed.

Fibrosis severity scoring on Sirius red histology with multiple-instance deep learning

Non-alcoholic fatty liver disease (NAFLD) is now the leading cause of chronic liver disease, affecting approximately 30% of people worldwide. Histopathology reading of fibrosis patterns is crucial to diagnosing NAFLD. In particular, separating mild from severe stages corresponds to a critical transition as it correlates with clinical outcomes. Deep Learning for digitized histopathology whole-slide images (WSIs) can reduce high inter- and intra-rater variability. We demonstrate a novel solution to score fibrosis severity on a retrospective cohort of 152 Sirius-Red WSIs, with fibrosis stage annotated at slide level by an expert pathologist. We exploit multiple instance learning and multiple-inferences to address the sparsity of pathological signs. We achieved an accuracy of , an F1 score of and an AUC of . These results set new state-of-the-art benchmarks for this application.

A researcher's guide to preclinical mouse NASH models

Non-alcoholic fatty liver disease (NAFLD) and its inflammatory form, non-alcoholic steatohepatitis (NASH), have quickly risen to become the most prevalent chronic liver disease in the Western world and are risk factors for the development of hepatocellular carcinoma (HCC). HCC is not only one of the most common cancers but is also highly lethal. Nevertheless, there are currently no clinically approved drugs for NAFLD, and NASH-induced HCC poses a unique metabolic microenvironment that may influence responsiveness to certain treatments. Therefore, there is an urgent need to better understand the pathogenesis of this rampant disease to devise new therapies. In this line, preclinical mouse models are crucial tools to investigate mechanisms as well as novel treatment modalities during the pathogenesis of NASH and subsequent HCC in preparation for human clinical trials. Although, there are numerous genetically induced, diet-induced and toxin-induced models of NASH, not all of these models faithfully phenocopy and mirror the human pathology very well. In this Perspective, we shed some light onto the most widely used mouse models of NASH and highlight some of the key advantages and disadvantages of the various models with an emphasis on 'Western diets', which are increasingly recognized as some of the best models in recapitulating the human NASH pathology and comorbidities.