Assessment of Digital Pathology Imaging Biomarkers Associated with Breast Cancer Histologic Grade

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Exploration of the relationship between tumor-infiltrating lymphocyte score and histological grade in breast cancer

BACKGROUND

The histological grade is an important factor in the prognosis of invasive breast cancer and is vital to accurately identify the histological grade and reclassify of Grade2 status in breast cancer patients.

METHODS

In this study, data were collected from 556 invasive breast cancer patients, and then randomly divided into training cohort (n = 335) and validation cohort (n = 221). All patients were divided into actual low risk group (Grade1) and high risk group (Grade2/3) based on traditional histological grade, and tumor-infiltrating lymphocyte score (TILs-score) obtained from multiphoton images, and the TILs assessment method proposed by International Immuno-Oncology Biomarker Working Group (TILs-WG) were also used to differentiate between high risk group and low risk group of histological grade in patients with invasive breast cancer. Furthermore, TILs-score was used to reclassify Grade2 (G2) into G2 /Low risk and G2/High risk. The coefficients for each TILs in the training cohort were retrieved using ridge regression and TILs-score was created based on the coefficients of the three kinds of TILs.

RESULTS

Statistical analysis shows that TILs-score is significantly correlated with histological grade, and is an independent predictor of histological grade (odds ratio [OR], 2.548; 95%CI, 1.648-3.941; P < 0.0001), but TILs-WG is not an independent predictive factor for grade (P > 0.05 in the univariate analysis). Moreover, the risk of G2/High risk group is higher than that of G2/Low risk group, and the survival rate of patients with G2/Low risk is similar to that of Grade1, while the survival rate of patients with G2/High risk is even worse than that of patients with G3.

CONCLUSION

Our results suggest that TILs-score can be used to predict the histological grade of breast cancer and potentially to guide the therapeutic management of breast cancer patients.

Shedding light on the black box of a neural network used to detect prostate cancer in whole slide images by occlusion-based explainability

Diagnostic histopathology faces increasing demands due to aging populations and expanding healthcare programs. Semi-automated diagnostic systems employing deep learning methods are one approach to alleviate this pressure. The learning models for histopathology are inherently complex and opaque from the user's perspective. Hence different methods have been developed to interpret their behavior. However, relatively limited attention has been devoted to the connection between interpretation methods and the knowledge of experienced pathologists. The main contribution of this paper is a method for comparing morphological patterns used by expert pathologists to detect cancer with the patterns identified as important for inference of learning models. Given the patch-based nature of processing large-scale histopathological imaging, we have been able to show statistically that the VGG16 model could utilize all the structures that are observable by the pathologist, given the patch size and scan resolution. The results show that the neural network approach to recognizing prostatic cancer is similar to that of a pathologist at medium optical resolution. The saliency maps identified several prevailing histomorphological features characterizing carcinoma, e.g., single-layered epithelium, small lumina, and hyperchromatic nuclei with halo. A convincing finding was the recognition of their mimickers in non-neoplastic tissue. The method can also identify differences, i.e., standard patterns not used by the learning models and new patterns not yet used by pathologists. Saliency maps provide added value for automated digital pathology to analyze and fine-tune deep learning systems and improve trust in computer-based decisions.

A hierarchical self-attention-guided deep learning framework to predict breast cancer response to chemotherapy using pre-treatment tumor biopsies

BACKGROUND

Pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) has demonstrated a strong correlation to improved survival in breast cancer (BC) patients. However, pCR rates to NAC are less than 30%, depending on the BC subtype. Early prediction of NAC response would facilitate therapeutic modifications for individual patients, potentially improving overall treatment outcomes and patient survival.

PURPOSE

This study, for the first time, proposes a hierarchical self-attention-guided deep learning framework to predict NAC response in breast cancer patients using digital histopathological images of pre-treatment biopsy specimens.

METHODS

Digitized hematoxylin and eosin-stained slides of BC core needle biopsies were obtained from 207 patients treated with NAC, followed by surgery. The response to NAC for each patient was determined using the standard clinical and pathological criteria after surgery. The digital pathology images were processed through the proposed hierarchical framework consisting of patch-level and tumor-level processing modules followed by a patient-level response prediction component. A combination of convolutional layers and transformer self-attention blocks were utilized in the patch-level processing architecture to generate optimized feature maps. The feature maps were analyzed through two vision transformer architectures adapted for the tumor-level processing and the patient-level response prediction components. The feature map sequences for these transformer architectures were defined based on the patch positions within the tumor beds and the bed positions within the biopsy slide, respectively. A five-fold cross-validation at the patient level was applied on the training set (144 patients with 9430 annotated tumor beds and 1,559,784 patches) to train the models and optimize the hyperparameters. An unseen independent test set (63 patients with 3574 annotated tumor beds and 173,637 patches) was used to evaluate the framework.

RESULTS

The obtained results on the test set showed an AUC of 0.89 and an F1-score of 90% for predicting pCR to NAC a priori by the proposed hierarchical framework. Similar frameworks with the patch-level, patch-level + tumor-level, and patch-level + patient-level processing components resulted in AUCs of 0.79, 0.81, and 0.84 and F1-scores of 86%, 87%, and 89%, respectively.

CONCLUSIONS

The results demonstrate a high potential of the proposed hierarchical deep-learning methodology for analyzing digital pathology images of pre-treatment tumor biopsies to predict the pathological response of breast cancer to NAC.

Multiplex immunofluorescence and single-cell transcriptomic profiling reveal the spatial cell interaction networks in the non-small cell lung cancer microenvironment

BACKGROUND

Conventional immunohistochemistry technologies were limited by the inability to simultaneously detect multiple markers and the lack of identifying spatial relationships among cells, hindering understanding of the biological processes in cancer immunology.

METHODS

Tissue slices of primary tumours from 553 IA∼IIIB non-small cell lung cancer (NSCLC) cases were stained by multiplex immunofluorescence (mIF) assay for 10 markers, including CD4, CD38, CD20, FOXP3, CD66b, CD8, CD68, PD-L1, CD133 and CD163, evaluating the amounts of 26 phenotypes of cells in tumour nest and tumour stroma. StarDist depth learning model was utilised to determine the spatial location of cells based on mIF graphs. Single-cell RNA sequencing (scRNA-seq) on four primary NSCLC cases was conducted to investigate the putative cell interaction networks.

RESULTS

Spatial proximity among CD20+ B cells, CD4+ T cells and CD38+ T cells (r2  = 0.41) was observed, whereas the distribution of regulatory T cells was associated with decreased infiltration levels of CD20+ B cells and CD38+ T cells (r2  = -0.45). Univariate Cox analyses identified closer proximity between CD8+ T cells predicted longer disease-free survival (DFS). In contrast, closer proximity between CD133+ cancer stem cells (CSCs), longer distances between CD4+ T cells and CD20+ B cells, CD4+ T cells and neutrophils, and CD20+ B cells and neutrophils were correlated with dismal DFS. Data from scRNA-seq further showed that spatially adjacent N1-like neutrophils could boost the proliferation and activation of T and B lymphocytes, whereas spatially neighbouring M2-like macrophages showed negative effects. An immune-related risk score (IRRS) system aggregating robust quantitative and spatial prognosticators showed that high-IRRS patients had significantly worse DFS than low-IRRS ones (HR 2.72, 95% CI 1.87-3.94, p < .001).

CONCLUSIONS

We developed a framework to analyse the cell interaction networks in tumour microenvironment, revealing the spatial architecture and intricate interplays between immune and tumour cells.