Method for coregistration of optical measurements of breast tissue with histopathology: the importance of accounting for tissue deformations

Point Projection Mapping System for Tracking, Registering, Labeling, and Validating Optical Tissue Measurements

The validation of newly developed optical tissue-sensing techniques for tumor detection during cancer surgery requires an accurate correlation with the histological results. Additionally, such an accurate correlation facilitates precise data labeling for developing high-performance machine learning tissue-classification models. In this paper, a newly developed Point Projection Mapping system will be introduced, which allows non-destructive tracking of the measurement locations on tissue specimens. Additionally, a framework for accurate registration, validation, and labeling with the histopathology results is proposed and validated on a case study. The proposed framework provides a more-robust and accurate method for the tracking and validation of optical tissue-sensing techniques, which saves time and resources compared to the available conventional techniques.

Direct co-registration of [18F]FDG uptake and histopathology in surgically excised malignancies of the head and neck: a feasibility study

PURPOSE

Recent technical advancements in PET imaging have improved sensitivity and spatial resolution. Consequently, clinical nuclear medicine will be confronted with PET images on a previously unfamiliar resolution. To better understand [18F]FDG distribution at submillimetric scale, a direct correlation of radionuclide-imaging and histopathology is required.

METHODS

A total of five patients diagnosed with a malignancy of the head and neck were injected with a clinical activity of [18F]FDG before undergoing surgical resection. The resected specimen was imaged using a preclinical high-resolution PET/CT, followed by slicing of the specimen. Multiple slices were rescanned using a micro-PET/CT device, and one of the slices was snap-frozen for frozen sections. Frozen sections were placed on an autoradiographic film, followed by haematoxylin and eosin staining to prepare them for histopathological assessment. The results from both autoradiography and histopathology were co-registered using an iterative co-registration algorithm, and regions of interest were identified to study radiotracer uptake.

RESULTS

The co-registration between the autoradiographs and their corresponding histopathology was successful in all specimens. The use of this novel methodology allowed direct comparison of autoradiography and histopathology and enabled the visualisation of uncharted heterogeneity in [18F]FDG uptake in both benign and malignant tissue.

CONCLUSION

We here describe a novel methodology enabling the direct co-registration of [18F]FDG autoradiography with the gold standard of histopathology in human malignant tissue. The future use of the current methodology could further increase our understanding of the distribution of radionuclides in surgically excised malignancies and hence, improve the integration of pathology and molecular imaging in a multiscale perspective.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT05068687.

Discriminating healthy from tumor tissue in breast lumpectomy specimens using deep learning-based hyperspectral imaging

Achieving an adequate resection margin during breast-conserving surgery remains challenging due to the lack of intraoperative feedback. Here, we evaluated the use of hyperspectral imaging to discriminate healthy tissue from tumor tissue in lumpectomy specimens. We first used a dataset obtained on tissue slices to develop and evaluate three convolutional neural networks. Second, we fine-tuned the networks with lumpectomy data to predict the tissue percentages of the lumpectomy resection surface. A MCC of 0.92 was achieved on the tissue slices and an RMSE of 9% on the lumpectomy resection surface. This shows the potential of hyperspectral imaging to classify the resection margins of lumpectomy specimens.

Correlation of in-vivo imaging with histopathology: A review

Despite tremendous advancements in in vivo imaging modalities, there remains substantial uncertainty with respect to tumor delineation on in these images. Histopathology remains the gold standard for determining the extent of malignancy, with in vivo imaging to histopathologic correlation enabling spatial comparisons. In this review, the steps necessary for successful imaging to histopathologic correlation are described, including in vivo imaging, resection, fixation, specimen sectioning (sectioning technique, securing technique, orientation matching, slice matching), microtome sectioning and staining, correlation (including image registration) and performance evaluation. The techniques used for each of these steps are also discussed. Hundreds of publications from the past 20 years were surveyed, and 62 selected for detailed analysis. For these 62 publications, each stage of the correlative pathology process (and the sub-steps of specimen sectioning) are listed. A statistical analysis was conducted based on 19 studies that reported target registration error as their performance metric. While some methods promise greater accuracy, they may be expensive. Due to the complexity of the processes involved, correlative pathology studies generally include a small number of subjects, which hinders advanced developments in this field.

Technical Note: Histological validation of anatomical imaging for breast modeling using a novel cryo-microtome

PURPOSE

Precise correlation between three-dimensional (3D) imaging and histology can aid biomechanical modeling of the breast. We develop a framework to register ex vivo images to histology using a novel cryo-fluorescence tomography (CFT) device.

METHODS

A formalin-fixed cadaveric breast specimen, including chest wall, was subjected to high-resolution magnetic resonance (MR) imaging. The specimen was then frozen and embedded in an optimal cutting temperature (OCT) compound. The OCT block was placed in a CFT device with an overhead camera and 50 μm thick slices were successively shaved off the block. After each shaving, the block-face was photographed. At select locations including connective/adipose tissue, muscle, skin, and fibroglandular tissue, 20 μm sections were transferred onto cryogenic tape for manual hematoxylin and eosin staining, histological assessment, and image capture. A 3D white-light image was automatically reconstructed from the photographs by aligning fiducial markers embedded in the OCT block. The 3D MR image, 3D white-light image, and photomicrographs were rigidly registered. Target registration errors (TREs) were computed based on 10 pairs of points marked at fibroglandular intersections. The overall MR-histology registration was used to compare the MR intensities at tissue extraction sites with a one-way analysis of variance.

RESULTS

The MR image to CFT-captured white-light image registration achieved a mean TRE of 0.73 ± 0.25 mm (less than the 1 mm MR slice resolution). The block-face white-light image and block-face photomicrograph registration showed visually indistinguishable alignment of anatomical structures and tissue boundaries. The MR intensities at the four tissue sites identified from histology differed significantly (p < 0.01). Each tissue pair, except the skin-connective/adipose tissue pair, also had significantly different MR intensities (p < 0.01).

CONCLUSIONS

Fine sectioning in a highly controlled imaging/sectioning environment enables accurate registration between the MR image and histology. Statistically significant differences in MR signal intensities between histological tissues are indicators for the specificity of correlation between MRI and histology.

Explainable liver tumor delineation in surgical specimens using hyperspectral imaging and deep learning

Surgical removal is the primary treatment for liver cancer, but frequent recurrence caused by residual malignant tissue remains an important challenge, as recurrence leads to high mortality. It is unreliable to distinguish tumors from normal tissues merely under visual inspection. Hyperspectral imaging (HSI) has been proved to be a promising technology for intra-operative use by capturing the spatial and spectral information of tissue in a fast, non-contact and label-free manner. In this work, we investigated the feasibility of HSI for liver tumor delineation on surgical specimens using a multi-task U-Net framework. Measurements are performed on 19 patients and a dataset of 36 specimens was collected with corresponding pathological results serving as the ground truth. The developed framework can achieve an overall sensitivity of 94.48% and a specificity of 87.22%, outperforming the baseline SVM method by a large margin. In particular, we propose to add explanations on the well-trained model from the spatial and spectral dimensions to show the contribution of pixels and spectral channels explicitly. On that basis, a novel saliency-weighted channel selection method is further proposed to select a small subset of 5 spectral channels which provide essentially as much information as using all 224 channels. According to the dominant channels, the absorption difference of hemoglobin and bile content in the normal and malignant tissues seems to be promising markers that could be further exploited.

Influence of neoadjuvant chemotherapy on diffuse reflectance spectra of tissue in breast surgery specimens

Diffuse reflectance spectroscopy (DRS) can discriminate different tissue types based on optical characteristics. Since this technology has the ability to detect tumor tissue, several groups have proposed to use DRS for margin assessment during breast-conserving surgery for breast cancer. Nowadays, an increasing number of patients with breast cancer are being treated by neoadjuvant chemotherapy. Limited research has been published on the influence of neoadjuvant chemotherapy on the optical characteristics of the tissue. Hence, it is unclear whether margin assessment based on DRS is feasible in this specific group of patients. We investigate whether there is an effect of neoadjuvant chemotherapy on optical measurements of breast tissue. To this end, DRS measurements were performed on 92 ex-vivo breast specimens from 92 patients, treated with neoadjuvant chemotherapy and without neoadjuvant chemotherapy. Generalized estimating equation (GEE) models were generated, comparing the measurements of patients with and without neoadjuvant chemotherapy in datasets of different tissue types using a significance level of 5%. As input for the GEE models, either the intensity at a specific wavelength or a fit parameter, derived from the spectrum, was used. In the evaluation of the intensity, no influence of neoadjuvant chemotherapy was found, since none of the wavelengths were significantly different between the measurements with and the measurements without neoadjuvant chemotherapy in any of the datasets. These results were confirmed by the analysis of the fit parameters, which showed a significant difference for the amount of collagen in only one dataset. All other fit parameters were not significant for any of the datasets. These findings may indicate that assessment of the resection margin with DRS is also feasible in the growing population of breast cancer patients who receive neoadjuvant chemotherapy. However, it is possible that we did not detect neoadjuvant chemotherapy effect in the some of the datasets due to the small number of measurements in those datasets.