Fully Automated Postlumpectomy Breast Margin Assessment Utilizing Convolutional Neural Network Based Optical Coherence Tomography Image Classification Method

Comparing the diagnostic efficacy of optical coherence tomography and frozen section for margin assessment in breast-conserving surgery: a meta-analysis

AIMS

This meta-analysis assessed the relative diagnostic accuracy of optical coherence tomography (OCT) versus frozen section (FS) in evaluating surgical margins during breast-conserving procedures.

METHODS

PubMed and Embase were searched for relevant studies published up to October 2023. The inclusion criteria encompassed studies evaluating the diagnostic accuracy of OCT or FS in patients undergoing breast-conserving surgery. Sensitivity and specificity were analysed using the DerSimonian and Laird method and subsequently transformed through the Freeman-Tukey double inverse sine method.

RESULTS

The meta-analysis encompassed 36 articles, comprising 16 studies on OCT and 20 on FS, involving 10 289 specimens from 8058 patients. The overall sensitivity of OCT was 0.93 (95% CI: 0.90 to 0.96), surpassing that of FS, which was 0.82 (95% CI: 0.71 to 0.92), indicating a significantly higher sensitivity for OCT (p=0.04). Conversely, the overall specificity of OCT was 0.89 (95% CI: 0.83 to 0.94), while FS exhibited a higher specificity at 0.97 (95% CI: 0.95 to 0.99), suggesting a superior specificity for FS (p＜0.01).

CONCLUSIONS

Our meta-analysis reveals that OCT offers superior sensitivity but inferior specificity compared with FS in assessing surgical margins in breast-conserving surgery patients. Further larger well-designed prospective studies are needed, especially those employing a head-to-head comparison design.

PROSPERO REGISTRATION NUMBER

CRD42023483751.

Spatial and Spectral Reconstruction of Breast Lumpectomy Hyperspectral Images

(1) Background: Hyperspectral imaging has emerged as a promising margin assessment technique for breast-conserving surgery. However, to be implicated intraoperatively, it should be both fast and capable of yielding high-quality images to provide accurate guidance and decision-making throughout the surgery. As there exists a trade-off between image quality and data acquisition time, higher resolution images come at the cost of longer acquisition times and vice versa. (2) Methods: Therefore, in this study, we introduce a deep learning spatial-spectral reconstruction framework to obtain a high-resolution hyperspectral image from a low-resolution hyperspectral image combined with a high-resolution RGB image as input. (3) Results: Using the framework, we demonstrate the ability to perform a fast data acquisition during surgery while maintaining a high image quality, even in complex scenarios where challenges arise, such as blur due to motion artifacts, dead pixels on the camera sensor, noise from the sensor's reduced sensitivity at spectral extremities, and specular reflections caused by smooth surface areas of the tissue. (4) Conclusion: This gives the opportunity to facilitate an accurate margin assessment through intraoperative hyperspectral imaging.

The LMIT: Light-mediated minimally-invasive theranostics in oncology

Minimally-invasive diagnosis and therapy have gradually become the trend and research hotspot of current medical applications. The integration of intraoperative diagnosis and treatment is a development important direction for real-time detection, minimally-invasive diagnosis and therapy to reduce mortality and improve the quality of life of patients, so called minimally-invasive theranostics (MIT). Light is an important theranostic tool for the treatment of cancerous tissues. Light-mediated minimally-invasive theranostics (LMIT) is a novel evolutionary technology that integrates diagnosis and therapeutics for the less invasive treatment of diseased tissues. Intelligent theranostics would promote precision surgery based on the optical characterization of cancerous tissues. Furthermore, MIT also requires the assistance of smart medical devices or robots. And, optical multimodality lay a solid foundation for intelligent MIT. In this review, we summarize the important state-of-the-arts of optical MIT or LMIT in oncology. Multimodal optical image-guided intelligent treatment is another focus. Intraoperative imaging and real-time analysis-guided optical treatment are also systemically discussed. Finally, the potential challenges and future perspectives of intelligent optical MIT are discussed.

Atherosclerosis plaque tissue classification using self-attention-based conditional variational auto-encoder generative adversarial network using OCT plaque image

Adults with coronary artery disease often have atherosclerosis, this is defined as the accumulation of plaque in the tissues of the arterial wall. Cardiologists utilize optical coherence tomography (OCT), a light-based imaging method, to examine the layers of intracoronary tissue along pathological formations, such as plaque accumulation. Intracoronary cross-sectional images produced by state-of-the-art catheter-based imaging scheme have 10-15 µm high resolution. Nevertheless, interpretation of the obtained images depends on the operator, which takes a lot of time and is exceedingly error-prone from one observer to another. OCT image post-processing that automatically and accurately tags coronary plaques can help the technique become more widely used and lower the diagnostic error rate. To overcome these problems, Atherosclerosis plaque tissue classification using Self-Attention-Based Conditional Variational Auto-Encoder Generative Adversarial Network (APC-OCTPI-SACVAGAN) is proposed which classifies the Atherosclerosis plaque images as Fibro calcific plaque, Fibro atheroma, Thrombus, Fibrous plaque and Micro-vessel. The proposed APC-OCTPI-SACVAGAN technique is executed in MATLAB. The efficiency of proposed APC-OCTPI-SACVAGAN method attains 16.19 %, 17.93 %, 19.81 % and 1.57 % higher accuracy; 16.92 %, 11.54 %, 5.29 % and 1.946 % higher Area under curve; and 28.06 %, 25.32 %, 32.19 % and 39.185 % lower computational time comparing to the existing methods respectively.

Rapid On-Site AI-Assisted Grading for Lung Surgery Based on Optical Coherence Tomography

The determination of resection extent traditionally relies on the microscopic invasiveness of frozen sections (FSs) and is crucial for surgery of early lung cancer with preoperatively unknown histology. While previous research has shown the value of optical coherence tomography (OCT) for instant lung cancer diagnosis, tumor grading through OCT remains challenging. Therefore, this study proposes an interactive human-machine interface (HMI) that integrates a mobile OCT system, deep learning algorithms, and attention mechanisms. The system is designed to mark the lesion's location on the image smartly and perform tumor grading in real time, potentially facilitating clinical decision making. Twelve patients with a preoperatively unknown tumor but a final diagnosis of adenocarcinoma underwent thoracoscopic resection, and the artificial intelligence (AI)-designed system mentioned above was used to measure fresh specimens. Results were compared to FSs benchmarked on permanent pathologic reports. Current results show better differentiating power among minimally invasive adenocarcinoma (MIA), invasive adenocarcinoma (IA), and normal tissue, with an overall accuracy of 84.9%, compared to 20% for FSs. Additionally, the sensitivity and specificity, the sensitivity and specificity were 89% and 82.7% for MIA and 94% and 80.6% for IA, respectively. The results suggest that this AI system can potentially produce rapid and efficient diagnoses and ultimately improve patient outcomes.

Diagnostic accuracy of optical coherence tomography for margin assessment in breast-conserving surgery: A systematic review and meta-analysis

BACKGROUND

Breast cancer is the most common malignant tumor among women, and its incidence is increasing annually. At present, the results of the study on whether optical coherence tomography (OCT) can be used as an intraoperative margin assessment method for breast-conserving surgery (BCS) are inconsistent. We herein conducted this systematic review and meta-analysis to assess the diagnostic value of OCT in BCS.

METHODS

PubMed, Web of Science, Cochrane Library, and Embase were used to search relevant studies published up to September 15, 2022. We used Review Manager 5.4, Meta-Disc 1.4, and STATA 16.0 for statistical analysis.

RESULTS

The results displayed 18 studies with 782 patients included according to the inclusion and exclusion criteria. Meta-analysis showed the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and the area under the curve (AUC) of OCT in the margin assessment of BCS were 0.91 (95% CI 0.88-0.93), 0.88 (95% CI 0.83-0.92), 7.53 (95% CI 5.19-10.93), 0.11(95% CI 0.08-0.14), 70.37 (95% CI 39.78-124.47), and 0.94 (95% CI 0.92-0.96), respectively.

CONCLUSIONS

OCT is a promising technique in intraoperative margin assessment of breast cancer patients.

Optical coherence tomography combined with convolutional neural networks can differentiate between intrahepatic cholangiocarcinoma and liver parenchyma ex vivo

PURPOSE

Surgical resection with complete tumor excision (R0) provides the best chance of long-term survival for patients with intrahepatic cholangiocarcinoma (iCCA). A non-invasive imaging technology, which could provide quick intraoperative assessment of resection margins, as an adjunct to histological examination, is optical coherence tomography (OCT). In this study, we investigated the ability of OCT combined with convolutional neural networks (CNN), to differentiate iCCA from normal liver parenchyma ex vivo.

METHODS

Consecutive adult patients undergoing elective liver resections for iCCA between June 2020 and April 2021 (n = 11) were included in this study. Areas of interest from resection specimens were scanned ex vivo, before formalin fixation, using a table-top OCT device at 1310 nm wavelength. Scanned areas were marked and histologically examined, providing a diagnosis for each scan. An Xception CNN was trained, validated, and tested in matching OCT scans to their corresponding histological diagnoses, through a 5 × 5 stratified cross-validation process.

RESULTS

Twenty-four three-dimensional scans (corresponding to approx. 85,603 individual) from ten patients were included in the analysis. In 5 × 5 cross-validation, the model achieved a mean F1-score, sensitivity, and specificity of 0.94, 0.94, and 0.93, respectively.

CONCLUSION

Optical coherence tomography combined with CNN can differentiate iCCA from liver parenchyma ex vivo. Further studies are necessary to expand on these results and lead to innovative in vivo OCT applications, such as intraoperative or endoscopic scanning.

Automatic diagnosis and classification of breast surgical samples with dynamic full-field OCT and machine learning

Purpose

The adoption of emerging imaging technologies in the medical community is often hampered when they provide a new unfamiliar contrast that requires experience to be interpreted. Dynamic full-field optical coherence tomography (D-FF-OCT) microscopy is such an emerging technique. It provides fast, high-resolution images of excised tissues with a contrast comparable to H&E histology but without any tissue preparation and alteration.

Approach

We designed and compared two machine learning approaches to support interpretation of D-FF-OCT images of breast surgical specimens and thus provide tools to facilitate medical adoption. We conducted a pilot study on 51 breast lumpectomy and mastectomy surgical specimens and more than 1000 individual 1.3 × 1.3    mm 2 images and compared with standard H&E histology diagnosis.

Results

Using our automatic diagnosis algorithms, we obtained an accuracy above 88% at the image level (1.3 × 1.3    mm 2 ) and above 96% at the specimen level (above cm 2 ).

Conclusions

Altogether, these results demonstrate the high potential of D-FF-OCT coupled to machine learning to provide a rapid, automatic, and accurate histopathology diagnosis with minimal sample alteration.

Optical coherence tomography holds promise to transform the diagnostic anatomic pathology gross evaluation process

SIGNIFICANCE

Real-time histology can close a variety of gaps in tissue diagnostics. Currently, gross pathology analysis of excised tissue is dependent upon visual inspection and palpation to identify regions of interest for histopathological processing. Such analysis is limited by the variable correlation between macroscopic and microscopic findings. The current standard of care is costly, burdensome, and inefficient.

AIM

We are the first to address this gap by introducing optical coherence tomography (OCT) to be integrated in real-time during the pathology grossing process.

APPROACH

This is achieved by our high-resolution, ultrahigh-speed, large field-of-view OCT device designed for this clinical application.

RESULTS

We demonstrate the feasibility of imaging tissue sections from multiple human organs (breast, prostate, lung, and pancreas) in a clinical gross pathology setting without interrupting standard workflows.

CONCLUSIONS

OCT-based real-time histology evaluation holds promise for addressing a gap that has been present for >100 years.

Binary dose level classification of tumour microvascular response to radiotherapy using artificial intelligence analysis of optical coherence tomography images

The dominant consequence of irradiating biological systems is cellular damage, yet microvascular damage begins to assume an increasingly important role as the radiation dose levels increase. This is currently becoming more relevant in radiation medicine with its pivot towards higher-dose-per-fraction/fewer fractions treatment paradigm (e.g., stereotactic body radiotherapy (SBRT)). We have thus developed a 3D preclinical imaging platform based on speckle-variance optical coherence tomography (svOCT) for longitudinal monitoring of tumour microvascular radiation responses in vivo. Here we present an artificial intelligence (AI) approach to analyze the resultant microvascular data. In this initial study, we show that AI can successfully classify SBRT-relevant clinical radiation dose levels at multiple timepoints (t = 2–4 weeks) following irradiation (10 Gy and 30 Gy cohorts) based on induced changes in the detected microvascular networks. Practicality of the obtained results, challenges associated with modest number of animals, their successful mitigation via augmented data approaches, and advantages of using 3D deep learning methodologies, are discussed. Extension of this encouraging initial study to longitudinal AI-based time-series analysis for treatment outcome predictions at finer dose level gradations is envisioned.

Research progress on the application of optical coherence tomography in the field of oncology

Optical coherence tomography (OCT) is a non-invasive imaging technique which has become the “gold standard” for diagnosis in the field of ophthalmology. However, in contrast to the eye, nontransparent tissues exhibit a high degree of optical scattering and absorption, resulting in a limited OCT imaging depth. And the progress made in the past decade in OCT technology have made it possible to image nontransparent tissues with high spatial resolution at large (up to 2mm) imaging depth. On the one hand, OCT can be used in a rapid, noninvasive way to detect diseased tissues, organs, blood vessels or glands. On the other hand, it can also identify the optical characteristics of suspicious parts in the early stage of the disease, which is of great significance for the early diagnosis of tumor diseases. Furthermore, OCT imaging has been explored for imaging tumor cells and their dynamics, and for the monitoring of tumor responses to treatments. This review summarizes the recent advances in the OCT area, which application in oncological diagnosis and treatment in different types: (1) superficial tumors:OCT could detect microscopic information on the skin’s surface at high resolution and has been demonstrated to help diagnose common skin cancers; (2) gastrointestinal tumors: OCT can be integrated into small probes and catheters to image the structure of the stomach wall, enabling the diagnosis and differentiation of gastrointestinal tumors and inflammation; (3) deep tumors: with the rapid development of OCT imaging technology, it has shown great potential in the diagnosis of deep tumors such in brain tumors, breast cancer, bladder cancer, and lung cancer.

Multi-class classification of breast tissue using optical coherence tomography and attenuation imaging combined via deep learning

We demonstrate a convolutional neural network (CNN) for multi-class breast tissue classification as adipose tissue, benign dense tissue, or malignant tissue, using multi-channel optical coherence tomography (OCT) and attenuation images, and a novel Matthews correlation coefficient (MCC)-based loss function that correlates more strongly with performance metrics than the commonly used cross-entropy loss. We hypothesized that using multi-channel images would increase tumor detection performance compared to using OCT alone. 5,804 images from 29 patients were used to fine-tune a pre-trained ResNet-18 network. Adding attenuation images to OCT images yields statistically significant improvements in several performance metrics, including benign dense tissue sensitivity (68.0% versus 59.6%), malignant tissue positive predictive value (PPV) (79.4% versus 75.5%), and total accuracy (85.4% versus 83.3%), indicating that the additional contrast from attenuation imaging is most beneficial for distinguishing between benign dense tissue and malignant tissue.

Classifying breast cancer in ultrahigh-resolution optical coherence tomography images using convolutional neural networks

Optical coherence tomography (OCT) is being investigated in breast cancer diagnostics as a real-time histology evaluation tool. We present a customized deep convolutional neural network (CNN) for classification of breast tissues in OCT B-scans. Images of human breast samples from mastectomies and breast reductions were acquired using a custom ultrahigh-resolution OCT system with 2.72 µm axial resolution and 5.52 µm lateral resolution. The network achieved 96.7% accuracy, 92% sensitivity, and 99.7% specificity on a dataset of 23 patients. The usage of deep learning will be important for the practical integration of OCT into clinical practice.

Development of intraoperative assessment of margins in breast conserving surgery: a narrative review

OBJECTIVE

We intend to provide an informative and up-to-date summary on the topic of intraoperative assessment of margins in breast conserving surgery (BCS). Conventional methods as well as cutting-edge technologies are analyzed for their advantages and limitations in the hope that clinicians can turn to this for reference. This review can also offer guidance for technicians in the future design of intraoperative margin assessment tools.

BACKGROUND

Achieving negative margins during BCS is one of the vital factors for preventing local recurrence. Conducting intraoperative margin assessment can ensure negative margins to a large extent and possibly relieve patients of the anguish of re-interventions. In recent years, innovative methods for margin assessment during BCS are advancing rapidly. And there is a lack of summary regarding the development of intraoperative margin assessment in BCS.

METHODS

A PubMed search with keywords "intraoperative margin assessment" and "breast conserving surgery" was conducted. Relevant publications were screened manually for its title, abstract and even full text to determine its true relevance. Publications on neo-adjuvant therapy and intraoperative radiotherapy were excluded. References from the searched articles and other supplementary articles were also looked into.

CONCLUSIONS

Conventional methods for margin assessment yields stable outcome but its use is limited because of the demand on pathology staff and the trade-off between time and precision. Conventional imaging techniques pass the workload to radiologists at the cost of a significantly low duration of time. Involving artificial intelligence for image-based assessment is a further improvement. However, conventional imaging is inherently flawed in that occult lesions can't show on the image and the showing ones are ambiguous and open to interpretation. Unconventional techniques which base their judgment on cellular composition are more reassuring. Nonetheless, unconventional techniques should be subjected to clinical trials before putting into practice. And studies regarding comparison between conventional methods and unconventional methods are also needed to evaluate their relative efficacy.

Multi-Channel Local Binary Pattern Guided Convolutional Neural Network for Breast Cancer Classification

Background:

The advancement in convolutional neural network (CNN) has reduced the burden of experts using the computer-aided diagnosis of human breast cancer. However, most CNN networks use spatial features only. The inherent texture structure present in histopathological images plays an important role in distinguishing malignant tissues. This paper proposes an alternate CNN network that integrates Local Binary Pattern (LBP) based texture information with CNN features.

Methods:

The study propagates that LBP provides the most robust rotation, and translation-invariant features in comparison with other texture feature extractors. Therefore, a formulation of LBP in context of convolution operation is presented and used in the proposed CNN network. A non-trainable fixed set binary convolutional filters representing LBP features are combined with trainable convolution filters to approximate the response of the convolution layer. A CNN architecture guided by LBP features is used to classify the histopathological images.

Result:

The network is trained using BreKHis datasets. The use of a fixed set of LBP filters reduces the burden of CNN by minimizing training parameters by a factor of 9. This makes it suitable for the environment with fewer resources. The proposed network obtained 96.46% of maximum accuracy with 98.51% AUC and 97% F1-score.

Conclusion:

LBP based texture information plays a vital role in cancer image classification. A multi-channel LBP futures fusion is used in the CNN network. The experiment results propagate that the new structure of LBP-guided CNN requires fewer training parameters preserving the capability of the CNN network’s classification accuracy.

Millimeter-scale chip-based supercontinuum generation for optical coherence tomography

Supercontinuum sources for optical coherence tomography (OCT) have raised great interest as they provide broad bandwidth to enable high resolution and high power to improve imaging sensitivity. Commercial fiber-based supercontinuum systems require high pump powers to generate broad bandwidth and customized optical filters to shape/attenuate the spectra. They also have limited sensitivity and depth performance. We introduce a supercontinuum platform based on a 1-mm² Si₃N₄ photonic chip for OCT. We directly pump and efficiently generate supercontinuum near 1300 nm without any postfiltering. With a 25-pJ pump pulse, we generate a broadband spectrum with a flat 3-dB bandwidth of 105 nm. Integrating the chip into a spectral domain OCT system, we achieve 105-dB sensitivity and 1.81-mm 6-dB sensitivity roll-off with 300-μW optical power on sample. We image breast tissue to demonstrate strong imaging performance. Our chip will pave the way toward portable OCT and incorporating integrated photonics into optical imaging technologies.

3-D compressed sensing optical coherence tomography using predictive coding

We present a compressed sensing (CS) algorithm and sampling strategy for reconstructing 3-D Optical Coherence Tomography (OCT) image volumes from as little as 10% of the original data. Reconstruction using the proposed method, Denoising Predictive Coding (DN-PC), is demonstrated for five clinically relevant tissue types including human heart, retina, uterus, breast, and bovine ligament. DN-PC reconstructs the difference between adjacent b-scans in a volume and iteratively applies Gaussian filtering to improve image sparsity. An a-line sampling strategy was developed that can be easily implemented in existing Spectral-Domain OCT systems and reduce scan time by up to 90%.

Optical palpation for tumor margin assessment in breast-conserving surgery

Intraoperative margin assessment is needed to reduce the re-excision rate of breast-conserving surgery. One possibility is optical palpation, a tactile imaging technique that maps stress (force applied across the tissue surface) as an indicator of tissue stiffness. Images (optical palpograms) are generated by compressing a transparent silicone layer on the tissue and measuring the layer deformation using optical coherence tomography (OCT). This paper reports, for the first time, the diagnostic accuracy of optical palpation in identifying tumor within 1 mm of the excised specimen boundary using an automated classifier. Optical palpograms from 154 regions of interest (ROIs) from 71 excised tumor specimens were obtained. An automated classifier was constructed to predict the ROI margin status by first choosing a circle diameter, then searching for a location within the ROI where the circle was ≥ 75% filled with high stress (indicating a positive margin). A range of circle diameters and stress thresholds, as well as the impact of filtering out non-dense tissue regions, were tested. Sensitivity and specificity were calculated by comparing the automated classifier results with the true margin status, determined from co-registered histology. 83.3% sensitivity and 86.2% specificity were achieved, compared to 69.0% sensitivity and 79.0% specificity obtained with OCT alone on the same dataset using human readers. Representative optical palpograms show that positive margins containing a range of cancer types tend to exhibit higher stress compared to negative margins. These results demonstrate the potential of optical palpation for margin assessment.

Towards an Optical Biopsy during Visceral Surgical Interventions

Background

Cancer will replace cardiovascular diseases as the most frequent cause of death. Therefore, the goals of cancer treatment are prevention strategies and early detection by cancer screening and ideal stage therapy. From an oncological point of view, complete tumor resection is a significant prognostic factor. Optical coherence tomography (OCT) and confocal laser microscopy (CLM) are two techniques that have the potential to complement intraoperative frozen section analysis as in vivo and real-time optical biopsies.

Summary

In this review we present both procedures and review the progress of evaluation for intraoperative application in visceral surgery. For visceral surgery, there are promising studies evaluating OCT and CLM; however, application during routine visceral surgical interventions is still lacking.

Key Message

OCT and CLM are not competing but complementary approaches of tissue analysis to intraoperative frozen section analysis. Although intraoperative application of OCT and CLM is at an early stage, they are two promising techniques of intraoperative in vivo and real-time tissue examination. Additionally, deep learning strategies provide a significant supplement for automated tissue detection.