Endoscopic optical coherence tomography: technologies and clinical applications [Invited]

Distal planar rotary scanner for endoscopic optical coherence tomography

Optical coherence tomography (OCT) is becoming a more common endoscopic imaging modality for detecting and treating disease given its high resolution and image quality. To use OCT for 3-dimensional imaging of small lumen, embedding an optical scanner at the distal end of an endoscopic probe for circumferential scanning the probing light is a promising way to implement high-quality imaging unachievable with the conventional method of revolving an entire probe. To this end, the present work proposes a hollow and planar micro rotary actuator for its use as an endoscopic distal scanner. A miniaturized design of this ferrofluid-assisted electromagnetic actuator is prototyped to act as a full 360° optical scanner, which is integrated at the tip of a fiber-optic probe together with a gradient-index lens for use with OCT. The scanner is revealed to achieve a notably improved dynamic performance that shows a maximum speed of 6500 rpm, representing 325% of the same reported with the preceding design, while staying below the thermal limit for safe in-vivo use. The scanner is demonstrated to perform real-time OCT using human fingers as live tissue samples for the imaging tests. The acquired images display no shadows from the electrical wires to the scanner, given its hollow architecture that allows the probing light to pass through the actuator body, as well as the quality high enough to differentiate the dermis from the epidermis while resolving individual sweat glands, proving the effectiveness of the prototyped scanner design for endoscopic OCT application.

Multifunctional Ablative Gastrointestinal Imaging Capsule (MAGIC) for Esophagus Surveillance and Interventions

Objective and Impact Statement: A clinically viable technology for comprehensive esophagus surveillance and potential treatment is lacking. Here, we report a novel multifunctional ablative gastrointestinal imaging capsule (MAGIC) technology platform to address this clinical need. The MAGIC technology could also facilitate the clinical translation and adoption of the tethered capsule endomicroscopy (TCE) technology. Introduction: Recently developed optical coherence tomography (OCT) TCE technologies have shown a promising potential for surveillance of Barrett's esophagus and esophageal cancer in awake patients without the need for sedation. However, it remains challenging with the current TCE technology for detecting early lesions and clinical adoption due to its suboptimal resolution, imaging contrast, and lack of visual guidance during imaging. Methods: Our technology reported here integrates dual-wavelength OCT imaging (operating at 800 and 1300 nm), an ultracompact endoscope camera, and an ablation laser, aiming to enable comprehensive surveillance, guidance, and potential ablative treatment of the esophagus. Results: The MAGIC has been successfully developed with its multimodality imaging and ablation capabilities demonstrated by imaging swine esophagus ex vivo and in vivo. The 800-nm OCT imaging offers exceptional resolution and contrast for the superficial layers, well suited for detecting subtle changes associated with early neoplasia. The 1300-nm OCT imaging provides deeper penetration, essential for assessing lesion invasion. The built-in miniature camera affords a conventional endoscopic view for assisting capsule deployment and laser ablation. Conclusion: By offering complementary and clinically viable functions in a single device, the reported technology represents an effective solution for endoscopic screening, diagnosis, and potential ablation treatment of the esophagus of a patient in an office setting.

High-resolution rectoscopy using MHz optical coherence tomography: a step towards real time 3D endoscopy

Colonoscopy and endoscopic ultrasound play pivotal roles in the assessment of rectal diseases, especially rectal cancer and inflammatory bowel diseases. Optical coherence tomography (OCT) offers a superior depth resolution, which is a critical factor for individualizing the therapeutic concept and evaluating the therapy response. We developed two distinct rectoscope prototypes, which were integrated into a 1300 nm MHz-OCT system constructed at our facility. The rapid rotation of the distal scanning probe at 40,000 revolutions per minute facilitates a 667 Hz OCT frame rate, enabling real-time endoscopic imaging of large areas. The performance of these OCT-rectoscopes was assessed in an ex vivo porcine colon and a post mortem human in-situ colon. The OCT-rectoscope consistently distinguished various layers of the intestinal wall, identified gut-associated lymphatic tissue, and visualized a rectal polyp during the imaging procedure with 3D-reconstruction in real time. Subsequent histological examination confirmed these findings. The body donor was preserved using an ethanol-glycerol-lysoformin-based technique for true-to-life tissue consistency. We could demonstrate that the novel MHZ-OCT-rectoscope effectively discriminates rectal wall layers and crucial tissue characteristics in a post mortem human colon in-situ. This real-time-3D-OCT holds promise as a valuable future diagnostic tool for assessing disease state and therapy response on-site in rectal diseases.

Virtual Hall sensor triggered multi-MHz endoscopic OCT imaging for stable real-time visualization

Circumferential scanning in endoscopic imaging is crucial across various disciplines, and optical coherence tomography (OCT) is often the preferred choice due to its high-speed, high-resolution, and micron-scale imaging capabilities. Moreover, real-time and high-speed 3D endoscopy is a pivotal technology for medical screening and precise surgical guidance, among other applications. However, challenges such as image jitter and non-uniform rotational distortion (NURD) are persistent obstacles that hinder real-time visualization during high-speed OCT procedures. To address this issue, we developed an innovative, low-cost endoscope that employs a brushless DC motor for scanning, and a sensorless technique for triggering and synchronizing OCT imaging with the scanning motor. This sensorless approach uses the motor's electrical feedback (back electromotive force, BEMF) as a virtual Hall sensor to initiate OCT image acquisition and synchronize it with a Fourier Domain Mode-Locked (FDML)-based Megahertz OCT system. Notably, the implementation of BEMF-triggered OCT has led to a substantial reduction in image jitter and NURD (<4 mrad), thereby opening up a new window for real-time visualization capabilities. This approach suggests potential benefits across various applications, aiming to provide a more accurate, deployable, and cost-effective solution. Subsequent studies can explore the adaptability of this system to specific clinical scenarios and its performance under practical endoscopic conditions.

Cross-attention learning enables real-time nonuniform rotational distortion correction in OCT

Nonuniform rotational distortion (NURD) correction is vital for endoscopic optical coherence tomography (OCT) imaging and its functional extensions, such as angiography and elastography. Current NURD correction methods require time-consuming feature tracking/registration or cross-correlation calculations and thus sacrifice temporal resolution. Here we propose a cross-attention learning method for the NURD correction in OCT. Our method is inspired by the recent success of the self-attention mechanism in natural language processing and computer vision. By leveraging its ability to model long-range dependencies, we can directly obtain the spatial correlation between OCT A-lines at any distance, thus accelerating the NURD correction. We develop an end-to-end stacked cross-attention network and design three types of optimization constraints. We compare our method with two traditional feature-based methods and a CNN-based method on two publicly-available endoscopic OCT datasets. We further verify the NURD correction performance of our method on 3D stent reconstruction using a home-built endoscopic OCT system. Our method achieves a ∼3 × speedup to real time (26 ± 3 fps), and superior correction performance.

A Drosophila heart optical coherence microscopy dataset for automatic video segmentation

The heart of the fruit fly, Drosophila melanogaster, is a particularly suitable model for cardiac studies. Optical coherence microscopy (OCM) captures in vivo cross-sectional videos of the beating Drosophila heart for cardiac function quantification. To analyze those large-size multi-frame OCM recordings, human labelling has been employed, leading to low efficiency and poor reproducibility. Here, we introduce a robust and accurate automated Drosophila heart segmentation algorithm, called FlyNet 2.0+, which utilizes a long short-term memory (LSTM) convolutional neural network to leverage time series information in the videos, ensuring consistent, high-quality segmentation. We present a dataset of 213 Drosophila heart videos, equivalent to 604,000 cross-sectional images, containing all developmental stages and a wide range of beating patterns, including faster and slower than normal beating, arrhythmic beating, and periods of heart stop to capture these heart dynamics. Each video contains a corresponding ground truth mask. We expect this unique large dataset of the beating Drosophila heart in vivo will enable new deep learning approaches to efficiently characterize heart function to advance cardiac research.

Imaging microvascular changes in nonocular oncological clinical applications by optical coherence tomography angiography: a literature review

BACKGROUND

Optical coherence tomography angiography (OCTA) is an emerging imaging modality that enables noninvasive visualization and analysis of tumor vasculature. OCTA has been particularly useful in clinical ocular oncology, while in this article, we evaluated OCTA in assessing microvascular changes in clinical nonocular oncology through a systematic review of the literature.

METHOD

The inclusion criterion for the literature search in PubMed, Web of Science and Scopus electronic databases was the use of OCTA in nonocular clinical oncology, meaning that all ocular clinical studies and all ocular and nonocular animal, phantom, ex vivo, experimental, research and development, and purely methodological studies were excluded.

RESULTS

Eleven articles met the inclusion criteria. The anatomic locations of the neoplasms in the selected articles were the gastrointestinal tract (2 articles), head and neck (1 article) and skin (8 articles).

CONCLUSIONS

While OCTA has shown great advancements in ophthalmology, its translation to the nonocular clinical oncology setting presents several limitations, with a lack of standardized protocols and interpretation guidelines posing the most significant challenge.

Metafiber transforming arbitrarily structured light

Structured light has proven useful for numerous photonic applications. However, the current use of structured light in optical fiber science and technology is severely limited by mode mixing or by the lack of optical elements that can be integrated onto fiber end-faces for wavefront engineering, and hence generation of structured light is still handled outside the fiber via bulky optics in free space. We report a metafiber platform capable of creating arbitrarily structured light on the hybrid-order Poincaré sphere. Polymeric metasurfaces, with unleashed height degree of freedom and a greatly expanded 3D meta-atom library, were 3D laser nanoprinted and interfaced with polarization-maintaining single-mode fibers. Multiple metasurfaces were interfaced on the fiber end-faces, transforming the fiber output into different structured-light fields, including cylindrical vector beams, circularly polarized vortex beams, and arbitrary vector field. Our work provides a paradigm for advancing optical fiber science and technology towards fiber-integrated light shaping, which may find important applications in fiber communications, fiber lasers and sensors, endoscopic imaging, fiber lithography, and lab-on-fiber technology.

Imagining the future of optical microscopy: everything, everywhere, all at once

The optical microscope has revolutionized biology since at least the 17th Century. Since then, it has progressed from a largely observational tool to a powerful bioanalytical platform. However, realizing its full potential to study live specimens is hindered by a daunting array of technical challenges. Here, we delve into the current state of live imaging to explore the barriers that must be overcome and the possibilities that lie ahead. We venture to envision a future where we can visualize and study everything, everywhere, all at once - from the intricate inner workings of a single cell to the dynamic interplay across entire organisms, and a world where scientists could access the necessary microscopy technologies anywhere.

High-speed submillimeter magnetic-driven rotational scanning side-imaging OCT probe

A high-speed side-imaging magnetic-driven scanning (MDS) probe is proposed for endoscopic optical coherence tomography (OCT). In the distal end of the probe, a reflecting micromirror is attached to a tiny magnet, which is driven by an external fast-rotating magnetic field to achieve unobstructed 360-degree side-view scanning. A prototype probe was fabricated with an outer diameter of 0.89 mm. Using the prototype probe, OCT images of an ex vivo porcine artery with implanted stent were acquired in 100 frames per second. The OCT engine was a swept-source system, and the system sensitivity with the prototype probe was 95 dB with an output power of 6 mW. The axial and lateral resolutions of the system were 10.3 and 39.7 μm, respectively. The high-speed submillimeter MDS-OCT probe provides a promising alternative endoscopic OCT solution for intravascular imaging applications.

Artificial intelligence in esophageal cancer diagnosis and treatment: where are we now?-a narrative review

Background and Objective

Artificial intelligence (AI) use is becoming increasingly prevalent directly or indirectly in daily clinical practice, including esophageal cancer (EC) diagnosis and treatment. Although the limits of its adoption and their clinical benefits are still unknown, any physician related to EC patients' management should be aware of the status and future perspectives of AI use in their field. The purpose of this review is to summarize the existing literature regarding the role of AI in diagnosis and treatment of EC. We have focused on the aids AI entails in the management of this pathology and we have tried to offer an updated perspective to maximize current applications and to identify potential future uses of it.

Methods

Data concerning AI applied to EC diagnosis and treatment is not limited, including direct (those specifically related to them) and indirect (those referring to other specialties as radiology or pathology), applications. However, the clinical relevance of the discussed and presented models is still unknown. We performed a research in PubMed of English and Spanish written studies from January 1970 to June 2022.

Key Content and Findings

Information regarding the role of AI in EC diagnosis and treatment has increased exponentially in recent years. Several models, including different variables and features have been investigated and some of them internally and externally validated. However, the main challenge remains to apply and introduce all these data into clinical practice, and, as some of the discussed studies argue, if the models are able to enhance experienced endoscopists' judgement. Although AI use is increasing steadily in different medical specialties, the truth is, most of the time, the gap between model development and clinical implementation is not closed. Learning to understand the routinely application of AI, as well as future improvements, would lead to a broadened adoption.

Conclusions

Physicians should be aware of the multiple current clinical uses of AI in EC diagnosis and treatment and should take part in their clinical application and future developments to enhance patient care.

Intraoperative application of optical coherence tomography for lung tumor

On-site instant determination of benign or malignant tumors for deciding the types of resection is crucial during pulmonary surgery. We designed a portable spectral-domain optical coherence tomography (SD-OCT) system to do real-time scanning intraoperatively for the distinction of fresh tumor specimens in the lung. A total of 12 ex vivo lung specimens from six patients were enrolled. Three patients were diagnosed with invasive adenocarcinoma (IA), while the others were benign. After OCT-imaged reconstruction, we compared the qualitative morphology of OCT and histology among malignant, benign, and normal tissues. In addition, through analysis of the quantitative data, a discrete difference in optical attenuation coefficients around the junctional surface was shown by our data processing. This study demonstrated a feasible OCT-assisted resection guide by a rapid on-site tumor diagnosis. The results indicate that future deep learning of OCT-captured image systems able to improve diagnostic and therapeutic efficiency is warranted.

Microcamera Visualisation System to Overcome Specular Reflections for Tissue Imaging

In vivo tissue imaging is an essential tool for medical diagnosis, surgical guidance, and treatment. However, specular reflections caused by glossy tissue surfaces can significantly degrade image quality and hinder the accuracy of imaging systems. In this work, we further the miniaturisation of specular reflection reduction techniques using micro cameras, which have the potential to act as intra-operative supportive tools for clinicians. In order to remove these specular reflections, two small form factor camera probes, handheld at 10 mm footprint and miniaturisable to 2.3 mm, are developed using different modalities, with line-of-sight to further miniaturisation. (1) The sample is illuminated via multi-flash technique from four different positions, causing a shift in reflections which are then filtered out in a post-processing image reconstruction step. (2) The cross-polarisation technique integrates orthogonal polarisers onto the tip of the illumination fibres and camera, respectively, to filter out the polarisation maintaining reflections. These form part of a portable imaging system that is capable of rapid image acquisition using different illumination wavelengths, and employs techniques that lend themselves well to further footprint reduction. We demonstrate the efficacy of the proposed system with validating experiments on tissue-mimicking phantoms with high surface reflection, as well as on excised human breast tissue. We show that both methods can provide clear and detailed images of tissue structures along with the effective removal of distortion or artefacts caused by specular reflections. Our results suggest that the proposed system can improve the image quality of miniature in vivo tissue imaging systems and reveal underlying feature information at depth, for both human and machine observers, leading to better diagnosis and treatment outcomes.

Engineering and Development of a Tissue Model for the Evaluation of Microneedle Penetration Ability, Drug Diffusion, Photothermal Activity, and Ultrasound Imaging: A Promising Surrogate to Ex Vivo and In Vivo Tissues

Driven by regulatory authorities and the ever-growing demands from industry, various artificial tissue models have been developed. Nevertheless, there is no model to date that is capable of mimicking the biomechanical properties of the skin whilst exhibiting the hydrophilicity/hydrophobicity properties of the skin layers. As a proof-of-concept study, tissue surrogates based on gel and silicone are fabricated for the evaluation of microneedle penetration, drug diffusion, photothermal activity, and ultrasound bioimaging. The silicone layer aims to imitate the stratum corneum while the gel layer aims to mimic the water-rich viable epidermis and dermis present in in vivo tissues. The diffusion of drugs across the tissue model is assessed, and the results reveal that the proposed tissue model shows similar behavior to a cancerous kidney. In place of typical in vitro aqueous solutions, this model can also be employed for evaluating the photoactivity of photothermal agents since the tissue model shows a similar heating profile to skin of mice when irradiated with near-infrared laser. In addition, the designed tissue model exhibits promising results for biomedical applications in optical coherence tomography and ultrasound imaging. Such a tissue model paves the way to reduce the use of animals testing in research whilst obviating ethical concerns.

Volumetric Tissue Imaging of Surgical Tissue Specimens Using Micro-Computed Tomography: An Emerging Digital Pathology Modality for Nondestructive, Slide-Free Microscopy-Clinical Applications of Digital Pathology in 3 Dimensions

OBJECTIVES

Micro-computed tomography (micro-CT) is a novel, nondestructive, slide-free digital imaging modality that enables the acquisition of high-resolution, volumetric images of intact surgical tissue specimens. The aim of this systematic mapping review is to provide a comprehensive overview of the available literature on clinical applications of micro-CT tissue imaging and to assess its relevance and readiness for pathology practice.

METHODS

A computerized literature search was performed in the PubMed, Scopus, Web of Science, and CENTRAL databases. To gain insight into regulatory and financial considerations for performing and examining micro-CT imaging procedures in a clinical setting, additional searches were performed in medical device databases.

RESULTS

Our search identified 141 scientific articles published between 2000 and 2021 that described clinical applications of micro-CT tissue imaging. The number of relevant publications is progressively increasing, with the specialties of pulmonology, cardiology, otolaryngology, and oncology being most commonly concerned. The included studies were mostly performed in pathology departments. Current micro-CT devices have already been cleared for clinical use, and a Current Procedural Terminology (CPT) code exists for reimbursement of micro-CT imaging procedures.

CONCLUSIONS

Micro-CT tissue imaging enables accurate volumetric measurements and evaluations of entire surgical specimens at microscopic resolution across a wide range of clinical applications.

Visualizing enteric nervous system activity through dye-free dynamic full-field optical coherence tomography

Major advances have been achieved in imaging technologies but most methodological approaches currently used to study the enteric neuronal functions rely on exogenous contrast dyes that can interfere with cellular functions or survival. In the present paper, we investigated whether full-field optical coherence tomography (FFOCT), could be used to visualize and analyze the cells of the enteric nervous system. Experimental work on whole-mount preparations of unfixed mouse colons showed that FFOCT enables the visualization of the myenteric plexus network whereas dynamic FFOCT enables to visualize and identify in situ individual cells in the myenteric ganglia. Analyzes also showed that dynamic FFOCT signal could be modified by external stimuli such veratridine or changes in osmolarity. These data suggest that dynamic FFOCT could be of great interest to detect changes in the functions of enteric neurons and glia in normal and disease conditions.

Bioelectronic devices for light-based diagnostics and therapies

Light has broad applications in medicine as a tool for diagnosis and therapy. Recent advances in optical technology and bioelectronics have opened opportunities for wearable, ingestible, and implantable devices that use light to continuously monitor health and precisely treat diseases. In this review, we discuss recent progress in the development and application of light-based bioelectronic devices. We summarize the key features of the technologies underlying these devices, including light sources, light detectors, energy storage and harvesting, and wireless power and communications. We investigate the current state of bioelectronic devices for the continuous measurement of health and on-demand delivery of therapy. Finally, we highlight major challenges and opportunities associated with light-based bioelectronic devices and discuss their promise for enabling digital forms of health care.

Multimodal Raman spectroscopy and optical coherence tomography for biomedical analysis

Optical techniques hold great potential to detect and monitor disease states as they are a fast, non-invasive toolkit. Raman spectroscopy (RS) in particular is a powerful label-free method capable of quantifying the biomolecular content of tissues. Still, spontaneous Raman scattering lacks information about tissue morphology due to its inability to rapidly assess a large field of view. Optical Coherence Tomography (OCT) is an interferometric optical method capable of fast, depth-resolved imaging of tissue morphology, but lacks detailed molecular contrast. In many cases, pairing label-free techniques into multimodal systems allows for a more diverse field of applications. Integrating RS and OCT into a single instrument allows for both structural imaging and biochemical interrogation of tissues and therefore offers a more comprehensive means for clinical diagnosis. This review summarizes the efforts made to date toward combining spontaneous RS-OCT instrumentation for biomedical analysis, including insights into primary design considerations and data interpretation.

Towards OCT-Guided Endoscopic Laser Surgery-A Review

Optical Coherence Tomography (OCT) is an optical imaging technology occupying a unique position in the resolution vs. imaging depth spectrum. It is already well established in the field of ophthalmology, and its application in other fields of medicine is growing. This is motivated by the fact that OCT is a real-time sensing technology with high sensitivity to precancerous lesions in epithelial tissues, which can be exploited to provide valuable information to clinicians. In the prospective case of OCT-guided endoscopic laser surgery, these real-time data will be used to assist surgeons in challenging endoscopic procedures in which high-power lasers are used to eradicate diseases. The combination of OCT and laser is expected to enhance the detection of tumors, the identification of tumor margins, and ensure total disease eradication while avoiding damage to healthy tissue and critical anatomical structures. Therefore, OCT-guided endoscopic laser surgery is an important nascent research area. This paper aims to contribute to this field with a comprehensive review of state-of-the-art technologies that may be exploited as the building blocks for achieving such a system. The paper begins with a review of the principles and technical details of endoscopic OCT, highlighting challenges and proposed solutions. Then, once the state of the art of the base imaging technology is outlined, the new OCT-guided endoscopic laser surgery frontier is reviewed. Finally, the paper concludes with a discussion on the constraints, benefits and open challenges associated with this new type of surgical technology.

Circular array transducer based-photoacoustic/ultrasonic endoscopic imaging with tunable ring-beam excitation

Photoacoustic/ultrasound endoscopic imaging is regarded as an effective method to achieve accurate detection of intestinal disease by offering both the functional and structural information, simultaneously. Compared to the conventional endoscopy with single transducer and laser spot for signal detection and optical excitation, photoacoustic/ultrasound endoscopic probe using circular array transducer and ring-shaped laser beam avoids the instability brought by the mechanical scanning point-to-point, offering the dual-modality imaging with high accuracy and efficiency. Meanwhile, considering the complex morphological environments of intestinal tracts in clinics, developing the probe having sufficient wide imaging distance range is especially important. In this work, we develop a compact circular photoacoustic/ultrasonic endoscopic probe, using the group of fiber, lens and home-made axicon, to generate relatively concentrated ring-shaped laser beam for 360° excitation with high efficiency. Furthermore, the laser ring size can be tuned conveniently by changing the fiber-lens distance to ensure the potential applicability of the probe in various and complex morphological environments of intestines. Phantom experimental results demonstrate imaging distance range wide enough to cover from 12 mm to 30 mm. In addition, the accessibility of the photoacoustic signals of molecular probes in ex vivo experiments at the tissue depth of 7 mm using excitation energy of 5 mJ has also been demonstrated, showing a high optical excitation efficiency of the probe.

Diseased thyroid tissue classification in OCT images using deep learning: Towards surgical decision support

Intraoperative guidance tools for thyroid surgery based on optical coherence tomography (OCT) could aid distinguish between normal and diseased tissue. However, OCT images are difficult to interpret, thus, real-time automatic analysis could support the clinical decision-making. In this study, several deep learning models were investigated for thyroid disease classification on 2D and 3D OCT data obtained from ex vivo specimens of 22 patients undergoing surgery and diagnosed with several thyroid pathologies. Additionally, two open-access datasets were used to evaluate the custom models. On the thyroid dataset, the best performance was achieved by the 3D vision transformer model with a Matthew's correlation coefficient (MCC) of 0.79 (accuracy = 0.90) for the normal-versus-abnormal classification. On the open-access datasets, the custom models achieved the best performance (MCC > 0.88, accuracy > 0.96). Results obtained for the normal-versus-abnormal classification suggest OCT, complemented with deep learning-based analysis, as a tool for real-time automatic diseased tissue identification in thyroid surgery.

Improved FAST algorithm for non-uniform rotational distortion correction in OCT endoscopic imaging

Optical Coherence Tomography (OCT) is widely used for endoscopic imaging in endoluminal organs because of its high imaging accuracy and resolution. However, OCT endoscopic imaging suffers from Non-Uniform Rotational Distortion (NURD), which can be caused by many factors, such as irregular motor rotation and changes in friction between the probe and the sheath. Correcting this distortion is essential to obtaining high-quality Optical Coherence Tomography Angiography (OCTA) images. There are two main approaches for correcting NURD: hardware-based methods and algorithm-based methods. Hardware-based methods can be costly, challenging to implement, and may not eliminate NURD. Algorithm-based methods, such as image registration, can be effective for correcting NURD but can also be prone to the problem of NURD propagation. To address this issue, we process frames by coarse and fine registration, respectively. The new reference frame is generated by filtering out the A-scan that may have the NURD problem by coarse registration. And the fine registration uses this frame to achieve the final NURD correction. In addition, we have improved the Features from Accelerated Segment Test (FAST) algorithm and put it into coarse and fine registration process. Four evaluation functions were used for the experimental results, including signal-to-noise ratio (SNR), peak signal-to-noise ratio (PSNR), mean squared error (MSE), and structural similarity index measure (SSIM). By comparing with Scale-invariant feature transform (SIFT), Speeded up robust features (SURF), Oriented FAST and Rotated BRIEF (ORB), intensity-based (Cross-correlation), and Optical Flow algorithms, our algorithm has a higher similarity between the corrected frames. Moreover, the noise in the OCTA data is better suppressed, and the vascular information is well preserved. Our image registration-based algorithm reduces the problem of NURD propagation between B-scan frames and improves the imaging quality of OCT endoscopic images.

In vivo detection of bile duct pre-cancer with endoscopic light scattering spectroscopy

Bile duct cancer is the second most common primary liver cancer, with most diagnoses occurring in the advanced stages. This leads to a poor survival rate, which means a technique capable of reliably detecting pre-cancer in the bile duct is urgently required. Unfortunately, radiological imaging lacks adequate accuracy for distinguishing dysplastic and benign biliary ducts, while endoscopic techniques, which can directly assess the bile duct lining, often suffer from insufficient sampling. Here, we report an endoscopic optical light scattering technique for clinical evaluation of the malignant potential of the bile duct. This technique employs an ultraminiature spatial gating fiber optic probe compatible with cholangioscopes and endoscopic retrograde cholangiopancreatography (ERCP) catheters. The probe allowed us to investigate the internal cellular composition of the bile duct epithelium with light scattering spectroscopy (LSS) and phenotypic properties of the underlying connective tissue with diffuse reflectance spectroscopy (DRS). In a pilot in vivo double-blind prospective study involving 29 patients undergoing routine ERCP procedures, the technique detected malignant transformation with 97% accuracy, showing that biliary duct pre-cancer can be reliably identified in vivo non-invasively.

Multiscale Label-Free Imaging of Fibrillar Collagen in the Tumor Microenvironment

With recent advances in cancer therapeutics, there is a great need for improved imaging methods for characterizing cancer onset and progression in a quantitative and actionable way. Collagen, the most abundant extracellular matrix protein in the tumor microenvironment (and the body in general), plays a multifaceted role, both hindering and promoting cancer invasion and progression. Collagen deposition can defend the tumor with immunosuppressive effects, while aligned collagen fiber structures can enable tumor cell migration, aiding invasion and metastasis. Given the complex role of collagen fiber organization and topology, imaging has been a tool of choice to characterize these changes on multiple spatial scales, from the organ and tumor scale to cellular and subcellular level. Macroscale density already aids in the detection and diagnosis of solid cancers, but progress is being made to integrate finer microscale features into the process. Here we review imaging modalities ranging from optical methods of second harmonic generation (SHG), polarized light microscopy (PLM), and optical coherence tomography (OCT) to the medical imaging approaches of ultrasound and magnetic resonance imaging (MRI). These methods have enabled scientists and clinicians to better understand the impact collagen structure has on the tumor environment, at both the bulk scale (density) and microscale (fibrillar structure) levels. We focus on imaging methods with the potential to both examine the collagen structure in as natural a state as possible and still be clinically amenable, with an emphasis on label-free strategies, exploiting intrinsic optical properties of collagen fibers.

Confocal laser endomicroscope with distal MEMS scanner for real-time histopathology

Confocal laser endomicroscopy is an emerging methodology to perform real time optical biopsy. Fluorescence images with histology-like quality can be collected instantaneously from the epithelium of hollow organs. Currently, scanning is performed at the proximal end of probe-based instruments used routinely in the clinic, and flexibility to control the focus is limited. We demonstrate use of a parametric resonance scanner packaged in the distal end of the endomicroscope to perform high speed lateral deflections. An aperture was etched in the center of the reflector to fold the optical path. This design reduced the dimensions of the instrument to 2.4 mm diameter and 10 mm length, allowing for forward passage through the working channel of a standard medical endoscope. A compact lens assembly provides lateral and axial resolution of 1.1 and 13.6 μm, respectively. A working distance of 0 μm and field-of-view of 250 μm × 250 μm was achieved at frame rates up to 20 Hz. Excitation at 488 nm was delivered to excite fluorescein, an FDA-approved dye, to generate high tissue contrast. The endomicroscope was reprocessed using a clinically-approved sterilization method for 18 cycles without failure. Fluorescence images were collected during routine colonoscopy from normal colonic mucosa, tubular adenomas, hyperplastic polyps, ulcerative colitis, and Crohn's colitis. Individual cells, including colonocytes, goblet cells, and inflammatory cells, could be identified. Mucosal features, such as crypt structures, crypt lumens, and lamina propria, could be distinguished. This instrument has potential to be used as an accessory during routine medical endoscopy.

An optically-guided cochlear implant sheath for real-time monitoring of electrode insertion into the human cochlea

In cochlear implant surgery, insertion of perimodiolar electrode arrays into the scala tympani can be complicated by trauma or even accidental translocation of the electrode array within the cochlea. In patients with partial hearing loss, cochlear trauma can not only negatively affect implant performance, but also reduce residual hearing function. These events have been related to suboptimal positioning of the cochlear implant electrode array with respect to critical cochlear walls of the scala tympani (modiolar wall, osseous spiral lamina and basilar membrane). Currently, the position of the electrode array in relation to these walls cannot be assessed during the insertion and the surgeon depends on tactile feedback, which is unreliable and often comes too late. This study presents an image-guided cochlear implant device with an integrated, fiber-optic imaging probe that provides real-time feedback using optical coherence tomography during insertion into the human cochlea. This novel device enables the surgeon to accurately detect and identify the cochlear walls ahead and to adjust the insertion trajectory, avoiding collision and trauma. The functionality of this prototype has been demonstrated in a series of insertion experiments, conducted by experienced cochlear implant surgeons on fresh-frozen human cadaveric cochleae.

OCT Meets micro-CT: A Subject-Specific Correlative Multimodal Imaging Workflow for Early Chick Heart Development Modeling

Structural and Doppler velocity data collected from optical coherence tomography have already provided crucial insights into cardiac morphogenesis. X-ray microtomography and other ex vivo methods have elucidated structural details of developing hearts. However, by itself, no single imaging modality can provide comprehensive information allowing to fully decipher the inner workings of an entire developing organ. Hence, we introduce a specimen-specific correlative multimodal imaging workflow combining OCT and micro-CT imaging which is applicable for modeling of early chick heart development—a valuable model organism in cardiovascular development research. The image acquisition and processing employ common reagents, lab-based micro-CT imaging, and software that is free for academic use. Our goal is to provide a step-by-step guide on how to implement this workflow and to demonstrate why those two modalities together have the potential to provide new insight into normal cardiac development and heart malformations leading to congenital heart disease.

Visualization and Validation of The Microstructures in The Airway Wall in vivo Using Diffractive Optical Coherence Tomography

RATIONALE AND OBJECTIVES

At present, there is no available method to study the in vivo microstructures of the airway wall (epithelium, smooth muscle, adventitia, basement membrane, glands, cartilage). Currently, we rely on ex vivo histologic evaluation of airway biopsies. To overcome this obstacle, we have developed an endoscopic ultrahigh-resolution diffractive optical coherence tomography (OCT) system, operating at a wavelength of 800 nm, to non-invasively study the in vivo microstructures of the airway wall. Prior to human study, validation of diffractive OCT's ability to quantitate airway microstructural components is required.

MATERIALS AND METHODS

To validate and demonstrate the accuracy of this OCT system, we used an ovine model to image small airways (∼ 2 mm in diameter). Histologic samples and correlated OCT images were matched. The cross-sectional area of the airway wall, lumen, and other microstructures were measured and compared.

RESULTS

A total of 27 sheep were studied from which we identified 39 paired OCT-histology airway images. We found strong correlations between the OCT and the histology measurements of the airway wall area and the microstructural area measurements of the epithelium, basement membrane, airway smooth muscle, glands, cartilage, and adventitia. The correlations ranged from r=0.61 (p<0.001) for the epithelium to r=0.86 (p<0.001) for the adventitia with the correlation between the OCT and the histology measurements for the entire airway wall of r=0.76 (p<0.001).

CONCLUSION

Given the high degree of correlation, these data validate the ability to acquire and quantify in vivo microscopic level imaging with this newly developed 800nm ultra-high resolution diffractive OCT system.

Non-contact optical in-vivo sensing of cilia motion by analyzing speckle patterns

Cilia motion is an indicator of pathological-ciliary function, however current diagnosis relies on biopsies. In this paper, we propose an innovative approach for sensing cilia motility. We present an endoscopic configuration for measuring the motion frequency of cilia in the nasal cavity. The technique is based on temporal tracking of the reflected spatial distribution of defocused speckle patterns while illuminating the cilia with a laser. The setup splits the optical signal into two channels; One imaging channel is for the visualization of the physician and another is, defocusing channel, to capture the speckles. We present in-vivo measurements from healthy subjects undergoing endoscopic examination. We found an average motion frequency of around 7.3 Hz and 9.8 Hz in the antero-posterior nasal mucus (an area rich in cilia), which matches the normal cilia range of 7–16 Hz. Quantitative and precise measurements of cilia vibration will optimize the diagnosis and treatment of pathological-ciliary function. This method is simple, minimally invasive, inexpensive, and promising to distinguish between normal and ciliary dysfunction.

Intravascular optical coherence elastography

Optical coherence elastography (OCE), a functional extension of optical coherence tomography (OCT), visualizes tissue strain to deduce the tissue's biomechanical properties. In this study, we demonstrate intravascular OCE using a 1.1 mm motorized catheter and a 1.6 MHz Fourier domain mode-locked OCT system. We induced an intraluminal pressure change by varying the infusion rate from the proximal end of the catheter. We analysed the pixel-matched phase change between two different frames to yield the radial strain. Imaging experiments were carried out in a phantom and in human coronary arteries in vitro. At an imaging speed of 3019 frames/s, we were able to capture the dynamic strain. Stiff inclusions in the phantom and calcification in atherosclerotic plaques are associated with low strain values and can be distinguished from the surrounding soft material, which exhibits elevated strain. For the first time, circumferential intravascular OCE images are provided side by side with conventional OCT images, simultaneously mapping both the tissue structure and stiffness.

Edge detection in single multimode fiber imaging based on deep learning

We propose a new edge detection scheme based on deep learning in single multimode fiber imaging. In this scheme, we creatively design a novel neural network, whose input is a one-dimensional light intensity sequence, and the output is the edge detection result of the target. Different from the traditional scheme, we can directly obtain the edge information of unknown objects by using this neural network without rebuilding the image. Simulation and experimental results show that, compared with the traditional method, this method can get better edge details, especially in the case of low sampling rates. It can increase the structural similarity index of edge detection imaging from 0.38 to 0.62 at the sampling rate of 0.6%. At the same time, the robustness of the method to fiber bending is also proved. This scheme improves the edge detection performance of endoscopic images and provides a promising way for the practical application of multimode fiber endoscopy.

Ultrathin, high-speed, all-optical photoacoustic endomicroscopy probe for guiding minimally invasive surgery

Photoacoustic (PA) endoscopy has shown significant potential for clinical diagnosis and surgical guidance. Multimode fibres (MMFs) are becoming increasingly attractive for the development of miniature endoscopy probes owing to their ultrathin size, low cost and diffraction-limited spatial resolution enabled by wavefront shaping. However, current MMF-based PA endomicroscopy probes are either limited by a bulky ultrasound detector or a low imaging speed that hindered their usability. In this work, we report the development of a highly miniaturised and high-speed PA endomicroscopy probe that is integrated within the cannula of a 20 gauge medical needle. This probe comprises a MMF for delivering the PA excitation light and a single-mode optical fibre with a plano-concave microresonator for ultrasound detection. Wavefront shaping with a digital micromirror device enabled rapid raster-scanning of a focused light spot at the distal end of the MMF for tissue interrogation. High-resolution PA imaging of mouse red blood cells covering an area 100 µm in diameter was achieved with the needle probe at ∼3 frames per second. Mosaicing imaging was performed after fibre characterisation by translating the needle probe to enlarge the field-of-view in real-time. The developed ultrathin PA endomicroscopy probe is promising for guiding minimally invasive surgery by providing functional, molecular and microstructural information of tissue in real-time.

Two-photon endomicroscopy with microsphere-spliced double-cladding antiresonant fiber for resolution enhancement

We demonstrate a miniature fiber-optic two two-photon endomicroscopy with microsphere-spliced double-cladding antiresonant fiber for resolution enhancement. An easy-to-operate process for fixing microsphere permanently in an antiresonant fiber core, by arc discharge, is proposed. The flexible fiber-optic probe is integrated with a parameter of 5.8 mm × 49.1 mm (outer diameter × rigid length); the field of view is 210 µm, the resolution is 1.3 µm, and the frame rate is 0.7 fps. The imaging ability is verified using ex-vivo mouse kidney, heart, stomach, tail tendon, and in-vivo brain neural imaging.

Assessment of angle-dependent spectral distortion to develop accurate hyperspectral endoscopy

Hyperspectral endoscopy has shown its potential to improve disease diagnosis in gastrointestinal tracts. Recent approaches in developing hyperspectral endoscopy are mainly focusing on enhancing image speed and quality of spectral information under a clinical environment, but there are many issues in obtaining consistent spectral information due to complicated imaging conditions, including imaging angle, non-uniform illumination, working distance, and low reflected signal. We quantitatively investigated the effect of imaging angle on the distortion of spectral information by exploiting a bifurcated fiber, spectrometer, and tissue-mimicking phantom. Spectral distortion becomes severe as increasing the angle of the imaging fiber or shortening camera exposure time for fast image acquisition. Moreover, spectral ranges from 450 to 550 nm are more susceptible to the angle-dependent spectral distortion than longer spectral ranges. Therefore, imaging angles close to normal and longer target spectral ranges with enough detector exposure time could minimize spectral distortion in hyperspectral endoscopy. These findings will help implement clinical HSI endoscopy for the robust and accurate measurement of spectral information from patients in vivo.

A computational modeling method for root canal endoscopy using a specific CBCT filter: A new era in the metaverse of endodontics begins

A contemporary technological revolution has started a new era in the metaverse of Endodontics, a world of virtual operational possibilities that use an exact replica of the natural structures of the maxillofacial complex. This study describes a modeling method for root canal endoscopy using modern cone-beam CT (CBCT) software in a series of clinical cases. The method consists in acquiring thin CBCT slices (0.10mm) in the coronal, sagittal, and axial planes. A specific 3D volume filter, the pulp cavity filter of the e-Vol DX CBCT software, was used to navigate anatomical root canal microstructures, and to scan them using root canal endoscopy. The pulp cavity filter should be set to synchronize CBCT scans from 2D mode - multiplanar reformations (MPR) - to 3D mode - volumetric reconstruction. This filter, when adopting the option of volumetric reconstruction, the developed algorithm leaves the dentin density in transparent mode so that the pulp cavity may be visualized. The algorithm applied performs the suppression (visual) of areas with dentin density. This ensures 3D visualization of the slices and the microanatomy of the root canal, as well as a dynamic navigation throughout the pulp cavity. This computational modeling method adds new resources to Endodontics, which may impact the predictability of root canal treatments positively. The virtual visualization of the internal anatomy of an exact replica of the canal ensures better communications, reliability, and clinical operationalization. Root canal endoscopy using this novel CBCT filter may be used for clinical applications together with innovative digital and virtual-reality resources that will be naturally incorporated into the principles of Endodontics.

Dynamic microscopic optical coherence tomography to visualize the morphological and functional micro-anatomy of the airways

In the imaging of airway tissue, optical coherence tomography (OCT) provides cross-sectional images of tissue structures, shows cilia movement and mucus secretion, but does not provide sufficient contrast to differentiate individual cells. By using fast sequences of microscopic resolution OCT (mOCT) images, OCT can use small signal fluctuations to overcome lack in contrast and speckle noise. In this way, OCT visualizes airway morphology on a cellular level and allows the tracking of the dynamic behavior of immune cells, as well as mucus transport and secretion. Here, we demonstrate that mOCT, by using temporal tissue fluctuation as contrast (dynamic mOCT), provides the possibility to study physiological and pathological tissue processes in vivo.

Intraoral optical coherence tomography and angiography combined with autofluorescence for dental assessment

There remains a clinical need for an accurate and non-invasive imaging tool for intraoral evaluation of dental conditions. Optical coherence tomography (OCT) is a potential candidate to meet this need, but the design of current OCT systems limits their utility in the intraoral examinations. The inclusion of light-induced autofluorescence (LIAF) can expedite the image collection process and provides a large field of view for viewing the condition of oral tissues. This study describes a novel LIAF-OCT system equipped with a handheld probe designed for intraoral examination of microstructural (via OCT) and microvascular information (via OCT angiography, OCTA). The handheld probe is optimized for use in clinical studies, maintaining the ability to detect and image changes in the condition of oral tissue (e.g., hard tissue damage, presence of dental restorations, plaque, and tooth stains). The real-time LIAF provides guidance for OCT imaging to achieve a field of view of approximately 6.9 mm × 7.8 mm, and a penetration depth of 1.5 mm to 3 mm depending on the scattering property of the target oral tissue. We demonstrate that the proposed system is successful in capturing reliable depth-resolved images from occlusal and palatal surfaces and offers added design features that can enhance its usability in clinical settings.

Human colorectal cancer tissue assessment using optical coherence tomography catheter and deep learning

Optical coherence tomography (OCT) can differentiate normal colonic mucosa from neoplasia, potentially offering a new mechanism of endoscopic tissue assessment and biopsy targeting, with a high optical resolution and an imaging depth of ~1 mm. Recent advances in convolutional neural networks (CNN) have enabled application in ophthalmology, cardiology, and gastroenterology malignancy detection with high sensitivity and specificity. Here, we describe a miniaturized OCT catheter and a residual neural network (ResNet)-based deep learning model manufactured and trained to perform automatic image processing and real-time diagnosis of the OCT images. The OCT catheter has an outer diameter of 3.8 mm, a lateral resolution of ~7 μm, and an axial resolution of ~6 μm. A customized ResNet is utilized to classify OCT catheter colorectal images. An area under the receiver operating characteristic (ROC) curve (AUC) of 0.975 is achieved to distinguish between normal and cancerous colorectal tissue images.

Optomechanical Analysis and Design of Polygon Mirror-Based Laser Scanners

Polygon Mirror (PM)-based scanning heads are one of the fastest and most versatile optomechanical laser scanners. The aim of this work is to develop a multi-parameter opto-mechanical analysis of PMs, from which to extract rules-of-thumbs for the design of such systems. The characteristic functions and parameters of PMs scanning heads are deduced and studied, considering their constructive and functional parameters. Optical aspects related to the kinematics of emergent laser beams (and of corresponding laser spots on a scanned plane or objective lens) are investigated. The PM analysis (which implies a larger number of parameters) is confronted with the corresponding, but less complex aspects of Galvanometer Scanners (GSs). The issue of the non-linearity of the scanning functions of both PMs and GSs (and, consequently, of their variable scanning velocities) is approached, as well as characteristic angles, the angular and linear Field-of-View (FOV), and the duty cycle. A device with two supplemental mirrors is proposed and designed to increase the distance between the GS or PM and the scanned plane or lens to linearize the scanning function (and thus to achieve an approximately constant scanning velocity). These optical aspects are completed with Finite Element Analyses (FEA) of fast rotational PMs, to assess their structural integrity issues. The study is concluded with an optomechanical design scheme of PM-based scanning heads, which unites optical and mechanical aspects—to allow for a more comprehensive approach of possible issues of such scanners. Such a scheme can be applied to other types of optomechanical scanners, with mirrors or refractive elements, as well.

Endoscopic OCT Angiography Using Clinical Proximal-End Scanning Catheters

Endoscopic optical coherence tomography angiography (OCTA) is a promising modality to inspect the microvasculature of inner organs in the early-stage tumor diagnosis. However, an endoscopic clinical proximal-end scanning catheter has limited flow imaging capability due to the nonuniform rotational distortion (NURD) and physiological motion. In this study, a combined local and global (CLG) optical flow algorithm was used to estimate the motion vectors caused by NURD and physiological motion. The motion vectors were used to bicubic-interpolation-resample the OCT structure to ensure that the circumferential pixels were equally spaced in the space domain. Then, angiograms were computed based on the statistical relation between inverse SNR (iSNR) and amplitude decorrelation (IDa), termed as IDa-OCTA. Finally, the ability of this technique for endoscopic OCTA imaging was demonstrated by flow phantom experiments and human nailfold capillary imaging.

Comprehensive Assessment of Coronary Calcification in Intravascular OCT Using a Spatial-Temporal Encoder-Decoder Network

Coronary calcification is a strong indicator of coronary artery disease and a key determinant of the outcome of percutaneous coronary intervention. We propose a fully automated method to segment and quantify coronary calcification in intravascular OCT (IVOCT) images based on convolutional neural networks (CNN). All possible calcified plaques were segmented from IVOCT pullbacks using a spatial-temporal encoder-decoder network by exploiting the 3D continuity information of the plaques, which were then screened and classified by a DenseNet network to reduce false positives. A novel data augmentation method based on the IVOCT image acquisition pattern was also proposed to improve the performance and robustness of the segmentation. Clinically relevant metrics including calcification area, depth, angle, thickness, volume, and stent-deployment calcification score, were automatically computed. 13844 IVOCT images with 2627 calcification slices from 45 clinical OCT pullbacks were collected and used to train and test the model. The proposed method performed significantly better than existing state-of-the-art 2D and 3D CNN methods. The data augmentation method improved the Dice similarity coefficient for calcification segmentation from 0.615±0.332 to 0.756±0.222, reaching human-level inter-observer agreement. Our proposed region-based classifier improved image-level calcification classification precision and F1-score from 0.725±0.071 and 0.791±0.041 to 0.964±0.002 and 0.883±0.008, respectively. Bland-Altman analysis showed close agreement between manual and automatic calcification measurements. Our proposed method is valuable for automated assessment of coronary calcification lesions and in-procedure planning of stent deployment.

3D-Printed Micro Lens-in-Lens for In Vivo Multimodal Microendoscopy

Multimodal microendoscopes enable co-located structural and molecular measurements in vivo, thus providing useful insights into the pathological changes associated with disease. However, different optical imaging modalities often have conflicting optical requirements for optimal lens design. For example, a high numerical aperture (NA) lens is needed to realize high-sensitivity fluorescence measurements. In contrast, optical coherence tomography (OCT) demands a low NA to achieve a large depth of focus. These competing requirements present a significant challenge in the design and fabrication of miniaturized imaging probes that are capable of supporting high-quality multiple modalities simultaneously. An optical design is demonstrated which uses two-photon 3D printing to create a miniaturized lens that is simultaneously optimized for these conflicting imaging modalities. The lens-in-lens design contains distinct but connected optical surfaces that separately address the needs of both fluorescence and OCT imaging within a lens of 330 µm diameter. This design shows an improvement in fluorescence sensitivity of >10x in contrast to more conventional fiber-optic design approaches. This lens-in-lens is then integrated into an intravascular catheter probe with a diameter of 520 µm. The first simultaneous intravascular OCT and fluorescence imaging of a mouse artery in vivo is reported.

Advances in Endoscopic Photoacoustic Imaging

Photoacoustic (PA) imaging is able to provide extremely high molecular contrast while maintaining the superior imaging depth of ultrasound (US) imaging. Conventional microscopic PA imaging has limited access to deeper tissue due to strong light scattering and attenuation. Endoscopic PA technology enables direct delivery of excitation light into the interior of a hollow organ or cavity of the body for functional and molecular PA imaging of target tissue. Various endoscopic PA probes have been developed for different applications, including the intravascular imaging of lipids in atherosclerotic plaque and endoscopic imaging of colon cancer. In this paper, the authors review representative probe configurations and corresponding preclinical applications. In addition, the potential challenges and future directions of endoscopic PA imaging are discussed.

Video-rate dual-modal photoacoustic and fluorescence imaging through a multimode fibre towards forward-viewing endomicroscopy

Multimode fibres (MMFs) are becoming increasingly attractive in optical endoscopy as they promise to enable unparallelled miniaturisation, spatial resolution and cost. However, high-speed imaging with wavefront shaping has been challenging. Here, we report the development of a video-rate dual-modal photoacoustic (PA) and fluorescence microscopy probe with a high-speed digital micromirror device (DMD) towards forward-viewing endomicroscopy. Optimal DMD patterns were obtained using a real-valued intensity transmission matrix algorithm to raster-scan a 1.5  μ m-diameter focused beam at the distal fibre tip for imaging. The PA imaging speed and spatial resolution were varied from  ∼ 2 to 57 frames per second and from 1.7 to 3  μ m, respectively. Further, high-fidelity PA images of carbon fibres and mouse red blood cells were acquired at unprecedented speed. The capability of dual-modal imaging was demonstrated with phantoms. We anticipate that with further miniaturisation of the ultrasound detector, this probe could be integrated into medical needles to guide minimally invasive procedures.

Esophageal optical coherence tomography image synthesis using an adversarially learned variational autoencoder

Endoscopic optical coherence tomography (OCT) imaging offers a non-invasive way to detect esophageal lesions on the microscopic scale, which is of clinical potential in the early diagnosis and treatment of esophageal cancers. Recent studies focused on applying deep learning-based methods in esophageal OCT image analysis and achieved promising results, which require a large data size. However, traditional data augmentation techniques generate samples that are highly correlated and sometimes far from reality, which may not lead to a satisfied trained model. In this paper, we proposed an adversarial learned variational autoencoder (AL-VAE) to generate high-quality esophageal OCT samples. The AL-VAE combines the generative adversarial network (GAN) and variational autoencoder (VAE) in a simple yet effective way, which preserves the advantages of VAEs, such as stable training and nice latent manifold, and requires no extra discriminators. Experimental results verified the proposed method achieved better image quality in generating esophageal OCT images when compared with the state-of-the-art image synthesis network, and its potential in improving deep learning model performance was also evaluated by esophagus segmentation.

Double-Clad Fiber-Based Multifunctional Biosensors and Multimodal Bioimaging Systems: Technology and Applications

Optical fibers have been used to probe various tissue properties such as temperature, pH, absorption, and scattering. Combining different sensing and imaging modalities within a single fiber allows for increased sensitivity without compromising the compactness of an optical fiber probe. A double-clad fiber (DCF) can sustain concurrent propagation modes (single-mode, through its core, and multimode, through an inner cladding), making DCFs ideally suited for multimodal approaches. This study provides a technological review of how DCFs are used to combine multiple sensing functionalities and imaging modalities. Specifically, we discuss the working principles of DCF-based sensors and relevant instrumentation as well as fiber probe designs and functionalization schemes. Secondly, we review different applications using a DCF-based probe to perform multifunctional sensing and multimodal bioimaging.

Endoscopic en-face optical coherence tomography and fluorescence imaging using correlation-based probe tracking

Forward-viewing endoscopic optical coherence tomography (OCT) provides 3D imaging in vivo, and can be combined with widefield fluorescence imaging by use of a double-clad fiber. However, it is technically challenging to build a high-performance miniaturized 2D scanning system with a large field-of-view. In this paper we demonstrate how a 1D scanning probe, which produces cross-sectional OCT images (B-scans) and 1D fluorescence T-scans, can be transformed into a 2D scanning probe by manual scanning along the second axis. OCT volumes are assembled from the B-scans using speckle decorrelation measurements to estimate the out-of-plane motion along the manual scan direction. Motion within the plane of the B-scans is corrected using image registration by normalized cross correlation. En-face OCT slices and fluorescence images, corrected for probe motion in 3D, can be displayed in real-time during the scan. For a B-scan frame rate of 250 Hz, and an OCT lateral resolution of approximately 20 μ m , the approach can handle out-of-plane motion at speeds of up to 4 mm/s.

Lung tissue phantom mimicking pulmonary optical properties, relative humidity, and temperature: a tool to analyze the changes in oxygen gas absorption for different inflated volumes

SIGNIFICANCE

Gas in scattering media absorption spectroscopy (GASMAS) enables noninvasive gas sensing in the body. It is developing as a tool for diagnosis and monitoring of respiratory conditions in neonates. Phantom models with relevant features to the clinical translation of GASMAS technology are necessary to understand technical challenges and potential applications of this technique. State-of-the-art phantoms designed for this purpose have focused on the optical properties and anthropomorphic geometry of the thorax, contributing to the source-detector placement, design, and optimization. Lung phantom mimicking the alveolar anatomy has not been included in the existent models due to the inherent complexity of the tissue. We present a simplified model that recreates inflated alveoli embedded in lung phantom.

AIM

The goal of this study was to build a lung model with air-filled structures mimicking inflated alveoli surrounded by optical phantom with accurate optical properties (μa  =  0.50  cm  -  1 and μs'=5.4  cm-1) and physiological parameters [37°C and 100% relative humidity (RH)], and to control the air volume within the phantom to demonstrate the feasibility of GASMAS in sensing changes in pulmonary air volume.

APPROACH

The lung model was built using a capillary structure with analogous size to alveolar units. Part of the capillaries were filled with liquid lung optical phantom to recreate scattering and absorption, whereas empty capillaries mimicked air filled alveoli. The capillary array was placed inside a custom-made chamber that maintained pulmonary temperature and RH. The geometry of the chamber permitted the placement of the laser head and detector of a GASMAS bench top system (MicroLab Dual O2  /  H2O), to test the changes in volume of the lung model in transmittance geometry.

RESULTS

The lung tissue model with air volume range from 6.89  ×  10  -  7  m3 to 1.80  ×  10  -  3  m3 was built. Two measurement sets, with 10 different capillary configurations each, were arranged to increase or decrease progressively (in steps of 3.93  ×  10  -  8  m3) the air volume in the lung model. The respective GASMAS data acquisition was performed for both data sets. The maximum absorption signal was obtained for configurations with the highest number of air-filled capillaries and decreased progressively when the air spaces were replaced by capillaries filled with liquid optical phantom. Further studies are necessary to define the minimum and maximum volume of air that can be measured with GASMAS-based devices for different source-detector geometries.

CONCLUSIONS

The optical properties and the structure of tissue from the respiratory zone have been modeled using a simplified capillary array immersed in a controlled environment chamber at pulmonary temperature and RH. The feasibility of measuring volume changes with GASMAS technique has been proven, stating a new possible application of GASMAS technology in respiratory treatment and diagnostics.

Reconstruction of visible light optical coherence tomography images retrieved from discontinuous spectral data using a conditional generative adversarial network

Achieving high resolution in optical coherence tomography typically requires the continuous extension of the spectral bandwidth of the light source. This work demonstrates an alternative approach: combining two discrete spectral windows located in the visible spectrum with a trained conditional generative adversarial network (cGAN) to reconstruct a high-resolution image equivalent to that generated using a continuous spectral band. The cGAN was trained using OCT image pairs acquired with the continuous and discontinuous visible range spectra to learn the relation between low- and high-resolution data. The reconstruction performance was tested using 6000 B-scans of a layered phantom, micro-beads and ex-vivo mouse ear tissue. The resultant cGAN-generated images demonstrate an image quality and axial resolution which approaches that of the high-resolution system.