High-speed fiber scanning endoscope for volumetric multi-megahertz optical coherence tomography

Deep Learning for High Speed Optical Coherence Elastography With a Fiber Scanning Endoscope

Tissue stiffness is related to soft tissue pathologies and can be assessed through palpation or via clinical imaging systems, e.g., ultrasound or magnetic resonance imaging. Typically, the image based approaches are not suitable during interventions, particularly for minimally invasive surgery. To this end, we present a miniaturized fiber scanning endoscope for fast and localized elastography. Moreover, we propose a deep learning based signal processing pipeline to account for the intricate data and the need for real-time estimates. Our elasticity estimation approach is based on imaging complex and diffuse wave fields that encompass multiple wave frequencies and propagate in various directions. We optimize the probe design to enable different scan patterns. To maximize temporal sampling while maintaining three-dimensional information we define a scan pattern in a conical shape with a temporal frequency of 5.05kHz. To efficiently process the image sequences of complex wave fields we consider a spatio-temporal deep learning network. We train the network in an end-to-end fashion on measurements from phantoms representing multiple elasticities. The network is used to obtain localized and robust elasticity estimates, allowing to create elasticity maps in real-time. For 2D scanning, our approach results in a mean absolute error of 6.31(576)kPa compared to 11.33(1278)kPa for conventional phase tracking. For scanning without estimating the wave direction, the novel 3D method reduces the error to 4.48(363)kPa compared to 19.75(2182)kPa for the conventional 2D method. Finally, we demonstrate feasibility of elasticity estimates in ex-vivo porcine tissue.

Handheld laser scanning microscope catheter for real-time and in vivo confocal microscopy using a high definition high frame rate Lissajous MEMS mirror

A handheld confocal microscope using a rapid MEMS scanning mirror facilitates real-time optical biopsy for simple cancer diagnosis. Here we report a handheld confocal microscope catheter using high definition and high frame rate (HDHF) Lissajous scanning MEMS mirror. The broad resonant frequency region of the fast axis on the MEMS mirror with a low Q-factor facilitates the flexible selection of scanning frequencies. HDHF Lissajous scanning was achieved by selecting the scanning frequencies with high greatest common divisor (GCD) and high total lobe number. The MEMS mirror was fully packaged into a handheld configuration, which was coupled to a home-built confocal imaging system. The confocal microscope catheter allows fluorescence imaging of in vivo and ex vivo mouse tissues with 30 Hz frame rate and 95.4% fill factor at 256 × 256 pixels image, where the lateral resolution is 4.35 μm and the field-of-view (FOV) is 330 μm × 330 μm. This compact confocal microscope can provide diverse handheld microscopic applications for real-time, on-demand, and in vivo optical biopsy.

Endoscopic en-face optical coherence tomography and fluorescence imaging using correlation-based probe tracking

Forward-viewing endoscopic optical coherence tomography (OCT) provides 3D imaging in vivo, and can be combined with widefield fluorescence imaging by use of a double-clad fiber. However, it is technically challenging to build a high-performance miniaturized 2D scanning system with a large field-of-view. In this paper we demonstrate how a 1D scanning probe, which produces cross-sectional OCT images (B-scans) and 1D fluorescence T-scans, can be transformed into a 2D scanning probe by manual scanning along the second axis. OCT volumes are assembled from the B-scans using speckle decorrelation measurements to estimate the out-of-plane motion along the manual scan direction. Motion within the plane of the B-scans is corrected using image registration by normalized cross correlation. En-face OCT slices and fluorescence images, corrected for probe motion in 3D, can be displayed in real-time during the scan. For a B-scan frame rate of 250 Hz, and an OCT lateral resolution of approximately 20 μ m , the approach can handle out-of-plane motion at speeds of up to 4 mm/s.

Microscopic optical coherence tomography (mOCT) at 600 kHz for 4D volumetric imaging and dynamic contrast

Volumetric imaging of dynamic processes with microscopic resolution holds a huge potential in biomedical research and clinical diagnosis. Using supercontinuum light sources and high numerical aperture (NA) objectives, optical coherence tomography (OCT) achieves microscopic resolution and is well suited for imaging cellular and subcellular structures of biological tissues. Currently, the imaging speed of microscopic OCT (mOCT) is limited by the line-scan rate of the spectrometer camera and ranges from 30 to 250 kHz. This is not fast enough for volumetric imaging of dynamic processes in vivo and limits endoscopic application. Using a novel CMOS camera, we demonstrate fast 3-dimensional OCT imaging with 600,000 A-scans/s at 1.8 µm axial and 1.1 µm lateral resolution. The improved speed is used for imaging of ciliary motion and particle transport in ex vivo mouse trachea. Furthermore, we demonstrate dynamic contrast OCT by evaluating the recorded volumes rather than en face planes or B-scans. High-speed volumetric mOCT will enable the correction of global tissue motion and is a prerequisite for applying dynamic contrast mOCT in vivo. With further increase in imaging speed and integration in flexible endoscopes, volumetric mOCT may be used to complement or partly replace biopsies.

Machine learning enabled self-calibration single fiber endoscopic imaging

Single fiber scanners (SFSs), with the advantages of compact size, versatility, large field of view, and high resolution, have been applied in many areas. However, image distortions persistently impair the imaging quality of the SFS, although many efforts have been made to address the problem. In this Letter, we propose a simple and complete solution by combining the piezoelectric (PZT) self-induction sensor and machine learning algorithms. The PZT tube was utilized as both the actuator and the fiber position sensor. Additionally, the feedback sensor signal was interrogated by a convolution neural network to eliminate the noise. The experimental results show that the predicted fiber trajectory error was below 0.1%. Moreover, this self-calibration SFS has an excellent robustness to temperature changes (20-50°C). It is believed that the proposed solution has removed the biggest barrier for the SFS and greatly improved its performance and stability in complex environments.

Dynamic contrast in scanning microscopic OCT

While optical coherence tomography (OCT) provides a resolution down to 1 µm, it has difficulties in visualizing cellular structures due to a lack of scattering contrast. By evaluating signal fluctuations, a significant contrast enhancement was demonstrated using time-domain full-field OCT (FF-OCT), which makes cellular and subcellular structures visible. The putative cause of the dynamic OCT signal is the site-dependent active motion of cellular structures in a sub-micrometer range, which provides histology-like contrast. Here we demonstrate dynamic contrast with a scanning frequency-domain OCT (FD-OCT), which we believe has crucial advantages. Given the inherent sectional imaging geometry, scanning FD-OCT provides depth-resolved images across tissue layers, a perspective known from histopathology, much faster and more efficiently than FF-OCT. Both shorter acquisition times and tomographic depth-sectioning reduce the sensitivity of dynamic contrast for bulk tissue motion artifacts and simplify their correction in post-processing. Dynamic contrast makes microscopic FD-OCT a promising tool for the histological analysis of unstained tissues.

Concept for Markerless 6D Tracking Employing Volumetric Optical Coherence Tomography

Optical tracking systems are widely used, for example, to navigate medical interventions. Typically, they require the presence of known geometrical structures, the placement of artificial markers, or a prominent texture on the target’s surface. In this work, we propose a 6D tracking approach employing volumetric optical coherence tomography (OCT) images. OCT has a micrometer-scale resolution and employs near-infrared light to penetrate few millimeters into, for example, tissue. Thereby, it provides sub-surface information which we use to track arbitrary targets, even with poorly structured surfaces, without requiring markers. Our proposed system can shift the OCT’s field-of-view in space and uses an adaptive correlation filter to estimate the motion at multiple locations on the target. This allows one to estimate the target’s position and orientation. We show that our approach is able to track translational motion with root-mean-squared errors below 0.25 mm and in-plane rotations with errors below 0.3°. For out-of-plane rotations, our prototypical system can achieve errors around 0.6°.

Miniaturized precalibration-based Lissajous scanning fiber probe for high speed endoscopic optical coherence tomography

We present a miniaturized precalibration-based forward-viewing Lissajous scanning fiber probe for high speed endoscopic optical coherence tomography (OCT). The probe is based on an asymmetric fiber cantilever driven by the piezoelectric bender to realize two-dimensional (2D) Lissajous scanning. The stability and repeatability of the Lissajous scanning trajectory of the probe is tested by a position sensitive detector (PSD)-based position calibration setup. The two orthogonal resonant frequencies of the cantilever are measured to be 167.2 and 121 Hz. A 25 µm focal spot is formed at the working distance of 5 mm by the graded-index (GRIN) lens, and the field of view of the imaging probe is around ${1.5}\;{\rm mm} \times {1.5}\;{\rm mm}$1.5mm×1.5mm. The probe is fully packaged in a hypodermic tube for endoscopic imaging. The total rigid length and outer diameter are 35 mm and 3.5 mm, respectively. The probe is incorporated in a 50 KHz swept source OCT system with the axial resolution of 14 µm, and its imaging performance is validated by the 2D en face and 3D volumetric OCT imaging of the phantom and the biological tissue.

Comparison of optical coherence tomography angiography and narrow-band imaging using a bimodal endoscope

We present coregistered images of tissue vasculature that allow a direct comparison between the performance of narrow-band imaging (NBI) and optical coherence tomography angiography (OCTA). Images were generated with a bimodal endomicroscope having a size of 15  ×  2.4  ×  3.3  ³   ( l  ,  w  ,  h  )   that combines two imaging channels. The white light imaging channel was used to perform NBI, the current gold standard for endoscopic visualization of vessels. The second channel allowed the simultaneous acquisition of optical coherence tomography (OCT) and OCTA images, enabling a three-dimensional (3-D) visualization of morphological as well as functional tissue information. In order to obtain 3-D OCT images scanning of the light-transmitting fiber was implemented by a small piezoelectric tube. A field of view of ∼1.1  mm was achieved for both modalities. Under the assumption that OCTA can address current limitations of NBI, their performance was studied and compared during in vivo experiments. The preliminary results show the potential of OCT regarding an improved visualization and localization of vessel beds, which can be beneficial for diagnosis of pathological conditions.

Ultralow-voltage electrothermal MEMS based fiber-optic scanning probe for forward-viewing endoscopic OCT

We report an ultralow-voltage, electrothermal (ET) micro-electro-mechanical system (MEMS) based probe for forward-viewing endoscopic optical coherence tomography (OCT) imaging. The fully assembled probe has a diameter of 5.5 mm and a length of 55 mm, including the imaging optics and a 40 mm long fiber-optic cantilever attached on a micro-platform of the bimorph ET MEMS actuator. The ET MEMS actuator provides a sufficient mechanical actuation force as well as a large vertical displacement, achieving up to a 3 mm optical scanning range with only a 3 V_ACp-p drive voltage with a 1.5 V_DC offset. The imaging probe was integrated with a swept-source OCT system of a 100 kHz A-scan rate, and its performance was successfully demonstrated with cross-sectional imaging of biological tissues ex vivo and in vivo at a speed up to 200 frames per second.

Endoscopic optical coherence tomography angiography using a forward imaging piezo scanner probe

A forward imaging endoscope for optical coherence tomography angiography (OCTA) featuring a piezoelectric fiber scanner is presented. Imaging is performed with an optical coherence tomography (OCT) system incorporating an akinetic light source with a center wavelength of 1300 nm, bandwidth of 90 nm and A-line rate of 173 kHz. The endoscope operates in contact mode to avoid motion artifacts, in particular, beneficial for OCTA measurements, and achieves a transversal resolution of 12 μm in air at a rigid probe size of 4 mm in diameter and 11.3 mm in length. A spiral scan pattern is generated at a scanning frequency of 360 Hz to sample a maximum field of view of 1.3 mm. OCT images of a human finger as well as visualization of microvasculature of the human palm are presented both in two and three dimensions. The combination of morphological tissue contrast with qualitative dynamic blood flow information within this endoscopic imaging approach potentially enables improved early diagnostic capabilities of internal organs for diseases such as bladder cancer.