Adaptive multiphoton endomicroscopy through a dynamically deformed multicore optical fiber using proximal detection

Real-time holographic lensless micro-endoscopy through flexible fibers via fiber bundle distal holography

Fiber-based micro-endoscopes are a critically important tool for minimally-invasive deep-tissue imaging. However, current micro-endoscopes cannot perform three-dimensional imaging through dynamically-bent fibers without the use of bulky optical elements such as lenses and scanners at the distal end, increasing the footprint and tissue-damage. Great efforts have been invested in developing approaches that avoid distal bulky optical elements. However, the fundamental barrier of dynamic optical wavefront-distortions in propagation through flexible fibers limits current approaches to nearly-static or non-flexible fibers. Here, we present an approach that allows holographic, bend-insensitive, coherence-gated, micro-endoscopic imaging using commercially available multi-core fibers (MCFs). We achieve this by adding a partially-reflecting mirror to the distal fiber-tip, allowing to perform low-coherence full-field phase-shifting holography. We demonstrate widefield diffraction-limited reflection imaging of amplitude and phase targets through dynamically bent fibers at video-rate. Our approach holds potential for label-free investigations of dynamic samples.

Real-time complex light field generation through a multi-core fiber with deep learning

The generation of tailored complex light fields with multi-core fiber (MCF) lensless microendoscopes is widely used in biomedicine. However, the computer-generated holograms (CGHs) used for such applications are typically generated by iterative algorithms, which demand high computation effort, limiting advanced applications like fiber-optic cell manipulation. The random and discrete distribution of the fiber cores in an MCF induces strong spatial aliasing to the CGHs, hence, an approach that can rapidly generate tailored CGHs for MCFs is highly demanded. We demonstrate a novel deep neural network-CoreNet, providing accurate tailored CGHs generation for MCFs at a near video rate. The CoreNet is trained by unsupervised learning and speeds up the computation time by two magnitudes with high fidelity light field generation compared to the previously reported CGH algorithms for MCFs. Real-time generated tailored CGHs are on-the-fly loaded to the phase-only spatial light modulator (SLM) for near video-rate complex light fields generation through the MCF microendoscope. This paves the avenue for real-time cell rotation and several further applications that require real-time high-fidelity light delivery in biomedicine.

Adaptive Wave-Front Shaping and Beam Focusing through Fiber Bundles for High-Resolution Bioimaging

We demonstrate an adaptive wave-front shaping of optical beams transmitted through fiber bundles as a powerful resource for multisite, high-resolution bioimaging. With the phases of all the beamlets delivered through up to 6000 different fibers within the fiber bundle controlled individually, by means of a high-definition spatial light modulator, the overall beam transmitted through the fiber bundle can be focused into a beam waist with a diameter less than 1 μm within a targeted area in a biotissue, providing a diffraction-limited spatial resolution adequate for single-cell or even subcellular bioimaging. The field intensity in the adaptively-focused continuous-wave laser beam in our fiber-bundle-imaging setting is more than two orders of magnitude higher than the intensity of the speckle background. Once robust beam focusing was achieved with a suitable phase profile across the input face of the fiber bundle, the beam focus can be scanned over a targeted area with no need for a further adaptive search, by applying a physically intuitive, wave-front-tilting phase mask on the field of input beamlets. This method of beam-focus scanning promises imaging speeds compatible with the requirements of in vivo calcium imaging.

Rapid computational cell-rotation around arbitrary axes in 3D with multi-core fiber

Optical trapping is a vital tool in biology, allowing precise optical manipulation of nanoparticles, micro-robots, and cells. Due to the low risk of photodamage and high trap stiffness, fiber-based dual-beam traps are widely used for optical manipulation of large cells. Besides trapping, advanced applications like 3D refractive index tomography need a rotation of cells, which requires precise control of the forces, for example, the acting-point of the forces and the intensities in the region of interest (ROI). A precise rotation of large cells in 3D about arbitrary axes has not been reported yet in dual-beam traps. We introduce a novel dual-beam optical trap in which a multi-core fiber (MCF) is transformed to a phased array, using wavefront shaping and computationally programmable light. The light-field distribution in the trapping region is holographically controlled within 0.1 s, which determines the orientation and the rotation axis of the cell with small retardation. We demonstrate real-time controlled rotation of HL60 cells about all 3D axes with a very high degree of freedom by holographic controlled light through an MCF with a resolution close to the diffraction limit. For the first time, the orientation of the cell can be precisely controlled about all 3D axes in a dual-beam trap. MCFs provide much higher flexibility beyond the bulky optics, enabling lab-on-a-chip applications and can be easily integrated for applications like contactless cell surgery, refractive index tomography, cell-elasticity measurement, which require precise 3D manipulation of cells.

Guidestar-free image-guided wavefront shaping

Optical imaging through scattering media is a fundamental challenge in many applications. Recently, breakthroughs such as imaging through biological tissues and looking around corners have been obtained via wavefront-shaping approaches. However, these require an implanted guidestar for determining the wavefront correction, controlled coherent illumination, and most often raster scanning of the shaped focus. Alternative novel computational approaches that exploit speckle correlations avoid guidestars and wavefront control but are limited to small two-dimensional objects contained within the "memory-effect" correlation range. Here, we present a new concept, image-guided wavefront shaping, allowing widefield noninvasive, guidestar-free, incoherent imaging through highly scattering layers, without illumination control. The wavefront correction is found even for objects that are larger than the memory-effect range, by blindly optimizing image quality metrics. We demonstrate imaging of extended objects through highly scattering layers and multicore fibers, paving the way for noninvasive imaging in various applications, from microscopy to endoscopy.

Complex Wavefront Shaping through a Multi-Core Fiber

Wavefront shaping through a multi-core fiber (MCF) is turning into an attractive method for endoscopic imaging and optical cell-manipulation on a chip. However, the discrete distribution and the low number of cores induce pixelated phase modulation, becoming an obstacle for delivering complex light field distributions through MCFs. We demonstrate a novel phase retrieval algorithm named Core–Gerchberg–Saxton (Core-GS) employing the captured core distribution map to retrieve tailored modulation hologram for the targeted intensity distribution at the distal far-field. Complex light fields are reconstructed through MCFs with high fidelity up to 96.2%. Closed-loop control with experimental feedback denotes the capability of the Core-GS algorithm for precise intensity manipulation of the reconstructed light field. Core-GS provides a robust way for wavefront shaping through MCFs; it facilitates the MCF becoming a vital waveguide in endoscopic and lab-on-a-chip applications.

Averaging speckle patterns to improve the robustness of compressive multimode fiber imaging against fiber bend

Fiber bend is a major challenge of multimode fiber (MMF) imaging. More robustness against fiber bend is demonstrated in compressive MMF imaging using mean speckle patterns captured at multiple potential bending configurations beforehand, rather than sticking to single patterns at initial configuration. Experiments demonstrate an overall quality improvement on recovered images than previous work, which is important for robust endoscopic application.

Quantitative phase and polarization imaging through an optical fiber applied to detection of early esophageal tumorigenesis

Phase and polarization of coherent light are highly perturbed by interaction with microstructural changes in premalignant tissue, holding promise for label-free detection of early tumors in endoscopically accessible tissues such as the gastrointestinal tract. Flexible optical multicore fiber (MCF) bundles used in conventional diagnostic endoscopy and endomicroscopy scramble phase and polarization, restricting clinicians instead to low-contrast amplitude-only imaging. We apply a transmission matrix characterization approach to produce full-field en-face images of amplitude, quantitative phase, and resolved polarimetric properties through an MCF. We first demonstrate imaging and quantification of biologically relevant amounts of optical scattering and birefringence in tissue-mimicking phantoms. We present an entropy metric that enables imaging of phase heterogeneity, indicative of disordered tissue microstructure associated with early tumors. Finally, we demonstrate that the spatial distribution of phase and polarization information enables label-free visualization of early tumors in esophageal mouse tissues, which are not identifiable using conventional amplitude-only information.

Reconstruction of Optical Vector-Fields With Applications in Endoscopic Imaging

We introduce a framework for the reconstruction of the amplitude, phase, and polarization of an optical vector-field using measurements acquired by an imaging device characterized by an integral transform with an unknown spatially variant kernel. By incorporating effective regularization terms, this new approach is able to recover an optical vector-field with respect to an arbitrary representation system, which may be different from the one used for device calibration. In particular, it enables the recovery of an optical vector-field with respect to a Fourier basis, which is shown to yield indicative features of increased scattering associated with tissue abnormalities. We demonstrate the effectiveness of our approach using synthetic holographic images and biological tissue samples in an experimental setting, where the measurements of an optical vector-field are acquired by a multicore fiber endoscope, and observe that indeed the recovered Fourier coefficients are useful in distinguishing healthy tissues from tumors in early stages of oesophageal cancer.

Selective femtosecond laser ablation via two-photon fluorescence imaging through a multimode fiber

We demonstrate the ability of a multimode fiber probe to provide two-photon fluorescence (TPF) imaging feedback that guides the femtosecond laser ablation (FLA) in biological samples for highly selective modifications. We implement the system through the propagation of high power femtosecond pulses through a graded-index (GRIN) multimode fiber and we investigate the limitations posed by the high laser peak intensities required for laser ablation. We demonstrate that the GRIN fiber probe can deliver laser intensities up to 1.5x10¹³ W/cm², sufficient for the ablation of a wide range of materials, including biological samples. Wavefront shaping through an ultrathin probe of around 400 μm in diameter is used for diffraction limited focusing and digital scanning of the focus spot. Selective FLA of cochlear hair cells is performed based on the TPF images obtained through the same multimode fiber probe.

Two-photon lensless micro-endoscopy with in-situ wavefront correction

Multi-core fiber-bundle endoscopes provide a minimally-invasive solution for deep tissue imaging and opto-genetic stimulation, at depths beyond the reach of conventional microscopes. Recently, wavefront-shaping has enabled lensless bundle-based micro-endoscopy by correcting the wavefront distortions induced by core-to-core inhomogeneities. However, current wavefront-shaping solutions require access to the fiber distal end for determining the bend-sensitive wavefront-correction. Here, we show that it is possible to determine the wavefront correction in-situ, without any distal access. Exploiting the nonlinearity of two-photon excited fluorescence, we adaptively determine the wavefront correction in-situ using only proximal detection of epi-detected fluorescence. We experimentally demonstrate diffraction-limited, three-dimensional, two-photon lensless microendoscopy with commercially-available ordered- and disordered multi-core fiber bundles.

Self-calibration of lensless holographic endoscope using programmable guide stars

Coherent fiber bundle (CFB)-based endoscopes enable optical keyhole access in applications such as biophotonics. In conjunction with objective lenses, CFBs allow imaging of intensity patterns. In contrast, digital optical phase conjugation enables lensless holographic endoscopes for the generation of pixelation-free arbitrary light patterns. For real-world applications, however, this requires a non-invasive in situ calibration of the complex optical transfer function of the CFB with only single-sided access. We show that after an initial calibration in a forward direction, a differential phase measurement of the back-reflected light allows for tracking and compensating of bending-induced phase distortions. Furthermore, we present a novel in situ calibration procedure based on a programmable guide star, which requires access to only one side of the fiber.

Semi-random multicore fibre design for adaptive multiphoton endoscopy

This paper reports the development, modelling and application of a semi-random multicore fibre (MCF) design for adaptive multiphoton endoscopy. The MCF was constructed from 55 sub-units, each comprising 7 single mode cores, in a hexagonally close-packed lattice where each sub-unit had a random angular orientation. The resulting fibre had 385 single mode cores and was double-clad for proximal detection of multiphoton excited fluorescence. The random orientation of each sub-unit in the fibre reduces the symmetry of the positions of the cores in the MCF, reducing the intensity of higher diffracted orders away from the central focal spot formed at the distal tip of the fibre and increasing the maximum size of object that can be imaged. The performance of the MCF was demonstrated by imaging fluorescently labelled beads with both distal and proximal fluorescence detection and pollen grains with distal fluorescence detection. We estimate that the number of independent resolution elements in the final image - measured as the half-maximum area of the two-photon point spread function divided by the area imaged - to be ~3200.

Bending-induced inter-core group delays in multicore fibers

We examine the impact of fiber bends on ultrashort pulse propagation in a 169-core multicore fiber (MCF) by numerical simulations and experimental measurements. We show that an L-shaped bend (where only one end of the MCF is fixed) induces significant changes in group delays that are a function of core position but linear along the bending axis with a slope directly proportional to the bending angle. For U- and S-shaped bends (where both ends of the MCF are fixed) the induced refractive index and group delay changes are much smaller than the residual, intrinsic inter-core group delay differences of the unbent MCF. We further show that when used for point-scanning lensless endoscopy with ultrashort pulse excitation, bend-induced group delays in the MCF degrade the point-spread function due to spatiotemporal coupling. Our results show that bend-induced effects in MCFs can be parametrized with only two parameters: the angle of the bend axis and the amplitude of the bend. This remains valid for bend amplitudes up to at least 200 degrees.

High power, ultrashort pulse control through a multi-core fiber for ablation

Ultrashort pulse ablation has become a useful tool for micromachining and biomedical surgical applications. Implementation of ultrashort pulse ablation in confined spaces has been limited by endoscopic delivery and focusing of a high peak power pulse. Here we demonstrate ultrashort pulse ablation through a thin multi-core fiber (MCF) using wavefront shaping, which allows for focusing and scanning the pulse without requiring distal end optics and enables a smaller ablation tool. The intensity necessary for ablation is significantly higher than for multiphoton imaging. We show that the ultimate limitations of the MCF based ablation are the nonlinear effects induced by the pulse in the MCFs cores. We characterize and compare the performance of two devices utilizing a different number of cores and demonstrate ultrashort pulse ablation on a thin film of gold.

Bend translation in multimode fiber imaging

Light propagation in multimode fibers is typically assumed to be extremely sensitive to changes in geometry. We study here a particular configuration where an S-shaped bend is translated between two sections of fiber. In this sliding bend configuration, we show that nearly constant propagation characteristics can be obtained in certain fibers. Several fibers were tested using a bend with a peak radius of curvature of 25 mm. We found large differences in bending behavior between fibers of varying core diameters and numerical apertures. Fibers with a large numerical aperture are found to be more stable. In several fibers, the bend can be translated over a distance of 25 mm with a limited impact on imaging performance. The experimental results are confirmed using simulations. Our findings shed a new light on bending sensitivity in multimode fibers, and open up more possibilities for their use as imaging devices.

Phase retrieval in multicore fiber bundles

Multicore fiber bundles are widely used in endoscopy due to their miniature size and their direct imaging capabilities. They have recently been used, in combination with spatial light modulators, in various realizations of endoscopy with little or no optics at the distal end. These schemes require characterization of the relative phase offsets between the different cores, typically done using off-axis holography, thus requiring both an interferometric setup and, typically, access to the distal tip. Here we explore the possibility of employing phase retrieval to extract the necessary phase information. We show that in the noise-free case, disordered fiber bundles are superior for phase retrieval over their periodic counterparts, and demonstrate experimentally accurate retrieval of phase information for up to 10 simultaneously illuminated cores. Thus, phase retrieval is presented as a viable alternative for real-time monitoring of phase distortions in multicore fiber bundles.