Averaging speckle patterns to improve the robustness of compressive multimode fiber imaging against fiber bend

Optical fiber bundle differential compressive imaging

We present a differential compressive imaging method for an optical fiber bundle (OFB), which provides a solution for an ultrathin bend-resistant endoscope with high resolution. This method uses an OFB and a diffuser to generate speckle illumination patterns. Differential operation is additionally applied to the speckle patterns to produce sensing matrices, by which the correlation between the matrices is greatly reduced from 0.875 to 0.0275, which ensures the high quality of image reconstruction. Pixilation artifacts from the fiber core arrangement are also effectively eliminated with this configuration. We demonstrate high-resolution reconstruction of images of 132 × 132 pixels with a compression rate of 12% using 77 fiber cores, the total diameter of which is only about 91 µm. An experimental verification proves that this method is tolerant to a limited degree of fiber bending, which provides a potential approach for robust high-resolution fiber endoscopy.

Robust real-time imaging through flexible multimode fibers

Conventional endoscopes comprise a bundle of optical fibers, associating one fiber for each pixel in the image. In principle, this can be reduced to a single multimode optical fiber (MMF), the width of a human hair, with one fiber spatial-mode per image pixel. However, images transmitted through a MMF emerge as unrecognizable speckle patterns due to dispersion and coupling between the spatial modes of the fiber. Furthermore, speckle patterns change as the fiber undergoes bending, making the use of MMFs in flexible imaging applications even more complicated. In this paper, we propose a real-time imaging system using flexible MMFs, but which is robust to bending. Our approach does not require access or feedback signal from the distal end of the fiber during imaging. We leverage a variational autoencoder to reconstruct and classify images from the speckles and show that these images can still be recovered when the bend configuration of the fiber is changed to one that was not part of the training set. We utilize a MMF 300 mm long with a 62.5 μm core for imaging [Formula: see text] cm objects placed approximately at 20 cm from the fiber and the system can deal with a change in fiber bend of 50[Formula: see text] and range of movement of 8 cm.

Block-based compressed sensing for fast optic fiber bundle imaging with high spatial resolution

The resolution of traditional fiber bundle imaging is usually limited by the density and the diameter of the fiber cores. To improve the resolution, compression sensing was introduced to resolve multiple pixels from a single fiber core, but current methods have the drawbacks of excessive sampling and long reconstruction time. In this paper, we present, what we believe to be, a novel block-based compressed sensing scheme for fast realization of high-resolution optic fiber bundle imaging. In this method, the target image is segmented into multiple small blocks, each of which covers the projection area of one fiber core. All block images are independently and simultaneously sampled and the intensities are recorded by a two-dimensional detector after they are collected and transmitted through corresponding fiber cores. Because the size of sampling patterns and the sampling numbers are greatly reduced, the reconstruction complexity and reconstruction time are also decreased. According to the simulation analysis, our method is 23 times faster than the current compressed sensing optical fiber imaging for reconstructing a fiber image of 128 × 128 pixels, while the sampling number is only 0.39%. Experiment results demonstrate that the method is also effective for reconstructing large target images and the number of sampling does not increase with the size of the image. Our finding may provide a new idea for high-resolution real-time imaging of fiber bundle endoscope.

Sub-diffraction computational imaging via a flexible multicore-multimode fiber

An ultra-thin multimode fiber is an ideal platform for minimally invasive microscopy with the advantages of a high density of modes, high spatial resolution, and a compact size. In practical applications, the probe needs to be long and flexible, which unfortunately destroys the imaging capabilities of a multimode fiber. In this work, we propose and experimentally demonstrate sub-diffraction imaging through a flexible probe based on a unique multicore-multimode fiber. A multicore part consists of 120 Fermat's spiral distributed single-mode cores. Each of the cores offers stable light delivery to the multimode part, which provides optimal structured light illumination for sub-diffraction imaging. As a result, perturbation-resilient fast sub-diffraction fiber imaging by computational compressive sensing is demonstrated.

Compressive endoscopic imaging with complementary light modulation

We propose an effective endoscopic imaging method utilizing compressive sensing (CS) theory on the basis of complementary light modulation of a spatial light modulator. Both the simulated and the experimental results show that complementary compressive sensing (CCS) always needs less time to obtain better work than conventional CS with normal modulation at the same sampling rate. First, the speed of CCS is at least twice as fast as CS. Second, in comparison with CS, CCS can improve the signal-to-noise ratio of the reconstructed image by 49.7%, which indicates that this method is of great significance to endoscopic applications in terms of image fidelity and denoising performance.