Single-shot isotropic differential interference contrast microscopy

In Vivo Intelligent Fluorescence Endo-Microscopy by Varifocal Meta-Device and Deep Learning

Endo-microscopy is crucial for real-time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta-device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo-microscope is developed based on varifocal meta-lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta-lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field-of-view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high-resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.

Terahertz metalens for generating multi-polarized focal points and images with uniform intensity distributions

Metasurfaces have provided a flexible platform for designing ultracompact metalenses with unusual functionalities. However, traditional multi-foci metalenses are limited to generating circularly polarized (CP) or linearly polarized (LP) focal points, and the intensity distributions are always inhomogeneous/chaotical between the multiple focal points. Here, an inverse design approach is proposed to optimize the in-plane orientation of each meta-atom in a terahertz (THz) multi-foci metalens that can generate multi-polarized focal points with nearly uniform intensity distributions. As a proof-of-principle example, we numerically and experimentally demonstrate an inversely designed metalens for simultaneously generating multiple CP- and LP-based focal points with homogeneous intensity distributions, leading to a multi-polarized image (rather than the holography). Furthermore, the multi-channel and multi-polarized images consisting of multiple focal points with homogeneous intensity distributions are also numerically demonstrated. The unique approach for inversely designing multi-foci metalens that can generate multi-polarized focal points and images with uniform intensity distributions will enable potential applications in imaging and sensing.

Optimizing an electromagnetic wave absorber for bi-anisotropic metasurfaces based on toroidal modes

The design and optimization of an electromagnetic wave absorber for far-field wireless power transmission (WPT) is the subject of this research study. The goal of the research is to effectively absorb energy from ambient RF electromagnetic waves without the usage of a ground plane by employing metasurfaces with chiral components.By integrating trioidal moments into the design theory, the objective is to create a metasurface that functions in two frequency bands and produces high-quality resonance. The study also explores the dual non-homogeneity property of structures, polarization tensor coefficients, and the electromagnetic response of non-homogeneous metasurfaces. Based on the relative orientation of induced fields and moments, it delves deeper into the two basic possibilities for dual non-homogeneous elements. The development of chiral metasurfaces and the notion of electromagnetic chirality and its implications for polarization properties are introduced.

Compact meta-differentiator for achieving isotropically high-contrast ultrasonic imaging

Ultrasonic imaging is crucial in the fields of biomedical engineering for its deep penetration capabilities and non-ionizing nature. However, traditional techniques heavily rely on impedance differences within objects, resulting in poor contrast when imaging acoustically transparent targets. Here, we propose a compact spatial differentiator for underwater isotropic edge-enhanced imaging, which enhances the imaging contrast without the need for contrast agents or external physical fields. This design incorporates an amplitude meta-grating for linear transmission along the radial direction, combined with a phase meta-grating that utilizes focus and spiral phases with a first-order topological charge. Through theoretical analysis, numerical simulations, and experimental validation, we substantiate the effectiveness of our technique in distinguishing amplitude objects with isotropic edge enhancements. Importantly, this method also enables the accurate detection of both phase objects and artificial biological models. This breakthrough creates new opportunities for applications in medical diagnosis and nondestructive testing.

TIMP3/Wnt axis regulates gliosis of Müller glia

BACKGROUND

Previous studies have confirmed the expression of tissue inhibitor of metalloproteinase-3 (TIMP3) in Müller glia (MG). However, the role of TIMP3 in MG remains unknown.

METHODS

A mouse model of laser-induced retinal damage and gliosis was generated using wild-type C57BL/6 mice. TIMP3 and associated proteins were detected using Western blotting and immunofluorescence microscopy. RNA sequencing (GSE132140) of mouse laser-induced gliosis was utilized for pathway analysis. TIMP3 overexpression was induced in human MG. Human vitreous samples were obtained from patients with proliferative diabetic retinopathy (PDR) and healthy controls for protein analysis.

RESULTS

TIMP3 levels increased in mouse eyes after laser damage. Morphology and spatial location of TIMP3 indicated its presence in MG. TIMP3-overexpressing MG showed increased cellular proliferation, migration, and cell nuclei size, suggesting TIMP3-induced gliosis for retinal repair. Glial fibrillary acidic protein (GFAP) and vimentin levels were elevated in TIMP3-overexpressing MG and laser-damaged mouse retinas. RNA sequencing and Western blotting suggested a role for β-catenin in mediating TIMP3 effects on the retina. Human vitreous samples from patients with PDR showed a positive correlation between TIMP3 and GFAP levels, both of which were elevated in patients with PDR.

CONCLUSIONS

TIMP3 is associated with MG gliosis to enhance the repair ability of damaged retinas and is mediated by the canonical Wnt/β-catenin. Changes in TIMP3 could potentially be used to control gliosis in a range of retinal diseases However, given the multifaceted nature of TIMP3, care must be taken when developing treatments that aim solely to boost the function of TIMP3.

FUNDING

National Cheng Kung University Hospital, Taiwan (NCKUH-10604009 and NCKUH-11202007); the Ministry of Science and Technology (MOST 110-2314-B-006-086-MY3).

Metasurface-Based Optical Logic Operators Driven by Diffractive Neural Networks

In this paper, a novel optical logic operator based on the multifunctional metasurface driven by all-optical diffractive neural network is reported, which can perform four principal quantum logic operations (Pauli-X, Pauli-Y, Pauli-Z, and Hadamard gates). The two ground states| 0 ⟩ $|0 \rangle $ and| 1 ⟩ $|1 \rangle $  are characterized by two orthogonal linear polarization states. The proposed spatial- and polarization-multiplexed all-optical diffractive neural network only contains a hidden layer physically mapped as a metasurface with simple and compact unit cells, which dramatically reduces the volume and computing resources required for the system. The designed optical quantum operator is proven to achieve high fidelities for all four quantum logical gates, up to 99.96% numerically and 99.88% experimentally. The solution will facilitate the construction of large-scale optical quantum computing systems and scalable optical quantum devices.

Gallium nitride-based geometric and propagation metasurfaces for vortex beam emissions

This work experimentally demonstrates the highly-efficient geometric and propagation metasurfaces for vortex beam emissions. These metasurfaces are respectively composed of high-aspect-ratio fin-like and cylindrical gallium nitride (GaN) meta-atoms. Remarkably, the optimized configuration of the fin-like GaN meta-atoms achieves a cross-polarization transmission efficiency of up to 99 %. Similarly, the cylindrical GaN meta-atoms exhibit an average co-polarization transmission efficiency of 97 %. Both metasurfaces, designed for vortex beam emission, exhibit annular intensity converging capabilities at distinct wavelengths in the visible. Notably, the geometric metasurface shows achromatic annular intensity distributions over a continuous wavelength range up to 100 nm, in sharp contrast to the propagation metasurface, which is subject to inherent wavelength dispersion limitations.

Broadband and large-aperture metasurface edge encoders for incoherent infrared radiation

The prevalence of computer vision systems necessitates hardware-based approaches to relieve the high computational demand of deep neural networks in resource-limited applications. One solution would be to off-load low-level image feature extraction, such as edge detection, from the digital network to the analog imaging system. To that end, this work demonstrates incoherent, broadband, low-noise optical edge detection of real-world scenes by combining the wavefront shaping of a 24-mm aperture metasurface with a refractive lens. An inverse design approach is used to optimize the metasurface for Laplacian-based edge detection across the 7.5- to 13.5-μm LWIR imaging band, allowing for facile integration with uncooled microbolometer-based LWIR imagers to encode edge information. A polarization multiplexed approach leveraging a birefringent metasurface is also demonstrated as a single-aperture implementation. This work could be applied to improve computer vision capabilities of resource-constrained systems by leveraging optical preprocessing to alleviate the computational requirements for high-accuracy image segmentation and classification.

Four-channel meta-hologram enabled by a frequency-multiplexed mono-layered geometric phase metasurface

In recent years, frequency-multiplexed metasurfaces have received extensive attention due to the increasing demand for multifunction integration and communication capacity. However, multi-channel studies achieved with a mono-layered frequency-multiplexed metasurface are limited. Herein, a universal design strategy for a frequency-multiplexed mono-layered geometric phase metasurface is proposed by utilizing Pancharatnam-Berry (PB) phase modulations. The elementary meta-atom is judiciously designed to transmit the cross-polarized component of a circularly polarized incident wave at four distinct frequencies with independent 360° phase shifts and a constant amplitude of 0.48, close to the theoretical limit of 0.5. As a proof-of-concept demonstration, a four-channel meta-hologram is designed to achieve distinct holographic images of "three foci", "five foci", "J" and "X" at 7.2 GHz, 9.1 GHz, 10.9 GHz, and 15.2 GHz respectively. The images are projected in the desired azimuth planes by exploiting the time-shifting properties of the Fourier transform. The experimental and full-wave simulation results are in good agreement, which indicates that the proposed strategy has great potentials in various applications, such as multi-channel imaging and information encryption technology.

Scattered beam control of encoded metasurface based on near-field coupling effects of elements

The coupling effect between the element structures of the traditional Huygens metasurface is easy to cause the efficiency of the designed functional devices to be reduced. In order to eliminate or reduce the coupling effect between the element structures, a border-type Huygens metasurface element structure is proposed. In order to confirm that the bounding element structure can significantly reduce the coupling effect, the near-field distribution and far-field properties of two Huygens metasurfaces with and without bounding are compared. Through comparative analysis, we find that the bounding Huygens element structure can significantly reduce the coupling effect between the element structures, and the far-field scattering angle is more consistent with the theoretical calculation value. In order to realize the free regulation of the far-field scattering angle of THz waves, we introduce the Fourier convolution principle in digital signal processing, and operate the element sequence of Huygens metasurface on the addition principle to realize the free regulation of scattered beams. In addition, we performed functional addition operations on the bounding and unbounding coding sequences. The bounding code structure can accurately achieve the synthesis of functions.

Broadband Achromatic Imaging of a Metalens with Optoelectronic Computing Fusion

The remarkable ultrathin ability of metalenses gives them potential as a next-generation imaging candidate. However, the inherent chromatic aberration of metalenses restricts their widespread application. We present an achromatic metalens with optoelectronic computing fusion (OCF) to mitigate the impact of chromatic aberration and simultaneously avoid the significant challenges of nanodesign, nanofabrication, and mass production of metalenses, a method different from previous methods. Leveraging the nonlinear fitting, we demonstrate that OCF can effectively learn the chromatic aberration mapping of metalens and thus restore the chromatic aberration. In terms of the peak signal-to-noise ratio index, there is a maximum improvement of 12 dB, and ∼8 ms is needed to correct the chromatic aberration. Furthermore, the edge extraction of images and super-resolution reconstruction that effectively enhances resolution by a factor of 4 are also demonstrated with OCF. These results offer the possibility of applications of metalenses in mobile cameras, virtual reality, etc.

Polychromatic Dual-Mode Imaging with Structured Chiral Photonic Crystals

Optical spatial differentiation is a typical operation of optical analog computing and can single out the edge to accelerate the subsequent image processing, but in some cases, overall information about the object needs to be presented synchronously. Here, we propose a multifunctional optical device based on structured chiral photonic crystals for the simultaneous realization of real-time dual-mode imaging. This optical differentiator is realized by self-organized large-birefringence cholesteric liquid crystals, which are photopatterned to encode with a special integrated geometric phase. Two highly spin-selective modes of second-order spatial differentiation and bright-field imaging are exhibited in the reflected and transmitted directions, respectively. Two-dimensional edges of both amplitude and phase objects have been efficiently enhanced in high contrast and the broadband spectrum. This work extends the ingenious building of hierarchical chiral nanostructures, enriches their applications in the emerging frontiers of optical computing, and boasts considerable potential in machine vision and microscopy.

Single-shot deterministic complex amplitude imaging with a single-layer metalens

Conventional imaging systems can only capture light intensity. Meanwhile, the lost phase information may be critical for a variety of applications such as label-free microscopy and optical metrology. Existing phase retrieval techniques typically require a bulky setup, multiframe measurements, or prior information of the target scene. Here, we proposed an extremely compact system for complex amplitude imaging, leveraging the extreme versatility of a single-layer metalens to generate spatially multiplexed and polarization phase-shifted point spread functions. Combining the metalens with a polarization camera, the system can simultaneously record four polarization shearing interference patterns along both in-plane directions, thus allowing the deterministic reconstruction of the complex amplitude light field in a single shot. Using an incoherent light-emitting diode as the illumination, we experimentally demonstrated speckle-noise-free complex amplitude imaging for both static and moving objects with tailored magnification ratio and field of view. The miniaturized and robust system may open the door for complex amplitude imaging in portable devices for point-of-care applications.

TIE-GANs: single-shot quantitative phase imaging using transport of intensity equation with integration of GANs

Significance

Artificial intelligence (AI) has become a prominent technology in computational imaging over the past decade. The expeditious and label-free characteristics of quantitative phase imaging (QPI) render it a promising contender for AI investigation. Though interferometric methodologies exhibit potential efficacy, their implementation involves complex experimental platforms and computationally intensive reconstruction procedures. Hence, non-interferometric methods, such as transport of intensity equation (TIE), are preferred over interferometric methods.

Aim

TIE method, despite its effectiveness, is tedious as it requires the acquisition of many images at varying defocus planes. The proposed methodology holds the ability to generate a phase image utilizing a single intensity image using generative adversarial networks (GANs). We present a method called TIE-GANs to overcome the multi-shot scheme of conventional TIE.

Approach

The present investigation employs the TIE as a QPI methodology, which necessitates reduced experimental and computational efforts. TIE is being used for the dataset preparation as well. The proposed method captures images from different defocus planes for training. Our approach uses an image-to-image translation technique to produce phase maps and is based on GANs. The main contribution of this work is the introduction of GANs with TIE (TIE:GANs) that can give better phase reconstruction results with shorter computation times. This is the first time the GANs is proposed for TIE phase retrieval.

Results

The characterization of the system was carried out with microbeads of 4    μ m size and structural similarity index (SSIM) for microbeads was found to be 0.98. We demonstrated the application of the proposed method with oral cells, which yielded a maximum SSIM value of 0.95. The key characteristics include mean squared error and peak-signal-to-noise ratio values of 140 and 26.42 dB for oral cells and 100 and 28.10 dB for microbeads.

Conclusions

The proposed methodology holds the ability to generate a phase image utilizing a single intensity image. Our method is feasible for digital cytology because of its reported high value of SSIM. Our approach can handle defocused images in such a way that it can take intensity image from any defocus plane within the provided range and able to generate phase map.

Intelligent Phase Contrast Meta-Microscope System

Phase contrast imaging techniques enable the visualization of disparities in the refractive index among various materials. However, these techniques usually come with a cost: the need for bulky, inflexible, and complicated configurations. Here, we propose and experimentally demonstrate an ultracompact meta-microscope, a novel imaging platform designed to accomplish both optical and digital phase contrast imaging. The optical phase contrast imaging system is composed of a pair of metalenses and an intermediate spiral phase metasurface located at the Fourier plane. The performance of the system in generating edge-enhanced images is validated by imaging a variety of human cells, including lung cell lines BEAS-2B, CLY1, and H1299 and other types. Additionally, we integrate the ResNet deep learning model into the meta-microscope to transform bright-field images into edge-enhanced images with high contrast accuracy. This technology promises to aid in the development of innovative miniature optical systems for biomedical and clinical applications.

Polarization-encoded optical secret sharing based on a dielectric metasurface incorporating near-field nanoprinting and far-field holography

Metasurface encryption with high concealment and resolution is promising for information security. To improve the encryption security, a polarization-encoded secret sharing scheme based on dielectric metasurface by combining the secret sharing method with nanoprinting and holography is proposed. In this encryption scheme, the secret image is split into camouflaged holograms of different polarization channels and shares a total of 24-1 encryption channels. Benefiting from the secret sharing mechanism, the secret image cannot be obtained by decoding the hologram with a single shared key. Specifically, the secret hologram of a specific channel in the far field can be obtained by specifying the optical key, acquiring the near-field nanoprinting image to determine the combination order for the shared key, and decoding using multiple shared keys. The secret sharing encryption scheme can not only enhance the security level of metasurface encryption, but also increase the number of information channels by predefining camouflage information. We believe that it has important potential applications in large-capacity optical encryption and information storage.

Highly flexible and compact volumetric endoscope by integrating multiple micro-imaging devices

A light-field endoscope can simultaneously capture the three-dimensional information of in situ lesions and enables single-shot quantitative depth perception with minimal invasion for improving surgical and diagnostic accuracy. However, due to oversized rigid probes, clinical applications of current techniques are limited by their cumbersome devices. To minimize the size and enhance the flexibility, here we report a highly flexible and compact volumetric endoscope by employing precision-machined multiple micro-imaging devices (MIRDs). To further protect the flexibility, the designed MIRD with a diameter and height of 5 mm is packaged in pliable polyamide, using soft data cables for data transmission. It achieves the optimal lateral resolvability of 31 µm and axial resolvability of 255 µm, with an imaging volume over 2.3 × 2.3 × 10 mm3. Our technique allows easy access to the organism interior through the natural entrance, which has been verified through observational experiments of the stomach and rectum of a rabbit. Together, we expect this device can assist in the removal of tumors and polyps as well as the identification of certain early cancers of the digestive tract.

Dielectric Metasurface Enabled Compact, Single-Shot Digital Holography for Quantitative Phase Imaging

Quantitative phase imaging (QPI) enables nondestructive, real-time, label-free imaging of transparent specimens and can reveal information about their fundamental properties such as cell size and morphology, mass density, particle dynamics, and cellular fluctuations. Development of high-performance and low-cost quantitative phase imaging systems is thus required in many fields, including on-site biomedical imaging and industrial inspection. Here, we propose an ultracompact, highly stable interferometer based on a single-layer dielectric metasurface for common path off-axis digital holography and experimentally demonstrate quantitative phase imaging. The interferometric imaging system leveraging an ultrathin multifunctional metasurface captures image plane holograms in a single shot and provides quantitative phase information on the test samples for extraction of its physical properties. With the benefits of planar engineering and high integrability, the proposed metasurface-based method establishes a stable miniaturized QPI system for reliable and cost-effective point-of-care devices, live cell imaging, 3D topography, and edge detection for optical computing.

Trichannel Spin-Selective Metalenses

Metalenses have the potential to revolutionize optical devices into the next generation of consumer devices. Through new inventive strategies, metalenses with advanced functionalities have been released to integrate multiple responses into a single flat device. Here, we design metalenses that are sensitive to the incident spin angular momentum to provide three distinct modes based on the handedness of the incident and transmitted light. Propagation phase is employed to encode a hyperbolic lens phase to the metalens, while geometric phase is exploited for additional spin-selective properties. We experimentally demonstrate two different metalenses: the co-polarized channels function as a standard metalens, while the cross-polarized channels (1) deflect and (2) introduce orbital angular momentum to the transmitted light. We experimentally characterize the metalenses and prove their use for spin-selective imaging of visible light. We envision that such trichannel metalenses could be employed in chiral bioimaging, optical computing, and computer vision.