Metasurface enabled quantum edge detection

Computing Metasurface Enabled Quantum Phase Distillation

Quantum image distillation aims to extract the signal image from a mixture of the signal and noise images that are indistinguishable in terms of spectrum and polarization, a process that is unachievable with classical methods. However, in contrast to the amplitude image, phase distillation is challenging via direct spatial or temporal correlation of photon pairs. Incorporating with the polarization entanglement of photon pairs, it is demonstrated here that the phase signal can be quickly distilled by using an integrated computing metasurface to solve the Poisson equation. The proposed technique remains robust even with noise levels two orders higher than the signal, with potential applications in quantum communication and cryptography. Based on the present scheme, it also enables the measurement of photon wave function and the achievement of noninterferometric quantum-enhanced quantitative phase imaging. Our work involving the integrated-metasurface analogue computing paves the way for advancing efficient and rapid quantum information and image processing.

Dispersion-engineered spin photonics based on folded-path metasurfaces

Spin photonics revolutionizes photonic technology by enabling precise manipulation of photon spin states, with spin-decoupled metasurfaces emerging as pivotal in complex optical field manipulation. Here, we propose a folded-path metasurface concept that enables independent dispersion and phase control of two opposite spin states, effectively overcoming the limitations of spin photonics in achieving broadband decoupling and higher integration levels. This advanced dispersion engineering is achieved by modifying the equivalent length of a folded path, generated by a virtual reflective surface, in contrast to previous methods that depended on effective refractive index control by altering structural geometries. Our approach unlocks previously unattainable capabilities, such as achieving achromatic focusing and achromatic spin Hall effect using the rotational degree of freedom, and generating spatiotemporal vector optical fields with only a single metasurface. This advancement substantially broadens the potential of metasurface-based spin photonics, extending its applications from the spatial domain to the spatiotemporal domain.

Nonlocal flat optics for size-selective image processing and denoising

All-optical image processing based on metasurfaces is a swiftly advancing field of technology, due to its high speed, large integrability and inherently low energy requirements. So far, the proposed devices have been focusing on canonical operations, such as differentiations to perform edge detection across all objects in a complex scene. Yet, undesired background noise and clutter can hinder such operations, requiring target selection with digital post-processing which inherently limits the overall accuracy, efficiency and speed. Here, we introduce an optical solution for real-time size-selective image processing and experimentally demonstrate the concept with a metal-dielectric-metal film performing a spatial band-pass filter in momentum space. We show high-resolution (~0.9 μm) edge detection and real-time dynamic denoising, ideally suited for bio-imaging applications and target recognitions. Our demonstrated k-space filtering metasurface expands the scope of nonlocal flat optics for analog image processing, ushering in opportunities for ultra-compact, cost-effective, and multifunctional image processors.

Quantum CZ gates on a single gradient metasurface

For the requirement of quantum photonic integration in on-chip quantum information, we propose a scheme to realize quantum controlled-Z (CZ) gates through single gradient metasurface. Using its parallel beam-splitting feature, i.e., a series of connected beamsplitters with the same splitting ratio, one metasurface can support a polarization encoding CZ gate or path encoding CZ gate, several independent CZ gates, and cascade CZ gates. Taking advantage that the path of output state is locked by the polarization of input state, path encoding CZ gates can efficiently filter out bit-flip errors coming from beam-splitting processes. These CZ gates also have the potential to detect quantum errors and generate high-dimensional entanglement through multi-degree-of-freedom correlation on metasurfaces. By integrating quantum CZ gates into a single metasurface, our results open an avenue for high-density and multifunctional integration of quantum devices.

A Multichannel Metasurface for Multiprotocol Quantum Key Distributions

Multiprotocol quantum key distribution (mQKD) enables users to flexibly select protocols for secure quantum communication, though achieving mQKD introduces considerable system complexity and resource demands. Here, we report the first realization of mQKD using a metasurface, which generates multiple hybrid states of photonic spin angular momentum (SAM) and orbital angular momentum (OAM) and distributes them to different users. The incident polarization-entangled photon pair interacts with the metasurface, producing four SAM-OAM hybrid states with high fidelity through spin-orbit conversion. Among these hybrid states, two execute the BB84 protocol, while the other two perform the BBM92 protocol, all demonstrating high secret key rates and low quantum bit error rates. This approach provides a robust, compact solution for generating and distributing SAM-OAM hybrid states and stands out for the remarkable capability of a metasurface in secured information processing.

Multifunctional Meta-optic Azimuthal Shear Interferometer

Azimuthal shear interferometry is a versatile tool for analyzing wavefront asymmetries. However, conventional systems are bulky, alignment-sensitive, and prone to nonuniform shear. We present a broadband, compact, and robust meta-optics-based azimuthal shear interferometer in a common-path configuration, reducing the system size to the millimeter scale. Unlike conventional designs, the meta-optic azimuthal shear interferometer utilizes the localized wavefront modulation capabilities of meta-optics to achieve uniform azimuthal shear displacement independent of the radial position, significantly enhancing accuracy and stability. Our approach eliminates the need for bulky optical components and precise multipath alignment, making it more resilient to environmental disturbances. Its multifunctionality is demonstrated through applications in all-optical edge detection, differential interference contrast microscopy, and aberrated wavefront sensing. These results underscore its potential for real-time analog image processing, advanced optical imaging, and optical testing.

Metasurface-assisted multimodal quantum imaging

Traditional quantum imaging is featured by remarkable sensitivity and signal-to-noise ratio, but limited by bulkiness and static function (either phase contrast imaging or edge detection). Our report synergizes a polarization-entangled source with a metasurface consisting of various sophisticatedly engineered spatial frequency segments. By tuning polarization, we demonstrate multiple "on"-state quantum imaging modes, enabling flexible switching between phase contrast, edge, and arbitrary superimposed imaging mode. Furthermore, the "off"-state, which characterizes the background noise, enables self-calibration of the system by subtracting this noise in "on"-state modes, resulting in self-enhanced edge detection. Our approach performs phase contrast imaging with a phase difference of π/4 present in the target object, and edge imaging capable of detecting tiny (radius about 2 μm) defects, maintaining high image contrast (phase contrast of 0.726, and enhanced edge contrast of 0.902). Our results provide insights into constructive duet between quantum imaging and metaoptics.

A Simple Optical Convolution Strategy Based on Versatile Adjustable Optical Convolution Kernel for All-Optical Convolution Computing

Convolutional neural network (CNN) is currently one of the most important artificial neural networks. However, traditional CNN hardware architectures suffer from significant increases in energy consumption and processing time as the demand for artificial intelligence tasks grows. Here, a novel optical convolution computing strategy is proposed that leverages a continuously adjustable photoluminescent device (CA-PLD) as the optical convolution kernel, enabling parallel, all-optical convolution computing and greatly simplifying the traditional convolution process. Under ultraviolet illumination, the CA-PLD exhibits visible long-afterglow emission characteristics due to the charge trapping and retention effects. This allows for continuously adjustable light weights, facilitating arbitrary convolution operations. Building on this, parallel and efficient multiply-accumulate operations have been successfully demonstrated using CA-PLD arrays with different weight combinations. Moreover, space-transformable CA-PLD units enable applications in dilated convolution. In a semantic segmentation task with 20 categories, the CA-PLD units achieve higher Intersection over Union (IoU) values and accuracy. Therefore, the weight-adjustable and spatial transformable CA-PLD proposed in this work holds promise for future applications in intelligent optical computing systems and optical implementations of non-von Neumann architectures.

Customizing Multicolored Orbital Angular Momentum Combs

Current orbital angular momentum (OAM) combs generating technology is hindered by bulky optical systems, limited control, and lack of multicolored information, impeding system integration and practical applications. We present a metasurface approach to realizing multicolored OAM comb engineering along the light propagation direction. The OAM combs are measured based on the intensity of bright spots in the generated intensity patterns that correspond to the weights of the OAM modes. Three OAM combs with different colors are generated at different observation planes. The positioning of transition points along the azimuthal direction is the key to shaping the OAM distribution of the generated beams. OAM combs with customized mode spacings and broad OAM spectra are obtained. Our approach provides a compact platform to realize OAM combs with multidimensional information in the domains of the OAM spectra, frequency, and space, which can significantly enhance the information capacity for potential applications in optical communications.

All-optical analog differential operation and information processing empowered by meta-devices

The burgeoning demand for high-performance computing, robust data processing, and rapid growth of big data necessitates the emergence of novel optical devices to efficiently execute demanding computational processes. The field of meta-devices, such as metamaterial or metasurface, has experienced unprecedented growth over the past two decades. By manipulating the amplitude, phase, polarization, and dispersion of light wavefronts in spatial, spectral, and temporal domains, viable solutions for the implementation of all-optical analog computation and information processing have been provided. In this review, we summarize the latest developments and emerging trends of computational meta-devices as innovative platforms for spatial optical analog differentiators and information processing. Based on the general concepts of spatial Fourier transform and Green's function, we analyze the physical mechanisms of meta-devices in the application of amplitude differentiation, phase differentiation, and temporal differentiation and summarize their applications in image edge detection, image edge enhancement, and beam shaping. Finally, we explore the current challenges and potential solutions in optical analog differentiators and provide perspectives on future research directions and possible developments.

Optical edge detection with adjustable resolution using the planar liquid crystal Alvarez lens

In this Letter, we propose an optical edge detection method with adjustable resolution using a planar liquid crystal Alvarez lens (LCAL). A planar liquid crystal Alvarez lens was fabricated by laser direct writing. When the focal length of the liquid crystal Alvarez lens changes and linearly polarized light (LP) passes through the liquid crystal Alvarez lens, the angle between the emitted left-handed circularly polarized light and right-handed circularly polarized light can be controlled, enabling adjustable resolution edge detection. The lens can adjust an edge width from 32.5 μm to 73.7 μm without requiring any rotation or axial displacement. Moreover, it can accomplish comprehensive edge detection across a broadband spectral range. This edge detection method could offer a potential application value for compact optical devices such as high-contrast microscopes and smart cameras.

Metasurface enabled high-order differentiator

Metasurface-enabled optical analog differentiation has garnered significant attention due to its inherent capacity of parallel operation, compactness, and low power consumption. Most previous works focused on the first- and second-order operations, while several significant works have also achieved higher-order differentiation in both real space and k-space. However, how to construct the desired optical transfer function in a practical system to realize scalable and multi-order-parallel high-order differentiation of images in real space, and particularly how to leverage it to tackle practical problems, have not been fully explored. Here, drawing on the basic mathematical feature of the Fourier transform, we theoretically propose universal phase-gradient functions of the Pancharatnam-Berry-phase-based meta-device for performing arbitrary order differentiation. The fifth-order optical differentiations for both intensity and phase images are realized in the experiment. More importantly, by exploring this elaborately designed spatial differentiator, we construct another scheme for optical super-resolution and achieve the estimation of the distance between two incoherent point sources within 0.015 of the Rayleigh distance, which thereby provides a potential toolkit for optical alignment in high-precision semiconductor nano-fabrication. Our findings hold promise for image processing, microscopy imaging, and optical super-resolution imaging.

Meta-Device for Field-of-View Tunability via Adaptive Optical Spatial Differentiation

Optical edge detection is a crucial optical analog computing method in fundamental artificial intelligence, machine vision, and image recognition, owing to its advantages of parallel processing, high computing speed, and low energy consumption. Field-of-view-tunable edge detection is particularly significant for detecting a broader range of objects, enhancing both practicality and flexibility. In this work, a novel approach-adaptive optical spatial differentiation is proposed for field-of-view-tunable edge detection. This method improves the ability to acquire spatial information and facilitates edge detection over a wider angular range. The adaptive optical spatial differentiation meta-device relies on two core components: the spatial differentiation dielectric metasurface and the adaptive liquid prism. The meta-device is shown to function as a highly efficient (≈85%) isotropic spatial differentiator, operating across the entire visible spectrum (400 to 700 nm) within a wide-angle object space, expanding up to 4.5 times the original field of view. The proposed scheme presents new opportunities for efficient, flexible, high-capacity integrated data processing and imaging devices. And simultaneously provides a novel optical analog computing architecture for the next generation of wide field-of-view phase contrast microscopy.

Advanced Quantitative Phase Microscopy Achieved with Spatial Multiplexing and a Metasurface

Quantitative optical phase information provides an alternative method to observe biomedical properties, where conventional phase imaging fails. Phase retrieval typically requires multiple intensity measurements and iterative computations to ensure uniqueness and robustness against detection noise. To increase the measurement speed, we propose a single-shot quantitative phase imaging method with metasurface optics that can be conveniently integrated into conventional imaging systems with minimal modification. The improvement of the measurement speed is simultaneously made possible by combining deep learning with the transport-of-intensity equation. As a proof-of-concept, we demonstrate phase retrieval on both calibrated phase objects and biological specimens by using an imaging system integrated with our metasurface. When combined with the matched neural network, the system yields result with errors as low as 5% and increased space-bandwidth-product. A multitude of commercial applications can benefit from the compactness and rapid implementation of our proposed method.

Dynamically switchable edge-detection and bright-field imaging based on a phase-change nonlocal metasurface

Optical metasurfaces offer significant advantages in enhancing the speed, efficiency, and miniaturization of imaging systems. However, most existing metasurfaces are limited to static functionalities and lack reconfigurability, which is a key feature for practical applications in dynamic environments. In this work, we demonstrate a reconfigurable optical metasurface capable of switching between two distinct imaging functions (edge detection and bright-field imaging) within the visible spectrum. This reconfigurability is achieved by tuning the phase transition of antimony sulfide (Sb2S3), which controls the angular dependence of the magnetic dipole resonance. The phase transition of Sb2S3 from the amorphous phase to the crystalline phase enables different optical transfer functions, achieving high-performance imaging with a numerical aperture of 0.42, isotropic second-order differentiation, and high-resolution imaging, respectively. This approach allows for functional switching on a single surface, opening up possibilities for applications in medical imaging, optical sensing, and microscopy.

Active Physics-Informed Deep Learning: Surrogate Modeling for Nonplanar Wavefront Excitation of Topological Nanophotonic Devices

Topological plasmonics combines principles of topology and plasmonics to provide new methods for controlling light, analogous to topological edge states in photonics. However, designing such topological states remains challenging due to the complexity of the high-dimensional design space. We present a novel method that uses supervised, physics-informed deep learning and surrogate modeling to design topological devices for desired wavelengths. By embedding physical constraints in the neural network's training, our model efficiently explores the design space, significantly reducing simulation time. Additionally, we use nonplanar wavefront excitations to probe topologically protected plasmonic modes, making the design and training process nonlinear. Using this approach, we design a topological device with unidirectional edge modes in a ring resonator at specific operational frequencies. Our method reduces computational cost and time while maintaining high accuracy, highlighting the potential of combining machine learning and advanced techniques for photonic device innovation.

Bidirectional Vectorial Holography Using Bi-Layer Metasurfaces and Its Application to Optical Encryption

The field of optical systems with asymmetric responses has grown significantly due to their various potential applications. Janus metasurfaces are noteworthy for their ability to control light asymmetrically at the pixel level within thin films. However, previous demonstrations are restricted to the partial control of asymmetric transmission for a limited set of input polarizations, focusing primarily on scalar functionalities. Here, optical bi-layer metasurfaces that achieve a fully generalized form of asymmetric transmission for any input polarization are presented. The designs owe much to the theoretical model of asymmetric transmission in reciprocal systems, which elucidates the relationship between front- and back-side Jones matrices in general cases. This model reveals a fundamental correlation between the polarization-direction channels of opposing sides. To circumvent this constraint, partitioning the transmission space is utilized to realize four distinct vector functionalities within the target volume. As a proof of concept, polarization-direction-multiplexed Janus vectorial holograms generating four vectorial holographic images are experimentally demonstrated. When integrated with computational vector polarizer arrays, this approach enables optical encryption with a high level of obscurity. The proposed mathematical framework and novel material systems for generalized asymmetric transmission may pave the way for applications such as optical computation, sensing, and imaging.

Fast selective edge-enhanced imaging with topological chiral lamellar superstructures

Edge detection is a fundamental operation for feature extraction in image processing. The all-optical method has aroused growing interest owing to its ultra-fast speed, low energy consumption and parallel computation. However, current optical edge detection methods are generally limited to static devices and fixed functionality. Herein, we propose a fast-switchable scheme based on a ferroelectric liquid crystal topological structure. The self-assembled chiral lamellar superstructure, directed by the azimuthally variant photo-alignment agent, can be dynamically controlled by the polarity of the external electric field and respectively generates the vector beams with nearly orthogonal polarization distribution. Even after thousands of cycles, the horizontal and vertical edges of the object are selectively enhanced with an ultra-fast switching time of ∼57 μs. Broadband edge-enhanced imaging is efficiently demonstrated. This work extends the ingenious building of topological heliconical superstructures and offers an important glimpse into their potential in the emerging frontiers of optical computing for artificial intelligence.

Full-space metasurfaces for independent manipulation of transmission and reflection

In recent years, beam manipulation using metasurfaces has evolved from being limited to either a transmission or reflection space to encompassing a full space. However, existing methods still inevitably require complex systems and are unable to achieve continuous and arbitrary phase manipulation. Here, one type of a bilayer metasurface is proposed to simultaneously manipulate reflection and transmission phases continuously and independently, which also makes the optical system more compact without requiring any analyzers and enhances the degree of freedom for full-space beam manipulation. As a proof-of-concept demonstration, one device is designed to show different holograms in transmission and reflection spaces. Additionally, the Dammann grating designed in the reflection hologram increases the information capacity. The proposed method may pave the way toward achieving a variety of applications such as multi-channel beam manipulation and multifunctional optical devices.

Eagle-Eye Inspired Meta-Device for Phase Imaging

The dual-focus vision observed in eagles' eyes is an intriguing phenomenon captivates scientists since a long time. Inspired by this natural occurrence, the authors' research introduces a novel bifocal meta-device incorporating a polarized camera capable of simultaneously capturing images for two different polarizations with slightly different focal distances. This innovative approach facilitates the concurrent acquisition of underfocused and overfocused images in a single snapshot, enabling the effective extraction of quantitative phase information from the object using the transport of intensity equation. Experimental demonstrations showcase the application of quantitative phase imaging to artificial objects and human embryonic kidney cells, particularly emphasizing the meta-device's relevance in dynamic scenarios such as laser-induced ablation in human embryonic kidney cells. Moreover, it provides a solution for the quantification during the dynamic process at the cellular level. Notably, the proposed eagle-eye inspired meta-device for phase imaging (EIMPI), due to its simplicity and compact nature, holds promise for significant applications in fields such as endoscopy and headsets, where a lightweight and compact setup is essential.

Quarter-wave Pancharatnam-Berry phase gradient liquid crystal-enabled dual-polarization optical edge detection

Here, we present a novel, to the best of our knowledge, optical edge detection scheme that can be operated in both linear and circular polarization modes, leveraging an optical spatial differentiator constructed by quarter-wave Pancharatnam-Berry (P-B) phase gradient element. After explaining the theoretical mechanism, we utilize a quarter-wave P-B phase liquid crystal polarization grating to validate the dual-polarization optical edge detection capability. We demonstrate that the orientation of linear polarization and the spin of circular polarization dictate the transition between edge and bright-field images. Besides, the linear and circular polarization modes exhibit broadband and monochromatic responsive properties, respectively. This mechanism, dependent on wavelength and polarization, holds promise for applications in color image processing, chiral sensing imaging, and polarization-entangled quantum imaging.

Multidimensional Encryption by Chip-Integrated Metasurfaces

Facing the challenge of information security in the current era of information technology, optical encryption based on metasurfaces presents a promising solution to this issue. However, most metasurface-based encryption techniques rely on limited decoding keys and struggle to achieve multidimensional complex encryption. It hinders the progress of optical storage capacity and puts encryption security at a disclosing risk. Here, we propose and experimentally demonstrate a multidimensional encryption system based on chip-integrated metasurfaces that successfully incorporates the simultaneous manipulation of three-dimensional optical parameters, including wavelength, direction, and polarization. Hence, up to eight-channel augmented reality (AR) holograms are concealed by near- and far-field fused encryption, which can only be extracted by correctly providing the three-dimensional decoding keys and then vividly exhibit to the authorizer with low crosstalk, high definition, and no zero-order speckle noise. We envision that the miniature chip-integrated metasurface strategy for multidimensional encryption functionalities promises a feasible route toward the encryption capacity and information security enhancement of the anticounterfeiting performance and optically cryptographic storage.

Polarization-independent edge detection based on the spin-orbit interaction of light

In previous edge detection schemes based on the spin-orbit interaction of light, the direction and intensity of the edge-enhanced images are influenced by the incident polarization state. In this study, we develop an edge detection strategy that is insensitive to changes in both the incident polarization and the incident angle. The output intensity and transfer function remain entirely impervious to changes in incident polarization, being explicitly formulated as functions of the incident angle, specifically in terms of cot 2⁡θ i and cot⁡θ i , respectively. This behavior is attributed to the opposing nature of the polarization components E~r H-H and E~r V-V in the x-direction after undergoing mapping through the Glan polarizer, while the sum of polarization components E~r H-V and E~r V-H in the y-direction can be simplified to terms independent of incident polarization. Furthermore, we propose a metasurface design to achieve the required optical properties in order to realize the derived edge detection scheme.

Metasurface for Engineering Superimposed Ince-Gaussian Beams

Ince-Gaussian beams (IGBs) are the third complete family of exact and orthogonal solutions of the paraxial wave equation and have been applied in many fields ranging from particle trapping to quantum optics. IGBs play a very important role in optics as they represent the exact and continuous transition modes connecting Laguerre-Gaussian and Hermite-Gaussian beams. The method currently in use suffers from the high cost, complexity, and large volume of the optical system. The superposition of IGBs can generate complicated structured beams with multiple phase and polarization singularities. A metasurface approach is proposed to realizing various superpositions of IGBs without relying on a complicated optical setup. By superimposing IGBs with even and odd modes, multiple phase, and polarization singularities are observed in the resultant beams. The phase and polarization singularities are modulated by setting the initial phase in the design and controlling the incident linear polarization. The compactness of the developed metasurface devices and the unique properties of the generated beams have the potential to impact many practical applications such as particle manipulation, orbital angular momentum spectrum manipulation, and optical communications.

Ultra-high order mode-assisted optical differentiator for edge detection with high tunability

An optical spatial differentiator based on the photonic spin Hall effect (PSHE) with high tunability is presented. By utilizing the characteristics of ultra-high order modes in the symmetrical metal cladding waveguide, the Fresnel reflection coefficient spectrum exhibits a narrow peak width and low trough at the resonant incident angles, resulting in high sensitivity to changes in the incident angle-induced spatial shift caused by the PSHE (the highest ∂(|r s/r p|)/∂ θ value can reach 107). After polarization transformation and extinction, the output field demonstrates differential operation with respect to the input field. When applied to edge detection, our differentiator can achieve tunable resolution edge images by adjusting the incident angle. Our proposed edge detection scheme has potential applications for cellular and molecular imaging through two-dimensional extension via the target rotation.

Structural-color meta-nanoprinting embedding multi-domain spatial light field information

Recently, multifunctional metasurface has showcased its powerful functionality to integrate nanoprinting and holography, and display ultracompact meta-images in near- and far-field simultaneously. Herein, we propose a tri-channel metasurface which can further extend the meta-imaging ranges, with three independent images located at the interface, Fresnel and Fourier domains, respectively. Specifically, a structural-color nanoprinting image is decoded right at the interface of the metasurface, enabled by varying the dimensions of nanostructures; a Fresnel holographic image and another Fourier holographic image are present at the Fresnel and Fourier (far-field) domains, respectively, enabled by geometric phase. The spectral and phase manipulation capabilities of nanostructures have been maximized, and the spatial multiplexing capabilities for diffraction in metasurfaces have also been fully exploited. By leveraging the design freedom enabled through the tuning of the geometric size and orientation of nanostructures, as well as optimizing the diffraction spatial light wave transformation, the encoding of multiple images on the single-celled metasurface is achieved. More interestingly, due to the spatial separation of images across different channels, crosstalk is virtually eliminated, effectively enhancing imaging quality. The proposed metasurface offers several advantages, including a compact design, easiness of fabrication, minimal crosstalk, and high storage density. Consequently, it holds promising applications in image display, data storage, information encryption, anti-counterfeiting, and various other fields.

Poincaré sphere trajectory encoding metasurfaces based on generalized Malus' law

As a fundamental property of light, polarization serves as an excellent information encoding carrier, playing significant roles in many optical applications, including liquid crystal displays, polarization imaging, optical computation and encryption. However, conventional polarization information encoding schemes based on Malus' law usually consider 1D polarization projections on a linear basis, implying that their encoding flexibility is largely limited. Here, we propose a Poincaré sphere (PS) trajectory encoding approach with metasurfaces that leverages a generalized form of Malus' law governing universal 2D projections between arbitrary elliptical polarization pairs spanning the entire PS. Arbitrary polarization encodings are realized by engineering PS trajectories governed by either arbitrary analytic functions or aligned modulation grids of interest, leading to versatile polarization image transformation functionalities, including histogram stretching, thresholding and image encryption within non-orthogonal PS loci. Our work significantly expands the encoding dimensionality of polarization information, unveiling new opportunities for metasurfaces in polarization optics for both quantum and classical regimes.

Metasurface for programmable quantum algorithms with classical and quantum light

Metasurfaces have recently opened up applications in the quantum regime, including quantum tomography and the generation of quantum entangled states. With their capability to store a vast amount of information by utilizing the various geometric degrees of freedom of nanostructures, metasurfaces are expected to be useful for processing quantum information. Here, we propose and experimentally demonstrate a programmable metasurface capable of performing quantum algorithms using both classical and quantum light with single photons. Our approach encodes multiple programmable quantum algorithms and operations, such as Grover's search algorithm and the quantum Fourier transform, onto the same metalens array on a metasurface. A spatial light modulator selectively excites different sets of metalenses to carry out the quantum algorithms, while the interference patterns captured by a single-photon camera are used to extract information about the output state at the selected output directions. Our programmable quantum metasurface approach holds promising potential as a cost-effective means of miniaturizing components for quantum computing and information processing.

Fast Multichannel Inverse Design through Augmented Partial Factorization

Computer-automated design and discovery have led to high-performance nanophotonic devices with diverse functionalities. However, massively multichannel systems such as metasurfaces controlling many incident angles and photonic-circuit components coupling many waveguide modes still present a challenge. Conventional methods require Min forward simulations and Min adjoint simulations-2Min simulations in total-to compute the objective function and its gradient for a design involving the response to Min input channels. Here, we develop a formalism that uses the recently proposed augmented partial factorization method to obtain both the objective function and its gradient for a massively multichannel system in a single or a few simulations, achieving over 2 orders of magnitude speedup and reduced memory usage. We use this method to inverse design a metasurface beam splitter that separates the incident light to the target diffraction orders for all incident angles of interest, a key component of the dot projector for 3D sensing. This formalism enables efficient inverse design for a wide range of multichannel optical systems.

Metasurface-Assisted Quantum Nonlocal Weak-Measurement Microscopy

In standard quantum weak measurements, preselection and postselection of quantum states are implemented in the same photon. Here we go beyond this restrictive setting and demonstrate that the preselection and postselection can be performed in two different photons, if the two photons are polarization entangled. The Pancharatnam-Berry phase metasurface is incorporated in the weak measurement system to perform weak coupling between probe wave function and spin observable. By introducing nonlocal weak measurement into the microscopy imaging system, it allows us to remotely switch different microscopy imaging modes of pure-phase objects, including bright-field, differential, and phase reconstruction. Furthermore, we demonstrate that the nonlocal weak-measurement scheme can prevent almost all environmental noise photons from detection and thus achieves a higher image contrast than the standard scheme at a low photon level. Our results provide the possibility to develop a quantum nonlocal weak-measurement microscope for label-free imaging of transparent biological samples.

Manipulation of path state based on spatiotemporal dielectric metasurface

In this work, a spatiotemporal metasurface is proposed to manipulate the path of photons flexibly. The spatial modulation is induced by the rectangle silicon units aligned on silica in a manner with a phase gradient only for y-polarized photons, and the temporal modulation is contributed by the pumps of constructing Kerr dynamic gratings. By quantizing designed metasurfaces, the analytical solutions of output photon states can be derived correspondingly. Reversal design could be implemented by tailoring the profile of higher harmonics to infer the intensity of pumps, size of meta-atoms, and initial state. The path-polarization entanglement and correlations of output photons are realized, and then a CNOT gate is obtained by utilizing the deflection of the photon path. This work provides a scheme to deal with the spatiotemporal metasurfaces and expands the applications of metasurfaces in the quantum realm.

Metalens for Accelerated Optoelectronic Edge Detection under Ambient Illumination

Analog systems may allow image processing, such as edge detection, with low computational power. However, most demonstrated analog systems, based on either conventional 4-f imaging systems or nanophotonic structures, rely on coherent laser sources for illumination, which significantly restricts their use in routine imaging tasks with ambient, incoherent illumination. Here, we demonstrated a metalens-assisted imaging system that can allow optoelectronic edge detection under ambient illumination conditions. The metalens was designed to generate polarization-dependent optical transfer functions (OTFs), resulting in a synthetic OTF with an isotropic high-pass frequency response after digital subtraction. We integrated the polarization-multiplexed metalens with a polarization camera and experimentally demonstrated single-shot edge detection of indoor and outdoor scenes, including a flying airplane, under ambient sunlight illumination. The proposed system showcased the potential of using polarization multiplexing for the construction of complex optical convolution kernels toward accelerated machine vision tasks such as object detection and classification under ambient illumination.

Efficient dual-wavelength metasurface for second-order differential edge detection in the ultraviolet

Metasurfaces for edge detection through spatial analog calculations have attracted much attention due to advantages such as a flexible design and small footprint. Up until now, most studies have focused on single-wavelength operation in the near-infrared or visible regions, while little work has been done in the ultraviolet band. It is of significance to explore metasurfaces for edge detection in the ultraviolet band for their great potential in high-resolution imaging and lithography. Here, we propose a dual-wavelength H f O 2 metasurface for edge detection working at 273 nm and 293 nm, with 25% and 72% efficiency, respectively, controlled by the linear polarization of the incident light. The efficient dual-wavelength second-order differential calculation in the ultraviolet band of the metasurface has been confirmed by 1D signal and 2D image processing. It may find applications in the fields of computer vision and bioimaging.

Polarization-multiplexed metasurface enabled tri-functional imaging

Diffraction-limited focusing imaging, edge-enhanced imaging, and long depth of focus imaging offer crucial technical capabilities for applications such as biological microscopy and surface topography detection. To conveniently and quickly realize the microscopy imaging of different functions, the multifunctional integrated system of microscopy imaging has become an increasingly important research direction. However, conventional microscopes necessitate bulky optical components to switch between these functionalities, suffering from the system's complexity and unstability. Hence, solving the problem of integrating multiple functions within an optical system is a pressing need. In this work, we present an approach using a polarization-multiplexed tri-functional metasurface, capable of realizing the aforementioned imaging functions simply by changing the polarization state of the input and output light, enhancing the system structure's compactness and flexibility. This work offers a new avenue for multifunctional imaging, with potential applications in biomedicine and microscopy imaging.

Surface topography detection based on an optical differential metasurface

Surface topography detection can extract critical characteristics from objects, playing an important role in target identification and precision measurement. Here, an optical method with the advantages of low power consumption, high speed, and simple devices is proposed to realize the surface topography detection of low-contrast phase objects. By constructing reflected light paths, a metasurface can perform spatial differential operation via receiving the light directly reflected from a target. Therefore, our scheme is experimentally demonstrated as having remarkable universality, which can be used not only for opaque objects, but also for transparent pure phase objects. It provides a new, to the best of our knowledge, application for optical differential metasurfaces in precise detection of microscale surface topography.

Electrically and all-optically switchable nonlocal nonlinear metasurfaces

Nonlocal effects on metasurfaces play an important role to achieve high-Q spectral selectivity, beneficial for development of multifunctional, multispectral integrated optics. In addition, they enhance the optical interaction and promote a variety of nonlinear effects, including frequency conversion and stimulated scattering. Active tuning of nonlocal nonlinearity is highly desirable for sensing and signal processing but was hardly explored until now. Here, we show drastic electric and all-optical tunability of nonlocal second-harmonic generation (SHG) from nonlinear metasurface, functionalized with a twisted nematic liquid-crystal (LC) layer. The addition of LC results in the emergence of strong nonlocal SHG, due to a surface lattice resonance of the system. We demonstrate a notable enhancement of SHG on resonance, more than 25 dB electrical switching amplitude, and all-optically induced phase transition imprinted on SHG. Our results on dynamic nonlocal effects introduce a very promising route for active nonlinear optical metadevices at the nanoscale.

Recent advances in metasurface design and quantum optics applications with machine learning, physics-informed neural networks, and topology optimization methods

As a two-dimensional planar material with low depth profile, a metasurface can generate non-classical phase distributions for the transmitted and reflected electromagnetic waves at its interface. Thus, it offers more flexibility to control the wave front. A traditional metasurface design process mainly adopts the forward prediction algorithm, such as Finite Difference Time Domain, combined with manual parameter optimization. However, such methods are time-consuming, and it is difficult to keep the practical meta-atom spectrum being consistent with the ideal one. In addition, since the periodic boundary condition is used in the meta-atom design process, while the aperiodic condition is used in the array simulation, the coupling between neighboring meta-atoms leads to inevitable inaccuracy. In this review, representative intelligent methods for metasurface design are introduced and discussed, including machine learning, physics-information neural network, and topology optimization method. We elaborate on the principle of each approach, analyze their advantages and limitations, and discuss their potential applications. We also summarize recent advances in enabled metasurfaces for quantum optics applications. In short, this paper highlights a promising direction for intelligent metasurface designs and applications for future quantum optics research and serves as an up-to-date reference for researchers in the metasurface and metamaterial fields.

Optical analog computing enabled broadband structured light

Mathematically, any function can be expressed as the operation form of another function. Here, the idea is introduced into an optical system to generate structured light. In the optical system, a mathematical function is represented by an optical field distribution, and any structured light field can be generated by performing different optical analog computations for any input optical field. In particular, optical analog computing has a good broadband performance, as it can be achieved based on the Pancharatnam-Berry phase. Therefore, our scheme can provide a flexible way to generate broadband structured light, and this is theoretically and experimentally demonstrated. It is envisioned that our work may inspire potential applications in high-resolution microscopy and quantum computation.

Single-shot isotropic differential interference contrast microscopy

Differential interference contrast (DIC) microscopy allows high-contrast, low-phototoxicity, and label-free imaging of transparent biological objects, and has been applied in the field of cellular morphology, cell segmentation, particle tracking, optical measurement and others. Commercial DIC microscopy based on Nomarski or Wollaston prism resorts to the interference of two polarized waves with a lateral differential offset (shear) and axial phase shift (bias). However, the shear generated by these prisms is limited to the rectilinear direction, unfortunately resulting in anisotropic contrast imaging. Here we propose an ultracompact metasurface-assisted isotropic DIC (i-DIC) microscopy based on a grand original pattern of radial shear interferometry, that converts the rectilinear shear into rotationally symmetric along radial direction, enabling single-shot isotropic imaging capabilities. The i-DIC presents a complementary fusion of typical meta-optics, traditional microscopes and integrated optical system, and showcases the promising and synergetic advancements in edge detection, particle motion tracking, and label-free cellular imaging.

Two-dimensional optical differentiator for broadband edge detection based on dielectric metasurface

Image edge processing has widespread adoption in a variety of scientific and industrial scenarios. To date, implementations of image edge processing have mostly been done electronically, but there are still difficulties to achieve real-time, high-throughput, and low power consumption image edge processing. The advantages of optical analog computing include low power consumption, fast transmission speed, and high parallel processing capability, and optical analog differentiators make this process possible. However, the proposed analog differentiators can hardly meet the requirements of broadband, polarization insensitive, high contrast, and high efficiency at the same time. Moreover, they are limited to one-dimensional differentiation or work in reflection mode. To be better compatible with two-dimensional image processing or image recognition systems, two-dimensional optical differentiators that integrate the above advantages are urgently needed. In this Letter, a two-dimensional analog optical differentiator with edge detection operating in transmission mode is proposed. It can cover the visible band, is polarization uncorrelated, and has a resolution that reaches 1.7 μm. The efficiency of the metasurface is higher than 88%.

Advances in Meta-Optics and Metasurfaces: Fundamentals and Applications

Meta-optics based on metasurfaces that interact strongly with light has been an active area of research in recent years. The development of meta-optics has always been driven by human's pursuits of the ultimate miniaturization of optical elements, on-demand design and control of light beams, and processing hidden modalities of light. Underpinned by meta-optical physics, meta-optical devices have produced potentially disruptive applications in light manipulation and ultra-light optics. Among them, optical metalens are most fundamental and prominent meta-devices, owing to their powerful abilities in advanced imaging and image processing, and their novel functionalities in light manipulation. This review focuses on recent advances in the fundamentals and applications of the field defined by excavating new optical physics and breaking the limitations of light manipulation. In addition, we have deeply explored the metalenses and metalens-based devices with novel functionalities, and their applications in computational imaging and image processing. We also provide an outlook on this active field in the end.

Angular momentum holography via a minimalist metasurface for optical nested encryption

Metasurfaces can perform high-performance multi-functional integration by manipulating the abundant physical dimensions of light, demonstrating great potential in high-capacity information technologies. The orbital angular momentum (OAM) and spin angular momentum (SAM) dimensions have been respectively explored as the independent carrier for information multiplexing. However, fully managing these two intrinsic properties in information multiplexing remains elusive. Here, we propose the concept of angular momentum (AM) holography which can fully synergize these two fundamental dimensions to act as the information carrier, via a single-layer, non-interleaved metasurface. The underlying mechanism relies on independently controlling the two spin eigenstates and arbitrary overlaying them in each operation channel, thereby spatially modulating the resulting waveform at will. As a proof of concept, we demonstrate an AM meta-hologram allowing the reconstruction of two sets of holographic images, i.e., the spin-orbital locked and the spin-superimposed ones. Remarkably, leveraging the designed dual-functional AM meta-hologram, we demonstrate a novel optical nested encryption scheme, which is able to achieve parallel information transmission with ultra-high capacity and security. Our work opens a new avenue for optionally manipulating the AM, holding promising applications in the fields of optical communication, information security and quantum science.

Metasurfaces enabled polarization-multiplexing heralded single photon imaging

Quantum imaging has non-negligible advantages in terms of sensitivity, signal-to-noise ratio, and novel imaging schemes. Based on metasurfaces, the information density and stability of the quantum imaging system can be further improved. Here we experimentally demonstrate that two patterns, simultaneously and independently superimposed on a high-efficiency dielectric metasurface, can be remotely switched via polarization-entangled photon pairs. Furthermore, using the time-correlated property of entangled photon pairs, the information carried by quantum light can be remarkably discriminated from background noise. This work confirms that the phase manipulation of quantum light with metasurfaces has a huge potential in the field of quantum imaging, quantum state tomography, and also promises real-world quantum metasurface devices.

Metasurface for complete measurement of polarization Bell state

Bell state measurement is vital to quantum information technology. Conventional linear optical elements, however, cannot fully distinguish all polarization Bell states without assisting of additional degrees of freedom. Leveraging on a pair of binary-pixel metasurfaces, we demonstrate direct measurement of all four polarization Bell states. Each metasurface is designed to produce two output modes that linearly superpose three Bell states in the coincidence counting measurement. By rotating the polarizers, the coincidence counting measurement achieves a tunable anticorrelation between one and the other two Bell states, achieving Bell state detection efficiency of 75% in a single measurement. Complete and deterministic Bell state measurement is further realized by performing two measurements. Our work shows the advantage of utilization of metasurfaces in quantum detection schemes and is of great applicative interest for quantum dense coding, entanglement swapping, quantum teleportation protocols, and novel quantum information processing tasks.

Jones-matrix imaging based on two-photon interference

Two-photon interference is an important effect that is tightly related to the quantum nature of light. Recently, it has been shown that the photon bunching from the Hong-Ou-Mandel (HOM) effect can be used for quantum imaging in which sample properties (reflection/transmission amplitude, phase delay, or polarization) can be characterized at the pixel-by-pixel level. In this work, we perform Jones matrix imaging for an unknown object based on two-photon interference. By using a reference metasurface with panels of known polarization responses in pairwise coincidence measurements, the object's polarization responses at each pixel can be retrieved from the dependence of the coincidence visibility as a function of the reference polarization. The post-selection of coincidence images with specific reference polarization in our approach eliminates the need in switching the incident polarization and thus parallelized optical measurements for Jones matrix characterization. The parallelization in preparing input states, prevalent in any quantum algorithms, is an advantage of adopting two-photon interference in Jones matrix imaging. We believe our work points to the usage of metasurfaces in biological and medical imaging in the quantum optical regime.

Realization of all-optical higher-order spatial differentiators based on cascaded operations

Cascaded operations play an important role in traditional electronic computing systems for the realization of advanced strategies. Here, we introduce the idea of cascaded operations into all-optical spatial analog computing. The single function of the first-order operation has difficulty meeting the requirements of practical applications in image recognition. The all-optical second-order spatial differentiators are implemented by cascading two first-order differential operation units, and the image edge detection of amplitude and phase objects are demonstrated. Our scheme provides a possible pathway toward the development of compact multifunctional differentiators and advanced optical analog computing networks.

Designable optical differential operation based on surface plasmon resonance

Various optical differential computing devices have been designed, which have advantages of high speed and low power consumption compared with traditional digital computing. In this paper, considering the reflection of a light beam through a three-layer structure composed of glass, metal and air, we propose a designable optical differential operation based on surface plasmon resonance (SPR). When the SPR is excited under certain conditions, the spin-dependent splitting in the photonic spin Hall effect (SHE) changes dramatically. We first prove theoretically that this three-layer structure can realize one-dimensional optical differential operation. By discussing the transverse beam displacement under different conditions, it is found that the designable differential operation with high sensitivity can be realized by slightly adjusting the incident angle and the thickness of metal film. We design the differentiator which can obtain the image of measured target edge in real time and get different edge effects at different times. This will provide more possible applications for autonomous driving and target recognition.

Metasurface Micro/Nano-Optical Sensors: Principles and Applications

Metasurfaces are 2D artificial materials consisting of arrays of metamolecules, which are exquisitely designed to manipulate light in terms of amplitude, phase, and polarization state with spatial resolutions at the subwavelength scale. Traditional micro/nano-optical sensors (MNOSs) pursue high sensitivity through strongly localized optical fields based on diffractive and refractive optics, microcavities, and interferometers. Although detections of ultra-low concentrations of analytes have already been demonstrated, the label-free sensing and recognition of complex and unknown samples remain challenging, requiring multiple readouts from sensors, e.g., refractive index, absorption/emission spectrum, chirality, etc. Additionally, the reliability of detecting large, inhomogeneous biosamples may be compromised by the limited near-field sensing area from the localization of light. Here, we review recent advances in metasurface-based MNOSs and compare them with counterparts using micro-optics from aspects of physics, working principles, and applications. By virtue of underlying the physics and design flexibilities of metasurfaces, MNOSs have now been endowed with superb performances and advanced functionalities, leading toward highly integrated smart sensing platforms.

Optical spatial filtering with plasmonic directional image sensors

Photonics provides a promising approach for image processing by spatial filtering, with the advantage of faster speeds and lower power consumption compared to electronic digital solutions. However, traditional optical spatial filters suffer from bulky form factors that limit their portability. Here we present a new approach based on pixel arrays of plasmonic directional image sensors, designed to selectively detect light incident along a small, geometrically tunable set of directions. The resulting imaging systems can function as optical spatial filters without any external filtering elements, leading to extreme size miniaturization. Furthermore, they offer the distinct capability to perform multiple filtering operations at the same time, through the use of sensor arrays partitioned into blocks of adjacent pixels with different angular responses. To establish the image processing capabilities of these devices, we present a rigorous theoretical model of their filter transfer function under both coherent and incoherent illumination. Next, we use the measured angle-resolved responsivity of prototype devices to demonstrate two examples of relevant functionalities: (1) the visualization of otherwise invisible phase objects and (2) spatial differentiation with incoherent light. These results are significant for a multitude of imaging applications ranging from microscopy in biomedicine to object recognition for computer vision.

Optical differentiation based on weak measurements

Optical differentiation shows much potential to be applied in computation due to its strong parallelizability. Currently, each optical differential method can only obtain partial differential information. Here, we propose a general approach to obtain complete differentiation. Compared to previous methods, we can separately obtain the differentiation of amplitude and phase, reserve the negative value of the differentiation, and acquire the differentiation in arbitrary directions of the two-dimensional field. We measure the differentiation of the Gaussian beam to demonstrate this method. A practical experiment of identifying the move direction of the motion-blurred image is also presented to verify the practicability of our method. Our method can further be applied to intelligence algorithms, image identification, and optical analog computing.