Power-balanced hybrid optics boosted design for achromatic extended depth-of-field imaging via optimized mixed OTF

Wavefront coding image reconstruction via physical prior and frequency attention

Wavefront coding (WFC) is an effective technique for extending the depth-of-field of imaging systems, including optical encoding and digital decoding. We applied physical prior information and frequency domain model to the wavefront decoding, proposing a reconstruction method by a generative model. Specifically, we rebuild the baseline inspired by the transformer and propose three modules, including the point spread function (PSF) attention layer, multi-feature fusion block, and frequency domain self-attention block. These models are used for end-to-end learning to extract PSF feature information, fuse it into the image features, and further re-normalize the image feature information, respectively. To verify the validity, in the encoding part, we use the genetic algorithm to design a phase mask in a large field-of-view fluorescence microscope system to generate the encoded images. And the experimental results after wavefront decoding show that our method effectively reduces noise, artifacts, and blur. Therefore, we provide a deep-learning wavefront decoding model, which improves reconstruction image quality while considering the large depth-of-field (DOF) of a large field-of-view system, with good potential in detecting digital polymerase chain reaction (dPCR) and biological images.

Miniature color camera via flat hybrid meta-optics

The race for miniature color cameras using flat meta-optics has rapidly developed the end-to-end design framework using neural networks. Although a large body of work has shown the potential of this methodology, the reported performance is still limited due to fundamental limitations coming from meta-optics, mismatch between simulated and resultant experimental point spread functions, and calibration errors. Here, we use a HIL optics design methodology to solve these limitations and demonstrate a miniature color camera via flat hybrid meta-optics (refractive + meta-mask). The resulting camera achieves high-quality full-color imaging for a 5-mm aperture optics with a focal length of 5 mm. We observed a superior quality of the images captured by the hybrid meta-optical camera compared to a compound multi-lens optics of a mirrorless commercial camera.

Hybrid diffractive optics design via hardware-in-the-loop methodology for achromatic extended-depth-of-field imaging

End-to-end optimization of diffractive optical elements (DOEs) profile through a digital differentiable model combined with computational imaging have gained an increasing attention in emerging applications due to the compactness of resultant physical setups. Despite recent works have shown the potential of this methodology to design optics, its performance in physical setups is still limited and affected by manufacturing artefacts of DOE, mismatch between simulated and resultant experimental point spread functions, and calibration errors. Additionally, the computational burden of the digital differentiable model to effectively design the DOE is increasing, thus limiting the size of the DOE that can be designed. To overcome the above mentioned limitations, a co-design of hybrid optics and image reconstruction algorithm is produced following the end-to-end hardware-in-the-loop strategy, using for optimization a convolutional neural network equipped with quantitative and qualitative loss functions. The optics of the imaging system consists on the phase-only spatial light modulator (SLM) as DOE and refractive lens. SLM phase-pattern is optimized by applying the Hardware-in-the-loop technique, which helps to eliminate the mismatch between numerical modelling and physical reality of image formation as light propagation is not numerically modelled but is physically done. Comparison with compound multi-lens optics of a last generation smartphone and a mirrorless commercial cameras show that the proposed system is advanced in all-in-focus sharp imaging for a depth range 0.4-1.9 m.