Thin infrared imaging systems through multichannel sampling

Cutting depth-oriented ductile machining of infrared micro-lens arrays by elliptical vibration cutting

Infrared micro-lens arrays (MLAs) are widely used in advanced optical systems due to their advantages such as low focusing depth and high sensitivity. Elliptical vibration cutting (EVC) is a promising approach for the fabrication of MLAs on infrared brittle materials. However, the mechanism of ductile machining of MLAs prepared by EVC has not been fully elucidated so far. In this paper, based on the vibration intermittent cutting characteristics and the transient material removal state, a ductile machining model of MLAs on brittle material by EVC was established. This model effectively calculates the subsurface damage of the machined surface and realizes the prediction of the critical depth for ductile machining of MLAs. Furthermore, the concave micro-lenses were prepared on single crystal silicon by EVC and ordinary cutting (OC) to verify this model. The results demonstrated that EVC could significantly enhance the critical depth by approximately 4.3 times compared to OC. Microstructural surface damage predominantly occurs at the exit side of the tool cutting. This proposed model accurately predicts the actual critical depth, with an average error of about 7.5%. Additionally, elevating the amplitude in the depth of cut direction could increase the critical depth, but a larger amplitude would inhibit the increase of the critical depth. This study contributes to a better understanding of ductile machining of microstructure on brittle materials and facilitates the process optimization of MLAs fabrication using EVC.

Study of asymmetric or decentered multi-view designs for uncooled infrared imaging applications

Multi-view architectures using lens arrays can bring interesting features like 3D or multispectral imagery over single aperture cameras. Combined with super-resolution algorithms, multi-view designs are a way to miniaturize cameras while maintaining their resolution. These optical designs can be adapted for thermal infrared imagery and can thus answer the size, weight and power (SWAP) challenge with advanced imagery functions. However, in this spectral range, the choice of an uncooled microbolometer detector imposes a high numerical aperture for the system which increases the size of the optics and makes difficult a multi-channel arrangement combined with a single focal plane array (FPA). In this paper, we theoretically investigate several asymmetric or decentered multi-view designs that allow both a high aperture for the optical channels and the use of a single FPA for the sub-images. Ray-traced designs will illustrate this study and their image quality will be checked with modulation transfer functions (MTF) for different field points.

Polarization-independent infrared micro-lens array based on all-silicon metasurfaces

The long-wavelength infrared (LWIR) micro-lens arrays, as one of the important components in wafer level thermal optics, have been applied for wavefront sensing, beam shaping, integral imaging, and other thermal optical applications. Recently, electromagnetic metasurfaces provide a promising platform for designing high-performance, lightweight and ultracompact optical elements. Here, we experimentally demonstrate a 60 × 60 transmissive type, polarization-independent LWIR micro-lens array based on all-silicon metasurfaces with a fill factor approaching 100%. Each single micro-metalens with a pitch of 100 μm and a focal length of 100 μm operating at λ = 10.6 μm, can focus the light to a spot with a full-width at half-maximum (FWHM) of 12.7 μm (~1.2λ) at the focal plane. Considering the fact of single-step photolithography and standard integrated circuit (IC) compatible fabrication processes, these metasurface-based micro-lens arrays may have great potentials in compact thermal imaging systems.

Catadioptric planar compound eye with large field of view

The planar compound eye has the advantages of simple structure and no requirement for complex relay optical elements, but the field of view (FOV) is very difficult to expand. Overcoming the limitation of FOV, especially with simple structures, is a great challenge for the development of planar compound eyes. Different from the existing designs that only considering refraction, this article proposes a catadioptric planar compound eye based on the reflection and refraction to expand the FOV. In the proposed design, the incident light from a large angle is reflected into the lenslet array by two rotationally symmetric mirrors whose surface equations are optimized by mathematical and optical softwares. The FOV of the proposed catadioptric planar compound eye theoretically can reach 96.6°, which is much wider than the opening record of 70°. Moreover, no distortion of the imaging system can be obtained theoretically in this design. Simulation results show a linearity of better than 99% for the most of the incident angles. The verification experiments show that the FOV of the proposed device can reach 90.7° while the FOV of the corresponding planar compound eye without mirrors is 41.6°. The proposed catadioptric planar compound eye has the great potential in monitoring, detection and virtual reality since the FOV has been widen significantly.

Design and simulation of a superposition compound eye system based on hybrid diffractive-refractive lenses

Compound eyes offer a promising field of miniaturized imaging systems. In one application of a compound eye, superposition of compound eye systems forms a composite image by superposing the images produced by different channels. The geometric configuration of superposition compound eye systems is achieved by three micro-lens arrays with different pitches and focal lengths. High resolution is indispensable for the practicability of superposition compound eye systems. In this paper, hybrid diffractive-refractive lenses are introduced into the design of a compound eye system for this purpose. With the help of ZEMAX, two superposition compound eye systems with and without hybrid diffractive-refractive lenses were separately designed. Then, we demonstrate the effectiveness of using a hybrid diffractive-refractive lens to improve the image quality.

Simple telecentric submillimeter lens with near-diffraction-limited performance across an 80 degree field of view

A simple and compact telecentric lens based on two hemispheric optical elements arranged in a formation resembling an "hourglass" is proposed and evaluated. Our modeling and experimental results show the ability of this lens in achieving high resolution over a large field of view. A prototype with 500 μm total thickness is built using silicon micromachining methods for a center wavelength of 1500 nm. Experimental measurement shows near-diffraction-limited performance and good telecentricity over an 80° field of view at a numerical aperture of 0.2. All elements of the hourglass lens are in direct contact, and hence the alignment is extremely simple. We believe the proposed lens is a good candidate for compact and low-cost multi-aperture imagers.

Computational imaging from non-uniform degradation of staggered TDI thermal infrared imager

For the Time Delay Integration (TDI) staggered line-scanning thermal infrared imager, a Computational Imaging (CI) approach is developed to achieve higher spatial resolution images. After a thorough analysis of the causes of non-uniform image displacement and degradation for multi-channel staggered TDI arrays, the study aims to approach one-dimensional (1D) sub-pixel displacement estimation and superposition of images from time-division multiplexing scanning lines. Under the assumption that a thermal image is 2D piecewise C(2) smooth, a sparse-and-smooth deconvolution algorithm with L1-norm regularization terms combining the first and second order derivative operators is proposed to restore high frequency components and to suppress aliasing simultaneously. It is theoretically and experimentally demonstrated, with simulation and airborne thermal infrared images, that this is a state-of-the-art practical CI method to reconstruct clear images with higher frequency components from raw thermal images that are subject to instantaneous distortion and blurring.

Compact multi-aperture imaging with high angular resolution

Previous reports have demonstrated that it is possible to emulate the imaging function of a single conventional lens with an N×N array of identical lenslets to provide an N-fold reduction in imaging-system track length. This approach limits the application to low-resolution imaging. We highlight how using an array of dissimilar lenslets, with an array width that can be much wider than the detector array, high-resolution super-resolved imaging is possible. We illustrate this approach with a ray-traced design and optimization of a long-wave infrared system employing a 3×3 array of freeform lenslets to provide a fourfold reduction in track length compared to a baseline system. Simulations of image recovery show that recovered image quality is comparable to that of the baseline system.

Superresolution of 3-D computational integral imaging based on moving least square method

In this paper, we propose an edge directive moving least square (ED-MLS) based superresolution method for computational integral imaging reconstruction(CIIR). Due to the low resolution of the elemental images and the alignment error of the microlenses, it is not easy to obtain an accurate registration result in integral imaging, which makes it difficult to apply superresolution to the CIIR application. To overcome this problem, we propose the edge directive moving least square (ED-MLS) based superresolution method which utilizes the properties of the moving least square. The proposed ED-MLS based superresolution takes the direction of the edge into account in the moving least square reconstruction to deal with the abrupt brightness changes in the edge regions, and is less sensitive to the registration error. Furthermore, we propose a framework which shows how the data have to be collected for the superresolution problem in the CIIR application. Experimental results verify that the resolution of the elemental images is enhanced, and that a high resolution reconstructed 3-D image can be obtained with the proposed method.

Influence of lenslet number on performance of image restoration algorithms for the TOMBO imaging system

In this paper the influence of the number of lenslets on the performance of image restoration algorithms for the thin observation module by bound optics (TOMBO) imaging system was investigated, and the lenslet number was optimized to achieve thin system and high imaging performance. Subimages with different numbers of lenslets were generated following the TOMBO observation model, and image restoration algorithms were applied to evaluate the imaging performance of the TOMBO system. The optimal lenslet number was determined via theoretical performance optimization and verified via experimental comparisons of angular resolutions of two TOMBO systems and a conventional single-lens system.

Super-resolution imaging using a camera array

The angular resolution of many commercial imaging systems is limited, not by diffraction or optical aberrations, but by pixilation effects. Multiaperture imaging has previously demonstrated the potential for super-resolution (SR) imaging using a lenslet array and single detector array. We describe the practical demonstration of SR imaging using an array of 25 independent commercial-off-the-shelf cameras. This technique demonstrates the potential for increasing the angular resolution toward the diffraction limit, but without the limit on angular resolution imposed by the use of a single detector array.

Large area IR microlens arrays of chalcogenide glass photoresists by grayscale maskless lithography

The ability to use chalcogenide glass thin films as photoresists for one-step maskless grayscale lithographic patterning is demonstrated. It is shown that the chalcogenide photoresists can be used to fabricate grayscale patterns with smooth and continuous profiles such as arrays of cylindrical and spherical microlenses, which are useful as optical structures for IR applications. The etching and exposure parameters are optimized to obtain smooth reproducible lens arrays of 150 μm periodicity and up to ∼170 nm height on large areas (∼1 cm(2)). The roughness is found to increase as a function of the exposure dose and is attributed to the selective dissolution of the As-Se, As-As, and Se-Se bonds present in the nanodistributed phases and the presence of the oxide phase. Thus, a minimum exposure dose produces optimally patterned lens arrays. The focal length calculated for the smooth microlens array is ∼9.3 mm, indicating the suitability of the lens arrays for focusing applications in the IR region.

Design of an image restoration algorithm for the TOMBO imaging system

The TOMBO system (thin observation module by bound optics) is a multichannel subimaging system over a single electronic imaging device. Each subsystem provides a low-resolution (LR) image from a unique lateral point of view. By estimating the image's lateral position, a high-resolution (HR) image is restored from the series of the LR images. This paper proposes an multistage algorithm comprised of successive stages, improving difficulties in previous suggested schemes. First, the registration algorithm estimates the subchannel shift parameters and eliminates bias. Second, we introduce a fast image fusion, overcoming visual blockiness artifacts that characterized previously suggested schemes. The algorithm fuses the set of sampled subchannel images into a single image, providing the reconstruction initial estimate. Third, an edge-sensitive quadratic upper bound term to the total variation regulator is suggested. The complete algorithm allows the reconstruction of a clean, HR image, in linear computation time, by the use of the linear conjugate gradient optimization. Finally, we present a simulated comparison between the proposed method and a previously suggested image restoration method. The results show that the proposed method yields better reconstruction fidelity while eliminating spatial speckle artifacts associated with the previously suggested method.

Toward a super imaging system [Invited]

This paper deals with the fast-developing area of computational photography where a combination of imaging techniques and efficient image processing algorithms is done to generate a super imaging system. In recent years, three main implementations of the computational photography philosophy were intensively investigated and demonstrated: (i) multiple aperture, (ii) light field photography, and (iii) multiexposure. The paper provides a mini-review of these three approaches and shows ways to improve and combine them toward a super imaging system. As a conclusion, the paper provides preliminary guidelines for fusing the three approaches into one integrated super imaging system with optimized performance.

Design of a multichannel, multiresolution smart imaging system

This paper presents the design of a multichannel imaging system where the different optical channels have a different angular resolution and field-of-view. Such an imaging system is able to resolve fine details in a small region of interest through the channel that has the highest angular resolution (0.0096°) while controlling the surrounding region through the channel that has the widest field-of-view (2×40°). An interesting feature of such a multichannel, multiresolution imaging system is that various image processing algorithms can be applied at different segments of the image sensor. We have designed a three channel imaging system where each optical channel consists of four aspheric lens surfaces. These three imaging channels share a single image sensor with a resolution of 1440×960 and a 10 μm pixel size. All imaging channels have diffraction-limited performance ensuring good overall image quality.

Multichanneled finite-conjugate imaging

Multichanneled imaging systems rely on nonredundant images recorded by an array of low-resolution imagers to enable construction of a high-resolution image. We show how the varying degree of redundancy associated with imaging throughout the imaged volume effects image quality. Using ray-traced image simulations and a metric used as a proxy for human perception, we show that robust recovery of high-resolution images can be obtained by avoiding excessive redundancy and that this is a felicitous consequence of typical manufacturing tolerances.

Design and fabrication of a freeform microlens array for a compact large-field-of-view compound-eye camera

In this research, a unique freeform microlens array was designed and fabricated for a compact compound-eye camera to achieve a large field of view. This microlens array has a field of view of 48°×48°, with a thickness of only 1.6 mm. The freeform microlens array resides on a flat substrate, and thus can be directly mounted to a commercial 2D image sensor. Freeform surfaces were used to design the microlens profiles, thus allowing the microlenses to steer and focus incident rays simultaneously. The profiles of the freeform microlenses were represented using extended polynomials, the coefficients of which were optimized using ZEMAX. To reduce crosstalk among neighboring channels, a micro aperture array was machined using high-speed micromilling. The molded microlens array was assembled with the micro aperture array, an adjustable fixture, and a board-level image sensor to form a compact compound-eye camera system. The imaging tests using the compound-eye camera showed that the unique freeform microlens array was capable of forming proper images, as suggested by design. The measured field of view of ±23.5° also matches the initial design and is considerably larger compared with most similar camera designs using conventional microlens arrays. To achieve low manufacturing cost without sacrificing image quality, the freeform microlens array was fabricated using a combination of ultraprecision diamond broaching and a microinjection molding process.

Compact infrared cryogenic wafer-level camera: design and experimental validation

We present a compact infrared cryogenic multichannel camera with a wide field of view equal to 120°. By merging the optics with the detector, the concept is compatible with both cryogenic constraints and wafer-level fabrication. The design strategy of such a camera is described, as well as its fabrication and integration process. Its characterization has been carried out in terms of the modulation transfer function and the noise equivalent temperature difference (NETD). The optical system is limited by the diffraction. By cooling the optics, we achieve a very low NETD equal to 15 mK compared with traditional infrared cameras. A postprocessing algorithm that aims at reconstructing a well-sampled image from the set of undersampled raw subimages produced by the camera is proposed and validated on experimental images.

Prototype development and field-test results of an adaptive multiresolution PANOPTES imaging architecture

The design, development, and field-test results of a visible-band, folded, multiresolution, adaptive computational imaging system based on the Processing Arrays of Nyquist-limited Observations to Produce a Thin Electro-optic Sensor (PANOPTES) concept is presented. The architectural layout that enables this imager to be adaptive is described, and the control system that ensures reliable field-of-view steering for precision and accuracy in subpixel target registration is explained. A digital superresolution algorithm introduced to obtain high-resolution imagery from field tests conducted in both nighttime and daytime imaging conditions is discussed. The digital superresolution capability of this adaptive PANOPTES architecture is demonstrated via results in which resolution enhancement by a factor of 4 over the detector Nyquist limit is achieved.

Object reconstruction from adaptive compressive measurements in feature-specific imaging

Static feature-specific imaging (SFSI), where the measurement basis remains fixed/static during the data measurement process, has been shown to be superior to conventional imaging for reconstruction tasks. Here, we describe an adaptive approach that utilizes past measurements to inform the choice of measurement basis for future measurements in an FSI system, with the goal of maximizing the reconstruction fidelity while employing the fewest measurements. An algorithm to implement this adaptive approach is developed for FSI systems, and the resulting systems are referred to as adaptive FSI (AFSI) systems. A simulation study is used to analyze the performance of the AFSI system for two choices of measurement basis: principal component (PC) and Hadamard. Here, the root mean squared error (RMSE) metric is employed to quantify the reconstruction fidelity. We observe that an AFSI system achieves as much as 30% lower RMSE compared to an SFSI system. The performance improvement of the AFSI systems is verified using an experimental setup employed using a digital micromirror device (DMD) array.

Thin wafer-level camera lenses inspired by insect compound eyes

We propose a microoptical approach to ultra-compact optics for real-time vision systems that are inspired by the compound eyes of insects. The demonstrated module achieves approx. VGA resolution with a total track length of 1.4 mm which is about two times shorter than comparable single-aperture optics on images sensors of the same pixel pitch. The partial images that are separately recorded in different optical channels are stitched together to form a final image of the whole field of view by means of image processing. A software correction is applied to each partial image so that the final image is made free of distortion. The microlens arrays are realized by state of the art microoptical fabrication techniques on wafer-level which are suitable for a potential application in high volume e.g. for consumer electronic products.

Modulation transfer function measurement of a multichannel optical system

We present a new method to measure the modulation transfer function (MTF) beyond the Nyquist frequency of a multichannel imaging system for which all the channels have parallel optical axes. Such a multichannel optical system produces a set of undersampled subimages. If the subimages contain nonredundant information, high spatial frequencies are folded between low spatial frequencies, leading to the possible extraction of frequencies higher than the Nyquist frequency. The measurement of the MTF of the multichannel system leads to the estimation of the resolution enhancement of the final image that can be obtained by applying a postprocessing algorithm to the collection of undersampled subimages. Experimental images are presented to validate this method.

Experimentally validated computational imaging with adaptive multiaperture folded architecture

We present experimental results of imaging and digital superresolution in a multiaperture miniature folded imaging architecture called PANOPTES. We prove the feasibility of integrating a low f-number folded imagers within a steerable multiaperture framework while maintaining a thin profile. Stringent requirements including low f-number and compact form factor, combined with the need for an ability to steer individual fields of view necessitate an off-axis design, resulting in a plane symmetric optical system. We present a detailed description of the ensuing optical design and its performance. The feasibility of this architecture is demonstrated through experiments and preliminary reconstruction results.

Compressive video sensors using multichannel imagers

We explore the possibilities of obtaining compression in video through modified sampling strategies using multichannel imaging systems. The redundancies in video streams are exploited through compressive sampling schemes to achieve low power and low complexity video sensors. The sampling strategies as well as the associated reconstruction algorithms are discussed. These compressive sampling schemes could be implemented in the focal plane readout hardware resulting in drastic reduction in data bandwidth and computational complexity.

Multiscale lens design

While lenses of aperture less than 1000lambda frequently form images with pixel counts approaching the space-bandwidth limit, only heroic designs approach the theoretical information capacity at larger scales. We propose to use the field processing capabilities of small-scale secondary lens arrays to correct aberrations due to larger scale objective lenses, with an ultimate goal of achieving diffraction-limited imaging for apertures greater than 10,000lambda .We present an example optical design using an 8 mm entrance pupil capable of resolving 20 megapixels.

Demonstration of an infrared microcamera inspired by Xenos peckii vision

We present an original and compact optical system inspired by the unusual eyes of a Strepsipteran insect called Xenos peckii. It is designed for a field of view of 30 degrees and is composed of multiple telescopes. An array of prisms of various angles is placed in front of these telescopes in order to set a different field of view for each channel. This type of camera operates in the [3-5 microm] spectral bandwidth and is entirely integrated in a Dewar in order to maximize its compactness. Experimental images are presented to validate this design.

Design and characterization of thin multiple aperture infrared cameras

We describe a multiple-aperture long-wave infrared camera built on an uncooled microbolometer array with the objective of decreasing camera thickness. The 5 mm thick optical system is an f/1.2 design with a 6.15 mm effective focal length. An integrated image is formed from the subapertures using correlation-based registration and a least gradient reconstruction algorithm. We measure a 131 mK NETD. The system's spatial frequency is analyzed with 4 bar targets. With proper calibration, our multichannel interpolation results recover contrast for targets at frequencies beyond the aliasing limit of the individual subimages.