Miniature optoelectronic compound eye camera

Seeing through arthropod eyes: An AI-assisted, biomimetic approach for high-resolution, multi-task imaging

Arthropods have intricate compound eyes and optic neuropils, exhibiting exceptional visual capabilities. Combining the strengths of digital imaging with the features of natural arthropod visual systems offers a promising approach to harness wide-angle vision and depth perception while addressing limitations like low resolving power. Here, we present an artificial intelligence-assisted biomimetic system modeled after arthropod vision. We developed a biomimetic compound eye camera with an effective pixel number of 4.3 megapixels capable of producing full-color panoramic images with a viewing angle of 165° and resolving power of 40 micrometers. Using rich visual information, our system achieves high-fidelity image reconstruction, precise 3D position prediction, high-accuracy classification, and pattern recognition through a multistage neural network. Moreover, our compact biomimetic visual system can simultaneously track the 3D motion of multiple miniature targets independently. The proof-of-concept biomimetic arthropod visual system offers a computational panoramic imaging solution, advancing applications in industry, medicine, and robotics.

A shape-reconfigurable electronic composite for stimulus customizable detection via neutral plane shifting

Three-dimensional (3D) sensors selectively measure the applied force in a particular direction through the designed shape. However, such a fixed sensor design incurs a relatively low sensitivity and narrow measurement range to forces applied from other directions. Here, we report a shape-reconfigurable electronic composite based on a stiffness-tunable polymer and a crack-based strain sensor. The stiffness-tunable polymer allows a high degree of freedom (DOF) in modifying the shape of the electronic composite in its flexible state, enabling the formation of various 3D structures. This modification involves shifting the neutral plane toward the electrode to prevent fractures in the embedded sensors. After modifying the shape of the soft and flexible electronic composite, the dramatically increased stiffness of the stiffness-tunable polymer enables the maintenance of the reconfigured shape of the electronic composite and amplifies the mechanical signal from the external force of the targeted direction by returning the neutral plane to the original position. We validated the reversible modification of the shape of the electronic composite by demonstrating the increase in sensitivity and measured range for targeted external forces (bending, pressing, and stretching) via sequential changes in the designed shapes (wire, spiral, and spring) compared to the initial shape. This facile approach for shape modification will provide an opportunity to realize versatile shape changes in rigid electronics for user purpose.

From Single to Multi-Material 3D Printing of Glass-Ceramics for Micro-Optics

Feynman's statement, "There is plenty of room at the bottom", underscores vast potential at the atomic scale, envisioning microscopic machines. Today, this vision extends into 3D space, where thousands of atoms and molecules are volumetrically patterned to create light-driven technologies. To fully harness their potential, 3D designs must incorporate high-refractive-index elements with exceptional mechanical and chemical resilience. The frontier, however, lies in creating spatially patterned micro-optical architectures in glass and ceramic materials of dissimilar compositions. This multi-material capability enables novel ways of shaping light, leveraging the interaction between diverse interfaced chemical compositions to push optical boundaries. Specifically, it encompasses both multi-material integration within the same architectures and the use of different materials for distinct architectural features in an optical system. Integrating fluid handling systems with two-photon lithography (TPL) provides a promising approach for rapidly prototyping such complex components. This review examines single and multi-material TPL processes, discussing photoresin customization, essential physico-chemical conditions, and the need for cross-scale characterization to assess optical quality. It reflects on challenges in characterizing multi-scale architectures and outlines advancements in TPL for both single and spatially patterned multi-material structures. The roadmap provides a bridge between research and industry, emphasizing collaboration and contributions to advancing micro-optics.

A promising eco-friendly and cost-effective photocatalytic rolled graphene oxide/poly(m-methylaniline) core-shell nanocomposite for antimicrobial action

A new and innovative rolled graphene oxide (roll-GO)/poly-m-methylaniline (PmMA) core-shell nanocomposite has been successfully synthesized using an in situ polymerization technique. This eco-friendly and cost-effective material shows great promise due to its antimicrobial properties. The characterization of the nanocomposite involved X-ray diffraction and Fourier transform infrared spectroscopy to analyze its structure and functional groups, whereas scanning electron microscopy and transmission electron microscopy (TEM) were utilized to examine its morphology. TEM analysis revealed the formation of roll-GO, forming multi-walled tubes with inner and outer diameters of 50 and 70 nm, respectively. Optical analysis demonstrated an enhanced bandgap in the nanocomposite, with bandgap values of 2.38 eV for PmMA, 2.67 eV for roll-GO, and 1.65 eV for roll-GO/PmMA. The antibacterial efficacy of the nanocomposite was tested against Gram-positive bacteria, including Bacillus subtilis and Staphylococcus aureus, as well as Gram-negative bacteria such as Escherichia coli and Salmonella sp. The well diffusion method was used to determine the inhibition zones, revealing that the nanocomposite demonstrated broad-spectrum antibacterial activity against all the pathogens tested. The largest inhibition zones were observed for B. subtilis, followed by S. aureus, E. coli, and Salmonella sp. Notably, the inhibition zones increased when the samples were exposed to light compared to dark conditions, with increases of 33 and 18 mm noted for B. subtilis. This enhanced activity under light exposure is attributed to the photocatalytic properties of the nanocomposite. The antibacterial mechanism is based on both adsorption and degradation processes. Moreover, antibacterial activity was found to increase with increasing concentrations of nanoparticles, ranging from 100 to 500 ppm. This suggests that the nanocomposite has potential as an alternative to antibiotics, especially considering the growing issue of bacterial resistance. The promising results obtained from the inhibition zones make these nanocomposites suitable for various applications. Currently, the research team is working on the development of a prototype utilizing these antimicrobial particles within commercial bottles for sterilization purposes in factories and companies.

Laser-based 3D printing and optical characterization of optical micro-nanostructures inspired by nocturnal insects compound eyes

Nature offers unique examples that help humans produce artificial systems which mimic specific functions of living organisms and provide solutions to complex technical problems of the modern world. For example, the development of 3D micro-nanostructures that mimic nocturnal insect eyes (optimized for night vision), emerges as promising technology for detection in IR spectral region. Here, we report a proof of principle concerning the design and laser 3D printing of all ultrastructural details of nocturnal moth Grapholita Funebrana eyes, for potential use as microlens arrays for IR detection systems. Optimized computer-aided design and laser writing parameters enabled us to reproduce the entire complex architecture of moth compound eyes, with submicrometric spatial accuracy. As such, the laser-imprinted structures consisted in ommatidia-like microstructures with average diameter of about 14 μm, decorated with nipple-like nanopillars between 200 and 400 nm in height and average periodicity of around 450 nm. The dimensions of moth-eye inspired structures deviated by less than 10% from the natural corresponding structures. The optical properties of the moth eyes-inspired microlens arrays were investigated in the infrared (IR) range, between 1000 and 1700 nm. The optical transmission of microlens arrays with nanopillars was up to 17.55% higher than the transmission through microlens arrays without nanopillars. Moreover, the reflection of nanopillar-decorated microlens arrays was up to 0.91% lower than the reflection for microlenses without nanopillars. In addition, the focal spot diameter at 1/e2 for nanopillar-decorated microlens arrays was of 7.64 μm, representing and improvement of 16.5% of focal spot diameter as compared to microlens arrays without nanopillars. Similarly with the IR region, the reflection measured in the Visible range was higher for microlense arrays with nanopillars than the reflection through microlenses arrays without nanopillars. In contrast, in the Visible range the transmission of nanopillar-decorated microlens arrays was lower than the one for microlense arrays without nanopillars, which could be, most likely, assigned to diffraction losses on the nanopillars.

Biologically inspired microlens array camera for high-speed and high-sensitivity imaging

Nocturnal and crepuscular fast-eyed insects often exploit multiple optical channels and temporal summation for fast and low-light imaging. Here, we report high-speed and high-sensitive microlens array camera (HS-MAC), inspired by multiple optical channels and temporal summation for insect vision. HS-MAC features cross-talk-free offset microlens arrays on a single rolling shutter CMOS image sensor and performs high-speed and high-sensitivity imaging by using channel fragmentation, temporal summation, and compressive frame reconstruction. The experimental results demonstrate that HS-MAC accurately measures the speed of a color disk rotating at 1950 rpm, recording fast sequences at 9120 fps with low noise equivalent irradiance (0.43 μW/cm2). Besides, HS-MAC visualizes the necking pinch-off of a pool fire flame in dim light conditions below one thousandth of a lux. The compact high-speed low-light camera can offer a distinct route for high-speed and low-light imaging in mobile, surveillance, and biomedical applications.

Fiber-integrated hybrid achromatic microlenses by combined femtosecond laser 3D printing

Compact achromats for visible wavelengths are crucial for miniaturized and lightweight full-color endoscopes. Emerging femtosecond laser 3D printing technology offers new possibilities for enhancing the optical performance of miniature imaging lenses on fibers. In this work, we combine refractive and diffractive elements with complementary dispersive properties to create thin, high-performance hybrid achromatic lenses within the visible spectrum, avoiding the use of different optical materials. Using a fiber-integrated hybrid achromatic lens array, clear images are captured across different wavelengths. The fabrication process is carried out using femtosecond laser direct writing (DLW) assisted by femtosecond projection lithography based on a digital micromirror device (DMD). Our work is expected to significantly contribute to the advancement of integrated and miniaturized biomedical imaging devices.

Inspiration from Visual Ecology for Advancing Multifunctional Robotic Vision Systems: Bio-inspired Electronic Eyes and Neuromorphic Image Sensors

In robotics, particularly for autonomous navigation and human-robot collaboration, the significance of unconventional imaging techniques and efficient data processing capabilities is paramount. The unstructured environments encountered by robots, coupled with complex missions assigned to them, present numerous challenges necessitating diverse visual functionalities, and consequently, the development of multifunctional robotic vision systems has become indispensable. Meanwhile, rich diversity inherent in animal vision systems, honed over evolutionary epochs to meet their survival demands across varied habitats, serves as a profound source of inspirations. Here, recent advancements in multifunctional robotic vision systems drawing inspiration from natural ocular structures and their visual perception mechanisms are delineated. First, unique imaging functionalities of natural eyes across terrestrial, aerial, and aquatic habitats and visual signal processing mechanism of humans are explored. Then, designs and functionalities of bio-inspired electronic eyes are explored, engineered to mimic key components and underlying optical principles of natural eyes. Furthermore, neuromorphic image sensors are discussed, emulating functional properties of synapses, neurons, and retinas and thereby enhancing accuracy and efficiency of robotic vision tasks. Next, integration examples of electronic eyes with mobile robotic/biological systems are introduced. Finally, a forward-looking outlook on the development of bio-inspired electronic eyes and neuromorphic image sensors is provided.

Compact biologically inspired camera with computational compound eye

The growing interests have been witnessed in the evolution and improvement of artificial compound eyes (CE) inspired by arthropods. However, the existing CE cameras are suffering from a defocusing problem due to the incompatibility with commercial CMOS cameras. Inspired by the CEs of South American Shrimps, we report a compact biologically inspired camera that enables wide-field-of-view (FOV), high-resolution imaging and sensitive 3D moving trajectory reconstruction. To overcome the defocusing problem, a deep learning architecture with distance regulation is proposed to achieve wide-range-clear imaging, without any hardware or complex front-end design, which greatly reduces system complexity and size. The architecture is composed of a variant of Unet and Pyramid-multi-scale attention, with designed short, middle and long distance regulation. Compared to the current competitive well-known models, our method is at least 2 dB ahead. Here we describe the high-resolution computational-CE camera with 271 ommatidia, with a weight of 5.4 g an area of 3 × 3 cm2 and 5-mm thickness, which achieves compatibility and integration of CE with commercial CMOS. The experimental result illustrates this computational-CE camera has competitive advantages in enhanced resolution and sensitive 3D live moving trajectory reconstruction. The compact camera has promising applications in nano-optics fields such as medical endoscopy, panoramic imaging and vision robotics.

Bright Innovations: Review of Next-Generation Advances in Scintillator Engineering

This review focuses on modern scintillators, the heart of ionizing radiation detection with applications in medical diagnostics, homeland security, research, and other areas. The conventional method to improve their characteristics, such as light output and timing properties, consists of improving in material composition and doping, etc., which are intrinsic to the material. On the contrary, we review recent advancements in cutting-edge approaches to shape scintillator characteristics via photonic and metamaterial engineering, which are extrinsic and introduce controlled inhomogeneity in the scintillator's surface or volume. The methods to be discussed include improved light out-coupling using photonic crystal (PhC) coating, dielectric architecture modification producing the Purcell effect, and meta-materials engineering based on energy sharing. These approaches help to break traditional bulk scintillators' limitations, e.g., to deal with poor light extraction efficiency from the material due to a typically large refractive index mismatch or improve timing performance compared to bulk materials. In the Outlook section, modern physical phenomena are discussed and suggested as the basis for the next generations of scintillation-based detectors and technology, followed by a brief discussion on cost-effective fabrication techniques that could be scalable.

Avian eye-inspired perovskite artificial vision system for foveated and multispectral imaging

Avian eyes have deep central foveae as a result of extensive evolution. Deep foveae efficiently refract incident light, creating a magnified image of the target object and making it easier to track object motion. These features are essential for detecting and tracking remote objects in dynamic environments. Furthermore, avian eyes respond to a wide spectrum of light, including visible and ultraviolet light, allowing them to efficiently distinguish the target object from complex backgrounds. Despite notable advances in artificial vision systems that mimic animal vision, the exceptional object detection and targeting capabilities of avian eyes via foveated and multispectral imaging remain underexplored. Here, we present an artificial vision system that capitalizes on these aspects of avian vision. We introduce an artificial fovea and vertically stacked perovskite photodetector arrays whose designs were optimized by theoretical simulations for the demonstration of foveated and multispectral imaging. The artificial vision system successfully identifies colored and mixed-color objects and detects remote objects through foveated imaging. The potential for use in uncrewed aerial vehicles that need to detect, track, and recognize distant targets in dynamic environments is also discussed. Our avian eye-inspired perovskite artificial vision system marks a notable advance in bioinspired artificial visions.

Research on key technology of cooled infrared bionic compound eye camera based on small lens array

Traditional 2D imaging technologies are limited by the need for a large field of view and their sensitivity to small target motion. Inspired by the characteristics of insect compound eye structure, we propose an infrared bionic compound eye camera based on a small lens array. The camera is composed of 61 small lens arrays mounted on a curved spherical shell and a relay optical system. The imaging device is a high-performance cooled mid-wave infrared detector. This is an innovative design for an infrared biomimetic compound eye camera system that provides a wide field of view and all-day detection capability. Aimed to meet the specified requirements. The optical system achieves a 100% cold-membrane match between the infrared optical system and the cooled detector, and the relay optical system optimizes the large-field aberration by introducing a higher-order aspheric surface and modifying the geometric surface of the lenses. Our entire system enables an observation field angle of108 ∘ × 108 ∘ . The experiments showed that the image quality of the system is high, each ommatidium was effective within the imaging range of the compound eye camera, resulting in an improved signal-to-noise ratio in various scenes.

Miniature bioinspired artificial compound eyes: microfabrication technologies, photodetection and applications

As an outstanding visual system for insects and crustaceans to cope with the challenges of survival, compound eye has many unique advantages, such as wide field of view, rapid response, infinite depth of field, low aberration and fast motion capture. However, the complex composition of their optical systems also presents significant challenges for manufacturing. With the continuous development of advanced materials, complex 3D manufacturing technologies and flexible electronic detectors, various ingenious and sophisticated compound eye imaging systems have been developed. This paper provides a comprehensive review on the microfabrication technologies, photoelectric detection and functional applications of miniature artificial compound eyes. Firstly, a brief introduction to the types and structural composition of compound eyes in the natural world is provided. Secondly, the 3D forming manufacturing techniques for miniature compound eyes are discussed. Subsequently, some photodetection technologies for miniature curved compound eye imaging are introduced. Lastly, with reference to the existing prototypes of functional applications for miniature compound eyes, the future development of compound eyes is prospected.

The Synergistic Effect on the Mimetic Optical Structure of Feline Eyes toward Household Health Monitoring of Acute and Chronic Diseases

A breakthrough in the performance of bionic optical structures will only be achieved if we can obtain an in-depth understanding of the synergy mechanisms operating in natural optical structures and find ways to imitate them. In this work, inspired by feline eyes, an optical substrate that takes advantage of a synergistic effect that occurs between resonant and reflective structures was designed. The synergistic effect between the reflective and resonant components leads to a Raman enhancement factor (EF) of 1.16 × 107, which is much greater than that achieved using the reflective/resonant cavities on their own. Finite-difference time-domain (FDTD) simulations and experimental results together confirm that the mechanism of this synergistic effect is achieved by realizing multiple reflections and repeated absorptions of light, generating a strong local electric field. Thus, a 2-3 order of magnitude increase in sensitivity could be achieved. More importantly, with the homemade centrifugal device, above optical substrates were further used to develop a rapidly highly sensitive household health monitoring system (detection time <3 min). It can thus be used to give early warning of acute diseases with high risk (e.g., acute myocardial infarction (AMI) and cerebral peduncle). Due to the good reusability and storability (9% and 8% reduction in EF after washing 30 times and 9 months of storage, respectively) of the substrates, the substrates thus reduce detection costs (to ∼$1), making them much cheaper to use than the current gold-standard methods (e.g., ∼$16 for gout detection).

Differential perovskite hemispherical photodetector for intelligent imaging and location tracking

Advanced photodetectors with intelligent functions are expected to take an important role in future technology. However, completing complex detection tasks within a limited number of pixels is still challenging. Here, we report a differential perovskite hemispherical photodetector serving as a smart locator for intelligent imaging and location tracking. The high external quantum efficiency (~1000%) and low noise (10-13 A Hz-0.5) of perovskite hemispherical photodetector enable stable and large variations in signal response. Analysing the differential light response of only 8 pixels with the computer algorithm can realize the capability of colorful imaging and a computational spectral resolution of 4.7 nm in a low-cost and lensless device geometry. Through machine learning to mimic the differential current signal under different applied biases, one more dimensional detection information can be recorded, for dynamically tracking the running trajectory of an object in a three-dimensional space or two-dimensional plane with a color classification function.

Nanomaterial-Based Artificial Vision Systems: From Bioinspired Electronic Eyes to In-Sensor Processing Devices

High-performance robotic vision empowers mobile and humanoid robots to detect and identify their surrounding objects efficiently, which enables them to cooperate with humans and assist human activities. For error-free execution of these robots' tasks, efficient imaging and data processing capabilities are essential, even under diverse and complex environments. However, conventional technologies fall short of meeting the high-standard requirements of robotic vision under such circumstances. Here, we discuss recent progress in artificial vision systems with high-performance imaging and data processing capabilities enabled by distinctive electrical, optical, and mechanical characteristics of nanomaterials surpassing the limitations of traditional silicon technologies. In particular, we focus on nanomaterial-based electronic eyes and in-sensor processing devices inspired by biological eyes and animal visual recognition systems, respectively. We provide perspectives on key nanomaterials, device components, and their functionalities, as well as explain the remaining challenges and future prospects of the artificial vision systems.

Precise Focal Spot Positioning on an Opaque Substrate Based on the Diffraction Phenomenon in Laser Microfabrication

The precise positioning of the laser focal spot on the substrate is an important issue for laser microfabrication. In this work, a diffraction pattern-based focal spot positioning method (DFSPM) is proposed to achieve the precise positioning of the laser focal spot on opaque substrates. A series of diffraction patterns of laser focus under-positioning, exact positioning and over-positioning were obtained to investigate the cross-section light distribution of the laser focal spot. According to the monotonic tendency of FWHM to exhibit light intensity at the focal spot cross-section away from the focal plane, the FWHM threshold of polynomial fitted curves was used to determine the exact positioning of laser focus. The ascending scanning method was used to obtain the diffraction patterns at various vertical positions and the FWHM threshold of light distribution at the exact position. The polynomial fitted curves verify the FWHM monotonic tendency of light intensity distribution at the focal spot cross-section along the optical axis. Precise positioning can be achieved with a 100 nm adjustment resolution. This work was expected to provide references for laser microfabrication on opaque materials.

High-Transmission Biomimetics Structural Surfaces Produced via Ultrafast Laser Manufacturing

Inspired by periodically aligned micro/nanostructures on biological surfaces, researchers have been fabricating biomimetic structures with superior performance. As a promising and versatile tool, an ultrafast laser combined with other forms of processing technology has been utilized to manufacture functional structures, e.g., the biomimetic subwavelength structures to restrain the surface Fresnel reflectance. In this review paper, we interpret the biomimetic mechanism of antireflective subwavelength structures (ARSSs) for high-transmission windows. Recent advances in the fabrication of ARSSs with an ultrafast laser are summarized and introduced. The limitations and challenges of laser processing technology are discussed, and the future prospects for advancement are outlined, too.

MXene based flexible photodetectors: progress, challenges, and opportunities

The growing interest in applying 2D transition-metal carbides and nitrides (MXenes) to diverse application fields such as energy storage and harvesters, catalysts, sensors, optoelectronics, electromagnetic interference shielding and antennas since its first discovery in 2011 is clearly evident. Their intrinsic high conductivity limits the development of MXenes in photodetectors that rely on the semiconducting properties of active materials, while the abundant functional groups on the surface of MXenes provide opportunities for using MXenes as sensing materials in the fabrication of flexible photodetectors. Considerable studies on MXene based photodetectors have been carried out, but the main obstacles include seeking novel semiconducting materials in MXene families, the manufacturing technology, etc. This review highlights the progress, challenges and opportunities in MXene based flexible photodetectors and discusses novel materials, architectures, and approaches that capitalize on our growing understanding of MXenes.

Low-temperature 3D printing of transparent silica glass microstructures

Transparent silica glass is one of the most essential materials used in society and industry, owing to its exceptional optical, thermal, and chemical properties. However, glass is extremely difficult to shape, especially into complex and miniaturized structures. Recent advances in three-dimensional (3D) printing have allowed for the creation of glass structures, but these methods involve time-consuming and high-temperature processes. Here, we report a photochemistry-based strategy for making glass structures of micrometer size under mild conditions. Our technique uses a photocurable polydimethylsiloxane resin that is 3D printed into complex structures and converted to silica glass via deep ultraviolet (DUV) irradiation in an ozone environment. The unique DUV-ozone conversion process for silica microstructures is low temperature (~220°C) and fast (<5 hours). The printed silica glass is highly transparent with smooth surface, comparable to commercial fused silica glass. This work enables the creation of arbitrary structures in silica glass through photochemistry and opens opportunities in unexplored territories for glass processing techniques.

Dual-Stimuli Cooperative Responsive Hydrogel Microactuators Via Two-Photon Lithography

With the development of bionics as well as materials science, intelligent soft actuators have shown promising applications in many fields such as soft robotics, sensing, and remote manipulation. Microfabrication technologies have enabled the reduction of the size of responsive soft actuators to the micron level. However, it is still challenging to construct microscale actuators capable of responding to different external stimuli in complex and diverse conditions. Here, this work demonstrates a dual-stimuli cooperative responsive hydrogel microactuator by asymmetric fabrication via femtosecond laser direct writing. The dual response of the hydrogel microstructure is achieved by employing responsive hydrogel with functional monomer 2-(dimethylamino)ethyl methacrylate. Raman spectra of the hydrogel microstructures suggest that the pH and temperature response of the hydrogel is generated by the changes in tertiary amine groups and hydrogen bonds, respectively. The asymmetric hydrogel microstructures show opposite bending direction when being heated to high temperature or exposed to acid solution, and can independently accomplish the grasp of polystyrene microspheres. Moreover, this work depicts the cooperative response of the hydrogel microactuator to pH and temperature at the same time. The dual-stimuli cooperative responsive hydrogel microactuators will provide a strategy for designing and fabricating controllable microscale actuators with promising applications in microrobotics and microfluidics.

Biomimetic Compound Eyes with Gradient Ommatidium Arrays

Compound eyes are high-performing natural optical perception systems with compact configurations, generating extensive research interest. Existing compound eye systems are often combinations of simple uniform microlens arrays; there are still challenges in making more ommatidia on the compound eye surface to focus to the same plane. Here, a biomimetic gradient compound eye is presented by artificially mimicking dragonflies. The multiple replication process efficiently endows compound eyes with the gradient characteristics of dragonfly compound eyes. Experimental results show that the manufactured compound eye allows multifocus imaging by virtue of the gradient ommatidium array arranged closely in a honeycomb pattern while ensuring excellent optical properties and compact configurations. Thousands of ommatidia showing a gradient trend at the millimeter scale while remaining relatively uniform at the micron scale have gradient focal lengths ranging from 260 to 450 μm. This gradient compound eye allows more ommatidia to focus on the same plane than traditional uniform compound eyes, which have experimentally been shown to capture more than 1100 in-plane clear images simultaneously, promising potential applications in micro-optical devices, optical imaging, and biochemical sensing.

Three-Dimensional (3D) Visualization under Extremely Low Light Conditions Using Kalman Filter

In recent years, research on three-dimensional (3D) reconstruction under low illumination environment has been reported. Photon-counting integral imaging is one of the techniques for visualizing 3D images under low light conditions. However, conventional photon-counting integral imaging has the problem that results are random because Poisson random numbers are temporally and spatially independent. Therefore, in this paper, we apply a technique called Kalman filter to photon-counting integral imaging, which corrects data groups with errors, to improve the visual quality of results. The purpose of this paper is to reduce randomness and improve the accuracy of visualization for results by incorporating the Kalman filter into 3D reconstruction images under extremely low light conditions. Since the proposed method has better structure similarity (SSIM), peak signal-to-noise ratio (PSNR) and cross-correlation values than the conventional method, it can be said that the visualization of low illuminated images can be accurate. In addition, the proposed method is expected to accelerate the development of autonomous driving technology and security camera technology.

Highly Uniform Spherical MoO2-MoO3/Polypyrrole Core-Shell Nanocomposite as an Optoelectronic Photodetector in UV, Vis, and IR Domains

A highly uniform spherical MoO2-MoO3/polypyrrole core-shell nanocomposite has been successfully synthesized as an optoelectronic photon sensing material, capable of detecting light in the UV, Vis, and IR domains. The nanocomposite is prepared through the oxidation of pyrrole using Na2MoO4, resulting in a uniform spherical morphology that has been confirmed by TEM, theoretical modeling, and SEM analyses. This morphology contributes to its promising optical behavior, characterized by a small bandgap of 1.36 eV. The optoelectronic photosensing capability of the nanocomposite has been evaluated across the UV, Vis, and IR spectra, demonstrating high efficiency. The photoresponsivity R values indicate the ability of the nanocomposite to generate hot electrons in response to incident photons. With an R value of 4.15 mA·W-1 at 440 nm, this optoelectronic device exhibits considerable promise for integration into an advanced technological apparatus. The detection (D) value of 9.30 × 108 Jones at 440 nm further confirms the high sensitivity in the Vis region. The excellent stability of the device can be attributed to the inherent MoO2-MoO3 oxide and Ppy polymer materials. This stability has been demonstrated through reproducibility studies and current-voltage measurements under various optical conditions. The combination of stability, efficiency, and sensitivity makes this optoelectronic device well suited for light sensing applications in both industrial and commercial settings. Its promising performance opens up opportunities for advancements in various fields requiring accurate and reliable light detection.

Wide field of view and full Stokes polarization imaging using metasurfaces inspired by the stomatopod eye

Wide field of view and polarization imaging capabilities are crucial for implementation of advanced imaging devices. However, there are still great challenges in the integration of such optical systems. Here, we report a bionic compound eye metasurface that can realize full Stokes polarization imaging in a wide field of view. The bionic compound eye metasurface consists of a bifocal metalens array in which every three bifocal metalenses form a subeye. The phase of the bifocal metalens is composed of gradient phase and hyperbolic phase. Numerical simulations show that the bifocal metalens can not only improve the focusing efficiency in the oblique light but also correct the aberration caused by the oblique incident light. And the field of view of the bionic compound eye metasurface can reach 120° × 120°. We fabricated a bionic compound eye metasurface which consists of three subeyes. Experiments show that the bionic compound eye metasurface can perform near diffraction-limited polarization focusing and imaging in a large field of view. The design method is generic and can be used to design metasurfaces with different materials and wavelengths. It has great potential in the field of robot polarization vision and polarization detection.

Heterogeneous compound eye camera for dual-scale imaging in a large field of view

Multi-scale imaging with large field of view is pivotal for fast motion detection and target identification. However, existing single camera systems are difficult to achieve snapshot multi-scale imaging with large field of view. To solve this problem, we propose a design method for heterogeneous compound eye, and fabricate a prototype of heterogeneous compound eye camera (HeCECam). This prototype which consists of a heterogeneous compound eye array, an optical relay system and a CMOS sensor, is capable of dual-scale imaging in large field of view (360°×141°). The heterogeneous compound eye array is composed of 31 wide-angle (WA) subeyes and 226 high-definition (HD) subeyes. An optical relay system is introduced to re-image the curved focal surface formed by the heterogeneous compound eye array on a CMOS sensor, resulting in a heterogeneous compound eye image containing dual-scale subimages. To verify the imaging characteristics of this prototype, a series of experiments, such as large field of view imaging, imaging performance, and real-world scene imaging, were conducted. The experiment results show that this prototype can achieve dual-scale imaging in large field of view and has excellent imaging performance. This makes the HeCECam has great potential for UAV navigation, wide-area surveillance, and location tracking, and paves the way for the practical use of bio-inspired compound eye cameras.