Avian eye-inspired perovskite artificial vision system for foveated and multispectral imaging

In-sensor multilevel image adjustment for high-clarity contour extraction using adjustable synaptic phototransistors

Robotic vision has traditionally relied on high-performance yet resource-intensive computing solutions, which necessitate high-throughput data transmission from vision sensors to remote computing servers, sacrificing energy efficiency and processing speed. A promising solution is data compaction through contour extraction, visualizing only the outlines of objects while eliminating superfluous backgrounds. Here, we introduce an in-sensor multilevel image adjustment method using adjustable synaptic phototransistors, enabling the capture of well-defined images with optimal brightness and contrast suitable for achieving high-clarity contour extraction. This is enabled by emulating dopamine-mediated neuronal excitability regulation mechanisms. Electrostatic gating effect either facilitates or inhibits time-dependent photocurrent accumulation, adjusting photo-responses to varying lighting conditions. Through excitatory and inhibitory modes, the adjustable synaptic phototransistor enhances visibility of dim and bright regions, respectively, facilitating distinct contour extraction and high-accuracy semantic segmentation. Evaluations using road images demonstrate improvement of both object detection accuracy and intersection over union, and compression of data volume.

Light-to-Spike Encoding Using Indium-Gallium-Zinc Oxide Phototransistor for all-Color Image Recognition with Dynamic Range and Precision Tunability

To enhance the efficiency of machine vision system, physical hardware capable of sensing and encoding is essential. However, sensing and encoding color information has been overlooked. Therefore, this work utilizes an indium-gallium-zinc oxide (IGZO) phototransistor to detect varying densities of red, green, and blue (RGB) light, converting them into corresponding drain current (ID) states. By applying stochastic gate voltage (VG) pulses to the IGZO phototransistor, the fluctuations are generated in these ID states. When the ID exceeds the threshold current (ITC), a spike signal is generated. This approach enables the conversion of light densities into spike signals, achieving spike-rate encoding. Moreover, adjusting the standard deviation (σ) of the VG pulses controls the range of light densities converted into spike rates, while altering the mean (μ) of the VG pulses changes the baseline level of spike rates. Remarkably, separate RGB channels offer a tunable encoding process, which can emphasize individual colors and correct color bias. The encoded spike rates are also fed into a spiking neural network (SNN) for CIFAR-10 pattern recognition, achieving an accuracy of 86%. The method allows the operation of SNN and shows the tunability in the process of light-to-spike encoding, opening possibilities for color image processing.

Self-powered electrotactile textile haptic glove for enhanced human-machine interface

Human-machine interface (HMI) plays an important role in various fields, where haptic technologies provide crucial tactile feedback that greatly enhances user experience, especially in virtual reality/augmented reality, prosthetic control, and therapeutic applications. Through tactile feedback, users can interact with devices in a more realistic way, thereby improving the overall effectiveness of the experience. However, existing haptic devices are often bulky due to cumbersome instruments and power modules, limiting comfort and portability. Here, we introduce a concept of wearable haptic technology: a thin, soft, self-powered electrotactile textile haptic (SPETH) glove that uses the triboelectric effect and gas breakdown discharge for localized electrical stimulation. Daily hand movements generate sufficient mechanical energy to power the SPETH glove. Its features-softness, lightweight, self-sustainability, portability, and affordability-enable it to provide tactile feedback anytime and anywhere without external equipment. This makes the SPETH glove an enhanced, battery-free HMI suitable for a wide range of applications.

Ultrathin Ga2O3 Photodetector with Fast Response and Trajectory Tracking Capability Fabricated by Liquid Metal Oxidation

Low-dimensional Ga2O3 demonstrates a unique ultraviolet photoresponse and could be used in various electronic and optical systems. However, the low-dimensional Ga2O3 photodetector is faced with the challenges of a complex preparation process and poor device performance. In this work, ultrathin Ga2O3 layers with ∼7 nm thickness are prepared on quartz rods by UV exposure to liquid gallium. Benefiting from low-density oxygen vacancy defects cured by UV exposure, the low-dimensional Ga2O3 photodetector exhibits a high response speed (rise: 64.7 μs; fall: 51.4 μs) and an exceptional linear dynamic range of 120 dB. Furthermore, the photodetector array based on these ultrathin Ga2O3 shows an effective trajectory tracking capability by monitoring UV source motion. This work develops a simple preparation method to construct a low-dimensional UV photodetector array with fast response and useful trajectory tracking capability, exhibiting the significance of ultrathin Ga2O3 in UV optoelectronics.

Dual-Coated Antireflective Film for Flexible and Robust Multi-Environmental Optoelectronic Applications

Artificial antireflective nanostructured surfaces, inspired by moth eyes, effectively reduce optical losses at interfaces, offering significant advantages in enhancing optical performance in various optoelectronic applications, including solar cells, light-emitting diodes, and cameras. However, their limited flexibility and low surface hardness constrain their broader use. In this study, we introduce a universal antireflective film by integrating nanostructures on both sides of a thin polycarbonate film. One side was thinly coated with Al2O3 for its high hardness, enhancing surface durability while maintaining flexibility. The opposite side was coated with SiO2 to optimize antireflective properties, making the film suitable for diverse environments (i.e., air, water, and adhesives). This dual-coating strategy resulted in a mechanically robust and flexible antireflective film with superior optical properties in various conditions. We demonstrated the universal capabilities of our antireflective film via optical simulations and experiments with the fabricated film in different environments.

Characterization of Wing Kinematics by Decoupling Joint Movement in the Pigeon

Birds have remarkable flight capabilities due to their adaptive wing morphology. However, studying live birds is time-consuming and laborious, and obtaining information about the complete wingbeat cycle is difficult. To address this issue and provide a complete dataset, we recorded comprehensive motion capture wing trajectory data from five free-flying pigeons (Columba livia). Five key motion parameters are used to quantitatively characterize wing kinematics: flapping, sweeping, twisting, folding and bending. In addition, the forelimb skeleton is mapped using an open-chain three-bar mechanism model. By systematically evaluating the relationship of joint degrees of freedom (DOFs), we configured the model as a 3-DOF shoulder, 1-DOF elbow and 2-DOF wrist. Based on the correlation analysis between wingbeat kinematics and joint movement, we found that the strongly correlated shoulder and wrist roll within the stroke plane cause wing flap and bending. There is also a strong correlation between shoulder, elbow and wrist yaw out of the stroke plane, which causes wing sweep and fold. By simplifying the wing morphing, we developed three flapping wing robots, each with different DOFs inside and outside the stroke plane. This study provides insight into the design of flapping wing robots capable of mimicking the 3D wing motion of pigeons.

Bioelectronics for electrical stimulation: materials, devices and biomedical applications

Bioelectronics is a hot research topic, yet an important tool, as it facilitates the creation of advanced medical devices that interact with biological systems to effectively diagnose, monitor and treat a broad spectrum of health conditions. Electrical stimulation (ES) is a pivotal technique in bioelectronics, offering a precise, non-pharmacological means to modulate and control biological processes across molecular, cellular, tissue, and organ levels. This method holds the potential to restore or enhance physiological functions compromised by diseases or injuries by integrating sophisticated electrical signals, device interfaces, and designs tailored to specific biological mechanisms. This review explains the mechanisms by which ES influences cellular behaviors, introduces the essential stimulation principles, discusses the performance requirements for optimal ES systems, and highlights the representative applications. From this review, we can realize the potential of ES based bioelectronics in therapy, regenerative medicine and rehabilitation engineering technologies, ranging from tissue engineering to neurological technologies, and the modulation of cardiovascular and cognitive functions. This review underscores the versatility of ES in various biomedical contexts and emphasizes the need to adapt to complex biological and clinical landscapes it addresses.

Avian eye-inspired artificial vision takes a step forward

Bioinspiration from avian eyes allows development of artificial vision systems with foveated and multispectral imaging.